Measuring Eating Competence: Psychometric Properties and Validity of the ecSatter Inventory
ERIC Educational Resources Information Center
Lohse, Barbara; Satter, Ellyn; Horacek, Tanya; Gebreselassie, Tesfayi; Oakland, Mary Jane
2007-01-01
Objective: Assess validity of the ecSatter Inventory (ecSI) to measure eating competence (EC). Design: Concurrent administration of ecSI with validated measures of eating behaviors using on-line and paper-pencil formats. Setting: The on-line survey was completed by 370 participants; 462 completed the paper version. Participants: Participants…
Kavussanu, Maria; Stanger, Nicholas; Boardley, Ian D
2013-01-01
The purpose of this research was to provide further evidence for the construct validity (i.e., convergent, concurrent, and discriminant validity) of the Prosocial and Antisocial Behaviour in Sport Scale (PABSS), an instrument that has four subscales measuring prosocial and antisocial behaviour toward teammates and opponents. We also investigated test-retest reliability and stability of the PABSS. We conducted three studies using athletes from a variety of team sports. In Study 1, participants (N = 129) completed the PABSS and measures of physical and verbal aggression, hostility, anger, moral identity, and empathy; a sub-sample (n = 111) also completed the PABSS one week later. In Study 2, in addition to the PABSS, participants (N = 89) completed measures of competitive aggressiveness and anger, moral attitudes, moral disengagement, goal orientation, and anxiety. In Study 3, participants (N = 307) completed the PABSS and a measure of social goals. Across the three studies, the four subscales evidenced the hypothesised relationships with a number of variables. Correlations were large between the two antisocial behaviours and small between the two prosocial behaviours. Overall, the findings supported the convergent, concurrent, and discriminant validity of the scale, provided evidence for its test-retest reliability and stability, and suggest that the instrument is a valid and reliable measure of prosocial and antisocial behaviour in sport.
Measuring homework completion in behavioral activation.
Busch, Andrew M; Uebelacker, Lisa A; Kalibatseva, Zornitsa; Miller, Ivan W
2010-07-01
The aim of this study was to develop and validate an observer-based coding system for the characterization and completion of homework assignments during Behavioral Activation (BA). Existing measures of homework completion are generally unsophisticated, and there is no current measure of homework completion designed to capture the particularities of BA. The tested scale sought to capture the type of assignment, realm of functioning targeted, extent of completion, and assignment difficulty. Homework assignments were drawn from 12 (mean age = 48, 83% female) clients in two trials of a 10-session BA manual targeting treatment-resistant depression in primary care. The two coders demonstrated acceptable or better reliability on most codes, and unreliable codes were dropped from the proposed scale. In addition, correlations between homework completion and outcome were strong, providing some support for construct validity. Ultimately, this line of research aims to develop a user-friendly, reliable measure of BA homework completion that can be completed by a therapist during session.
The measurement of threat orientations.
Thompson, Suzanne C; Schlehofer, Michèle M; Bovin, Michelle J
2006-01-01
To develop measures of 3 threat orientations that affect responses to health behavior messages. In Study 1, college students (N = 47) completed items assessing threat orientations and health behaviors. In Study 2, college students and community adults (N = 110) completed the threat orientation items and measures of convergent and discriminant validity. In Study 1, the control-based, denial-based, and heightened-sensitivity-based threat orientation scales demonstrated good internal consistency and correlated with engagement in health behaviors. In Study 2, the convergent and discriminant validity of the 3 measures was established. The 3 scales have good internal reliability and construct validity.
Measuring Homework Completion in Behavioral Activation
ERIC Educational Resources Information Center
Busch, Andrew M.; Uebelacker, Lisa A.; Kalibatseva, Zornitsa; Miller, Ivan W.
2010-01-01
The aim of this study was to develop and validate an observer-based coding system for the characterization and completion of homework assignments during Behavioral Activation (BA). Existing measures of homework completion are generally unsophisticated, and there is no current measure of homework completion designed to capture the particularities…
Measuring eating competence: psychometric properties and validity of the ecSatter Inventory.
Lohse, Barbara; Satter, Ellyn; Horacek, Tanya; Gebreselassie, Tesfayi; Oakland, Mary Jane
2007-01-01
Assess validity of the ecSatter Inventory (ecSI) to measure eating competence (EC). Concurrent administration of ecSI with validated measures of eating behaviors using on-line and paper-pencil formats. The on-line survey was completed by 370 participants; 462 completed the paper version. Participants included 863 adults with 832 usable surveys from respondents (mean age 36.2 +/- 13.4 years) without eating disorders, mostly female, white, educated, overweight, physically active, and food secure. Of those indicating intent to complete the on-line survey, 80.3% did so; 54% of mailed surveys were returned. Eating and food behaviors compared among EC tertiles and between dichotomous EC categories; internal consistency of ecSI. Analysis of variance, independent t tests, chi-square, factor analysis, logistic regression. Significance level was P < .05. Mean ecSI score was 31.1 +/- 7.5. ecSI included 4 subscales with internal reliability and content validity. Construct validity was supported by specific behavioral profiles for ecSI tertiles and ecSI dichotomized categories. Persons unsatisfied with weight were 54% less likely to be EC; unit increase in the food like index was associated with nearly 3 times greater likelihood of being EC. The ecSatter Inventory is a valid measure of EC and can be used for descriptive and outcome measurements.
How best to measure implementation of school health curricula: a comparison of three measures.
Resnicow, K; Davis, M; Smith, M; Lazarus-Yaroch, A; Baranowski, T; Baranowski, J; Doyle, C; Wang, D T
1998-06-01
The impact of school health education programs is often attenuated by inadequate teacher implementation. Using data from a school-based nutrition education program delivered in a sample of fifth graders, this study examines the discriminant and predictive validity of three measures of curriculum implementation: class-room observation of fidelity, and two measures of completeness, teacher self-report questionnaire and post-implementation interview. A fourth measure, obtained during teacher observations, that assessed student and teacher interaction and student receptivity to the curriculum (labeled Rapport) was also obtained. Predictive validity was determined by examining the association of implementation measures with three study outcomes; health knowledge, asking behaviors related to fruit and vegetables, and fruit and vegetable intake, assessed by 7-day diary. Of the 37 teachers observed, 21 were observed for two sessions and 16 were observed once. Implementation measures were moderately correlated, an indication of discriminant validity. Predictive validity analyses indicated that the observed fidelity, Rapport and interview measures were significantly correlated with post-test student knowledge. The association between health knowledge and observed fidelity (based on dual observation only), Rapport and interview measures remained significant after adjustment for pre-test knowledge values. None of the implementation variables were significantly associated with student fruit and vegetable intake or asking behaviors controlling for pre-test values. These results indicate that the teacher self-report questionnaire was not a valid measure of implementation completeness in this study. Post-implementation completeness interviews and dual observations of fidelity and Rapport appear to be more valid, and largely independent methods of implementation assessment.
ERIC Educational Resources Information Center
Horn, Aaron S.; Lee, Giljae
2016-01-01
A relatively simple way of measuring institutional effectiveness in relation to degree completion is to estimate the difference between an actual and predicted graduation rate, but the reliability and validity of this method have not been thoroughly examined. Longitudinal data were obtained from IPEDS for both public and private not-for-profit…
Lai, Jin-Shei; Goodnight, Siera; Downing, Nancy R; Ready, Rebecca E; Paulsen, Jane S; Kratz, Anna L; Stout, Julie C; McCormack, Michael K; Cella, David; Ross, Christopher; Russell, Jenna; Carlozzi, Noelle E
2018-03-01
Cognitive functioning impacts health-related quality of life (HRQOL) for individuals with Huntington disease (HD). The Neuro-QoL includes two patient-reported outcome (PRO) measures of cognition-Executive Function (EF) and General Concerns (GC). These measures have not previously been validated for use in HD. The purpose of this analysis is to evaluate the reliability and validity of the Neuro-QoL Cognitive Function measures for use in HD. Five hundred ten individuals with prodromal or manifest HD completed the Neuro-QoL Cognition measures, two other PRO measures of HRQOL (WHODAS 2.0 and EQ5D), and a depression measure (PROMIS Depression). Measures of functioning The Total Functional Capacity and behavior (Problem Behaviors Assessment) were completed by clinician interview. Objective measures of cognition were obtained using clinician-administered Symbol Digit Modalities Test and the Stroop Test (Word, Color, and Interference). Self-rated, clinician-rated, and objective composite scores were developed. We examined the Neuro-QoL measures for reliability, convergent validity, discriminant validity, and known-groups validity. Excellent reliabilities (Cronbach's alphas ≥ 0.94) were found. Convergent validity was supported, with strong relationships between self-reported measures of cognition. Discriminant validity was supported by less robust correlations between self-reported cognition and other constructs. Prodromal participants reported fewer cognitive problems than manifest groups, and early-stage HD participants reported fewer problems than late-stage HD participants. The Neuro-QoL Cognition measures provide reliable and valid assessments of self-reported cognitive functioning for individuals with HD. Findings support the utility of these measures for assessing self-reported cognition.
Patient-completed or symptom-based screening tools for endometriosis: a scoping review.
Surrey, Eric; Carter, Cathryn M; Soliman, Ahmed M; Khan, Shahnaz; DiBenedetti, Dana B; Snabes, Michael C
2017-08-01
The objective of this review was to evaluate existing patient-completed screening questionnaires and/or symptom-based predictive models with respect to their potential for use as screening tools for endometriosis in adult women. Validated instruments were of particular interest. We conducted structured searches of PubMed and targeted searches of the gray literature to identify studies reporting on screening instruments used in endometriosis. Studies were screened according to inclusion and exclusion criteria that followed the PICOS (population, intervention, comparison, outcomes, study design) framework. A total of 16 studies were identified, of which 10 described measures for endometriosis in general, 2 described measures for endometriosis at specific sites, and 4 described measures for deep-infiltrating endometriosis. Only 1 study evaluated a questionnaire that was solely patient-completed. Most measures required physician, imaging, or laboratory assessments in addition to patient-completed questionnaires, and several measures relied on complex scoring. Validation for use as a screening tool in adult women with potential endometriosis was lacking in all studies, as most studies focused on diagnosis versus screening. This literature review did not identify any fully validated, symptom-based, patient-reported questionnaires for endometriosis screening in adult women.
Jilcott Pitts, Stephanie Bell; Jahns, Lisa; Wu, Qiang; Moran, Nancy E; Bell, Ronny A; Truesdale, Kimberly P; Laska, Melissa N
2018-06-01
To assess the feasibility, reliability and validity of reflection spectroscopy (RS) to assess skin carotenoids in a racially diverse sample. Study 1 was a cross-sectional study of corner store customers (n 479) who completed the National Cancer Institute Fruit and Vegetable Screener as well as RS measures. Feasibility was assessed by examining the time it took to complete three RS measures, reliability was assessed by examining the variation between three RS measures, and validity was examined by correlation with self-reported fruit and vegetable consumption. In Study 2, validity was assessed in a smaller sample (n 30) by examining associations between RS measures and dietary carotenoids, fruits and vegetables as calculated from a validated FFQ and plasma carotenoids. Eastern North Carolina, USA. It took on average 94·0 s to complete three RS readings per person. The average variation between three readings for each participant was 6·8 %. In Study 2, in models adjusted for age, race and sex, there were statistically significant associations between RS measures and (i) FFQ-estimated carotenoid intake (P<0·0001); (ii) FFQ-estimated fruit and vegetable consumption (P<0·010); and (iii) plasma carotenoids (P<0·0001). RS is a potentially improved method to approximate fruit and vegetable consumption among diverse participants. RS is portable and easy to use in field-based public health nutrition settings. More research is needed to investigate validity and sensitivity in diverse populations.
Chen, Kuan-Wei; Lee, Shih-Chieh; Chiang, Hsin-Yu; Syu, Ya-Cing; Yu, Xiao-Xuan; Hsieh, Ching-Lin
2017-11-01
Patients with schizophrenia tend to have deficits in advanced Theory of Mind (ToM). The "Reading the mind in the eyes" test (RMET), the Faux Pas Task, and the Strange Stories are commonly used for assessing advanced ToM. However, most of the psychometric properties of these 3 measures in patients with schizophrenia are unknown. The aims of this study were to validate the psychometric properties of the 3 advanced ToM measures in patients with schizophrenia, including: (1) test-retest reliability; (2) random measurement error; (3) practice effect; (4) concurrent validity; and (5) ecological validity. We recruited 53 patients with schizophrenia, who completed the 3 measures twice, 4 weeks apart. The Revised Social Functioning Scale-Taiwan short version (R-SFST) was completed within 3 days of first session of assessments. We found that the intraclass correlation coefficients of the RMET, Strange Stories, and Faux Pas Task were 0.24, 0.5, and 0.76. All 3 advanced ToM measures had large random measurement error, trivial to small practice effects, poor concurrent validity, and low ecological validity. We recommend that the scores of the 3 advanced ToM measures be interpreted with caution because these measures may not provide reliable and valid results on patients' advanced ToM abilities. Copyright © 2017 Elsevier B.V. All rights reserved.
The development and validation of the Visual Analogue Self-Esteem Scale (VASES).
Brumfitt, S M; Sheeran, P
1999-11-01
To develop a visual analogue measure of self-esteem and test its psychometric properties. Two correlational studies involving samples of university students and aphasic speakers. Two hundred and forty-three university students completed multiple measures of self-esteem, depression and anxiety as well as measures of transitory mood and social desirability (Study 1). Two samples of aphasic speakers (N = 14 and N = 20) completed the Visual Analogue Self-Esteem Scale (VASES), the Rosenberg (1965) self-esteem scale and measures of depression and anxiety. (Study 2). Study 1 found evidence of good internal and test-retest reliability, construct validity and convergent and discriminant validity for a 10-item VASES. Study 2 demonstrated good internal reliability among aphasic speakers. The VASES is a short and easy to administer measure of self-esteem that possesses good psychometric properties.
Measuring attention in very old adults using the Test of Everyday Attention.
van der Leeuw, Guusje; Leveille, Suzanne G; Jones, Richard N; Hausdorff, Jeffrey M; McLean, Robert; Kiely, Dan K; Gagnon, Margaret; Milberg, William P
2017-09-01
There is a need for validated measures of attention for use in longitudinal studies of older populations. We studied 249 participants aged 80 to 101 years using the population-based MOBILIZE Boston Study. Four subscales of the Test of Everyday Attention (TEA) were included, measuring attention switching, selective, sustained and divided attention and a neuropsychological battery including validated measures of multiple cognitive domains measuring attention, executive function and memory. The TEA previously has not been validated in persons aged 80 and older. Among participants who completed the TEA, scores on other attentional measures strongly with TEA domains (R=.60-.70). Proportions of participants with incomplete TEA subscales ranged from 8% (selective attention) to 19% (attentional switching). Reasons for not completing TEA tests included failure to comprehend test instructions despite repetition and practice. These results demonstrate the challenges and potential value of the Test of Everyday Attention in studies of very old populations.
Reflective Thinking Scale: A Validity and Reliability Study
ERIC Educational Resources Information Center
Basol, Gulsah; Evin Gencel, Ilke
2013-01-01
The purpose of this study was to adapt Reflective Thinking Scale to Turkish and investigate its validity and reliability over a Turkish university students' sample. Reflective Thinking Scale (RTS) is a 5 point Likert scale (ranging from 1 corresponding Agree Completely, 3 to Neutral, and 5 to Not Agree Completely), purposed to measure reflective…
Further Studies into Synthetic Image Generation using CameoSim
2011-08-01
preparation of the validation effort a study of BRDF models has been completed, which includes the physical plausibility of models , how measured data...the visible to shortwave infrared. In preparation of the validation effort a study of BRDF models has been completed, which includes the physical...Example..................................................................................................................... 17 4. MODELLING BRDFS
Federal Register 2010, 2011, 2012, 2013, 2014
2012-07-13
... the completeness and reliability of the performance data included in it [that] * * * describes any material inadequacies in the completeness and reliability of the data.'' (OMB Circular A-11, Section 230.2... validity (accuracy) of the counts of transactions or measurements of status as follows. In the validation...
Mezey, Gillian; White, Sarah; Thachil, Ajoy; Berg, Rachel; Kallumparam, Sen; Nasiruddin, Omar; Wright, Christine; Killaspy, Helen
2013-08-01
Social exclusion can be both a cause and a consequence of mental health problems. Socially inclusive practice by mental health professionals can mitigate against the stigmatizing and excluding effects of severe mental illness. To develop and test the validity of a measure of social inclusion for individuals with severe mental illness - the Social Inclusion Questionnaire User Experience (SInQUE). The domains of the SInQUE were chosen to reflect the domains of social inclusion identified in the Poverty and Social Exclusion Survey. Patients with severe mental illness were recruited from rehabilitation, general and forensic psychiatric services and were asked to complete the questionnaire in an individual interview with a researcher. Sixty six patients with schizophrenia and schizoaffective disorder completed the SInQUE, alongside measures of psychiatric symptoms, needs and quality of life, to assess its acceptability, and concurrent and construct (convergent and discriminant) validity. The SInQUE took 45 minutes to complete and was found to have good concurrent and discriminant validity. Convergent validity was established for two domains: social integration and productivity. Preliminary findings suggest that the SInQUE may be a useful tool for assessing and monitoring social inclusion in individuals with severe mental illness. It has construct and concurrent validity with measures of unmet need and quality of life in this group. Further testing of the reliability of the SInQUE on a larger population is indicated.
Parent-Reported Social Support for Child's Fruit and Vegetable Intake: Validity of Measures
ERIC Educational Resources Information Center
Dave, Jayna M.; Evans, Alexandra E.; Condrasky, Marge D.; Williams, Joel E.
2012-01-01
Objective: To develop and validate measures of parental social support to increase their child's fruit and vegetable (FV) consumption. Design: Cross-sectional study design. Setting: School and home. Participants: Two hundred three parents with at least 1 elementary school-aged child. Main Outcome Measure: Parents completed a questionnaire that…
Svedberg, P; Nygren, J M; Staland-Nyman, C; Nyholm, M
2016-04-29
Research has shown inconsistencies in results and difficulties in conceptualization of assessment of socioeconomic status (SES) among adolescents. The aim of this study was thus to test the validity of self-reported information on SES in two age-groups (11-13 and 14-16 years old) in an adolescent population and to evaluate its relationship to self-reported health related quality of life (HRQOL). Different measures of SES commonly used in research in relation to HRQOL were tested in this study; parent's occupations status, family material affluence status (FAS) and perceived SES. A cross-sectional study, with a sample of 948 respondents (n = 467, 11-13 years old and n = 481, 14-16 years old) completed questionnaires about SES and HRQOL. The adolescents' completion rates were used, with chi2-test, to investigate differences between gender and age-group. Correlation was used for convergent validity and ANOVA for concurrent validity. We found a low completion rate for both fathers' (41.7 %) and mothers' (37.5 %) occupation status, and a difference in completion rate between gender and age-groups. FAS had the highest completion rate (100 %) compared to parent's occupations status and perceived SES. The convergent validity between the SES-indicators was weak (Spearman correlation coefficient below 0.3), suggesting that the indicators measured different dimensions of SES. Both FAS and perceived SES showed a gradient in mean HRQOL between low and high SES in relation to HRQOL, this was significant only for perceived SES (p < 0.01, both age-groups). This study indicates the need for considering different approaches to measures of SES among adolescences and when evaluating SES in relation to HRQOL. Further research is needed to investigate sustainable ways to measure SES, delineating the relevance of tangible measures of education, occupation and income in relation to the perceived socioeconomic status in comparison with others in immediate social networks and in society at large.
Validation of the Sexual Communication Self-Efficacy Scale
ERIC Educational Resources Information Center
Quinn-Nilas, Christopher; Milhausen, Robin R.; Breuer, Rebecca; Bailey, Julia; Pavlou, Menelaos; DiClemente, Ralph J.; Wingood, Gina M.
2016-01-01
This study assessed a newly developed Sexual Communication Self-Efficacy Scale designed to measure the sexual communication self-efficacy of adolescent men and women. Three-hundred and seventy-four U.K. adolescents completed this new scale, along with several other validity measures. Factor analysis revealed that the Sexual Communication…
Reliability and Validity of the Alcohol Consequences Expectations Scale
ERIC Educational Resources Information Center
Arriola, Kimberly R. Jacob; Usdan, Stuart; Mays, Darren; Weitzel, Jessica Aungst; Cremeens, Jennifer; Martin, Ryan J.; Borba, Christina; Bernhardt, Jay M.
2009-01-01
Objectives: To examine the reliability and validity of a new measure of alcohol outcome expectations for college students, the Alcohol Consequences Expectations Scale (ACES). Methods: College students (N = 169) completed the ACES and several other measures. Results: Results support the existence of 5 internally consistent subscales. Additionally,…
Ó Ciardha, Caoilte; Attard-Johnson, Janice; Bindemann, Markus
2018-04-01
Latency-based measures of sexual interest require additional evidence of validity, as do newer pupil dilation approaches. A total of 102 community men completed six latency-based measures of sexual interest. Pupillary responses were recorded during three of these tasks and in an additional task where no participant response was required. For adult stimuli, there was a high degree of intercorrelation between measures, suggesting that tasks may be measuring the same underlying construct (convergent validity). In addition to being correlated with one another, measures also predicted participants' self-reported sexual interest, demonstrating concurrent validity (i.e., the ability of a task to predict a more validated, simultaneously recorded, measure). Latency-based and pupillometric approaches also showed preliminary evidence of concurrent validity in predicting both self-reported interest in child molestation and viewing pornographic material containing children. Taken together, the study findings build on the evidence base for the validity of latency-based and pupillometric measures of sexual interest.
Validation of the Parental Facilitation of Mastery Scale-II.
Zalta, Alyson K; Allred, Kelly M; Jayawickreme, Eranda; Blackie, Laura E R; Chambless, Dianne L
2017-10-01
To develop a more reliable and comprehensive version of the Parental Facilitation of Mastery Scale (PFMS) METHOD: In Study 1, 387 undergraduates completed an expanded PFMS (PFMS-II) and measures of parenting, perceived control, responses to early life challenges, and psychopathology. In Study 2, 182 trauma-exposed community participants completed the PFMS-II and measures of perceived control, psychopathology, and well-being RESULTS: In Study 1, exploratory factor analysis of the PFMS-II revealed two factors. These factors replicated in Study 2; one item was removed to achieve measurement invariance across race. The final PFMS-II comprised a 10-item overprotection scale and a 7-item challenge scale. In both samples, this measure demonstrated good convergent and discriminant validity and was more reliable than the original PFMS. Parental challenge was a unique predictor of perceived control in both samples CONCLUSION: The PFMS-II is a valid measure of important parenting behaviors not fully captured in other measures. © 2016 Wiley Periodicals, Inc.
Patil, V M; Chakraborty, S; Jithin, T K; Dessai, S; Sajith Babu, T P; Raghavan, V; Geetha, M; Kumar, T Shiva; Biji, M S; Bhattacharjee, A; Nair, C
2016-01-01
The objective was to design and validate the questionnaire for capturing palliative chemotherapy-related preferences and expectations. Single arm, unicentric, prospective observational study. EXPECT questionnaire was designed to capture preferences and expectations of patients undergoing palliative chemotherapy. This questionnaire underwent a linguistic validation and then was tested in patients. Ten patients are undergoing chemotherapy for solid tumors who fulfilled the inclusion and exclusion criteria self-administered the EXPECT questionnaire in regional language. After filling this questionnaire, they self-administered quick questionnaire-10 (QQ-10). SPSS version 16 (IBM New York) was used for analysis. Completion rate of EXPECT questionnaire was calculated. The feasibility, face validity, utility and time taken for completion of EXPECT questionnaire was also assessed. The completion rate of this questionnaire was 100%. All patients completed questionnaire within 5 min. The QQ-10 tool confirmed the feasibility, face validity and utility of the questionnaire. EXPECT questionnaire was validated in the regional language, and it's an effective tool for capturing patient's preferences and expectation from chemotherapy.
Development and Validation of the Alcohol Identity Implicit Associations Test (AI-IAT)
Gray, Heather M.; LaPlante, Debi A.; Bannon, Brittany L.; Ambady, Nalini; Shaffer, Howard J.
2011-01-01
Alcohol identity is the extent to which an individual perceives drinking alcohol to be a defining characteristic of his or her self-identity. Although alcohol identity might play an important role in risky college drinking practices, there is currently no easily administered, implicit measure of this concept. Therefore we developed a computerized implicit measure of alcohol identity (the Alcohol Identity Implicit Associations Test; AI-IAT) and assessed its reliability and predictive validity in relation to risky college drinking practices. One hundred forty-one college students completed the AI-IAT. Again 3- and 6-months later, we administered the AI-IAT and indices of engagement in risky college drinking practices. A subset of participants also completed the previously-validated implicit measure of alcohol identity. Scores on the AI-IAT were stable over time, internally consistent, and positively correlated with the previously-validated measure of alcohol identity. Baseline AI-IAT scores predicted future engagement in risky college drinking practices, even after controlling for standard alcohol consumption measures. We conclude that the AI-IAT reliably measures alcohol identity, a concept that appears to play an important role in risky college drinking practices. PMID:21621924
Benni, Paul B; MacLeod, David; Ikeda, Keita; Lin, Hung-Mo
2018-04-01
We describe the validation methodology for the NIRS based FORE-SIGHT ELITE ® (CAS Medical Systems, Inc., Branford, CT, USA) tissue oximeter for cerebral and somatic tissue oxygen saturation (StO 2 ) measurements for adult subjects submitted to the United States Food and Drug Administration (FDA) to obtain clearance for clinical use. This validation methodology evolved from a history of NIRS validations in the literature and FDA recommended use of Deming regression and bootstrapping statistical validation methods. For cerebral validation, forehead cerebral StO 2 measurements were compared to a weighted 70:30 reference (REF CX B ) of co-oximeter internal jugular venous and arterial blood saturation of healthy adult subjects during a controlled hypoxia sequence, with a sensor placed on the forehead. For somatic validation, somatic StO 2 measurements were compared to a weighted 70:30 reference (REF CX S ) of co-oximetry central venous and arterial saturation values following a similar protocol, with sensors place on the flank, quadriceps muscle, and calf muscle. With informed consent, 25 subjects successfully completed the cerebral validation study. The bias and precision (1 SD) of cerebral StO 2 compared to REF CX B was -0.14 ± 3.07%. With informed consent, 24 subjects successfully completed the somatic validation study. The bias and precision of somatic StO 2 compared to REF CX S was 0.04 ± 4.22% from the average of flank, quadriceps, and calf StO 2 measurements to best represent the global whole body REF CX S . The NIRS validation methods presented potentially provide a reliable means to test NIRS monitors and qualify them for clinical use.
Gleadhill, Sam; Lee, James Bruce; James, Daniel
2016-05-03
This research presented and validated a method of assessing postural changes during resistance exercise using inertial sensors. A simple lifting task was broken down to a series of well-defined tasks, which could be examined and measured in a controlled environment. The purpose of this research was to determine whether timing measures obtained from inertial sensor accelerometer outputs are able to provide accurate, quantifiable information of resistance exercise movement patterns. The aim was to complete a timing measure validation of inertial sensor outputs. Eleven participants completed five repetitions of 15 different deadlift variations. Participants were monitored with inertial sensors and an infrared three dimensional motion capture system. Validation was undertaken using a Will Hopkins Typical Error of the Estimate, with a Pearson׳s correlation and a Bland Altman Limits of Agreement analysis. Statistical validation measured the timing agreement during deadlifts, from inertial sensor outputs and the motion capture system. Timing validation results demonstrated a Pearson׳s correlation of 0.9997, with trivial standardised error (0.026) and standardised bias (0.002). Inertial sensors can now be used in practical settings with as much confidence as motion capture systems, for accelerometer timing measurements of resistance exercise. This research provides foundations for inertial sensors to be applied for qualitative activity recognition of resistance exercise and safe lifting practices. Copyright © 2016 Elsevier Ltd. All rights reserved.
Littleton, Heather; Breitkopf, Carmen Radecki
2008-12-01
Dysmorphic appearance concern encompasses preoccupation with a perceived appearance defect, defect checking and camouflaging, and social avoidance. The current study sought to evaluate the internal consistency, factor structure, and convergent validity of a measure of dysmorphic appearance concern, the Body Image Concern Inventory, as well as evaluate the psychometric properties of a Spanish version of the instrument. Women recruited as part of a reproductive clinic-based clinical trial completed the BICI and other self-report measures of distress. A total of 1043 women completed the measures in English (M=29 years, range=18-55 years) and 573 women completed the measures in Spanish (M=32 years, range=18-55 years). Both the English and Spanish BICI were internally consistent and correlated moderately with measures of current psychological distress (STAI-S, CES-D). Confirmatory factor analyses replicated the measure's proposed factor structure. Applications of the BICI for future research are discussed.
THE CONSTRUCTION AND VALIDATION OF A MEASURE OF VOCATIONAL MATURITY.
ERIC Educational Resources Information Center
CLARY, JOE R.; WESTBROOK, BERT W.
THIS REPORT DEALS WITH THE ORGANIZATION, RATIONALE, METHODS AND EXPECTED END-PRODUCTS OF A RESEARCH PROJECT (SCHEDULED FOR COMPLETION ON JUNE 23, 1970) FOR THE CONSTRUCTION AND VALIDATION OF A RELIABLE VOCATIONAL MATURITY MEASURE (VMM). THE PROJECT'S EIGHT PHASES AND ACTIVITIES ARE EXPLAINED. THE PROJECT ASSUMES--(1) THE INDIVIDUAL AND SOCIETY AS…
Validity of the Butcher Treatment Planning Inventory as a Measure of Negative Treatment Attitudes
ERIC Educational Resources Information Center
Hatchett, Gregory T.
2007-01-01
This study evaluated the validity of the Butcher Treatment Planning Inventory (BTPI) as a measure of negative expectations and attitudes toward counseling. Undergraduate students completed the BTPI, the Attitudes Toward Seeking Professional Psychological Help Scale-Abbreviated Version, and the Expectations About Counseling-Brief Form during one…
Reliability and Validity Testing of the Physical Resilience Measure
ERIC Educational Resources Information Center
Resnick, Barbara; Galik, Elizabeth; Dorsey, Susan; Scheve, Ann; Gutkin, Susan
2011-01-01
Objective: The purpose of this study was to test reliability and validity of the Physical Resilience Scale. Methods: A single-group repeated measure design was used and 130 older adults from three different housing sites participated. Participants completed the Physical Resilience Scale, Hardy-Gill Resilience Scale, 14-item Resilience Scale,…
Predictive Validity of Explicit and Implicit Threat Overestimation in Contamination Fear
Green, Jennifer S.; Teachman, Bethany A.
2012-01-01
We examined the predictive validity of explicit and implicit measures of threat overestimation in relation to contamination-fear outcomes using structural equation modeling. Undergraduate students high in contamination fear (N = 56) completed explicit measures of contamination threat likelihood and severity, as well as looming vulnerability cognitions, in addition to an implicit measure of danger associations with potential contaminants. Participants also completed measures of contamination-fear symptoms, as well as subjective distress and avoidance during a behavioral avoidance task, and state looming vulnerability cognitions during an exposure task. The latent explicit (but not implicit) threat overestimation variable was a significant and unique predictor of contamination fear symptoms and self-reported affective and cognitive facets of contamination fear. On the contrary, the implicit (but not explicit) latent measure predicted behavioral avoidance (at the level of a trend). Results are discussed in terms of differential predictive validity of implicit versus explicit markers of threat processing and multiple fear response systems. PMID:24073390
Candidate Quality Measures for Hand Surgery.
2017-11-01
Quality measures are tools used by physicians, health care systems, and payers to evaluate performance, monitor the outcomes of interventions, and inform quality improvement efforts. A paucity of quality measures exist that address hand surgery care. We completed a RAND/UCLA (University of California Los Angeles) Delphi Appropriateness process with the goal of developing and evaluating candidate hand surgery quality measures to be used for national quality measure development efforts. A consortium of 9 academic upper limb surgeons completed a RAND/UCLA Delphi Appropriateness process to evaluate the importance, scientific acceptability, usability, and feasibility of 44 candidate quality measures. These addressed hand problems the panelists felt were most appropriate for quality measure development. Panelists rated the measures on an ordinal scale between 1 (definitely not valid) and 9 (definitely valid) in 2 rounds (preliminary round and final round) with an intervening face-to-face discussion. Ratings from 1 to 3 were considered not valid, 4 to 6 as equivocal or uncertain, and 7 to 9 as valid. If no more than 2 of the 9 ratings were outside the 3-point range that included the median (1-3, 4-6, or 7-9), the panelists were considered to be in agreement. If 3 or more of the panelists' ratings of a measure were within the 1 to 3 range and 3 or more ratings were in the 7 to 9 range, the panelists were considered to be in disagreement. There was agreement on 43% (19) of the measures as important, 27% (12) as scientifically sound, 48% (21) as usable, and 59% (26) as feasible to complete. Ten measures met all 4 of these criteria and were, therefore, considered valid measurements of quality. Quality measures that were developed address outcomes (patient-reported outcomes for assessment and improvement of function) and processes of care (utilization rates of imaging, antibiotics, occupational therapy, ultrasound, and operative treatment). The consortium developed 10 measures of hand surgery quality using a validated methodology. These measures merit further development. Quality measures can be used to evaluate the quality of care provided by physicians and health systems and can inform quality and value-based reimbursement models. Copyright © 2017 American Society for Surgery of the Hand. Published by Elsevier Inc. All rights reserved.
A Validity and Reliability Study of the Attitudes toward Sustainable Development Scale
ERIC Educational Resources Information Center
Biasutti, Michele; Frate, Sara
2017-01-01
This article describes the development and validation of the Attitudes toward Sustainable Development scale, a quantitative 20-item scale that measures Italian university students' attitudes toward sustainable development. A total of 484 undergraduate students completed the questionnaire. The validity and reliability of the scale was statistically…
ERIC Educational Resources Information Center
Teo, Timothy
2010-01-01
Purpose: The purpose of this paper is to assess the cross-cultural validity of the technology acceptance measure for pre-service teachers (TAMPST) on a Malaysian sample. Design/methodology/approach: A total of 193 pre-service teachers from a Malaysian university completed a survey questionnaire measuring their responses to five constructs in the…
Wysocki, Tim; Gavin, Leslie
2004-01-01
Despite theoretical and empirical reasons suggesting its potential importance, paternal involvement in the management of pediatric chronic diseases has rarely been a primary focus of research on family adaptation to pediatric disease. This may be due to a lack of appropriate tools to measure relevant behaviors. This study assessed the reliability and validity of the Dads' Active Disease Support scale (DADS), which was designed to measure male and female caregivers' estimates of the amount and helpfulness of paternal involvement in managing six pediatric chronic diseases. A sample of 224 heterosexual couples completed the DADS and measures of mother, child, and family functioning, yielding 190 who completed data sets. Of these, 91 mothers and 88 fathers completed the DADS again after a 1-month interval. Results confirmed DADS internal consistency, test-retest reliability, and interparent agreement. Confirmatory factor analysis supported its construct validity: A two-factor model (amount and helpfulness of fathers' involvement) best accounted for participants' responses. Significant correlations with scores on the Family Assessment Device supported DADS convergent validity. DADS scores of mothers and fathers suggest substantial room for improvement in both the amount and the helpfulness of paternal involvement in disease management. Mothers provided significantly higher ratings of the helpfulness of fathers' involvement than did fathers. The DADS appears to be a reliable and valid measure for studies of the associations between paternal involvement in disease management and child, maternal, and family adaptation to pediatric chronic medical conditions.
Dykes, Patricia C; Hurley, Ann C; Brown, Suzanne; Carr, Robyn; Cashen, Margaret; Collins, Rita; Cook, Robyn; Currie, Leanne; Docherty, Charles; Ensio, Anneli; Foster, Joanne; Hardiker, Nicholas R; Honey, Michelle L L; Killalea, Rosaleen; Murphy, Judy; Saranto, Kaija; Sensmeier, Joyce; Weaver, Charlotte
2009-01-01
In 2005, the Healthcare Information Management Systems Society (HIMSS) Nursing Informatics Community developed a survey to measure the impact of health information technology (HIT), the I-HIT Scale, on the role of nurses and interdisciplinary communication in hospital settings. In 2007, nursing informatics colleagues from Australia, England, Finland, Ireland, New Zealand, Scotland and the United States formed a research collaborative to validate the I-HIT across countries. All teams have completed construct and face validation in their countries. Five out of six teams have initiated reliability testing by practicing nurses. This paper reports the international collaborative's validation of the I-HIT Scale completed to date.
Use of the color trails test as an embedded measure of performance validity.
Henry, George K; Algina, James
2013-01-01
One hundred personal injury litigants and disability claimants referred for a forensic neuropsychological evaluation were administered both portions of the Color Trails Test (CTT) as part of a more comprehensive battery of standardized tests. Subjects who failed two or more free-standing tests of cognitive performance validity formed the Failed Performance Validity (FPV) group, while subjects who passed all free-standing performance validity measures were assigned to the Passed Performance Validity (PPV) group. A cutscore of ≥45 seconds to complete Color Trails 1 (CT1) was associated with a classification accuracy of 78%, good sensitivity (66%) and high specificity (90%), while a cutscore of ≥84 seconds to complete Color Trails 2 (CT2) was associated with a classification accuracy of 82%, good sensitivity (74%) and high specificity (90%). A CT1 cutscore of ≥58 seconds, and a CT2 cutscore ≥100 seconds was associated with 100% positive predictive power at base rates from 20 to 50%.
Attitudes Toward Transgender Men and Women: Development and Validation of a New Measure
Billard, Thomas J
2018-01-01
A series of three studies were conducted to generate, develop, and validate the Attitudes toward Transgender Men and Women (ATTMW) scale. In Study 1, 120 American adults responded to an open-ended questionnaire probing various dimensions of their perceptions of transgender individuals and identity. Qualitative thematic analysis generated 200 items based on their responses. In Study 2, 238 American adults completed a questionnaire consisting of the generated items. Exploratory factor analysis (EFA) revealed two non-identical 12-item subscales (ATTM and ATTW) of the full 24-item scale. In Study 3, 150 undergraduate students completed a survey containing the ATTMW and a number of validity-testing variables. Confirmatory factor analysis (CFA) verified the single-factor structures of the ATTM and ATTW subscales, and the convergent, discriminant, predictive, and concurrent validities of the ATTMW were also established. Together, our results demonstrate that the ATTMW is a reliable and valid measure of attitudes toward transgender individuals. PMID:29666595
ter Hoeven, Claartje L; Zandbelt, Linda C; Fransen, Sanne; de Haes, Hanneke; Oort, Frans; Geijsen, Debby; Koning, Caro; Smets, Ellen
2011-11-01
This paper describes the further development and psychometric properties of an instrument to measure cancer patients' reasons to want complete or limited information: the Considerations Concerning Cancer Information questionnaire (CCCI). Understanding cancer patients' reasons to want complete or limited information will provide the physician with information that enables him or her to tailor information giving. CCCI's content validity, internal structure, and convergent validity were investigated among 145 cancer patients, new to radiotherapy. Underlying reasons for information preference among cancer patients were derived from existing qualitative studies, narratives, and interviews. This resulted in the CCCI containing two parts: reasons to favor complete information disclosure and reasons to prefer only limited information about disease and treatment. The four identified dimensions to prefer information consist of: sense of control, expectations of others, anxiety, and autonomy. The four dimensions for reasons to give up on acquiring information consist of: avoidance, optimism, comprehension, and not wanting to be a burden. Confirmatory factor analysis indicated that the measurement model provided good fit to the data. Scales had good internal consistency, satisfactory item-total correlations corrected for overlap and satisfactory convergent validity. These findings confirm evidence of the reliability and validity of the CCCI for use in cancer care. Researchers and health-care providers can use the instrument to assess cancer patients' reasons to want complete or limited information and provide tailored care. Copyright © 2010 John Wiley & Sons, Ltd.
Good validity of the international spinal cord injury quality of life basic data set.
Post, M W M; Adriaansen, J J E; Charlifue, S; Biering-Sørensen, F; van Asbeck, F W A
2016-04-01
Cross-sectional validation study. To examine the construct and concurrent validity of the International Spinal Cord Injury (SCI) Quality of Life (QoL) Basic Data Set. Dutch community. People 28-65 years of age, who obtained their SCI between 18 and 35 years of age, were at least 10 years post SCI and were wheelchair users in daily life. MEASURE(S): The International SCI QoL Basic Data Set consists of three single items on satisfaction with life as a whole, physical health and psychological health (0=complete dissatisfaction; 10=complete satisfaction). Reference measures were the Mental Health Inventory-5 and three items of the World Health Organization Quality of Life measure. Data of 261 participants were available. Mean time after SCI was 24.1 years (s.d. 9.1); 90.4% had a traumatic SCI, 81.5% a motor complete SCI and 40% had tetraplegia. Mean age was 47.9 years (s.d. 8.8) and 73.2% were male. Mean scores were 6.9 (s.d. 1.9) for general QoL, 5.8 (s.d. 2.2) for physical health and 7.1 (s.d. 1.9) for psychological health. No floor or ceiling effects were found. Strong inter-correlations (0.48-0.71) were found between the items, and Cronbach's alpha of the scale was good (0.81). Correlations with the reference measures showed the strongest correlations between the WHOQOL general satisfaction item and general QoL (0.64), the WHOQOL health and daily activities items and physical health (0.69 and 0.60) and the Mental Health Inventory-5 and psychological health (0.70). This first validity study of the International SCI QoL Basic Data Set shows that it appears valid for persons with SCI.
Smithline, Howard A; Caglar, Selin; Blank, Fidela S J
2010-01-01
This study assessed the convergent validity of 2 dyspnea measures, the transition measure and the change measure, by comparing them with each other in patients admitted to the hospital with acute decompensated heart failure. Static measures of dyspnea were obtained at baseline (pre-static measure) and at time 1 hour and 4 hour (post-static measures). The change measure was calculated as the difference between the pre-static and post-static measures. Transition measures were obtained at time 1 hour and 4 hour. Visual analog scales and Likert scales were used. Both physicians and patients measured the dyspnea independently. A total of 112 patients had complete data sets at time 0 and 1 hour and 86 patients had complete data sets at all 3 time points. Correlations were calculated between the transition measures and static measures (pre-static, post-static, and change measure). Bland-Altman plots were generated and the mean difference and limits of agreement between the transition measures and the change measures were calculated. In general, short-term dyspnea assessment using transition measures and serial static measures can not be used to validate each other in this population of patients being admitted with acute decompensated heart failure. © 2010 Wiley Periodicals, Inc.
Measuring Students' Physical Activity Levels: Validating SOFIT for Use with High-School Students
ERIC Educational Resources Information Center
van der Mars, Hans; Rowe, Paul J.; Schuldheisz, Joel M.; Fox, Susan
2004-01-01
This study was conducted to validate the System for Observing Fitness Instruction Time (SOFIT) for measuring physical activity levels of high-school students. Thirty-five students (21 girls and 14 boys from grades 9-12) completed a standardized protocol including lying, sitting, standing, walking, running, curl-ups, and push-ups. Heart rates and…
Evaluation of hand sensibility: a review.
Novak, C B
2001-01-01
Many assessment devices and measures have been described to evaluate sensibility, with little consensus on the optimal measurement tool. The purpose of this paper is to review the assessment methods and devices used in the evaluation of hand sensibility. Consideration is given to the characteristics of each measurement tool, the information necessary for complete patient evaluation, and the battery of valid and reliable measurements that provide the most complete and accurate patient assessment.
Measurement of Harm Outcomes in Older Adults after Hospital Discharge: Reliability and Validity
Douglas, Alison; Letts, Lori; Eva, Kevin; Richardson, Julie
2012-01-01
Objectives. Defining and validating a measure of safety contributes to further validation of clinical measures. The objective was to define and examine the psychometric properties of the outcome “incidents of harm.” Methods. The Incident of Harm Caregiver Questionnaire was administered to caregivers of older adults discharged from hospital by telephone. Caregivers completed daily logs for one month and medical charts were examined. Results. Test-retest reliability (n = 38) was high for the occurrence of an incident of harm (yes/no; kappa = 1.0) and the type of incident (agreement = 100%). Validation against daily logs found no disagreement regarding occurrence or types of incidents. Validation with medical charts found no disagreement regarding incident occurrence and disagreement in half regarding incident type. Discussion. The data support the Incident of Harm Caregiver Questionnaire as a reliable and valid estimation of incidents for this sample and are important to researchers as a method to measure safety when validating clinical measures. PMID:22649728
Shiroff, Jennifer J; Gregoski, Mathew J
2017-06-01
Measurement of recessive carrier screening attitudes related to conception and pregnancy is necessary to determine current acceptance, and whether behavioral intervention strategies are needed in clinical practice. To evaluate quantitative survey instruments to measure patient attitudes regarding genetic carrier testing prior to conception and pregnancy databases examining patient attitudes regarding genetic screening prior to conception and pregnancy from 2003-2013 were searched yielding 344 articles; eight studies with eight instruments met criteria for inclusion. Data abstraction on theoretical framework, subjects, instrument description, scoring, method of measurement, reliability, validity, feasibility, level of evidence, and outcomes was completed. Reliability information was provided in five studies with an internal consistency of Cronbach's α >0.70. Information pertaining to validity was presented in three studies and included construct validity via factor analysis. Despite limited psychometric information, these questionnaires are self-administered and can be briefly completed, making them a feasible method of evaluation.
Understanding and Measuring Health Care Insecurity
Tomsik, Philip E.; Smith, Samantha; Mason, Mary Jane; Zyzanski, Stephen J.; Stange, Kurt C.; Werner, James J.; Flocke, Susan A.
2015-01-01
Purpose To define the concept of “health care insecurity,” validate a new self-report measure, and examine the impact of beginning care at a free clinic on uninsured patients’ health care insecurity. Methods Consecutive new patients presenting at a free clinic completed 15 items assessing domains of health care insecurity (HCI) at their first visit and again four to eight weeks later. Psychometrics and change of the HCI measure were examined. Results The HCI measure was found to have high internal consistency (α=0.94). Evidence of concurrent validity was indicated by negative correlation with VR-12 health-related quality of life physical and mental health components and positive correlation with the Perceived Stress Scale. Predictive validity was shown among the 83% of participants completing follow-up: HCI decreased after beginning care at a free clinic (p<.001). Conclusion Reliably assessing patient experience of health care insecurity is feasible and has potential to inform efforts to improve quality and access to care among underserved populations. PMID:25418245
Garcia, Antonio F.; Acosta, Melina; Pirani, Saifa; Edwards, Daniel; Osman, Augustine
2017-01-01
We describe 2 studies designed to evaluate scores on the Multidimensional Shame-related Response Inventory-21 (MSRI-21), a recently developed instrument that measures affective and behavioral responses to shame. The inventory assesses shame-related responses in 3 categories: negative self-evaluation, fear of social consequences, and maladaptive behavior tendency. For Study 1, (N = 743) undergraduates completed the MSRI-21. Confirmatory factor analysis supported the validity of the MSRI-21 3-factor structure. Latent variable modeling of coefficient-α provided strong evidence for the internal consistency of scores on each scale. In Study 2, (N = 540) undergraduates completed the instrument along with 5 concurrent measures chosen for clinical significance. Achievement of factorial invariance supported the use of MSRI-21 scale scores to make valid mean comparisons across gender. In addition, MSRI-21 scale scores were associated as expected with scores on measures of self-harm, suicide, and other risk factors. Taken together, results of 2 studies support the internal consistency reliability, factorial validity, factorial invariance, and convergent validity of scores on the MSRI-21. Further work is needed to assess the temporal stability of the MSRI-21 scale scores, invariance across clinical status and other groupings, item-level measurement properties, and viability in highly symptomatic samples. PMID:28182490
Dritsakis, Giorgos; van Besouw, Rachel M; Kitterick, Pádraig; Verschuur, Carl A
2017-09-18
A music-related quality of life (MuRQoL) questionnaire was developed for the evaluation of music rehabilitation for adult cochlear implant (CI) users. The present studies were aimed at refinement and validation. Twenty-four experts reviewed the MuRQoL items for face validity. A refined version was completed by 147 adult CI users, and psychometric techniques were used for item selection, assessment of reliability, and definition of the factor structure. The same participants completed the Short Form Health Survey for construct validation. MuRQoL responses from 68 CI users were compared with those of a matched group of adults with normal hearing. Eighteen items measuring music perception and engagement and 18 items measuring their importance were selected; they grouped together into 2 domains. The final questionnaire has high internal consistency and repeatability. Significant differences between CI users and adults with normal hearing and a correlation between music engagement and quality of life support construct validity. Scores of music perception and engagement and importance for the 18 items can be combined to assess the impact of music on the quality of life. The MuRQoL questionnaire is a reliable and valid measure of self-reported music perception, engagement, and their importance for adult CI users with potential to guide music aural rehabilitation.
Swami, Viren; Barron, David; Weis, Laura; Voracek, Martin; Stieger, Stefan; Furnham, Adrian
2017-01-01
A number scales have been developed to measure conspiracist ideation, but little attention has been paid to the factorial validity of these scales. We reassessed the psychometric properties of four widely-used scales, namely the Belief in Conspiracy Theories Inventory (BCTI), the Conspiracy Mentality Questionnaire (CMQ), the Generic Conspiracist Beliefs Scale (GCBS), and the One-Item Conspiracy Measure (OICM). Eight-hundred-and-three U.S. adults completed all measures, along with measures of endorsement of 9/11 and anti-vaccination conspiracy theories. Through both exploratory and confirmatory factor analysis, we found that only the BCTI had acceptable factorial validity. We failed to confirm the factor structures of the CMQ and the GBCS, suggesting these measures had poor factorial validity. Indices of convergent validity were acceptable for the BCTI, but weaker for the other measures. Based on these findings, we provide suggestions for the future refinement in the measurement of conspiracist ideation.
Swami, Viren; Barron, David; Weis, Laura; Voracek, Martin; Stieger, Stefan; Furnham, Adrian
2017-01-01
A number scales have been developed to measure conspiracist ideation, but little attention has been paid to the factorial validity of these scales. We reassessed the psychometric properties of four widely-used scales, namely the Belief in Conspiracy Theories Inventory (BCTI), the Conspiracy Mentality Questionnaire (CMQ), the Generic Conspiracist Beliefs Scale (GCBS), and the One-Item Conspiracy Measure (OICM). Eight-hundred-and-three U.S. adults completed all measures, along with measures of endorsement of 9/11 and anti-vaccination conspiracy theories. Through both exploratory and confirmatory factor analysis, we found that only the BCTI had acceptable factorial validity. We failed to confirm the factor structures of the CMQ and the GBCS, suggesting these measures had poor factorial validity. Indices of convergent validity were acceptable for the BCTI, but weaker for the other measures. Based on these findings, we provide suggestions for the future refinement in the measurement of conspiracist ideation. PMID:28231266
Validation of a New Measure of the Concept of Good Death among Taiwanese Children
ERIC Educational Resources Information Center
Yang, Shu Ching; Lai, Sih-yi
2012-01-01
The purpose of this study was to develop and validate an instrument to measure dimensions of the concept of a good death held by Taiwanese children. The sample consisted of 1,698 Taiwanese children, approximately 12-14 years of age. Participants completed the self-administered Good Death Concept Scale (GDCS), which consists of 30 statements…
ERIC Educational Resources Information Center
Zhang, Xiao; Nurmi, Jari-Erik; Kiuru, Noona; Lerkkanen, Marja-Kristiina; Aunola, Kaisa
2011-01-01
This study aims to validate a teacher-report measure of children's task-avoidant behavior, namely the Behavioral Strategy Rating Scale (BSRS), in a sample of 352 Finnish children. In each of the four waves from Kindergarten to Grade 2, teachers rated children's task-avoidant behavior using the BSRS, children completed reading and mathematics…
Shah, Nina; Shi, Qiuling; Giralt, Sergio; Williams, Loretta; Bashir, Qaiser; Qazilbash, Muzaffar; Champlin, Richard E; Cleeland, Charles S; Wang, Xin Shelley
2018-04-01
We aimed to determine the utility of a patient-reported outcome (PRO) as it relates to patient performed testing (PPT) for measuring functional status in multiple myeloma patients after autologous hematopoietic stem cell transplantation (auto-HCT). Symptom interference on walking (a PRO) was measured by the MD Anderson Symptom Inventory (MDASI). PPT was assessed via 6-min walk test (6MWT). Mixed effects modeling was used to examine (1) the longitudinal relationship between the MDASI score and 6MWT distance and (2) the MDASI scores between patients who did or did not complete the 6WMT. Receiver operating characteristic (ROC) curve analysis was performed to quantify the construct validity of the PRO by differentiating performance status. Seventy-nine patients were included. Mean 6MWT distance significantly correlated with MDASI-walking interference score (PRO) over the first month of auto-HCT (est = 6.09, p = 0.006). There was a significantly higher completion rate for MDASI versus 6MWT at each time point (p < 0.01). Patients who completed the 6MWT reported less interference on walking during the study period (est = 1.61, p < 0.0001). Finally, the PRO demonstrated significant construct validity for measuring functioning status with MDASI-walking against ECOG-PS as the anchor (AUC = 0.77, 95% CI 0.60-0.94, p = 0.003). The PRO of MDASI-walking interference is a valid physical functioning measure, correlating with an objective functional measure (6MWT) in MM patients undergoing auto-HCT. As patients with poorer functional status during therapy are less likely to complete PPT, this PRO may offer a more practical quantitative measure of functioning in patients.
ERIC Educational Resources Information Center
Langberg, Joshua M.; Molitor, Stephen J.; Oddo, Lauren E.; Eadeh, Hana-May; Dvorsky, Melissa R.; Becker, Stephen P.
2017-01-01
Objective: The primary objective of this study was to evaluate the prevalence of multiple types of sleep problems in young adolescents with ADHD. Method: 262 adolescents comprehensively diagnosed with ADHD and their caregivers completed well-validated measures of sleep problems and daytime sleepiness. Participants also completed measures related…
ERIC Educational Resources Information Center
Yovanoff, Paul; Squires, Jane; McManus, Suzanne
2013-01-01
Adapting traditional paper-pencil instruments to computer-based environments has received considerable attention from the research community due to the possible administration mode effects on obtained measures. When differences due to mode of completion (i.e., paper-pencil, computer-based) are present, threats to measurement validity are posed. In…
Vivat, B; Young, T E; Winstanley, J; Arraras, J I; Black, K; Boyle, F; Bredart, A; Costantini, A; Guo, J; Irarrazaval, M E; Kobayashi, K; Kruizinga, R; Navarro, M; Omidvari, S; Rohde, G E; Serpentini, S; Spry, N; Van Laarhoven, H W M; Yang, G M
2017-11-01
The EORTC Quality of Life Group has just completed the final phase (field-testing and validation) of an international project to develop a stand-alone measure of spiritual well-being (SWB) for palliative cancer patients. Participants (n = 451)-from 14 countries on four continents; 54% female; 188 Christian; 50 Muslim; 156 with no religion-completed a provisional 36-item measure of SWB plus the EORTC QLQ-C15-PAL (PAL), then took part in a structured debriefing interview. All items showed good score distribution across response categories. We assessed scale structure using principal component analysis and Rasch analysis, and explored construct validity, and convergent/divergent validity with the PAL. Twenty-two items in four scoring scales (Relationship with Self, Relationships with Others, Relationship with Someone or Something Greater, and Existential) explained 53% of the variance. The measure also includes a global SWB item and nine other items. Scores on the PAL global quality-of-life item and Emotional Functioning scale weakly-moderately correlated with scores on the global SWB item and two of the four SWB scales. This new validated 32-item SWB measure addresses a distinct aspect of quality-of-life, and is now available for use in research and clinical practice, with a role as both a measurement and an intervention tool. © 2017 John Wiley & Sons Ltd.
Development and validation of a short-form Pain Medication Attitudes Questionnaire (PMAQ-14).
Elander, James; Said, Omimah; Maratos, Frances A; Dys, Ada; Collins, Hannah; Schofield, Malcolm B
2017-03-01
Attitudes to pain medication are important aspects of adjustment to chronic pain. They are measured by the 47-item Pain Medication Attitudes Questionnaire (PMAQ). To measure those attitudes more quickly and easily, we developed and evaluated a 14-item PMAQ using data from 3 separate surveys of people with pain in the general population. In survey 1, participants (n = 295) completed the 47-item PMAQ and measures of pain, analgesic use, analgesic dependence, and attitudes to self-medication. For each of the 7 PMAQ scales, the 2 items that best preserved the content of the full parent scales were identified using correlation and regression. The 2-item and full parent scales had very similar relationships with other measures, indicating that validity had been maintained. The resulting 14-item PMAQ was then completed by participants in survey 2 (n = 241) and survey 3 (n = 147), along with the same other measures as in survey 1. Confirmatory factor analysis showed that the 14-item PMAQ retained the 7-factor structure of the 47-item version, and correlations with other measures showed that it retained the validity of the 47-item version. The PMAQ scale Need was the most significant independent predictor of analgesic dependence in each of 4 separate multiple regression analyses. This short form of the PMAQ allows attitudes to pain medications to be measured in a valid and more efficient way.
Langberg, Joshua M; Smith, Zoe R; Dvorsky, Melissa R; Molitor, Stephen J; Bourchtein, Elizaveta; Eddy, Laura D; Eadeh, Hana-May; Oddo, Lauren E
2017-08-31
Many students with attention-deficit/hyperactivity disorder (ADHD) exhibit deficits in motivation to pursue long-term goals. Students with ADHD have particular difficulty with motivation to complete homework-related tasks and often fail to complete assignments. Although these problems are common and may impact academic performance, no homework-motivation measures have been validated for use with students with ADHD. The primary goal of the present study was to evaluate the factor structure and predictive validity of a homework-motivation measure based upon the expectancy-value theory of achievement motivation. A sample of 285 middle school students with ADHD completed the measure, and confirmatory factor analysis was used to evaluate the proposed factor structure and associations with parent and teacher ratings of homework performance. A 2-factor structure emerged, and model fit was excellent. Further, student-rated ability-expectancy beliefs demonstrated significant associations with parent-rated homework problems and performance and with teacher-rated homework performance and percentage of assignments turned in above and beyond ADHD symptoms. Future directions for studying the importance of motivation in students with ADHD are provided, with particular attention to the role that reward sensitivity may play in motivation. (PsycINFO Database Record (c) 2017 APA, all rights reserved).
Elzahaf, Raga A; Tashani, Osama A; Unsworth, Biddy A; Johnson, Mark I
2013-03-01
The Leeds Assessment of Neuropathic Symptoms and Signs (LANSS) pain scale is used to identify pain of neuropathic origin and has been validated as a self-completed tool (S-LANSS). We translated the S-LANSS into Arabic and evaluated its reliability and linguistic validity for use by Libyan people. Thirteen of 45 Libyan nationals living in the UK were identified as having chronic pain and completed an English and Arabic S-LANSS 1 week apart. In addition, 23 of 104 respondents to a telephone interview in Derna City, Libya, were identified as having chronic pain and completed the Arabic S-LANSS. Seven of these 23 completed the S-LANSS again 1 week later. Cronbach's alpha was 0.72 (P < 0.001) for the Arabic S-LANSS and 0.71 (P < 0.001) for the English S-LANSS. There was good measurement of agreement of individual items in Arabic and English S-LANSS tools with kappa coefficients ranging from 0.69 to 1.00. Twelve of the 23 (52.2%) individuals with chronic pain scored 12 or more on the Arabic S-LANSS and were classified as possibly having neuropathic pain. There was good measurement of agreement of individual items in Arabic S-LANSS tools with kappa coefficients ranging from 0.462 to 1.00. There were strong intraclass correlations in both versions for test-retest reliability of total score. The Arabic S-LANSS is reliable and linguistically valid to use in Libya. Our translation of the S-LANSS into Arabic was shown to be linguistically valid and reliable for use in a Libyan population. © 2012 The Authors. Pain Practice © 2012 World Institute of Pain.
Dong, Aishu; Chen, Sisi; Zhu, Lianlian; Shi, Lingmin; Cai, Yueli; Zeng, Jingni; Guo, Wenjian
2017-08-01
Chronic heart failure (CHF), a major public health problem worldwide, seriously limits health-related quality of life (HRQOL). How to evaluate HRQOL in older patients with CHF remains a problem. To evaluate the reliability and validity of the Chinese version of the Medical Outcomes Study Short Form version 2 (SF-36v2) in CHF patients. From September 2012 to June 2014, we assessed QOL using the SF-36v2 in 171 aging participants with CHF in four cardiology departments. Convergent and discriminant validity, factorial validity, sensitivity among different NYHA classes and between different age groups, and reliability were determined using standard measurement methods. A total of 150 participants completed a structured questionnaire including general information and the Chinese SF-36v2; 132 questionnaires were considered valid, while 21 patients refused to take part. 25 of the 50 participants invited to complete the 2-week test-retest questionnaires returned completed questionnaires. The internal consistency reliability (Cronbach's α) of the total SF-36v2 was 0.92 (range 0.74-0.93). All hypothesized item-subscale correlations showed satisfactory convergent and discriminant validity. Sensitivity was measured in different NYHA classes and age groups. Comparison of different NYHA classes showed statistical significance, but there was no significant difference between age groups. We confirmed the SF-36v2 as a valid instrument for evaluating HRQOL Chinese CHF patients. Both reliability and validity were strongly satisfactory, but there was divergence in understanding subscales such as "social functioning" because of differing cultural background. The reliability, validity, and sensitivity of SF-36v2 in aging patients with CHF were acceptable.
Annear, Michael J; Eccleston, Claire E; McInerney, Frances J; Elliott, Kate-Ellen J; Toye, Christine M; Tranter, Bruce K; Robinson, Andrew L
2016-06-01
To compare the psychometric performance of the Dementia Knowledge Assessment Scale (DKAS) and the Alzheimer's Disease Knowledge Scale (ADKS) when administered to a large international cohort before and after online dementia education. Comparative psychometric analysis with pre- and posteducation scale responses. The setting for this research encompassed 7,909 individuals from 124 countries who completed the 9-week Understanding Dementia Massive Open Online Course (MOOC). Volunteer respondents who completed the DKAS and ADKS before (n = 3,649) and after (n = 878) completion of the Understanding Dementia MOOC. Assessment and comparison of the DKAS and ADKS included evaluation of scale development procedures, interscale correlations, response distribution, internal consistency, and construct validity. The DKAS had superior internal consistency, wider response distribution with less ceiling effect, and better discrimination between pre- and posteducation scores and occupational cohorts than the ADKS. The 27-item DKAS is a reliable and preliminarily valid measure of dementia knowledge that is psychometrically and conceptually sound, overcomes limitations of existing instruments, and can be administered to diverse cohorts to measure baseline understanding and knowledge change. © 2016, Copyright the Authors Journal compilation © 2016, The American Geriatrics Society.
Jones, Jordan T; Carle, Adam C; Wootton, Janet; Liberio, Brianna; Lee, Jiha; Schanberg, Laura E; Ying, Jun; Morgan DeWitt, Esi; Brunner, Hermine I
2017-01-01
To validate the pediatric Patient-Reported Outcomes Measurement Information System short forms (PROMIS-SFs) in childhood-onset systemic lupus erythematosus (SLE) in a clinical setting. At 3 study visits, childhood-onset SLE patients completed the PROMIS-SFs (anger, anxiety, depressive symptoms, fatigue, physical function-mobility, physical function-upper extremity, pain interference, and peer relationships) using the PROMIS assessment center, and health-related quality of life (HRQoL) legacy measures (Pediatric Quality of Life Inventory, Childhood Health Assessment Questionnaire, Simple Measure of Impact of Lupus Erythematosus in Youngsters [SMILEY], and visual analog scales [VAS] of pain and well-being). Physicians rated childhood-onset SLE activity on a VAS and completed the Systemic Lupus Erythematosus Disease Activity Index 2000. Using a global rating scale of change (GRC) between study visits, physicians rated change of childhood-onset SLE activity (GRC-MD1: better/same/worse) and change of patient overall health (GRC-MD2: better/same/worse). Questionnaire scores were compared in support of validity and responsiveness to change (external standards: GRC-MD1, GRC-MD2). In this population-based cohort (n = 100) with a mean age of 15.8 years (range 10-20 years), the PROMIS-SFs were completed in less than 5 minutes in a clinical setting. The PROMIS-SF scores correlated at least moderately (Pearson's r ≥ 0.5) with those of legacy HRQoL measures, except for the SMILEY. Measures of childhood-onset SLE activity did not correlate with the PROMIS-SFs. Responsiveness to change of the PROMIS-SFs was supported by path, mixed-model, and correlation analyses. To assess HRQoL in childhood-onset SLE, the PROMIS-SFs demonstrated feasibility, internal consistency, construct validity, and responsiveness to change in a clinical setting. © 2016, American College of Rheumatology.
Stetson, Barbara; Schlundt, David; Rothschild, Chelsea; Floyd, Jennifer E; Rogers, Whitney; Mokshagundam, Sri Prakash
2011-03-01
To develop and evaluate the validity and reliability of The Personal Diabetes Questionnaire (PDQ), a brief, yet comprehensive measure of diabetes self-care behaviors, perceptions and barriers. To examine individual items to provide descriptive and normative information and provide data on scale reliability and associations between PDQ scales and concurrently assessed HBA(1c) and BMI. Items were written to address nutritional management, medication utilization, blood glucose monitoring, and physical activity. The initial instrument was reviewed by multidisciplinary diabetes care providers and items subsequently revised until the measure provided complete coverage of the diabetes care domains using as few items as possible. The scoring scheme was generated rationally. Subjects were 790 adults (205 with type 1 and 585 with type 2 diabetes) who completed the PDQ while waiting for clinic appointments. Item completion rates were high, with few items skipped by participants. Subscales demonstrated good internal consistency (Cronbach α=.650-.834) and demonstrated significant associations with BMI (p ≤.001) and HbA(1c) (p ≤.001). The PDQ is a useful measure of diabetes self-care behaviors and related perceptions and barriers that is reliable and valid and feasible to administer in a clinic setting. This measure may be used to obtain data for assessing diabetes self-management and barriers and to guide patient care. Copyright © 2010 Elsevier Ireland Ltd. All rights reserved.
Phillips, Nicole Margaret; Street, Maryann; Haesler, Emily
2016-02-01
Patient participation in healthcare is recognised internationally as essential for consumer-centric, high-quality healthcare delivery. Its measurement as part of continuous quality improvement requires development of agreed standards and measurable indicators. This systematic review sought to identify strategies to measure patient participation in healthcare and to report their reliability and validity. In the context of this review, patient participation was constructed as shared decision-making, acknowledging the patient as having critical knowledge regarding their own health and care needs and promoting self-care/autonomy. Following a comprehensive search, studies reporting reliability or validity of an instrument used in a healthcare setting to measure patient participation, published in English between January 2004 and March 2014 were eligible for inclusion. From an initial search, which identified 1582 studies, 156 studies were retrieved and screened against inclusion criteria. Thirty-three studies reporting 24 patient participation measurement tools met inclusion criteria, and were critically appraised. The majority of studies were descriptive psychometric studies using prospective, cross-sectional designs. Almost all the tools completed by patients, family caregivers, observers or more than one stakeholder focused on aspects of patient-professional communication. Few tools designed for completion by patients or family caregivers provided valid and reliable measures of patient participation. There was low correlation between many of the tools and other measures of patient satisfaction. Few reliable and valid tools for measurement of patient participation in healthcare have been recently developed. Of those reported in this review, the dyadic Observing Patient Involvement in Decision Making (dyadic-OPTION) tool presents the most promise for measuring core components of patient participation. There remains a need for further study into valid, reliable and feasible strategies for measuring patient participation as part of continuous quality improvement. Published by the BMJ Publishing Group Limited. For permission to use (where not already granted under a licence) please go to http://www.bmj.com/company/products-services/rights-and-licensing/
Measuring Nutrition Literacy in Spanish-Speaking Latinos: An Exploratory Validation Study.
Gibbs, Heather D; Camargo, Juliana M T B; Owens, Sarah; Gajewski, Byron; Cupertino, Ana Paula
2017-11-21
Nutrition is important for preventing and treating chronic diseases highly prevalent among Latinos, yet no tool exists for measuring nutrition literacy among Spanish speakers. This study aimed to adapt the validated Nutrition Literacy Assessment Instrument for Spanish-speaking Latinos. This study was developed in two phases: adaptation and validity testing. Adaptation included translation, expert item content review, and interviews with Spanish speakers. For validity testing, 51 participants completed the Short Assessment of Health Literacy-Spanish (SAHL-S), the Nutrition Literacy Assessment Instrument in Spanish (NLit-S), and socio-demographic questionnaire. Validity and reliability statistics were analyzed. Content validity was confirmed with a Scale Content Validity Index of 0.96. Validity testing demonstrated NLit-S scores were strongly correlated with SAHL-S scores (r = 0.52, p < 0.001). Entire reliability was substantial at 0.994 (CI 0.992-0.996) and internal consistency was excellent (Cronbach's α = 0.92). The NLit-S demonstrates validity and reliability for measuring nutrition literacy among Spanish-speakers.
Rachakonda, Tara; Jeffe, Donna B; Shin, Jennifer J; Mankarious, Leila; Fanning, Robert J; Lesperance, Marci M; Lieu, Judith E C
2014-02-01
The prevalence of hearing loss (HL) in adolescents has grown over the past decade, but hearing-related quality of life (QOL) has not been well-measured. We sought to develop a reliable, valid measure of hearing-related QOL for adolescents and the Hearing Environments And Reflection on Quality of Life (HEAR-QL). Multisite observational study. Adolescents with HL and siblings without HL were recruited from five centers. Participants completed the HEAR-QL and validated questionnaires measuring generic pediatric QOL (PedsQL), depression and anxiety (RCADS-25), and hearing-related QOL for adults (HHIA) to determine construct and discriminant validity. Participants completed the HEAR-QL 2 weeks later for test-retest reliability. We used exploratory principal components analysis to determine the HEAR-QL factor structure and measured reliability. Sensitivity and specificity of the HEAR-QL, PedsQL, HHIA, and RCADS-25 were assessed. We compared scores on all surveys between those with normal hearing, unilateral, and bilateral HL. A total of 233 adolescents (13-18 years old) participated: 179 with HL, 54 without HL. The original 45-item HEAR-QL was shortened to 28 items after determining factor structure. The resulting HEAR-QL-28 demonstrated excellent reliability (Cronbach's alpha = 0.95) and construct validity (HHIA: r = .845, PedsQL: r = .587; RCADS-25: r = .433). The HEAR-QL-28 displayed excellent discriminant validity, with higher area under the curve (0.932) than the PedsQL (0.597) or RCADS-25 (0.529). Teens with bilateral HL using hearing devices reported worse QOL on the HEAR-QL and HHIA than peers with HL not using devices. The HEAR-QL is a sensitive, reliable, and valid measure of hearing-related QOL for adolescents. 2b. © 2013 The American Laryngological, Rhinological and Otological Society, Inc.
Rachakonda, Tara; Jeffe, Donna B.; Shin, Jennifer J.; Mankarious, Leila; Fanning, Robert J.; Lesperance, Marci M.; Lieu, Judith E.C.
2014-01-01
Objectives The prevalence of hearing loss (HL) in adolescents has grown over the past decade, but hearing-related quality of life (QOL) has not been well-measured. We sought to develop a reliable, valid measure of hearing-related QOL for adolescents, the Hearing Environments And Reflection on Quality of Life (HEAR-QL). Study Design Multi-site observational study. Methods Adolescents with HL and siblings without HL were recruited from five centers. Participants completed the HEAR-QL and validated questionnaires measuring generic pediatric QOL (PedsQL), depression and anxiety (RCADS-25), and hearing-related QOL for adults (HHIA) to determine construct and discriminant validity. Participants completed the HEAR-QL two weeks later for test-retest reliability. We used exploratory principal components analysis to determine the HEAR-QL factor structure and measured reliability. Sensitivity and specificity of the HEAR-QL, PedsQL, HHIA and RCADS-25 were assessed. We compared scores on all surveys between those with normal hearing, unilateral and bilateral HL. Results 233 adolescents (13–18 years old) participated—179 with HL, 54 without HL. The original 45-item HEAR-QL was shortened to 28 items after determining factor structure. The resulting HEAR-QL-28 demonstrated excellent reliability (Cronbach’s alpha= 0.95) and construct validity (HHIA: r =.845, PedsQL: r =.587; RCADS-25: r =.433). The HEAR-QL-28 displayed excellent discriminant validity, with higher area under the curve (0.932) than the PedsQL (0.597) or RCADS-25 (0.529). Teens with bilateral HL using hearing devices reported worse QOL on the HEAR-QL and HHIA than peers with HL not using devices. Conclusions The HEAR-QL is a sensitive, reliable and valid measure of hearing-related QOL for adolescents. PMID:23900836
Rusu, Adina C; Hallner, Dirk
2018-06-06
Depression is a common feature of chronic pain, but there is only limited research into the content and frequency of depressed cognitions in pain patients. This study describes the development of the Sentence Completion Test for Chronic Pain (SCP), an idiographic measure for assessing depressive thinking in chronic pain patients. The sentence completion task requires participants to finish incomplete sentences using their own words to a set of predefined stems that include negative, positive and neutral valenced self-referenced words. In addition, the stems include past, future and world stems, which reflect the theoretical negative triad typical to depression. Complete responses are coded by valence (negative, positive and neutral), pain and health-related content. A total of 89 participants were included in this study. Forty seven adult out-patients formed the depressed pain group and were compared to a non-clinical control sample of 42 healthy control participants. This study comprised several phases: (1) theory-driven generation of coding rules; (2) the development of a coding manual by a panel of experts (3) comparing reliability of coding by expert raters without the use of the coding manual and with the use of the coding manual; (4) preliminary analyses of the construct validity of the SCP. The internal consistency of the SCP was tested using the Kuder-Richardson coefficient (KR-20). Inter-rater agreement was assessed by intra-class correlations (ICC). The content and construct validity of the SCP was investigated by correlation coefficients between SCP negative completions, the Hospital Anxiety and Depression Scale (HADS) depression scores and the number of symptoms on the Structured Clinical Interview for DSM-IV-TR (SCID). As predicted for content validity, the number of SCP negative statements was significantly greater in the depressed pain group and this group also produced significantly fewer positive statements, compared to the healthy control group. The number of negative pain completions and negative health completions was significantly greater in the depressed pain group. As expected, in the depressed pain group, the correlation between SCP negatives and the HADS Depression score was r=0.60 and the correlation between SCP negatives and the number of symptoms on the SCID was r=0.56. The SCP demonstrated good content validity, internal consistency and inter-rater reliability. Uses for this measure, such as complementing questionnaire measures by an idiographic assessment of depressive thinking and generating hypotheses about key problems within a cognitive-behavioural case-formulation, are suggested.
Arbuckle, Rob; Abetz-Webb, Linda
2013-01-01
The US FDA and the European Medicines Agency (EMA) have issued incentives and laws mandating clinical research in pediatrics. While guidances for the development and validation of patient-reported outcomes (PROs) or health-related quality of life (HRQL) measures have been issued by these agencies, little attention has focused on pediatric PRO development methods. With reference to the literature, this article provides an overview of specific considerations that should be made with regard to the development of pediatric PRO measures, with a focus on performing qualitative research to ensure content validity. Throughout the questionnaire development process it is critical to use developmentally appropriate language and techniques to ensure outcomes have content validity, and will be reliable and valid within narrow age bands (0-2, 3-5, 6-8, 9-11, 12-14, 15-17 years). For qualitative research, sample sizes within those age bands must be adequate to demonstrate saturation while taking into account children's rapid growth and development. Interview methods, interview guides, and length of interview must all take developmental stage into account. Drawings, play-doh, or props can be used to engage the child. Care needs to be taken during cognitive debriefing, where repeated questioning can lead a child to change their answers, due to thinking their answer is incorrect. For the PROs themselves, the greatest challenge is in measuring outcomes in children aged 5-8 years. In this age range, while self-report is generally more valid, parent reports of observable behaviors are generally more reliable. As such, 'team completion' or a parent-administered child report is often the best option for children aged 5-8 years. For infants and very young children (aged 0-4 years), patient rating of observable behaviors is necessary, and, for adolescents and children aged 9 years and older, self-reported outcomes are generally valid and reliable. In conclusion, the development of PRO measures for use in children requires careful tailoring of qualitative methods, and performing research within narrow age bands. The best reporter should be carefully considered dependent on the child's age, developmental ability, and the concept being measured, and team completion should be considered alongside self-completion and observer measures.
Validation of the Social Appearance Anxiety Scale: factor, convergent, and divergent validity.
Levinson, Cheri A; Rodebaugh, Thomas L
2011-09-01
The Social Appearance Anxiety Scale (SAAS) was created to assess fear of overall appearance evaluation. Initial psychometric work indicated that the measure had a single-factor structure and exhibited excellent internal consistency, test-retest reliability, and convergent validity. In the current study, the authors further examined the factor, convergent, and divergent validity of the SAAS in two samples of undergraduates. In Study 1 (N = 323), the authors tested the factor structure, convergent, and divergent validity of the SAAS with measures of the Big Five personality traits, negative affect, fear of negative evaluation, and social interaction anxiety. In Study 2 (N = 118), participants completed a body evaluation that included measurements of height, weight, and body fat content. The SAAS exhibited excellent convergent and divergent validity with self-report measures (i.e., self-esteem, trait anxiety, ethnic identity, and sympathy), predicted state anxiety experienced during the body evaluation, and predicted body fat content. In both studies, results confirmed a single-factor structure as the best fit to the data. These results lend additional support for the use of the SAAS as a valid measure of social appearance anxiety.
Expressed emotion in children: associations with sibling relationships.
Yelland, I; Daley, D
2009-07-01
To investigate the reliability and validity of the expressed emotion (EE) measure, the Pre-school Five Minute Speech Sample (PFMSS), in child-to-child sibling relationships. A total of 106 boys aged 7-11 were recruited from 12 mainstream primary schools in North Wales. The children completed the PFMSS regarding their sibling and two self-report measures of sibling relationship: the Sibling Relationship Questionnaire (SRQ) and a Child Visual Analogue Scale (CVAS). The parents of 60 participants completed the Strengths and Difficulties Questionnaire regarding the behavioural problems of the participating child and his younger sibling. The PFMSS demonstrated good inter-rater and code-recode reliability. The significant associations between EE dimensions such as relationship, positive comments and critical comments with various components of the SRQ and CVAS provided support for the concurrent validity of the PFMSS. Significantly higher levels of Conflict and Rivalry and significantly lower levels of Warmth/Closeness on the SRQ were reported by children with high EE, demonstrating good discriminant validity for the PFMSS. There was no significant association between the child's EE profile and the behavioural difficulties of both siblings as reported by parents. The study found that the PFMSS is a valid and reliable measure of child EE. Future research is needed to clarify the concurrent validity of the warmth and initial statement components of the measure as well as the association between EE dimensions and behaviour.
Hill, Jonathan C; Kang, Sujin; Benedetto, Elena; Myers, Helen; Blackburn, Steven; Smith, Stephanie; Hay, Elaine; Rees, Jonathan; Beard, David; Glyn-Jones, Sion; Barker, Karen; Ellis, Benjamin; Fitzpatrick, Ray; Price, Andrew
2016-01-01
Objectives Current musculoskeletal outcome tools are fragmented across different healthcare settings and conditions. Our objectives were to develop and validate a single musculoskeletal outcome measure for use throughout the pathway and patients with different musculoskeletal conditions: the Arthritis Research UK Musculoskeletal Health Questionnaire (MSK-HQ). Setting A consensus workshop with stakeholders from across the musculoskeletal community, workshops and individual interviews with a broad mix of musculoskeletal patients identified and prioritised outcomes for MSK-HQ inclusion. Initial psychometric validation was conducted in four cohorts from community physiotherapy, and secondary care orthopaedic hip, knee and shoulder clinics. Participants Stakeholders (n=29) included primary care, physiotherapy, orthopaedic and rheumatology patients (n=8); general practitioners, physiotherapists, orthopaedists, rheumatologists and pain specialists (n=7), patient and professional national body representatives (n=10), and researchers (n=4). The four validation cohorts included 570 participants (n=210 physiotherapy, n=150 hip, n=150 knee, n=60 shoulder patients). Outcome measures Outcomes included the MSK-HQ's acceptability, feasibility, comprehension, readability and responder burden. The validation cohort outcomes were the MSK-HQ's completion rate, test–retest reliability and convergent validity with reference standards (EQ-5D-5L, Oxford Hip, Knee, Shoulder Scores, and the Keele MSK-PROM). Results Musculoskeletal domains prioritised were pain severity, physical function, work interference, social interference, sleep, fatigue, emotional health, physical activity, independence, understanding, confidence to self-manage and overall impact. Patients reported MSK-HQ items to be ‘highly relevant’ and ‘easy to understand’. Completion rates were high (94.2%), with scores normally distributed, and no floor/ceiling effects. Test–retest reliability was excellent, and convergent validity was strong (correlations 0.81–0.88). Conclusions A new musculoskeletal outcome measure has been developed through a coproduction process with patients to capture prioritised outcomes for use throughout the pathway and with different musculoskeletal conditions. Four validation cohorts found that the MSK-HQ had high completion rates, excellent test–retest reliability and strong convergent validity with reference standards. Further validation studies are ongoing, including a cohort with rheumatoid/inflammatory arthritis. PMID:27496243
Gleason, Philip M; Harris, Jeffrey; Sheean, Patricia M; Boushey, Carol J; Bruemmer, Barbara
2010-03-01
This is the sixth in a series of monographs on research design and analysis. The purpose of this article is to describe and discuss several concepts related to the measurement of nutrition-related characteristics and outcomes, including validity, reliability, and diagnostic tests. The article reviews the methodologic issues related to capturing the various aspects of a given nutrition measure's reliability, including test-retest, inter-item, and interobserver or inter-rater reliability. Similarly, it covers content validity, indicators of absolute vs relative validity, and internal vs external validity. With respect to diagnostic assessment, the article summarizes the concepts of sensitivity and specificity. The hope is that dietetics practitioners will be able to both use high-quality measures of nutrition concepts in their research and recognize these measures in research completed by others. Copyright 2010 American Dietetic Association. Published by Elsevier Inc. All rights reserved.
Validity of a physical activity questionnaire among African-American Seventh-day Adventists.
Singh, P N; Fraser, G E; Knutsen, S F; Lindsted, K D; Bennett, H W
2001-03-01
Physical activity has been identified as an important predictor of chronic disease risk in numerous studies in which activity levels were measured by questionnaire. Although the validity of physical activity questionnaires has been documented in a number of studies of U.S. adults, few have included a validation analysis among blacks. We have examined the validity and reliability of a physical activity questionnaire that was administered to 165 black Seventh-day Adventists from Southern California. Subjects completed a self-administered physical activity questionnaire and then "reference" measures of activity (7-d activity recalls, pedometer readings) and fitness (treadmill test) were completed in subsets of this population. The authors found that 7-d recall activity levels correlated well with the corresponding questionnaire indices among women (total activity, r = 0.65; vigorous, r = 0.85; moderate, r = 0.44; inactivity, r = 0.59; sleep duration, r = 0.52) and men (total activity, r = 0.51; vigorous, r = 0.65; moderate, r = 0.53; inactivity, r = 0.69; sleep duration, r = 0.39). Vigorous activity from 7-d recalls was best measured by gender-specific indices that included only recreational activities among men and emphasized nonrecreational activities among women. Correlations between questionnaire data and the other "reference" measures were lower. Test-retest correlations of questionnaire items over a 6-wk interval were high (r = 0.4-0.9). Simple questions can measure activities of different intensity with good validity and reliability among black Adventist men and women.
Boody, Barrett S; Bhatt, Surabhi; Mazmudar, Aditya S; Hsu, Wellington K; Rothrock, Nan E; Patel, Alpesh A
2018-03-01
OBJECTIVE The Patient-Reported Outcomes Measurement Information System (PROMIS), which is funded by the National Institutes of Health, is a set of adaptive, responsive assessment tools that measures patient-reported health status. PROMIS measures have not been validated for surgical patients with cervical spine disorders. The objective of this project is to evaluate the validity (e.g., convergent validity, known-groups validity, responsiveness to change) of PROMIS computer adaptive tests (CATs) for pain behavior, pain interference, and physical function in patients undergoing cervical spine surgery. METHODS The legacy outcome measures Neck Disability Index (NDI) and SF-12 were used as comparisons with PROMIS measures. PROMIS CATs, NDI-10, and SF-12 measures were administered prospectively to 59 consecutive tertiary hospital patients who were treated surgically for degenerative cervical spine disorders. A subscore of NDI-5 was calculated from NDI-10 by eliminating the lifting, headaches, pain intensity, reading, and driving sections and multiplying the final score by 4. Assessments were administered preoperatively (baseline) and postoperatively at 6 weeks and 3 months. Patients presenting for revision surgery, tumor, infection, or trauma were excluded. Participants completed the measures in Assessment Center, an online data collection tool accessed by using a secure login and password on a tablet computer. Subgroup analysis was also performed based on a primary diagnosis of either cervical radiculopathy or cervical myelopathy. RESULTS Convergent validity for PROMIS CATs was supported with multiple statistically significant correlations with the existing legacy measures, NDI and SF-12, at baseline. Furthermore, PROMIS CATs demonstrated known-group validity and identified clinically significant improvements in all measures after surgical intervention. In the cervical radiculopathy and myelopathic cohorts, the PROMIS measures demonstrated similar responsiveness to the SF-12 and NDI scores in the patients who self-identified as having postoperative clinical improvement. PROMIS CATs required a mean total of 3.2 minutes for PROMIS pain behavior (mean ± SD 0.9 ± 0.5 minutes), pain interference (1.2 ± 1.9 minutes), and physical function (1.1 ± 1.4 minutes) and compared favorably with 3.4 minutes for NDI and 4.1 minutes for SF-12. CONCLUSIONS This study verifies that PROMIS CATs demonstrate convergent and known-groups validity and comparable responsiveness to change as existing legacy measures. The PROMIS measures required less time for completion than legacy measures. The validity and efficiency of the PROMIS measures in surgical patients with cervical spine disorders suggest an improvement over legacy measures and an opportunity for incorporation into clinical practice.
Roberts, Richard D; Schulze, Ralf; O'Brien, Kristin; MacCann, Carolyn; Reid, John; Maul, Andy
2006-11-01
Emotions measures represent an important means of obtaining construct validity evidence for emotional intelligence (EI) tests because they have the same theoretical underpinnings. Additionally, the extent to which both emotions and EI measures relate to intelligence is poorly understood. The current study was designed to address these issues. Participants (N = 138) completed the Mayer-Salovey-Caruso Emotional Intelligence Test (MSCEIT), two emotions measures, as well as four intelligence tests. Results provide mixed support for the model hypothesized to underlie the MSCEIT, with emotions research and EI measures failing to load on the same factor. The emotions measures loaded on the same factor as intelligence measures. The validity of certain EI components (in particular, Emotion Perception), as currently assessed, appears equivocal. Copyright 2006 APA, all rights reserved.
The Vocal Cord Dysfunction Questionnaire: Validity and Reliability of the Persian Version.
Ghaemi, Hamide; Khoddami, Seyyedeh Maryam; Soleymani, Zahra; Zandieh, Fariborz; Jalaie, Shohreh; Ahanchian, Hamid; Khadivi, Ehsan
2017-12-25
The aim of this study was to develop, validate, and assess the reliability of the Persian version of Vocal Cord Dysfunction Questionnaire (VCDQ P ). The study design was cross-sectional or cultural survey. Forty-four patients with vocal fold dysfunction (VFD) and 40 healthy volunteers were recruited for the study. To assess the content validity, the prefinal questions were given to 15 experts to comment on its essential. Ten patients with VFD rated the importance of VCDQ P in detecting face validity. Eighteen of the patients with VFD completed the VCDQ 1 week later for test-retest reliability. To detect absolute reliability, standard error of measurement and smallest detected change were calculated. Concurrent validity was assessed by completing the Persian Chronic Obstructive Pulmonary Disease (COPD) Assessment Test (CAT) by 34 patients with VFD. Discriminant validity was measured from 34 participants. The VCDQ was further validated by administering the questionnaire to 40 healthy volunteers. Validation of the VCDQ as a treatment outcome tool was conducted in 18 patients with VFD using pre- and posttreatment scores. The internal consistency was confirmed (Cronbach α = 0.78). The test-retest reliability was excellent (intraclass correlation coefficient = 0.97). The standard error of measurement and smallest detected change values were acceptable (0.39 and 1.08, respectively). There was a significant correlation between the VCDQ P and the CAT total scores (P < 0.05). Discriminative validity was significantly different. The VCDQ scores in patients with VFD before and after treatment was significantly different (P < 0.001). The VCDQ was cross-culturally adapted to Persian and demonstrated to be a valid and reliable self-administered questionnaire in Persian-speaking population. Copyright © 2017 The Voice Foundation. Published by Elsevier Inc. All rights reserved.
Attitudes toward Anger Management Scale: Development and Initial Validation
ERIC Educational Resources Information Center
Boudreaux, David J.; Dahlen, Eric R.; Madson, Michael B.; Bullock-Yowell, Emily
2014-01-01
This article describes the development and preliminary validation of the Attitudes Toward Anger Management Scale (ATAMS), a self-report measure of attitudes toward anger management services. Undergraduate volunteers ("N" = 415) completed an initial version of the instrument. Principal components analysis yielded a two-factor solution.…
The internal structure of foster-parent completed SDQ for school-aged children
Lehmann, Stine; Bøe, Tormod; Breivik, Kyrre
2017-01-01
Mental health problems are common in foster-children, and tools to measure the mental health of these children are needed. One candidate instrument is the Strengths and Difficulties Questionnaire (SDQ), a measure of child psychological adjustment that is increasingly being employed by Child Protection services. The aim of the current study was to examine the structural validity of the foster parent completed SDQ in a sample of 237 school aged foster children. Confirmatory factor analysis demonstrated an excellent fit of the foster parent completed SDQ data to a five-factor model (CFI = 0.96, RMSEA = 0.05, 90% CI [0.04, 0.06]), thus confirming the structural validity of the five-factor model for the parent-version of the SDQ in Norwegian foster children. Measurement invariance analyses indicated that boys had lower thresholds for fighting with or bullying other children than girls. Girls were on their side more likely to be rated as less popular than boys with a similar level of peer problems. PMID:28665965
The internal structure of foster-parent completed SDQ for school-aged children.
Lehmann, Stine; Bøe, Tormod; Breivik, Kyrre
2017-01-01
Mental health problems are common in foster-children, and tools to measure the mental health of these children are needed. One candidate instrument is the Strengths and Difficulties Questionnaire (SDQ), a measure of child psychological adjustment that is increasingly being employed by Child Protection services. The aim of the current study was to examine the structural validity of the foster parent completed SDQ in a sample of 237 school aged foster children. Confirmatory factor analysis demonstrated an excellent fit of the foster parent completed SDQ data to a five-factor model (CFI = 0.96, RMSEA = 0.05, 90% CI [0.04, 0.06]), thus confirming the structural validity of the five-factor model for the parent-version of the SDQ in Norwegian foster children. Measurement invariance analyses indicated that boys had lower thresholds for fighting with or bullying other children than girls. Girls were on their side more likely to be rated as less popular than boys with a similar level of peer problems.
Gilet, Hélène; Arnould, Benoit; Fofana, Fatoumata; Clerson, Pierre; Colombel, Jean-Frédéric; D'Hondt, Olivier; Faure, Patrick; Hagège, Hervé; Nachury, Maria; Nahon, Stéphane; Tucat, Gilbert; Vandromme, Luc; Cazala-Telinge, Ines; Thibout, Emmanuel
2014-01-01
Severe Crohn's disease management includes anti-tumor necrosis factor (anti-TNF) drugs that differ from early-stage treatments regarding efficacy, safety, and convenience. This study aimed to finalize and psychometrically validate the Satisfaction for PAtients in Crohn's diseasE Questionnaire (SPACE-Q(©)), developed to measure satisfaction with anti-TNF treatment in patients with severe Crohn's disease. A total of 279 patients with severe Crohn's disease receiving anti-TNF therapy completed the SPACE-Q 62-item pilot version at inclusion and 12 and 13 weeks after first anti-TNF injection. The final SPACE-Q scoring was defined using multitrait and regression analyses and clinical relevance considerations. Psychometric validation included clinical validity against Harvey-Bradshaw score, concurrent validity against Treatment Satisfaction Questionnaire for Medication (TSQM), internal consistency reliability, test-retest reliability, and responsiveness against the patient global impression of change (PGIC). Quality of completion was good (55%-67% of patients completed all items). Four items were removed from the questionnaire. Eleven scores were defined within the final 58-item SPACE-Q: disease control; symptoms, anal symptoms, and quality of life transition scales; tolerability; convenience; expectation confirmation toward efficacy, side effects, and convenience; satisfaction with treatment; and motivation. Scores met standards for concurrent validity (correlation between SPACE-Q satisfaction with treatment and TSQM satisfaction scores =0.59), internal consistency reliability (Cronbach's α=0.67-0.93), test-retest reliability (intraclass correlations =0.62-0.91), and responsiveness (improvement in treatment experience assessed by the SPACE-Q for patients reporting improvement on the PGIC). Significantly different mean scores were observed between groups of patients with different Harvey-Bradshaw disease severity scores. The SPACE-Q is a valid, reliable, and responsive instrument to measure satisfaction with anti-TNF treatment in patients with severe Crohn's disease and for use in future studies.
Measuring Work Functioning: Validity of a Weighted Composite Work Functioning Approach.
Boezeman, Edwin J; Sluiter, Judith K; Nieuwenhuijsen, Karen
2015-09-01
To examine the construct validity of a weighted composite work functioning measurement approach. Workers (health-impaired/healthy) (n = 117) completed a composite measure survey that recorded four central work functioning aspects with existing scales: capacity to work, quality of work performance, quantity of work, and recovery from work. Previous derived weights reflecting the relative importance of these aspects of work functioning were used to calculate the composite weighted work functioning score of the workers. Work role functioning, productivity, and quality of life were used for validation. Correlations were calculated and norms applied to examine convergent and divergent construct validity. A t test was conducted and a norm applied to examine discriminative construct validity. Overall the weighted composite work functioning measure demonstrated construct validity. As predicted, the weighted composite score correlated (p < .001) strongly (r > .60) with work role functioning and productivity (convergent construct validity), and moderately (.30 < r < .60) with physical quality of life and less strongly than work role functioning and productivity with mental quality of life (divergent validity). Further, the weighted composite measure detected that health-impaired workers show with a large effect size (Cohen's d > .80) significantly worse work functioning than healthy workers (discriminative validity). The weighted composite work functioning measurement approach takes into account the relative importance of the different work functioning aspects and demonstrated good convergent, fair divergent, and good discriminative construct validity.
DOE Office of Scientific and Technical Information (OSTI.GOV)
Dixon, David A.; Hughes, Henry Grady
In this paper, we expand on previous validation work by Dixon and Hughes. That is, we present a more complete suite of validation results with respect to to the well-known Lockwood energy deposition experiment. Lockwood et al. measured energy deposition in materials including beryllium, carbon, aluminum, iron, copper, molybdenum, tantalum, and uranium, for both single- and multi-layer 1-D geometries. Source configurations included mono-energetic, mono-directional electron beams with energies of 0.05-MeV, 0.1-MeV, 0.3- MeV, 0.5-MeV, and 1-MeV, in both normal and off-normal angles of incidence. These experiments are particularly valuable for validating electron transport codes, because they are closely represented bymore » simulating pencil beams incident on 1-D semi-infinite slabs with and without material interfaces. Herein, we include total energy deposition and energy deposition profiles for the single-layer experiments reported by Lockwood et al. (a more complete multi-layer validation will follow in another report).« less
Reliability and Validity of the Early Years Physical Activity Questionnaire (EY-PAQ)
Bingham, Daniel D.; Collings, Paul J.; Clemes, Stacy A.; Costa, Silvia; Santorelli, Gillian; Griffiths, Paula; Barber, Sally E.
2016-01-01
Measuring physical activity (PA) and sedentary time (ST) in young children (<5 years) is complex. Objective measures have high validity but require specialist expertise, are expensive, and can be burdensome for participants. A proxy-report instrument for young children that accurately measures PA and ST is needed. The aim of this study was to assess the reliability and validity of the Early Years Physical Activity Questionnaire (EY-PAQ). In a setting where English and Urdu are the predominant languages spoken by parents of young children, a sample of 196 parents and their young children (mean age 3.2 ± 0.8 years) from Bradford, UK took part in the study. A total of 156 (79.6%) questionnaires were completed in English and 40 (20.4%) were completed in transliterated Urdu. A total of 109 parents took part in the reliability aspect of the study, which involved completion of the EY-PAQ on two occasions (7.2 days apart; standard deviation (SD) = 1.1). All 196 participants took part in the validity aspect which involved comparison of EY-PAQ scores against accelerometry. Validty anaylsis used all data and data falling with specific MVPA and ST boundaries. Reliability was assessed using intra-class correlations (ICC) and validity by Bland–Altman plots and rank correlation coefficients. The test re-test reliability of the EY-PAQ was moderate for ST (ICC = 0.47) and fair for moderate-to-vigorous physical activity (MVPA)(ICC = 0.35). The EY-PAQ had poor agreement with accelerometer-determined ST (mean difference = −87.5 min·day−1) and good agreement for MVPA (mean difference = 7.1 min·day−1) limits of agreement were wide for all variables. The rank correlation coefficient was non-significant for ST (rho = 0.19) and significant for MVPA (rho = 0.30). The EY-PAQ has comparable validity and reliability to other PA self-report tools and is a promising population-based measure of young children’s habitual MVPA but not ST. In situations when objective methods are not possible for measurement of young children’s MVPA, the EY-PAQ may be a suitable alternative but only if boundaries are applied.
The Grand Banks ERS-1 SAR wave spectra validation experiment
NASA Technical Reports Server (NTRS)
Vachon, P. W.; Dobson, F. W.; Smith, S. D.; Anderson, R. J.; Buckley, J. R.; Allingham, M.; Vandemark, D.; Walsh, E. J.; Khandekar, M.; Lalbeharry, R.
1993-01-01
As part of the ERS-1 validation program, the ERS-1 Synthetic Aperture Radar (SAR) wave spectra validation experiment was carried out over the Grand Banks of Newfoundland (Canada) in Nov. 1991. The principal objective of the experiment was to obtain complete sets of wind and wave data from a variety of calibrated instruments to validate SAR measurements of ocean wave spectra. The field program activities are described and the rather complex wind and wave conditions which were observed are summarized. Spectral comparisons with ERS-1 SAR image spectra are provided. The ERS-1 SAR is shown to have measured swell and range traveling wind seas, but did not measure azimuth traveling wind seas at any time during the experiment. Results of velocity bunching forward mapping and new measurements of the relationship between wind stress and sea state are also shown.
Kratz, Anna L; Schilling, Stephen G; Goesling, Jenna; Williams, David A
2015-06-01
Pain is often the focus of research and clinical care in fibromyalgia (FM); however, cognitive dysfunction is also a common, distressing, and disabling symptom in FM. Current efforts to address this problem are limited by the lack of a comprehensive, valid measure of subjective cognitive dysfunction in FM that is easily interpretable, accessible, and brief. The purpose of this study was to leverage cognitive functioning item banks that were developed as part of the Patient Reported Outcomes Measurement Information System (PROMIS) to devise a 10-item short form measure of cognitive functioning for use in FM. In study 1, a nationwide (U.S.) sample of 1,035 adults with FM (age range = 18-82, 95.2% female) completed 2 cognitive item pools. Factor analyses and item response theory analyses were used to identify dimensionality and optimally performing items. A recommended 10-item measure, called the Multidimensional Inventory of Subjective Cognitive Impairment (MISCI) was created. In study 2, 232 adults with FM completed the MISCI and a legacy measure of cognitive functioning that is used in FM clinical trials, the Multiple Ability Self-Report Questionnaire (MASQ). The MISCI showed excellent internal reliability, low ceiling/floor effects, and good convergent validity with the MASQ (r = -.82). This paper presents the MISCI, a 10-item measure of cognitive dysfunction in FM, developed through classical test theory and item response theory. This brief but comprehensive measure shows evidence of excellent construct validity through large correlations with a lengthy legacy measure of cognitive functioning. Copyright © 2015 American Pain Society. Published by Elsevier Inc. All rights reserved.
Rönspies, Jelena; Schmidt, Alexander F; Melnikova, Anna; Krumova, Rosina; Zolfagari, Asadeh; Banse, Rainer
2015-07-01
The present study was conducted to validate an adaptation of the Implicit Relational Assessment Procedure (IRAP) as an indirect latency-based measure of sexual orientation. Furthermore, reliability and criterion validity of the IRAP were compared to two established indirect measures of sexual orientation: a Choice Reaction Time task (CRT) and a Viewing Time (VT) task. A sample of 87 heterosexual and 35 gay men completed all three indirect measures in an online study. The IRAP and the VT predicted sexual orientation nearly perfectly. Both measures also showed a considerable amount of convergent validity. Reliabilities (internal consistencies) reached satisfactory levels. In contrast, the CRT did not tap into sexual orientation in the present study. In sum, the VT measure performed best, with the IRAP showing only slightly lower reliability and criterion validity, whereas the CRT did not yield any evidence of reliability or criterion validity in the present research. The results were discussed in the light of specific task properties of the indirect latency-based measures (task-relevance vs. task-irrelevance).
Neale, Joanne; Vitoratou, Silia; Finch, Emily; Lennon, Paul; Mitcheson, Luke; Panebianco, Daria; Rose, Diana; Strang, John; Wykes, Til; Marsden, John
2016-08-01
Patient Reported Outcome Measures (PROMs) assess health status and health-related quality of life from the patient/service user perspective. Our study aimed to: i. develop a PROM for recovery from drug and alcohol dependence that has good face and content validity, acceptability and usability for people in recovery; ii. evaluate the psychometric properties and factorial structure of the new PROM ('SURE'). Item development included Delphi groups, focus groups, and service user feedback on draft versions of the new measure. A 30-item beta version was completed by 575 service users (461 in person [IP] and 114 online [OL]). Analyses comprised rating scale evaluation, assessment of psychometric properties, factorial structure, and differential item functioning. The beta measure had good face and content validity. Nine items were removed due to low stability, low factor loading, low construct validity or high complexity. The remaining 21 items were re-scaled (Rasch model analyses). Exploratory and confirmatory factor analyses revealed 5 factors: substance use, material resources, outlook on life, self-care, and relationships. The MIMIC model indicated 95% metric invariance across the IP and OL samples, and 100% metric invariance for gender. Internal consistency and test-retest reliability were granted. The 5 factors correlated positively with the corresponding WHOQOL-BREF and ARC subscales and score differences between participant sub-groups confirmed discriminative validity. 'SURE' is a psychometrically valid, quick and easy-to-complete outcome measure, developed with unprecedented input from people in recovery. It can be used alongside, or instead of, existing outcome tools. Copyright © 2016 The Authors. Published by Elsevier Ireland Ltd.. All rights reserved.
Gärtner, Fania R; de Miranda, Esteriek; Rijnders, Marlies E; Freeman, Liv M; Middeldorp, Johanna M; Bloemenkamp, Kitty W M; Stiggelbout, Anne M; van den Akker-van Marle, M Elske
2015-10-01
To validate the Labor and Delivery Index (LADY-X), a new delivery-specific utility measure. In a test-retest design, women were surveyed online, 6 to 8 weeks postpartum and again 1 to 2 weeks later. For reliability testing, we assessed the standard error of measurement (S.E.M.) and the intraclass correlation coefficient (ICC). For construct validity, we tested hypotheses on the association with comparison instruments (Mackey Childbirth Satisfaction Rating Scale and Wijma Delivery Experience Questionnaire), both on domain and total score levels. We assessed known-group differences using eight obstetrical indicators: method and place of birth, induction, transfer, control over pain medication, complications concerning mother and child, and experienced control. The questionnaire was completed by 308 women, 257 (83%) completed the retest. The distribution of LADY-X scores was skewed. The reliability was good, as the ICC exceeded 0.80 and the S.E.M. was 0.76. Requirements for good construct validity were fulfilled: all hypotheses for convergent and divergent validity were confirmed, and six of eight hypotheses for known-group differences were confirmed as all differences were statistically significant (P-values: <0.001-0.023), but for two tests, difference scores did not exceed the S.E.M. The LADY-X demonstrates good reliability and construct validity. Despite its skewed distribution, the LADY-X can discriminate between groups. With the preference weights available, the LADY-X might fulfill the need for a utility measure for cost-effectiveness studies for perinatal care interventions. Copyright © 2015 Elsevier Inc. All rights reserved.
ERIC Educational Resources Information Center
Burkhart, Barry R.
1979-01-01
Seventy-five subjects, who spanned the range of assertiveness, completed two self-report measures of assertiveness, eight role-playing situations involving positive and negative assertiveness, and a telephone in-vivo task. Correlations between the three measurement methods were examined. (Author/SJL)
Reliability and Validity of a Measure of Preschool Teachers' Attributions for Disruptive Behavior
ERIC Educational Resources Information Center
Carter, Lauren M.; Williford, Amanda P.; LoCasale-Crouch, Jennifer
2014-01-01
Research Findings: This study examined the quality of teacher attributions for child disruptive behavior using a new measure, the Preschool Teaching Attributions measure. A sample of 153 early childhood teachers and 432 children participated. All teachers completed the behavior attributions measure, as well as measures regarding demographics,…
Digit Span as a measure of everyday attention: a study of ecological validity.
Groth-Marnat, Gary; Baker, Sonya
2003-12-01
This study investigated the effectiveness of the WAIS-III Digit Span subtest to predict the everyday attention of 75 participants with heterogeneous neurological conditions who were administered the Digit Span subtest as well as the ecologically valid Test of Everyday Attention. In addition, the more visually oriented Picture Completion subtest along with the verbally loaded National Adult Reading Test were administered. Analysis indicated that, although Digit Span was a weak but statistically significant predictor of attentional ability (accounting for 12.7% of the unique variance). Picture Completion was a somewhat stronger predictor (accounting for 19% of the unique variance). The weak association of Digit Span and the Test of Everyday Attention, along with the finding that Picture Completion was a better predictor of performance on the Test of Everyday Attention, question the clinical utility of using Digit Span as a measure of everyday attention.
Cessna, Julie M; Jim, Heather S L; Sutton, Steven K; Asvat, Yasmin; Small, Brent J; Salsman, John M; Zachariah, Babu; Fishman, Mayer; Field, Teresa; Fernandez, Hugo; Perez, Lia; Jacobsen, Paul B
2016-02-01
Fatigue is common among cancer patients and adversely impacts quality of life. As such, it is important to measure fatigue accurately in a way that is not burdensome to patients. The 7-item Patient Reported Outcome Measurement Information System (PROMIS) Cancer Fatigue Short Form scale was recently developed using item response theory (IRT). The current study evaluated the psychometric properties of this scale in two samples of cancer patients using classical test theory (CTT). Two samples were used: 121 men with prostate cancer and 136 patients scheduled to undergo hematopoietic cell transplantation (HCT) for hematologic cancer. All participants completed the PROMIS Cancer Fatigue Short Form as well as validated measures of fatigue, vitality, and depression. HCT patients also completed measures of anxiety, perceived stress, and a clinical interview designed to identify cases of cancer-related fatigue. PROMIS Cancer Fatigue Short Form items loaded on a single factor (CFI=0.948) and the scale demonstrated good internal consistency reliability in both samples (Cronbach's alphas>0.86). Correlations with psychosocial measures were significant (p values<.0001) and in the expected direction, offering evidence for convergent and concurrent validity. PROMIS Fatigue scores were significantly higher in patients who met case definition criteria for cancer-related fatigue (p<.0001), demonstrating criterion validity. The current study provides evidence that the PROMIS Cancer Fatigue Short Form is a reliable and valid measure of fatigue in cancer patients. Copyright © 2015 Elsevier Inc. All rights reserved.
Cessna, Julie M.; Jim, Heather S.L.; Sutton, Steven K.; Asvat, Yasmin; Small, Brent J.; Salsman, John M.; Zachariah, Babu; Fishman, Mayer; Field, Teresa; Fernandez, Hugo; Perez, Lia; Jacobsen, Paul B.
2016-01-01
Objective Fatigue is common among cancer patients and adversely impacts quality of life. As such, it is important to measure fatigue accurately in a way that is not burdensome to patients. The 7-item Patient Reported Outcome Measurement Information System (PROMIS) Cancer Fatigue Short Form scale was recently developed using item response theory (IRT). The current study evaluated the psychometric properties of this scale in two samples of cancer patients using classical test theory (CTT). Methods Two samples were used: 121 men with prostate cancer and 136 patients scheduled to undergo hematopoietic cell transplantation (HCT) for hematologic cancer. All participants completed the PROMIS Cancer Fatigue Short Form as well as validated measures of fatigue, vitality, and depression. HCT patients also completed measures of anxiety, perceived stress, and a clinical interview designed to identify cases of cancer -related fatigue. Results PROMIS Cancer Fatigue Short Form items loaded on a single factor (CFI = 0.948) and the scale demonstrated good internal consistency reliability in both samples (Cronbach’s alphas > 0.86). Correlations with psychosocial measures were significant (p-values < .0001) and in the expected direction, offering evidence for convergent and concurrent validity. PROMIS Fatigue scores were significantly higher in patients who met case definition criteria for cancer-related fatigue (p < .0001), demonstrating criterion validity. Conclusion The current study provides evidence that the PROMIS Cancer Fatigue Short Form is a reliable and valid measure of fatigue in cancer patients. PMID:26800633
Are implicit self-esteem measures valid for assessing individual and cultural differences?
Falk, Carl F; Heine, Steven J; Takemura, Kosuke; Zhang, Cathy X J; Hsu, Chih-Wei
2015-02-01
Our research utilized two popular theoretical conceptualizations of implicit self-esteem: 1) implicit self-esteem as a global automatic reaction to the self; and 2) implicit self-esteem as a context/domain specific construct. Under this framework, we present an extensive search for implicit self-esteem measure validity among different cultural groups (Study 1) and under several experimental manipulations (Study 2). In Study 1, Euro-Canadians (N = 107), Asian-Canadians (N = 187), and Japanese (N = 112) completed a battery of implicit self-esteem, explicit self-esteem, and criterion measures. Included implicit self-esteem measures were either popular or provided methodological improvements upon older methods. Criterion measures were sampled from previous research on implicit self-esteem and included self-report and independent ratings. In Study 2, Americans (N = 582) completed a shorter battery of these same types of measures under either a control condition, an explicit prime meant to activate the self-concept in a particular context, or prime meant to activate self-competence related implicit attitudes. Across both studies, explicit self-esteem measures far outperformed implicit self-esteem measures in all cultural groups and under all experimental manipulations. Implicit self-esteem measures are not valid for individual or cross-cultural comparisons. We speculate that individuals may not form implicit associations with the self as an attitudinal object. © 2013 Wiley Periodicals, Inc.
A measure of state persecutory ideation for experimental studies.
Freeman, Daniel; Pugh, Katherine; Green, Catherine; Valmaggia, Lucia; Dunn, Graham; Garety, Philippa
2007-09-01
Experimental research is increasingly important in developing the understanding of paranoid thinking. An assessment measure of persecutory ideation is necessary for such work. We report the reliability and validity of the first state measure of paranoia: The State Social Paranoia Scale. The items in the measure conform to a recent definition in which persecutory thinking has the 2 elements of feared harm and perpetrator intent. The measure was tested with 164 nonclinical participants and 21 individuals at high risk of psychosis with attenuated positive symptoms. The participants experienced a social situation presented in virtual reality and completed the new measure. The State Social Paranoia Scale was found to have excellent internal reliability, adequate test-retest reliability, clear convergent validity as assessed by both independent interviewer ratings and self-report measures, and showed divergent validity with measures of positive and neutral thinking. The measure of paranoia in a recent social situation has good psychometric properties.
Haggerty, Greg; Bornstein, Robert F.; Khalid, Mohammad; Sharma, Vishal; Riaz, Usman; Blanchard, Mark; Siefert, Caleb J; Sinclair, Samuel J.
2015-01-01
This study assessed the construct validity of the Relationship Profile Test (RPT; Bornstein & Languirand, 2003) with a substance abuse sample. One hundred-eight substance abuse patients completed the RPT, Experiences in Close Relationships Scale (ECR-SF; Wei, Russell, Mallinckrodt, & Vogel, 2007), Personality Assessment Inventory (PAI; Morey, 1991), and Symptom Checklist-90-Revised (SCL-90-R: Derogatis 1983). Results suggest that the RPT has good construct validity when compared against theoretically related broadband measures of personality, psychopathology and adult attachment. Overall, health hependency was negatively related to measures of psychopathology and insecure attachment, and overdependence was positively related to measures of psychopathology and attachment anxiety. Many of the predictions regarding RPT detachment and the criterion measures were not supported. Implications of these findings are discussed. PMID:26620463
Structured learning for robotic surgery utilizing a proficiency score: a pilot study.
Hung, Andrew J; Bottyan, Thomas; Clifford, Thomas G; Serang, Sarfaraz; Nakhoda, Zein K; Shah, Swar H; Yokoi, Hana; Aron, Monish; Gill, Inderbir S
2017-01-01
We evaluated feasibility and benefit of implementing structured learning in a robotics program. Furthermore, we assessed validity of a proficiency assessment tool for stepwise graduation. Teaching cases included robotic radical prostatectomy and partial nephrectomy. Procedure steps were categorized: basic, intermediate, and advanced. An assessment tool ["proficiency score" (PS)] was developed to evaluate ability to safely and autonomously complete a step. Graduation required a passing PS (PS ≥ 3) on three consecutive attempts. PS and validated global evaluative assessment of robotic skills (GEARS) were evaluated for completed steps. Linear regression was utilized to determine postgraduate year/PS relationship (construct validity). Spearman's rank correlation coefficient measured correlation between PS and GEARS evaluations (concurrent validity). Intraclass correlation (ICC) evaluated PS agreement between evaluator classes. Twenty-one robotic trainees participated within the pilot program, completing a median of 14 (2-69) cases each. Twenty-three study evaluators scored 14 (1-60) cases. Over 4 months, 229/294 (78 %) cases were designated "teaching" cases. Residents completed 91 % of possible evaluations; faculty completed 78 %. Verbal and quantitative feedback received by trainees increased significantly (p = 0.002, p < 0.001, respectively). Average PS increased with PGY (post-graduate year) for basic and intermediate steps (regression slopes: 0.402 (p < 0.0001), 0.323 (p < 0.0001), respectively) (construct validation). Overall, PS correlated highly with GEARS (ρ = 0.81, p < 0.0001) (concurrent validity). ICC was 0.77 (95 % CI 0.61-0.88) for resident evaluations. Structured learning can be implemented in an academic robotic program with high levels of trainee and evaluator participation, encouraging both quantitative and verbal feedback. A proficiency assessment tool developed for step-specific proficiency has construct and concurrent validity.
Ingo, Elisabeth; Brännström, K Jonas; Andersson, Gerhard; Lunner, Thomas; Laplante-Lévesque, Ariane
2016-07-01
Acceptance and readiness to seek professional help have shown to be important factors for favourable audiological rehabilitation outcomes. Theories from health psychology such as the transtheoretical (stages-of-change) model could help understand behavioural change in people with hearing impairment. In recent studies, the University of Rhode Island change assessment (URICA) has been found to have good predictive validity. In a previous study, 224 Swedish adults who had failed an online hearing screening completed URICA and two other measures of stages of change. This follow-up aimed to: (1) determine prevalence of help-seeking at a hearing clinic and hearing aid uptake, and (2) explore the predictive validity of the stages of change measures by a follow-up on the 224 participants who had failed a hearing screening 18 months previously. A total of 122 people (54%) completed the follow-up online questionnaire, including the three measures and questions regarding experience with hearing help-seeking and hearing aid uptake. Since failing the online hearing screening, 61% of participants had sought help. A good predictive validity for a one-item measure of stages of change was reported. The Staging algorithm was the stages of change measure with the best ability to predict help-seeking 18 months later.
Tasca, Giorgio A; Cabrera, Christine; Kristjansson, Elizabeth; MacNair-Semands, Rebecca; Joyce, Anthony S; Ogrodniczuk, John S
2016-01-01
We tested a very brief version of the 23-item Therapeutic Factors Inventory-Short Form (TFI-S), and describe the use of Item Response Theory (IRT) for the purpose of developing short and reliable scales for group psychotherapy. Group therapy patients (N = 578) completed the TFI-S on one occasion, and their data were used for the IRT analysis. Of those, 304 completed the TFI-S and other measures on more than one occasion to assess sensitivity to change, concurrent, and predictive validity of the brief version. Results suggest that the new TFI-8 is a brief, reliable, and valid measure of a higher-order group therapeutic factor. The TFI-8 may be used for continuous process measurement and feedback to improve the functioning of therapy groups.
Validity and Reliability of Farsi Version of Youth Sport Environment Questionnaire
Eshghi, Mohammad Ali; Kordi, Ramin; Memari, Amir Hossein; Ghaziasgar, Ahmad; Mansournia, Mohammad-Ali; Zamani Sani, Seyed Hojjat
2015-01-01
The Youth Sport Environment Questionnaire (YSEQ) had been developed from Group Environment Questionnaire, a well-known measure of team cohesion. The aim of this study was to adapt and examine the reliability and validity of the Farsi version of the YSEQ. This version was completed by 455 athletes aged 13–17 years. Results of confirmatory factor analysis indicated that two-factor solution showed a good fit to the data. The results also revealed that the Farsi YSEQ showed high internal consistency, test-retest reliability, and good concurrent validity. This study indicated that the Farsi version of the YSEQ is a valid and reliable measure to assess team cohesion in sport setting. PMID:26464900
Skinner, Timothy C; Blick, Julie; Coffin, Juli; Dudgeon, Pat; Forrest, Simon; Morrison, David
2013-01-01
This study sought to determine the construct validity of two self-report measures of attitudes towards Aboriginal Australians and Torres Strait Islanders against an implicit measure of attitude. Total of 102 volunteer participants completed the three measures in a randomized order. The explicit measures of prejudice towards Aboriginal Australians were the Modern Racism Scale (MRS) and the Attitudes Towards Indigenous Australians Scale (ATIAS). The implicit attitudes measure was an adaptation of the Implicit Association Test (IAT) and utilised simple drawn head-and-shoulder images of Aboriginal Australians and White Australians as the stimuli. Both explicit measures and implicit measure varied in the extent to which negative prejudicial attitudes were held by participants, and the corresponding construct validities were unimpressive. The MRS was significantly correlated with the IAT, (r =.314;p<.05) where the ATIAS was not significantly correlated with IAT scores (r =.12). Of the two self-report measures of attitudes towards Aboriginal Australians, only the MRS evidenced validity when compared with the use of an implicit attitude measure.
ERIC Educational Resources Information Center
Leong, Frederick T. L.; Austin, James T.; Sekaran, Uma; Komarraju, Meera
1998-01-01
Natives of India (n=172) completed Holland's Vocational Preference Inventory and job satisfaction measures. The inventory did not exhibit high external validity with this population. Congruence, consistency, and differentiation did not predict job or occupational satisfaction, suggesting cross-cultural limits on Holland's theory. (SK)
A Study of Developing an Environmental Attitude Scale for Primary School Students
ERIC Educational Resources Information Center
Artvinli, Eyup; Demir, Zulfiye Melis
2018-01-01
The aim of this research is to develop an instrument that measures environmental attitudes of third grade students. The study was completed in six stages: creating scale items, content validity study, item total and remaining item correlation study, determining item discrimination, determining construct validity study and examining the internal…
Validation of a Teachers' Achievement Goal Instrument for Teaching Physical Education
ERIC Educational Resources Information Center
Wang, Jian; Shen, Bo; Luo, Xiaobin; Hu, Qingshan; Garn, Alex C.
2018-01-01
Purpose: Using Butler's teacher achievement goal orientation as a conceptual framework, we developed this study to validate a teachers' achievement goal instrument for teaching physical education. Methods: A sample of 322 Chinese physical education teachers participated in this study and completed measures of achievement goal orientations and job…
Reliability, Validity and Utility of a Multiple Intelligences Assessment for Career Planning.
ERIC Educational Resources Information Center
Shearer, C. Branton
"The Multiple Intelligences Developmental Assessment Scales" (MIDAS) is a self- (or other-) completed instrument which is based upon the theory of multiple intelligences. The validity, reliability, and utility data regarding the MIDAS are reported here. The measure consists of 7 main scales and 24 subscales which summarize a person's intellectual…
Factorial Validity and Psychometric Examination of the Exercise Dependence Scale-Revised
ERIC Educational Resources Information Center
Downs, Danielle Symons; Hausenblas, Heather A.; Nigg, Claudio R.
2004-01-01
The research purposes were to examine the factorial and convergent validity, internal consistency, and test-retest reliability of the Exercise Dependence Scale (EDS). Two separate studies, containing a total of 1,263 college students, were undertaken to accomplish these purposes. Participants completed the EDS and measures of exercise behavior and…
Grandjean, Chantal; Latour, Jos M; Cotting, Jacques; Fazan, Marie-Christine; Leteurtre, Stéphane; Ramelet, Anne-Sylvie
2017-02-01
Within paediatric intensive care units (PICUs), only a few parent satisfaction instruments are validated and none are available for French-speaking parents. The aims of the study were to translate and culturally adapt the Dutch EMPATHIC-65 questionnaire into a French version and to test its psychometric equivalence. Two French-speaking PICUs in Switzerland and France participated. The questionnaire was translated using a standardised method and parents with PICU experience were interviewed to assess clarity of the translated version. Secondly, parents of children hospitalised for at least 24 hours and who were fluent in French, were invited to complete the French translated version of the EMPATHIC-65 questionnaire. Reliability and validity measures were used to examine its psychometric equivalence. The overall mean clarity agreement reached 90.2% by 17 French-speaking parents. Eight unclear items have subsequently been reworded. One hundred seventy-two parents completed the French version questionnaire. Reliability and convergent validity have been confirmed by an adequate internal consistency (0.59-0.89) and convergent validity (r s 0.25-0.63, p<0.01). Psychometric equivalence of the French EMPATHIC-65 questionnaire highlights the appropriateness of relying on available valid instrument to expand the availability of health instrument measure in French. Copyright © 2016 Elsevier Ltd. All rights reserved.
Cape, John; Morris, Elena; Burd, Mary; Buszewicz, Marta
2008-01-01
Background How GPs understand mental health problems determines their treatment choices; however, measures describing GPs' thinking about such problems are not currently available. Aim To develop a measure of the complexity of GP explanations of common mental health problems and to pilot its reliability and validity. Design of study A qualitative development of the measure, followed by inter-rater reliability and validation pilot studies. Setting General practices in North London. Method Vignettes of simulated consultations with patients with mental health problems were videotaped, and an anchored measure of complexity of psychosocial explanation in response to these vignettes was developed. Six GPs, four psychologists, and two lay people viewed the vignettes. Their responses were rated for complexity, both using the anchored measure and independently by two experts in primary care mental health. In a second reliability and revalidation study, responses of 50 GPs to two vignettes were rated for complexity. The GPs also completed a questionnaire to determine their interest and training in mental health, and they completed the Depression Attitudes Questionnaire. Results Inter-rater reliability of the measure of complexity of explanation in both pilot studies was satisfactory (intraclass correlation coefficient = 0.78 and 0.72). The measure correlated with expert opinion as to what constitutes a complex explanation, and the responses of psychologists, GPs, and lay people differed in measured complexity. GPs with higher complexity scores had greater interest, more training in mental health, and more positive attitudes to depression. Conclusion Results suggest that the complexity of GPs' psychosocial explanations about common mental health problems can be reliably and validly assessed by this new standardised measure. PMID:18505616
Beehler, Sarah; Ahern, Jennifer; Balmer, Brandi; Kuhlman, Jennifer
2017-01-01
This pilot study evaluated the validity and reliability of an Experience of Neighborhood (EON) measure developed to assess neighborhood characteristics that shape reintegration opportunities for returning service members and their families. A total of 91 post-9/11 veterans and spouses completed a survey administered at the Minnesota State Fair. Participants self-reported on their reintegration status (veterans), social functioning (spouses), social support, and mental health. EON factor structure, internal consistency reliability, and validity (discriminant, content, criterion) were analyzed. The EON measure showed adequate reliability, discriminant validity, and content validity. More work is needed to assess criterion validity because EON scores were not correlated with scores on a Census-based index used to measure quality of military neighborhoods. The EON may be useful in assessing broad local factors influencing health among returning veterans and spouses. More research is needed to understand geographic variation in neighborhood conditions and how those affect reintegration and mental health for military families.
Beehler, Sarah; Ahern, Jennifer; Balmer, Brandi; Kuhlman, Jennifer
2017-01-01
This pilot study evaluated the validity and reliability of an Experience of Neighborhood (EON) measure developed to assess neighborhood characteristics that shape reintegration opportunities for returning service members and their families. A total of 91 post-9/11 veterans and spouses completed a survey administered at the Minnesota State Fair. Participants self-reported on their reintegration status (veterans), social functioning (spouses), social support, and mental health. EON factor structure, internal consistency reliability, and validity (discriminant, content, criterion) were analyzed. The EON measure showed adequate reliability, discriminant validity, and content validity. More work is needed to assess criterion validity because EON scores were not correlated with scores on a Census-based index used to measure quality of military neighborhoods. The EON may be useful in assessing broad local factors influencing health among returning veterans and spouses. More research is needed to understand geographic variation in neighborhood conditions and how those affect reintegration and mental health for military families. PMID:28936370
Convergent and discriminant validity of measures of parenting efficacy and control.
Lovejoy, M C; Verda, M R; Hays, C E
1997-12-01
Examined the convergent and discriminant validity of the Parent Attribution Test (PAT; Bugental, Blue, & Cruzcosa, 1989), the Parental Locus of Control Scale (PLOC; Campis, Lyman, & Prentice-Dunn, 1986), and the Parenting Sense of Competence-Efficacy Scale (PSOC-Efficacy; Johnston & Mash, 1989) in 3 samples of community mothers. In the 1st 2 samples, mothers also completed measures of negative affect and social desirability. In the 3rd sample, the PAT and PSOC-Efficacy scales were administered with measures of adult attachment style and child behavior problems. There was weak support for the convergent validity of the measures. Moreover, the discriminant validity of the measures was not adequately demonstrated. Our results suggest that PLOC and PSOC-Efficacy scores may reflect distress and response style as well as beliefs about parenting. Scores on the PAT, although less influenced by response style and distress, appear to reflect a different dimension of efficacy than that assessed by other self-report measures.
Assessment of Individual Differences in Regulatory Focus among Cigarette Smokers
Haaga, David A. F.; Friedman-Wheeler, Dara G.; McIntosh, Elizabeth; Ahrens, Anthony H.
2008-01-01
Smoking cessation programs might benefit from tailoring messages to individual differences in regulatory focus (see Higgins, 1997), but there is little evidence on the stability or convergent validity of regulatory focus measures. In two studies, smokers completed four measures of regulatory focus: (a) Regulatory Focus Questionnaire (RFQ); (b) actual-ideal and actual-ought self-discrepancies; (c) response duration in naming name ideal or ought self-guides; and (d) reaction time for lexical decisions about one’s ideal or ought self-guides. Study 1 included a one-month retest. Retest reliability was adequate, but convergent validity was poor. Questionnaire and self-discrepancy measures were unrelated to each other or to the reaction time measures. To facilitate future studies of tailored health behavior change interventions, research is needed to determine whether weak convergent validity resulted from (a) invalidity of some or all of the regulatory focus measures or (b) validity of each for measuring a different aspect of the construct. PMID:18958291
Validation of a condition-specific measure for women having an abnormal screening mammography.
Brodersen, John; Thorsen, Hanne; Kreiner, Svend
2007-01-01
The aim of this study is to assess the validity of a new condition-specific instrument measuring psychosocial consequences of abnormal screening mammography (PCQ-DK33). The draft version of the PCQ-DK33 was completed on two occasions by 184 women who had received an abnormal screening mammography and on one occasion by 240 women who had received a normal screening result. Item Response Theories and Classical Test Theories were used to analyze data. Construct validity, concurrent validity, known group validity, objectivity and reliability were established by item analysis examining the fit between item responses and Rasch models. Six dimensions covering anxiety, behavioral impact, sense of dejection, impact on sleep, breast examination, and sexuality were identified. One item belonging to the dejection dimension had uniform differential item functioning. Two items not fitting the Rasch models were retained because of high face validity. A sick leave item added useful information when measuring side effects and socioeconomic consequences of breast cancer screening. Five "poor items" were identified and should be deleted from the final instrument. Preliminary evidence for a valid and reliable condition-specific measure for women having an abnormal screening mammography was established. The measure includes 27 "good" items measuring different attributes of the same overall latent structure-the psychosocial consequences of abnormal screening mammography.
Easton, Tiffany; Milte, Rachel; Crotty, Maria; Ratcliffe, Julie
2018-05-01
This study aimed to empirically compare the measurement properties of self-reported and proxy-reported (in cases of severe cognitive impairment) generic (EQ-5D-5L) and condition-specific (DEMQOL-U and DEMQOL-Proxy-U) preference-based HRQoL instruments in residential care, where the population is characterised by older people with high rates of cognitive impairment, dementia and disability. Participants were recruited from seventeen residential care facilities across four Australian states. One hundred and forty-three participants self-completed the EQ-5D-5L and the DEMQOL-U while three hundred and eight-seven proxy completed (due to the presence of severe dementia) the EQ-5D-5L and DEMQOL-Proxy-U. The convergent validity of the outcome measures and known group validity relative to a series of clinical outcome measures were assessed. Results satisfy convergent validity among the outcome measures. EQ-5D-5L and DEMQOL-U utilities were found to be significantly correlated with each other (p < 0.01) as were EQ-5D-5L and DEMQOL-Proxy-U utilities (p < 0.01). Both self-reported and proxy-reported EQ-5D-5L utilities demonstrated strong known group validity in relation to clinically recognised thresholds of cognition and physical functioning, while in contrast neither DEMQOL-U nor DEMQOL-Proxy-U demonstrated this association. The findings suggest that the EQ-5D-5L, DEMQOL-U and DEMQOL-Proxy-U capture distinct aspects of HRQoL for this population. The measurement and valuation of HRQoL form an essential component of economic evaluation in residential care. However, high levels of cognitive impairment may preclude self-completion for a majority. Further research is needed to determine cognition thresholds beyond which an individual is unable to reliably self-report their own health-related quality of life.
Van Lerbeirghe, J; Van Lerbeirghe, J; Van Schaeybroeck, P; Robijn, H; Rasschaert, R; Sys, J; Parlevliet, T; Hallaert, G; Van Wambeke, P; Depreitere, B
2018-01-01
The core outcome measures index (COMI) is a validated multidimensional instrument for assessing patient-reported outcome in patients with back problems. The aim of the present study is to translate the COMI into Dutch and validate it for use in native Dutch speakers with low back pain. The COMI was translated into Dutch following established guidelines and avoiding region-specific terminology. A total of 89 Dutch-speaking patients with low back pain were recruited from 8 centers, located in the Dutch-speaking part of Belgium. Patients completed a questionnaire booklet including the validated Dutch version of the Roland Morris disability questionnaire, EQ-5D, the WHOQoL-Bref, the Numeric Rating Scale (NRS) for pain, and the Dutch translation of the COMI. Two weeks later, patients completed the Dutch COMI translation again, with a transition scale assessing changes in their condition. The patterns of correlations between the individual COMI items and the validated reference questionnaires were comparable to those reported for other validated language versions of the COMI. The intraclass correlation for the COMI summary score was 0.90 (95% CI 0.84-0.94). It was 0.75 and 0.70 for the back and leg pain score, respectively. The minimum detectable change for the COMI summary score was 1.74. No significant differences were observed between repeated scores of individual COMI items or for the summary score. The reproducibility of the Dutch translation of the COMI is comparable to that of other validated spine outcome measures. The COMI items correlate well with the established item-specific scores. The Dutch translation of the COMI, validated by this work, is a reliable and valuable tool for spine centers treating Dutch-speaking patients and can be used in registries and outcome studies.
Validation of Accelerometer Prediction Equations in Children with Chronic Disease.
Stephens, Samantha; Takken, Tim; Esliger, Dale W; Pullenayegum, Eleanor; Beyene, Joseph; Tremblay, Mark; Schneiderman, Jane; Biggar, Doug; Longmuir, Pat; McCrindle, Brian; Abad, Audrey; Ignas, Dan; Van Der Net, Janjaap; Feldman, Brian
2016-02-01
The purpose of this study was to assess the criterion validity of existing accelerometer-based energy expenditure (EE) prediction equations among children with chronic conditions, and to develop new prediction equations. Children with congenital heart disease (CHD), cystic fibrosis (CF), dermatomyositis (JDM), juvenile arthritis (JA), inherited muscle disease (IMD), and hemophilia (HE) completed 7 tasks while EE was measured using indirect calorimetry with counts determined by accelerometer. Agreement between predicted EE and measured EE was assessed. Disease-specific equations and cut points were developed and cross-validated. In total, 196 subjects participated. One participant dropped out before testing due to time constraints, while 15 CHD, 32 CF, 31 JDM, 31 JA, 30 IMD, 28 HE, and 29 healthy controls completed the study. Agreement between predicted and measured EE varied across disease group and ranged from (ICC) .13-.46. Disease-specific prediction equations exhibited a range of results (ICC .62-.88) (SE 0.45-0.78). In conclusion, poor agreement was demonstrated using current prediction equations in children with chronic conditions. Disease-specific equations and cut points were developed.
Patel, Alpesh A; Dodwad, Shah-Nawaz M; Boody, Barrett S; Bhatt, Surabhi; Savage, Jason W; Hsu, Wellington K; Rothrock, Nan E
2018-03-19
Prospective, cohort study. Demonstrate validity of PROMIS physical function, pain interference, and pain behavior computer adaptive tests (CATs) in surgically treated lumbar stenosis patients. There has been increasing attention given to patient reported outcomes associated with spinal interventions. Historical patient outcome measures have inadequate validation, demonstrate floor/ceiling effects, and infrequently used due to time constraints. PROMIS is an adaptive, responsive NIH assessment tool that measures patient-reported health status. 98 consecutive patients were surgically treated for lumbar spinal stenosis and were assessed using PROMIS CATs, ODI, ZCQ and SF-12. Prior lumbar surgery, history of scoliosis, cancer, trauma, or infection were excluded. Completion time, preoperative assessment, 6 week and 3 month postoperative scores were collected. At baseline, 49%, 79%, and 81% of patients had PROMIS PB, PI, and PF scores greater than 1 SD worse than the general population. 50.6% were categorized as severely disabled, crippled, or bed bound by ODI. PROMIS CATs demonstrated convergent validity through moderate to high correlations with legacy measures (r = 0.35-0.73). PROMIS CATs demonstrated known groups validity when stratified by ODI levels of disability. ODI improvements of at least 10 points on average had changes in PROMIS scores in the expected direction (PI = -12.98, PB = -9.74, PF = 7.53). PROMIS CATs demonstrated comparable responsiveness to change when evaluated against legacy measures. PROMIS PB and PI decreased 6.66 and 9.62 and PROMIS PF increased 6.8 points between baseline and 3-months post-op (p < 0.001). Completion time for the PROMIS CATs (2.6 minutes) compares favorably to ODI, ZCQ, and SF-12 scores (3.1, 3.6, and 3.0 minutes). PROMIS CATs demonstrate convergent validity, known groups validity, and responsiveness for surgically treated patients with lumbar stenosis to detect change over time and are more efficient than legacy instruments. 2.
Are Active Australia physical activity questions valid for older adults?
Heesch, Kristiann C; Hill, Robert L; van Uffelen, Jannique G Z; Brown, Wendy J
2011-05-01
The Active Australia Survey (AAS) is used for physical activity (PA) surveillance in the general Australian adult population, but its validity in older adults has not been evaluated. Our aim was to examine the convergent validity of the AAS questions in older adults. The AAS was validated against pedometer step counts as an objective measure of PA, self-reported physical function, and a step-test to assess cardiorespiratory fitness. Participants were community-dwelling adults, aged 65-89 y, with the ability to walk 100 m. They completed a self-administered AAS and the step-test in one interview. One week earlier, they completed the Short Form-36 physical function subscale. Between these two interviews, they each wore a YAMAX Digiwalker SW200 pedometer and recorded daily steps. Using the AAS data, daily walking minutes and total PA minutes (walking, moderate-intensity PA and vigorous-intensity PA) were compared with the validity measures using Spearman rank-order correlations. Fifty-three adults completed the study. Median daily walking minutes were 34.2 (interquartile range [IQR] 17.1, 60.0), and median daily total PA minutes were 68.6 (IQR 31.4, 113.6). Walking and total PA minutes were both moderately correlated with pedometer steps (Spearman correlation r=0.42, p=0.003, for each) but not with step-test seconds to completion (r=-0.11, p=0.44; r=-0.25, p=0.08, respectively). Total PA minutes were significantly correlated with physical function scores (r=0.39, p=0.004), but walking minutes were not (r=0.15, p=0.29). This initial examination of the psychometric properties of the AAS for older adults suggests that this surveillance tool has acceptable convergent validity for ambulatory, community-dwelling older adults. Copyright © 2010 Sports Medicine Australia. Published by Elsevier Ltd. All rights reserved.
Reliability and validity: Part II.
Davis, Debora Winders
2004-01-01
Determining measurement reliability and validity involves complex processes. There is usually room for argument about most instruments. It is important that the researcher clearly describes the processes upon which she made the decision to use a particular instrument, and presents the evidence available showing that the instrument is reliable and valid for the current purposes. In some cases, the researcher may need to conduct pilot studies to obtain evidence upon which to decide whether the instrument is valid for a new population or a different setting. In all cases, the researcher must present a clear and complete explanation for the choices, she has made regarding reliability and validity. The consumer must then judge the degree to which the researcher has provided adequate and theoretically sound rationale. Although I have tried to touch on most of the important concepts related to measurement reliability and validity, it is beyond the scope of this column to be exhaustive. There are textbooks devoted entirely to specific measurement issues if readers require more in-depth knowledge.
Kong, Feng; You, Xuqun; Zhao, Jingjing
2017-01-01
The Gratitude Questionnaire (GQ; McCullough et al., 2002) is one of the most widely used instruments to assess dispositional gratitude. The purpose of this study was to validate a Chinese version of the GQ by examining internal consistency, factor structure, convergent validity, and measurement invariance across sex. A total of 1151 Chinese adults were recruited to complete the GQ, Positive Affect and Negative Affect Scales, and Satisfaction with Life Scale. Confirmatory factor analysis indicated that the original unidimensional model fitted well, which is in accordance with the findings in Western populations. Furthermore, the GQ had satisfactory composite reliability and criterion-related validity with measures of life satisfaction and affective well-being. Evidence of configural, metric and scalar invariance across sex was obtained. Tests of the latent mean differences found females had higher latent mean scores than males. These findings suggest that the Chinese version of GQ is a reliable and valid tool for measuring dispositional gratitude and can generally be utilized across sex in the Chinese context. PMID:28919873
Kong, Feng; You, Xuqun; Zhao, Jingjing
2017-01-01
The Gratitude Questionnaire (GQ; McCullough et al., 2002) is one of the most widely used instruments to assess dispositional gratitude. The purpose of this study was to validate a Chinese version of the GQ by examining internal consistency, factor structure, convergent validity, and measurement invariance across sex. A total of 1151 Chinese adults were recruited to complete the GQ, Positive Affect and Negative Affect Scales, and Satisfaction with Life Scale. Confirmatory factor analysis indicated that the original unidimensional model fitted well, which is in accordance with the findings in Western populations. Furthermore, the GQ had satisfactory composite reliability and criterion-related validity with measures of life satisfaction and affective well-being. Evidence of configural, metric and scalar invariance across sex was obtained. Tests of the latent mean differences found females had higher latent mean scores than males. These findings suggest that the Chinese version of GQ is a reliable and valid tool for measuring dispositional gratitude and can generally be utilized across sex in the Chinese context.
Assessment of competence to complete advance directives: validation of a patient centred approach
Fazel, Seena; Hope, Tony; Jacoby, Robin
1999-01-01
Objective To develop a patient centred approach for the assessment of competence to complete advance directives (“living wills”) of elderly people with cognitive impairment. Design Semistructured interviews. Setting Oxfordshire. Subjects 50 elderly volunteers living in the community, and 50 patients with dementia on first referral from primary care. Main outcome measures Psychometric properties of competence assessment. Results This patient centred approach for assessing competence to complete advance directives can discriminate between elderly persons living in the community and elderly patients with dementia. The procedure has good interrater (r=0.95) and test-retest (r=0.97) reliability. Validity was examined by relating this approach with a global assessment of competence to complete an advance directive made by two of us (both specialising in old age psychiatry). The data were also used to determine the best threshold score for discriminating between those competent and those incompetent to complete an advance directive. Conclusion A patient centred approach to assess competence to complete advance directives can be reliably and validly used in routine clinical practice. Key messagesAdvance directives could potentially be useful for patients with dementia as a means of extending their autonomy when they become incompetentCompetence to complete an advance directive involves understanding possible future clinical situationsVignettes presenting hypothetical medical problems were tested in 100 elderly people, and were found to validly and reliably discriminate between volunteers living in the community and patients with dementiaWe suggest that two clinical vignettes, each followed by a semistructured interview comprising 10 points, can aid in the assessment of competence to complete advance directives PMID:10024254
Benjamin, Sara E; Neelon, Brian; Ball, Sarah C; Bangdiwala, Shrikant I; Ammerman, Alice S; Ward, Dianne S
2007-01-01
Background Few assessment instruments have examined the nutrition and physical activity environments in child care, and none are self-administered. Given the emerging focus on child care settings as a target for intervention, a valid and reliable measure of the nutrition and physical activity environment is needed. Methods To measure inter-rater reliability, 59 child care center directors and 109 staff completed the self-assessment concurrently, but independently. Three weeks later, a repeat self-assessment was completed by a sub-sample of 38 directors to assess test-retest reliability. To assess criterion validity, a researcher-administered environmental assessment was conducted at 69 centers and was compared to a self-assessment completed by the director. A weighted kappa test statistic and percent agreement were calculated to assess agreement for each question on the self-assessment. Results For inter-rater reliability, kappa statistics ranged from 0.20 to 1.00 across all questions. Test-retest reliability of the self-assessment yielded kappa statistics that ranged from 0.07 to 1.00. The inter-quartile kappa statistic ranges for inter-rater and test-retest reliability were 0.45 to 0.63 and 0.27 to 0.45, respectively. When percent agreement was calculated, questions ranged from 52.6% to 100% for inter-rater reliability and 34.3% to 100% for test-retest reliability. Kappa statistics for validity ranged from -0.01 to 0.79, with an inter-quartile range of 0.08 to 0.34. Percent agreement for validity ranged from 12.9% to 93.7%. Conclusion This study provides estimates of criterion validity, inter-rater reliability and test-retest reliability for an environmental nutrition and physical activity self-assessment instrument for child care. Results indicate that the self-assessment is a stable and reasonably accurate instrument for use with child care interventions. We therefore recommend the Nutrition and Physical Activity Self-Assessment for Child Care (NAP SACC) instrument to researchers and practitioners interested in conducting healthy weight intervention in child care. However, a more robust, less subjective measure would be more appropriate for researchers seeking an outcome measure to assess intervention impact. PMID:17615078
de Boer, A Siebe; Tjioe, Roderik J C; Van der Sijde, Fleur; Meuffels, Duncan E; den Hoed, Pieter T; Van der Vlies, Cornelis H; Tuinebreijer, Wim E; Verhofstad, Michael H J; Van Lieshout, Esther M M
2017-08-03
The American Orthopaedic Foot and Ankle Society (AOFAS) Ankle-Hindfoot Scale is among the most commonly used instruments for measuring outcome of treatment in patients who sustained a complex ankle or hindfoot injury. It consists of a patient-reported and a physician-reported part. A validated, Dutch version of this instrument is currently not available. The aim of this study was to translate the instrument into Dutch and to determine the measurement properties of the AOFAS Ankle-Hindfoot Scale Dutch language version (DLV) in patients with a unilateral ankle fracture. Multicentre (two Dutch hospitals), prospective observational study. In total, 142 patients with a unilateral ankle fracture were included. Ten patients were lost to follow-up. Patients completed the subjective (patient-reported) part of the AOFAS Ankle-Hindfoot Scale-DLV. A physician or trained physician-assistant completed the physician-reported part. For comparison and evaluation of the measuring characteristics, the Foot Function Index and the Short Form-36 were completed by the patient. Descriptive statistics (including floor and ceiling effects), reliability (ie, internal consistency), construct validity, reproducibility (ie, test-retest reliability, agreement and smallest detectable change) and responsiveness were determined. The AOFAS-DLV and its subscales showed good internal consistency (Cronbach's α >0.90). Construct validity and longitudinal validity were proven to be adequate (76.5% of predefined hypotheses were confirmed). Floor effects were not present. Ceiling effects were present from 6 months onwards, as expected. Responsiveness was adequate, with a smallest detectable change of 12.0 points. The AOFAS-DLV is a reliable, valid and responsive measurement instrument for evaluating functional outcome in patients with a unilateral ankle fracture. This implies that the questionnaire is suitable to compare different treatment modalities within this population or to compare outcome across hospitals. The Netherlands Trial Register (NTR5613; 05-jan-2016). © Article author(s) (or their employer(s) unless otherwise stated in the text of the article) 2017. All rights reserved. No commercial use is permitted unless otherwise expressly granted.
Kliem, Sören; Lohmann, Anna; Mößle, Thomas; Brähler, Elmar
2017-12-04
Suicidal ideation has been identified as one of the major predictors of attempted or actual suicide. Routinely screening individuals for endorsing suicidal thoughts could save lives and protect many from severe psychological consequences following the suicide of loved ones. The aim of this study was to validate the German version of the Beck Scale for Suicide Ideation (BSS) in a sample representative for the Federal Republic of Germany. All 2450 participants completed the first part of the Scale, the BSS-Screen. A risk group of n = 112 individuals (4.6%) with active or passive suicidal ideation was identified and subsequently completed the entire BSS. Satisfactory internal reliability (α = .97 for the BSS-Screen; α = .94 for the entire BSS) and excellent model fit indices for the one-dimensional factorial structure of the BSS-Screen (CFI = .998; TLI = .995; RMSEA = .045 [95%-CI: .030-.061]) were confirmed. Measurement invariance analyses supported strict invariance across gender, age, and depression status. We found correlations with related self-report measures in expected directions comparable to previous studies, indicating satisfactory construct validity. Our study involved cross sectional data, hence neither predictive validity nor retest-reliability were examined. As only the risk group of n = 112 individuals completed the entire measure, confirmatory factor analyses could not be conducted for the full BSS. The German translation of the BSS is a reliable and valid instrument for assessing suicidal ideation in the general population. Using it as a screening device in general and specialized medical care could substantially advance suicide prevention.
Algamdi, Maaidah M; Hanneman, Sandra K
2018-02-14
Valid and reliable instruments in Arabic are needed to measure self-efficacy and quality of life for Arabic patients with cancer. The aim of this study was to test the psychometric performance of the Cancer Behavior Inventory-Brief Arabic (CBI-BA), including participant understanding of items, and the Functional Assessment of Cancer Therapy-Breast Arabic (FACT-BA). Using a cross-sectional design, 438 cancer patients completed the CBI-BA, 30 of whom completed cognitive interviews. A subsample 167 women with breast cancer also completed the FACT-BA. Internal consistency evidence was assessed with Cronbach's α and construct validity with principal axis factoring. Internal consistency estimates were acceptable for the total CBI-BA (α = .81) and FACT-BA (α = .88) scales. Exploratory factor analyses showed evidence of construct validity for the CBI-BA; 1 factor was derived, compared with four in the original English version. Cognitive interviews indicated satisfactory patient understanding of CBI-BA items. The Arabic version of the general FACT-General scale had 4 factors according to expectation. The CBI-BA has adequate psychometric performance for the measurement of self-efficacy for coping with cancer in Arabic patients. The FACT-General Arabic has adequate evidence of reliability and validity for the measurement of quality of life in Arabic women with breast cancer. The availability of culturally sensitive and psychometrically sound instruments for Arabic patients diagnosed with cancer should be valuable for healthcare clinicians and researchers to assess self-efficacy for coping with cancer and quality of life.
Bass, Malcolm; Dawkin, Mathew; Muncer, Steven; Vigurs, Scott; Bostock, Janet
2016-08-01
The Warwick-Edinburgh Mental Well-being Scale (WEMWBS) is a relatively new measure and to date has been validated in a number of populations, including student, general and adolescent samples across the UK. There is increasing interest in measuring the mental well-being of users of secondary care mental health services and therefore it is apt to validate WEMWBS for this population. To investigate the validity of WEMWBS in a secondary care mental health service user population. Data was collected from two NHS Trusts and one charity. Analyses are based on 1180 completed WEMWBS. WEMWBS scores for this population are significantly lower than those in a general population (Mean 34.9, SD 13.8). Overall the data analyses supported the use of WEMWBS in this population sample. The Rasch analysis found that the majority of the items can be seen as measuring one dimension. The confirmatory factor analysis supports a one factor solution and thus, measures a single underlying concept. The findings from this study show WEMWBS to be a valid and reliable measure for this population sample.
Liggett, Jacqueline; Carmichael, Kieran L C; Smith, Alexander; Sellbom, Martin
2017-01-01
This study examined the validity of newly developed disorder-specific impairment scales (IS), modeled on the Level of Personality Functioning Scale, for obsessive-compulsive (OCPD) and avoidant (AvPD) personality disorders. The IS focused on content validity (items directly reflected the disorder-specific impairments listed in DSM-5 Section III) and severity of impairment. A community sample of 313 adults completed personality inventories indexing the DSM-5 Sections II and III diagnostic criteria for OCPD and AvPD, as well as measures of impairment in the domains of self- and interpersonal functioning. Results indicated that both impairment measures (for AvPD in particular) showed promise in their ability to measure disorder-specific impairment, demonstrating convergent validity with their respective Section II counterparts and discriminant validity with their noncorresponding Section II disorder and with each other. The pattern of relationships between scores on the IS and scores on external measures of personality functioning, however, did not indicate that it is useful to maintain a distinction between impairment in the self- and interpersonal domains, at least for AvPD and OCPD.
Renison, Belinda; Ponsford, Jennie; Testa, Renee; Richardson, Barry; Brownfield, Kylie
2012-05-01
Virtual reality (VR) assessment paradigms have the potential to address the limited ecological validity of pen and paper measures of executive function (EF) and the pragmatic and reliability issues associated with functional measures. To investigate the ecological validity and construct validity of a newly developed VR measure of EF, the Virtual Library Task (VLT); a real life analogous task--the Real Library Task (RLT); and five neuropsychological measures of EF were administered to 30 patients with traumatic brain injury (TBI) and 30 healthy Controls. Significant others for each participant also completed the Dysexecutive Questionnaire (DEX), which is a behavioral rating scale of everyday EF. Performances on the VLT and the RLT were significantly positively correlated indicating that VR performance is similar to real world performance. The TBI group performed significantly worse than the Control group on the VLT and the Modified Six Elements Test (MSET) but the other four neuropsychological measures of EF failed to differentiate the groups. Both the MSET and the VLT significantly predicted everyday EF suggesting that they are both ecologically valid tools for the assessment of EF. The VLT has the advantage over the MSET of providing objective measurement of individual components of EF.
Frizelle, Pauline; Harte, Jennifer; O'Sullivan, Kathleen; Fletcher, Paul; Gibbon, Fiona
2017-01-01
The receptive language measure information-carrying word (ICW) level, is used extensively by speech and language therapists in the UK and Ireland. Despite this it has never been validated via its relationship to any other relevant measures. This study aims to validate the ICW measure by investigating the relationship between the receptive ICW score of children with specific language impairment (SLI) and their performance on standardized memory and language assessments. Twenty-seven children with SLI, aged between 5;07 and 8;11, completed a sentence comprehension task in which the instructions gradually increased in number of ICWs. The children also completed subtests from The Working Memory Test Battery for children and The Clinical Evaluation of Language Fundamentals- 4. Results showed that there was a significant positive relationship between both language and memory measures and children's ICW score. While both receptive and expressive language were significant in their contribution to children's ICW score, the contribution of memory was solely determined by children's working memory ability. ICW score is in fact a valid measure of the language ability of children with SLI. However therapists should also be cognisant of its strong association with working memory when using this construct in assessment or intervention methods.
Tsou, Kuo-Inn; Lin, Chaou-Shune; Cho, Shu-Ling; Powis, David; Bore, Miles; Munro, Don; Sze, Daniel Man-Yuen; Wu, Hsi-Chin; Hsieh, Ming-Shium; Lin, Chyi-Her
2013-06-01
How to select candidates with appropriate personal qualities for medical school is an important issue. This study examined the psychometric properties and group differences of the Personal Qualities Assessment (PQA) to test the feasibility of using it as a tool to assess the medical school applicants in a non-Western culture. Seven hundred forty-six medical students in Taiwan completed two psychometric measures: Mojac to assess moral orientation and NACE to assess four aspects of interpersonal relationships. Thirty-one students completed the tests twice to establish test-retest reliability. A subsample of 127 students also completed a measure of the "Big Five" personality traits to examine the construct validity of these scales. Both Mojac and NACE had acceptable internal consistency and test-retest reliability. Conceptually, coherent and significant relationships were observed between test components and between the NACE and Big Five. NACE but not Mojac varied significantly between different sociodemographic groups. Both tests demonstrated acceptable psychometric properties. However, the predictive validity of PQA requires future studies.
Morris, Anna E; Lutman, Mark E; Yardley, Lucy
2009-01-01
A prototype self-report measure of vestibular rehabilitation outcome is described in a previous paper. The objectives of the present work were to identify the most useful items and assess their psychometric properties. Stage 1: One hundred fifty-five participants completed a prototype 36-item Vestibular Rehabilitation Benefit Questionnaire (VRBQ). Statistical analysis demonstrated its subscale structure and identified redundant items. Stage 2: One hundred twenty-four participants completed a refined 22-item VRBQ and three established questionnaires (Dizziness Handicap Inventory, DHI; Vertigo Symptom Scale short form, VSS-sf; Medical Outcomes Study short form 36, SF-36) in a longitudinal study. Statistical analysis revealed four internally consistent subscales of the VRBQ: Dizziness, Anxiety, Motion-Provoked Dizziness, and Quality of Life. Correlations with the DHI, VSS-sf, and SF-36 support the validity of the VRBQ, and effect size estimates suggest that the VRBQ is more responsive than comparable questionnaires. Twenty participants completed the VRBQ twice in a 24-hour period, indicating excellent test-retest reliability. The VRBQ appears to be a concise and psychometrically robust questionnaire that addresses the main aspects of dizziness impact.
Design and validation of a comprehensive fecal incontinence questionnaire.
Macmillan, Alexandra K; Merrie, Arend E H; Marshall, Roger J; Parry, Bryan R
2008-10-01
Fecal incontinence can have a profound effect on quality of life. Its prevalence remains uncertain because of stigma, lack of consistent definition, and dearth of validated measures. This study was designed to develop a valid clinical and epidemiologic questionnaire, building on current literature and expertise. Patients and experts undertook face validity testing. Construct validity, criterion validity, and test-retest reliability was undertaken. Construct validity comprised factor analysis and internal consistency of the quality of life scale. The validity of known groups was tested against 77 control subjects by using regression models. Questionnaire results were compared with a stool diary for criterion validity. Test-retest reliability was calculated from repeated questionnaire completion. The questionnaire achieved good face validity. It was completed by 104 patients. The quality of life scale had four underlying traits (factor analysis) and high internal consistency (overall Cronbach alpha = 0.97). Patients and control subjects answered the questionnaire significantly differently (P < 0.01) in known-groups validity testing. Criterion validity assessment found mean differences close to zero. Median reliability for the whole questionnaire was 0.79 (range, 0.35-1). This questionnaire compares favorably with other available instruments, although the interpretation of stool consistency requires further research. Its sensitivity to treatment still needs to be investigated.
Llerena, Katiah; Park, Stephanie G; McCarthy, Julie M; Couture, Shannon M; Bennett, Melanie E; Blanchard, Jack J
2013-07-01
The Clinical Assessment Interview for Negative Symptoms (CAINS) is an empirically developed interview measure of negative symptoms. Building on prior work, this study examined the reliability and validity of a self-report measure based on the CAINS-the Motivation and Pleasure Scale-Self-Report (MAP-SR)-that assesses the motivation and pleasure domain of negative symptoms. Thirty-seven participants with schizophrenia or schizoaffective disorder completed the 18-item MAP-SR, the CAINS, and other measures of functional outcome. Item analyses revealed three items that performed poorly. The revised 15-item MAP-SR demonstrated good internal consistency and convergent validity with the clinician-rated Motivation and Pleasure scale of the CAINS, as well as good discriminant validity, with little association with psychotic symptoms or depression/anxiety. MAP-SR scores were related to social anhedonia, social closeness, and clinician-rated social functioning. The MAP-SR is a promising self-report measure of severity of negative symptoms. Copyright © 2013 Elsevier Inc. All rights reserved.
ERIC Educational Resources Information Center
Krall, Jodi Stotts; Lohse, Barbara
2010-01-01
Objective: Examine the validity of a self-report measure of eating competence with low-income women. Methods: Twenty-five females (18-49 years old) recruited from low-income venues in Pennsylvania completed cognitive testing through an iterative interview process. Respondents' oral responses were compared to researchers' intended meaning of…
Measuring Adolescent Social and Academic Self-Efficacy: Cross-Ethnic Validity of the SEQ-C
ERIC Educational Resources Information Center
Minter, Anthony; Pritzker, Suzanne
2017-01-01
Objective: This study examines the psychometric strength, including cross-ethnic validity, of two subscales of Muris' Self-Efficacy Questionnaire for Children: Academic Self-Efficacy (ASE) and Social Self-Efficacy (SSE). Methods: A large ethnically diverse sample of 3,358 early and late adolescents completed surveys including the ASE and SSE.…
An Examination and Validation of an Adapted Youth Experience Scale for University Sport
ERIC Educational Resources Information Center
Rathwell, Scott; Young, Bradley W.
2016-01-01
Limited tools assess positive development through university sport. Such a tool was validated in this investigation using two independent samples of Canadian university athletes. In Study 1, 605 athletes completed 99 survey items drawn from the Youth Experience Scale (YES 2.0), and separate a priori measurement models were evaluated (i.e., 99…
The Prosocial and Antisocial Behavior in Sport Scale.
Kavussanu, Maria; Boardley, Ian D
2009-02-01
This research aimed to (a) develop a measure of prosocial and antisocial behavior in sport, (b) examine its invariance across sex and sport, and (c) provide evidence for its discriminant and concurrent validity. We conducted two studies. In study 1, team sport athletes (N=1,213) recruited from 103 teams completed questionnaires assessing demographics and prosocial and antisocial behaviors in sport. Factor analyses revealed two factors representing prosocial behavior and two factors representing antisocial behavior. The model had a very good fit to the data and showed configural, metric, and scalar invariance across sex and sport. The final scale consisted of 20 items. In Study 2, team-sport athletes (N=106) completed the scale and measures of empathy and goal orientation. Analyses provided support for the discriminant and concurrent validity of the scale. In conclusion, the new scale can be used to measure prosocial and antisocial behaviors in team sport.
The Rorschach texture response: a construct validation study using attachment theory.
Cassella, Michael J; Viglione, Donald J
2009-11-01
Using attachment theory, in this research, we explored the construct validity of the Rorschach (Exner, 1974) Texture (T) response as a measure of interpersonal closeness and contact. A total of 40 men and 39 women completed the Rorschach and 2 attachment inventories. Their romantic partners also completed an informant version of the attachment measures. Attachment styles were measured by factor scores involving both self-report and partner report. Results indicate that attachment theory, as a broad conceptual framework, is associated with T. Specifically, T = 1 is most closely associated with a secure attachment style, T > 1 with aspects of the preoccupied style, and T = 0 with aspects of the avoidant style and an absence of secure attachment. Needs for closeness and contact associated with T can be couched within an adult attachment theory, but in this study, we did not test for problematic aspects of insecure attachment. Gender is a complicating factor and deserves more study.
Validation of the Focus on the Outcomes of Communication under Six outcome measure
Thomas-Stonell, Nancy; Oddson, Bruce; Robertson, Bernadette; Rosenbaum, Peter
2013-01-01
Aim The aim of this study was to establish the construct validity of the Focus on the Outcomes of Communication Under Six (FOCUS©),a tool designed to measure changes in communication skills in preschool children. Method Participating families' children (n=97; 68 males, 29 females; mean age 2y 8mo; SD 1.04y, range 10mo–4y 11mo) were recruited through eight Canadian organizations. The children were on a waiting list for speech and language intervention. Parents completed the Ages and Stages Questionnaire – Social/Emotional (ASQ-SE) and the FOCUS three times: at assessment and at the start and end of treatment. A second sample (n=28; 16 males 12 females) was recruited from another organization to correlate the FOCUS scores with speech, intelligibility and language measures. Second sample participants ranged in age from 3 years 1 month to 4 years 9 months (mean 3y 11mo; SD 0.41y). At the start and end of treatment, children were videotaped to obtain speech and language samples. Parents and speech–language pathologists (SLPs) independently completed the FOCUS tool. SLPs who were blind to the pre/post order of the videotapes analysed the samples. Results The FOCUS measured significantly more change (p<0.01) during treatment than during the waiting list period. It demonstrated both convergent and discriminant validity against the ASQ-SE. The FOCUS change corresponded to change measured by a combination of clinical speech and language measures (κ=0.31, p<0.05). Conclusion The FOCUS shows strong construct validity as a change-detecting instrument. PMID:23461266
Reliability and validity of a treatment adherence measure for child psychiatric rehabilitation.
Williams, Nathaniel J; Green, Philip
2012-09-01
Treatment adherence, defined as the degree to which practitioners implemented prescribed program principles and activities and avoided proscribed activities, has been an area of growing interest in mental health services for children with severe emotional and behavioral disorders. This study evaluated the reliability and validity of a treatment adherence measure for child psychiatric rehabilitation (CPSR). Parents of children receiving CPSR (n = 79) or psychotherapy (n = 27) completed the Children's Psychosocial Rehabilitation Treatment Adherence Measure (CTAM) and a measure of 2-week session impact. Psychiatric rehabilitation (PSR) supervisors identified PSR practitioners with reputations for high or low adherence to the model. The CTAM's discriminant validity was assessed by using known-groups procedures and predictive validity by examining its relationship to 2-week session impact. The CTAM demonstrated excellent internal consistency (α = .92), discriminant validity (p = .002, d = .72; p = .021, d = .59), and predictive validity (B = 2.24, SE = .31, p < .001), accounting for 28% of the child-level variance in 2-week session impact. Findings suggest the CTAM is a reliable and valid measure of treatment adherence for CPSR programs with a skill-teaching focus. Providers and agencies should take steps to enhance treatment adherence because it may be an important predictor of children's short-term response to CPSR. (PsycINFO Database Record (c) 2012 APA, all rights reserved).
Reliability and Validity of the Chinese (Mandarin) Tinnitus Handicap Inventory
Meng, Zhaoli; Zheng, Yun; Wang, Kai; Kong, Xiudan; Tao, Yong; Xu, Ke; Liu, Guanjian
2012-01-01
Objectives The Tinnitus Handicap Inventory (THI) is a commonly used self-reporting tinnitus questionnaire. We undertook this study to determine the reliability and validity of the Chinese-Mandarin version of the Tinnitus Handicap Inventory (THI-CM) for measuring tinnitus-related handicaps. Methods We tested the test-retest reliability, internal reliability, and construct validity of the THI-CM. Two-hundred patients seeking treatment for primary or secondary tinnitus in Southwest China were asked to complete THI-CM prior to clinical evaluation. Patients were evaluated by a clinician using standard methods, and 40 patients were asked to complete THI-CM a second time 14±3 days after the initial interview. Results The test-retest reliability of THI-CM was high (Pearson correlation, 0.98), as was the internal reliability (Cronbach's α, 0.93). Factor analysis indicated that THI-CM has a unifactorial structure. Conclusion The THI-CM version is reliable. The total score in THI-CM can be used to measure tinnitus-related handicaps in Mandarin-speaking populations. PMID:22468196
Peckham, Andrew D.; Johnson, Sheri L.
2015-01-01
Extensive research supports the role of striatal dopamine in pursuing and responding to reward, and that eye-blink rate is a valid indicator of striatal dopamine. This study tested whether phasic changes in blink rate could provide an index of reward pursuit. This hypothesis was tested in people with bipolar I disorder (BD; a population with aberrations in reward responsivity), and in those without BD. Thirty-one adults with BD and 28 control participants completed a laboratory task involving effort towards monetary reward. Blink rate was recorded using eye-tracking at baseline, reward anticipation, and post-reward. Those in the BD group completed self-report measures relating to reward and ambition. Results showed that across all participants, blink rates increased from reward anticipation to post-reward. In the BD group, reward-relevant measures were strongly correlated with variation in blink rate. These findings provide validation for phasic changes in blink rate as an index of reward response. PMID:27274949
Hauge, Cindy Horst; Jacobs-Knight, Jacque; Jensen, Jamie L; Burgess, Katherine M; Puumala, Susan E; Wilton, Georgiana; Hanson, Jessica D
2015-06-01
The purpose of this study was to use a mixed-methods approach to determine the validity and reliability of measurements used within an alcohol-exposed pregnancy prevention program for American Indian women. To develop validity, content experts provided input into the survey measures, and a "think aloud" methodology was conducted with 23 American Indian women. After revising the measurements based on this input, a test-retest was conducted with 79 American Indian women who were randomized to complete either the original measurements or the new, modified measurements. The test-retest revealed that some of the questions performed better for the modified version, whereas others appeared to be more reliable for the original version. The mixed-methods approach was a useful methodology for gathering feedback on survey measurements from American Indian participants and in indicating specific survey questions that needed to be modified for this population. © The Author(s) 2015.
Brown, Ted; Boyle, Malcolm; Williams, Brett; Molloy, Andrew; McKenna, Lisa; Palermo, Claire; Molloy, Liz
2013-06-01
It is important for educators to consider the communication skills of students enrolled in health science programmes. To date, research into this area is limited, and having measures that are valid and reliable would assist educators and researchers to complete high-quality investigations. The purpose of this study was to investigate the factor structure of Communicator Styles Measure. Data from the Communicator Styles Measure completed by 860 undergraduate health science students enrolled in eight different courses at an Australian university (response rate of 59%) were analysed using principal component analysis with varimax rotation and a cluster analysis using elementary linkage analysis. The Communicator Styles Measure is a self-report scale consisting of 40 items designed to assess ten communication styles and one's perception of his/her ability to communicate. Communicator Styles Measure items loaded onto five new viable factors labelled personable, energetic, confident, open and confronting. Six items of the original 40 from the Communicator Styles Measure did not load onto any factor and were therefore considered redundant. The original factor structure proposed by the Communicator Styles Measure's author was not supported, which calls into question its construct validity. However, the five new factors identified in this study may be useful for researchers and educators when assessing the communication skills of students and practitioners. Further investigation into the construct validity and reliability of the five new Communicator Styles Measure factors is recommended. © 2012 Nordic College of Caring Science.
The Dula dangerous driving index in China: an investigation of reliability and validity.
Qu, Weina; Ge, Yan; Jiang, Caihong; Du, Feng; Zhang, Kan
2014-03-01
The aim of this study was to translate the Dula Dangerous Driving Index (DDDI) into Chinese and to verify its reliability and validity. A total of 246 drivers completed the Chinese version of the DDDI and the Driver Behavior Questionnaire (DBQ). Specific sociodemographic variables and traffic violations were also measured. A confirmatory factor analysis confirmed the internal structure of the DDDI, and the four-factor model was supported in China. Measures of convergent and criterion validity demonstrated that the Chinese DDDI was valid. Its convergent validity was supported by its positive relationship with the DBQ, and its criterion validity was tested using its relationship with self-reported accident involvement and traffic violations. Finally, score comparisons between different demographic groups revealed significant differences, thereby linking age and driving years to dangerous driving. Copyright © 2013 Elsevier Ltd. All rights reserved.
Widger, Kimberley; Tourangeau, Ann E; Steele, Rose; Streiner, David L
2015-01-01
The field of pediatric palliative care is hindered by the lack of a well-defined, reliable, and valid method for measuring the quality of end-of-life care. The study purpose was to develop and test an instrument to measure mothers' perspectives on the quality of care received before, at the time of, and following a child's death. In Phase 1, key components of quality end-of-life care for children were synthesized through a comprehensive review of research literature. These key components were validated in Phase 2 and then extended through focus groups with bereaved parents. In Phase 3, items were developed to assess structures, processes, and outcomes of quality end-of-life care then tested for content and face validity with health professionals. Cognitive testing was conducted through interviews with bereaved parents. In Phase 4, bereaved mothers were recruited through 10 children's hospitals/hospices in Canada to complete the instrument, and psychometric testing was conducted. Following review of 67 manuscripts and 3 focus groups with 10 parents, 141 items were initially developed. The overall content validity index for these items was 0.84 as rated by 7 health professionals. Based on feedback from health professionals and cognitive testing with 6 parents, a 144-item instrument was finalized for further testing. In Phase 4, 128 mothers completed the instrument, 31 of whom completed it twice. Test-retest reliability, internal consistency, and construct validity were demonstrated for six subscales: Connect With Families, Involve Parents, Share Information With Parents, Share Information Among Health Professionals, Support Parents, and Provide Care at Death. Additional items with content validity were grouped in four domains: Support the Child, Support Siblings, Provide Bereavement Follow-up, and Structures of Care. Forty-eight items were deleted through psychometric testing, leaving a 95-item instrument. There is good initial evidence for the reliability and validity of this new quality of end-of-life care instrument as a mechanism for evaluative feedback to health professionals, health systems, and policy makers to improve children's end-of-life care.
Measuring decisional certainty among women seeking abortion.
Ralph, Lauren J; Foster, Diana Greene; Kimport, Katrina; Turok, David; Roberts, Sarah C M
2017-03-01
Evaluating decisional certainty is an important component of medical care, including preabortion care. However, minimal research has examined how to measure certainty with reliability and validity among women seeking abortion. We examine whether the Decisional Conflict Scale (DCS), a measure widely used in other health specialties and considered the gold standard for measuring this construct, and the Taft-Baker Scale (TBS), a measure developed by abortion counselors, are valid and reliable for use with women seeking abortion and predict the decision to continue the pregnancy. Eligible women at four family planning facilities in Utah completed baseline demographic surveys and scales before their abortion information visit and follow-up interviews 3 weeks later. For each scale, we calculated mean scores and explored factors associated with high uncertainty. We evaluated internal reliability using Cronbach's alpha and assessed predictive validity by examining whether higher scale scores, indicative of decisional uncertainty or conflict, were associated with still being pregnant at follow-up. Five hundred women completed baseline surveys; two-thirds (63%) completed follow-up, at which time 11% were still pregnant. Mean scores on the DCS (15.5/100) and TBS (12.4/100) indicated low uncertainty, with acceptable reliability (α=.93 and .72, respectively). Higher scores on each scale were significantly and positively associated with still being pregnant at follow-up in both unadjusted and adjusted analyses. The DCS and TBS demonstrate acceptable reliability and validity among women seeking abortion care. Comparing scores on the DCS in this population to other studies of decision making suggests that the level of uncertainty in abortion decision making is comparable to or lower than other health decisions. The high levels of decisional certainty found in this study challenge the narrative that abortion decision making is exceptional compared to other healthcare decisions and requires additional protection such as laws mandating waiting periods, counseling and ultrasound viewing. Copyright © 2016. Published by Elsevier Inc.
Kashkouli, Mohsen Bahmani; Karimi, Nasser; Aghamirsalim, Mohamadreza; Abtahi, Mohammad Bagher; Nojomi, Marzieh; Shahrad-Bejestani, Hadi; Salehi, Masoud
2017-02-01
To determine the measurement properties of the Persian language version of the Graves orbitopathy quality of life questionnaire (GO-QOL). Following a systematic translation and cultural adaptation process, 141 consecutive unselected thyroid eye disease (TED) patients answered the Persian GO-QOL and underwent complete ophthalmic examination. The questionnaire was again completed by 60 patients on the second visit, 2-4 weeks later. Construct validity (cross-cultural validity, structural validity and hypotheses testing), reliability (internal consistency and test-retest reliability), and floor and ceiling effects of the Persian version of the GO-QOL were evaluated. Furthermore, Rasch analysis was used to assess its psychometric properties. Cross-cultural validity was established by back-translation techniques, committee review and pretesting techniques. Bi-dimensionality of the questionnaire was confirmed by factor analysis. Construct validity was also supported through confirmation of 6 out of 8 predefined hypotheses. Cronbach's α and intraclass correlation coefficient (ICC) were 0.650 and 0.859 for visual functioning and 0.875 and 0.896 for appearance subscale, respectively. Mean quality of life (QOL) scores for visual functioning and appearance were 78.18 (standard deviation, SD, 21.57) and 56.25 (SD 26.87), respectively. Person reliabilities from the Rasch rating scale model for both visual functioning and appearance revealed an acceptable internal consistency for the Persian GO-QOL. The Persian GO-QOL questionnaire is a valid and reliable tool with good psychometric properties in evaluation of Persian-speaking patients with TED. Applying Rasch analysis to future versions of the GO-QOL is recommended in order to perform tests for linearity between the estimated item measures in different versions.
Validation of the Intelligibility in Context Scale for Jamaican Creole-Speaking Preschoolers.
Washington, Karla N; McDonald, Megan M; McLeod, Sharynne; Crowe, Kathryn; Devonish, Hubert
2017-08-15
To describe validation of the Intelligibility in Context Scale (ICS; McLeod, Harrison, & McCormack, 2012a) and ICS-Jamaican Creole (ICS-JC; McLeod, Harrison, & McCormack, 2012b) in a sample of typically developing 3- to 6-year-old Jamaicans. One-hundred and forty-five preschooler-parent dyads participated in the study. Parents completed the 7-item ICS (n = 145) and ICS-JC (n = 98) to rate children's speech intelligibility (5-point scale) across communication partners (parents, immediate family, extended family, friends, acquaintances, strangers). Preschoolers completed the Diagnostic Evaluation of Articulation and Phonology (DEAP; Dodd, Hua, Crosbie, Holm, & Ozanne, 2006) in English and Jamaican Creole to establish speech-sound competency. For this sample, we examined validity and reliability (interrater, test-rest, internal consistency) evidence using measures of speech-sound production: (a) percentage of consonants correct, (b) percentage of vowels correct, and (c) percentage of phonemes correct. ICS and ICS-JC ratings showed preschoolers were always (5) to usually (4) understood across communication partners (ICS, M = 4.43; ICS-JC, M = 4.50). Both tools demonstrated excellent internal consistency (α = .91), high interrater, and test-retest reliability. Significant correlations between the two tools and between each measure and language-specific percentage of consonants correct, percentage of vowels correct, and percentage of phonemes correct provided criterion-validity evidence. A positive correlation between the ICS and age further strengthened validity evidence for that measure. Both tools show promising evidence of reliability and validity in describing functional speech intelligibility for this group of typically developing Jamaican preschoolers.
García, Silvia M; González, Claudio; Rucci, Enzo; Ambrosino, Cintia; Vidal, Julia; Fantuzzi, Gabriel; Prestes, Mariana; Kronsbein, Peter
2018-06-05
Several instruments developed to assess dietary intake of groups or populations have strengths and weaknesses that affect their specific application. No self-administered, closed-ended dietary survey was previously used in Argentina to assess current food and nutrient intake on a daily basis. To design and validate a self-administered, structured food record (NutriQuid, NQ) representative of the adult Argentine population's food consumption pattern to measure individual energy and nutrient intake. Records were loaded onto a database using software that checks a regional nutrition information system (SARA program), automatically quantifying energy and nutrient intake. NQ validation included two phases: (1) NQ construct validity comparing records kept simultaneously by healthy volunteers (45-75 years) and a nutritionist who provided meals (reference), and (2) verification of whether NQ reflected target population consumption (calories and nutrients), week consumption differences, respondent acceptability, and ease of data entry/analysis. Data analysis included descriptive statistics, repeated measures ANOVA, intraclass correlation coefficient, nonparametric regression, and cross-classification into quintiles. The first validation (study group vs. reference) showed an underestimation (10%) of carbohydrate, fat, and energy intake. Second validation: 109 volunteers (91% response) completed the NQ for seven consecutive days. Record completion took about 9min/day, and data entry 3-6min. Mean calorie intake was 2240±119kcal/day (42% carbohydrates, 17% protein, and 41% fat). Intake significantly increased in the weekend. NQ is a simple and efficient tool to assess dietary intake in large samples. Copyright © 2018 SEEN y SED. Publicado por Elsevier España, S.L.U. All rights reserved.
Validation of Procedures for Monitoring Crewmember Immune Function
NASA Technical Reports Server (NTRS)
Pierson, Duane; Crucian, Brian; Mehta, Satish; Stowe, Raymond; Uchakin, Peter; Quiriarte, Heather; Sams, Clarence
2010-01-01
The objective of this Supplemental Medical Objective (SMO) is to determine the status of the immune system, physiological stress and latent viral reactivation (a clinical outcome that can be measured) during both short and long-duration spaceflight. In addition, this study will develop and validate an immune monitoring strategy consistent with operational flight requirements and constraints. Pre-mission, in-flight and post-flight blood and saliva samples will be obtained from participating crewmembers. Assays included peripheral immunophenotype, T cell function, cytokine profiles, viral-specific immunity, latent viral reactivation (EBV, CMV, VZV), and stress hormone measurements. To date, 18 short duration (now completed) and 8 long-duration crewmembers have completed the study. The long-duration phase of this study is ongoing. For this presentation, the final data set for the short duration subjects will be discussed.
Development and Initial Validation of the Adolescent Responses to Body Dissatisfaction Measure
ERIC Educational Resources Information Center
Maxwell, Melissa A.; Cole, David A.
2012-01-01
One community sample (N = 607) of youths generated self-reported responses to body dissatisfaction, from which the Adolescent Responses to Body Dissatisfaction (ARBD) inventory was constructed. A 2nd, similar sample (N = 830) completed this measure as well as measures of coping, body dissatisfaction, body mass index, depressive symptoms, and…
An implicit non-self-report measure of attitudes to speeding: development and validation.
Hatfield, Julie; Fernandes, Ralston; Faunce, Gavin; Job, R F Soames
2008-03-01
Speeding is a major contributor to road trauma and attitudes toward speeding are hypothesised to be a key determinant of the behaviour. Attitudinal research is limited by reliance on self-report measures and the attendant possibility of reporting biases. The Implicit Association Test (IAT) aims to measure attitudes without reliance on self-report, by assessing the association between a target-concept and an evaluation, in terms of reaction time for compatible versus non-compatible pairings. The present research aimed to develop and evaluate an IAT to measure attitudes to speeding. Forty-five licensed drivers completed the speed-related IAT, and drove a driving simulator. Participants also completed a questionnaire that assessed self-reported attitudes to speeding, and several variables theoretically related to attitudes, including speeding behaviour. Observed IAT results suggested that attitudes toward speeding are negative, and were generally consistent with results derived from the simulated driving and self-reported behaviours, beliefs, and attitudes. Thus, the speed-related IAT appears to be a valid measure of attitudes toward speeding, which might be used to measure attitudes in road safety research without reliance on self-report.
Validation of a novel virtual reality simulator for robotic surgery.
Schreuder, Henk W R; Persson, Jan E U; Wolswijk, Richard G H; Ihse, Ingmar; Schijven, Marlies P; Verheijen, René H M
2014-01-01
With the increase in robotic-assisted laparoscopic surgery there is a concomitant rising demand for training methods. The objective was to establish face and construct validity of a novel virtual reality simulator (dV-Trainer, Mimic Technologies, Seattle, WA) for the use in training of robot-assisted surgery. A comparative cohort study was performed. Participants (n = 42) were divided into three groups according to their robotic experience. To determine construct validity, participants performed three different exercises twice. Performance parameters were measured. To determine face validity, participants filled in a questionnaire after completion of the exercises. Experts outperformed novices in most of the measured parameters. The most discriminative parameters were "time to complete" and "economy of motion" (P < 0.001). The training capacity of the simulator was rated 4.6 ± 0.5 SD on a 5-point Likert scale. The realism of the simulator in general, visual graphics, movements of instruments, interaction with objects, and the depth perception were all rated as being realistic. The simulator is considered to be a very useful training tool for residents and medical specialist starting with robotic surgery. Face and construct validity for the dV-Trainer could be established. The virtual reality simulator is a useful tool for training robotic surgery.
Validity and cross-cultural adaptation of the persian version of the oxford elbow score.
Ebrahimzadeh, Mohammad H; Kachooei, Amir Reza; Vahedi, Ehsan; Moradi, Ali; Mashayekhi, Zeinab; Hallaj-Moghaddam, Mohammad; Azami, Mehran; Birjandinejad, Ali
2014-01-01
Oxford Elbow Score (OES) is a patient-reported questionnaire used to assess outcomes after elbow surgery. The aim of this study was to validate and adapt the OES into Persian language. After forward-backward translation of the OES into Persian, a total number of 92 patients after elbow surgeries completed the Persian OES along with the Persian DASH and SF-36. To assess test-retest reliability, 31 randomly selected patients (34%) completed the Persian OES again after three days while abstaining from all forms of therapeutic regimens. Reliability of the Persian OES was assessed by measuring intraclass correlation coefficient (ICC) for test-retest reliability and Cronbach's alpha for internal consistency. Spearman's correlation coefficient was used to test the construct validity. Cronbach's alpha coefficient was 0.92 showing excellent reliability. Cronbach's alpha for function, pain, and social-psychological subscales was 0.95, 0.86, and 0.85, respectively. Intraclass correlation coefficient (ICC) was 0.85 for the overall questionnaire and 0.90, 0.76, and 0.75 for function, pain, and social-psychological subscales, respectively. Construct validity was confirmed as the Spearman correlation between OES and DASH was 0.80. Persian OES is a valid and reliable patient-reported outcome measure to assess postsurgical elbow status in Persian speaking population.
McAllister, Marion; Wood, Alex M; Dunn, Graham; Shiloh, Shoshana; Todd, Chris
2012-02-01
Outcome measures are important assessment tools to evaluate clinical genetics services. Research suggests that perceived personal control (PPC) is an outcome valued by clinical genetics patients and clinicians. The PPC scale was developed in Hebrew to capture three dimensions of PPC: Cognitive, decisional, and behavioral control. This article reports on the first psychometric validation of the English translation of the PPC scale. Previous research has shown that the Hebrew and Dutch translations have good psychometric properties. However, the psychometric properties of the English translation have not been tested, and there is disagreement about the factor structure, with implications for how to score the measure. A total of 395 patients attending a clinical genetics appointment in the United Kingdom completed several measures at baseline, and a further 241 also completed measures at 2-4 weeks follow-up. The English language PPC has (a) a one-factor structure, (b) convergent validity with internal health locus of control (IHLC), satisfaction with life (SWL), depression, and authenticity, (c) high internal consistency (α = 0.83), and (d) sensitivity to change, being able to identify moderate changes in PPC following clinic attendance (Cohen's d = 0.40). These properties suggest the English language PPC measure is a useful tool for both clinical genetics research and for use as a Patient Reported Outcome Measure (PROM) in service evaluation. Copyright © 2011 Wiley Periodicals, Inc.
Greher, Michael R; Wodushek, Thomas R
2017-03-01
Performance validity testing refers to neuropsychologists' methodology for determining whether neuropsychological test performances completed in the course of an evaluation are valid (ie, the results of true neurocognitive function) or invalid (ie, overly impacted by the patient's effort/engagement in testing). This determination relies upon the use of either standalone tests designed for this sole purpose, or specific scores/indicators embedded within traditional neuropsychological measures that have demonstrated this utility. In response to a greater appreciation for the critical role that performance validity issues play in neuropsychological testing and the need to measure this variable to the best of our ability, the scientific base for performance validity testing has expanded greatly over the last 20 to 30 years. As such, the majority of current day neuropsychologists in the United States use a variety of measures for the purpose of performance validity testing as part of everyday forensic and clinical practice and address this issue directly in their evaluations. The following is the first article of a 2-part series that will address the evolution of performance validity testing in the field of neuropsychology, both in terms of the science as well as the clinical application of this measurement technique. The second article of this series will review performance validity tests in terms of methods for development of these measures, and maximizing of diagnostic accuracy.
Validation of the Abdominal Pain Index Using a Revised Scoring Method
Sherman, Amanda L.; Smith, Craig A.; Walker, Lynn S.
2015-01-01
Objective Evaluate the psychometric properties of child- and parent-report versions of the four-item Abdominal Pain Index (API) in children with functional abdominal pain (FAP) and healthy controls, using a revised scoring method that facilitates comparisons of scores across samples and time. Methods Pediatric patients aged 8–18 years with FAP and controls completed the API at baseline (N = 1,967); a subset of their parents (N = 290) completed the API regarding the child’s pain. Subsets of patients completed follow-up assessments at 2 weeks (N = 231), 3 months (N = 330), and 6 months (N = 107). Subsets of both patients (N = 389) and healthy controls (N = 172) completed a long-term follow-up assessment (mean age at follow-up = 20.21 years, SD = 3.75). Results The API demonstrated good concurrent, discriminant, and construct validity, as well as good internal consistency. Conclusion We conclude that the API, using the revised scoring method, is a useful, reliable, and valid measure of abdominal pain severity. PMID:25617048
Chavarria, Jesus; Rueger, Sandra Y; King, Andrea C
2018-04-16
Alcohol hangovers have been found to be a common and costly consequence of alcohol misuse. However, there is only limited psychometric support for instruments to accurately measure hangovers beyond the college-age years. This study investigated the psychometric properties of the Hangover Symptom Scale (HSS) and the Hangover Symptom Scale-Short Form (HSS-5) including the internal consistency, convergent and discriminant validity, construct validity, and the measurement invariance of these scales between light and heavy drinkers, individuals with a positive and negative family history of alcohol use disorder (AUD), and men and women in a post-college-aged sample. The association of the HSS and HSS-5 with alcohol use problems was also tested. Participants were 294 nonalcoholic light and heavy social drinkers (age range 21 to 35 years; 57.8% male) enrolled in the Chicago Social Drinking Project. They completed the HSS as part of a take-home packet completed outside of the laboratory. The psychometric properties of the HSS and HSS-5 were tested. Stronger psychometric support was found for the HSS-5 relative to the full HSS. While both measures demonstrated strong internal consistency reliability, convergent and discriminant validity, and an association with alcohol use problems, only the HSS-5 showed construct validity as determined by confirmatory factor analysis. Further, only the HSS-5 showed measurement invariance between men and women, light and heavy drinkers, and individuals with a positive and negative family history of AUD. This was the first study to examine the psychometric properties of the HSS and HSS-5 in a post-college-aged sample and the first to investigate the measurement invariance of these measures as a function of sex, drinking history, and family history of AUD. This study supports the use of the HSS-5 as a reliable and valid brief measure of frequency of hangover symptoms. Copyright © 2018 by the Research Society on Alcoholism.
Cook, Karon F; Jensen, Sally E; Schalet, Benjamin D; Beaumont, Jennifer L; Amtmann, Dagmar; Czajkowski, Susan; Dewalt, Darren A; Fries, James F; Pilkonis, Paul A; Reeve, Bryce B; Stone, Arthur A; Weinfurt, Kevin P; Cella, David
2016-05-01
To present an overview of a series of studies in which the clinical validity of the National Institutes of Health's Patient Reported Outcome Measurement Information System (NIH; PROMIS) measures was evaluated, by domain, across six clinical populations. Approximately 1,500 individuals at baseline and 1,300 at follow-up completed PROMIS measures. The analyses reported in this issue were conducted post hoc, pooling data across six previous studies, and accommodating the different designs of the six, within-condition, parent studies. Changes in T-scores, standardized response means, and effect sizes were calculated in each study. When a parent study design allowed, known groups validity was calculated using a linear mixed model. The results provide substantial support for the clinical validity of nine PROMIS measures in a range of chronic conditions. The cross-condition focus of the analyses provided a unique and multifaceted perspective on how PROMIS measures function in "real-world" clinical settings and provides external anchors that can support comparative effectiveness research. The current body of clinical validity evidence for the nine PROMIS measures indicates the success of NIH PROMIS in developing measures that are effective across a range of chronic conditions. Copyright © 2016 Elsevier Inc. All rights reserved.
NASA Technical Reports Server (NTRS)
Tai, H.; Wilson, J. W.; Maiden, D. L.
2003-01-01
The atmospheric ionizing radiation (AIR) ER-2 preflight analysis, one of the first attempts to obtain a relatively complete measurement set of the high-altitude radiation level environment, is described in this paper. The primary thrust is to characterize the atmospheric radiation and to define dose levels at high-altitude flight. A secondary thrust is to develop and validate dosimetric techniques and monitoring devices for protecting aircrews. With a few chosen routes, we can measure the experimental results and validate the AIR model predictions. Eventually, as more measurements are made, we gain more understanding about the hazardous radiation environment and acquire more confidence in the prediction models.
Connelly, Mark; Rapoff, Michael A
2006-08-01
To evaluate the reliability and validity of a commonly used measure of health-related quality of life (HRQOL), the Pediatric Quality of Life Inventory (PedsQL 4.0), in a sample of children with a recurrent headache syndrome. Participants were 40 children aged 7-12 who completed measures of HRQOL, headache-related disability, and headache activity during a baseline period and following a self-directed cognitive-behavioral intervention. The data are supportive of the reliability (internal consistency and test-retest) and validity (criterion related, convergent, known-groups, and responsiveness to intervention) of the PedsQL 4.0 within a pediatric headache sample. We conclude that the PedsQL 4.0 is a reliable and valid measure of HRQOL in children with recurrent headache and captures important information not routinely evaluated in chronic pain populations.
Development of a measure of informed choice suitable for use in low literacy populations.
Dormandy, Elizabeth; Tsui, Elaine Y L; Marteau, Theresa M
2007-06-01
To assess the reliability and validity of a simplified questionnaire-based measure of informed choice in populations with low literacy. The measure comprises (a) knowledge about the test and (b) attitudes towards undergoing the test. Responses to (a) and (b) together with information on test uptake, are used to classify choices as informed or uninformed. A cross-sectional study of 79 pregnant women (46 women with higher, and 33 with lower education levels) completed a simplified questionnaire, a standardised questionnaire and a semi-structured interview about antenatal sickle cell and thalassaemia (SCT) screening. The measures used were: (a) informed choice, based on knowledge about the test, attitudes towards undergoing the test, and uptake of the test and (b) ease of completion measures. The simplified measures of knowledge and attitudes were able to distinguish between women classified according to interview responses as having good or poor knowledge (knowledge scores 6.8 versus 3.2, p<0.001), and positive or negative attitudes towards undergoing the test (attitude scores 20.6 versus 16.2, p=0.023). There was no difference in rates of informed choice derived from the simplified or standardised measures (54% versus 51%, 95% CI difference -11 to 19). Women with lower levels of education found the simplified questionnaire easier to complete than the standardised version (11.0 versus 9.6, p=0.009). Those with higher levels of education found no difference in ease of completion between the two versions of the questionnaire (11.8 versus 11.6, p=0.54). A simplified questionnaire-based measure of informed choice in antenatal SCT screening is as reliable and valid as a more complex standardised version and for those with less education, easier to complete. The simplified questionnaire-based measure of informed choice is suitable for use in populations with low and high levels of education.
Reliability and Validity of a Q-Sort Measure of Attachment Security in Hispanic Infants.
ERIC Educational Resources Information Center
Busch-Rossnagel, Nancy A.; And Others
1994-01-01
A set of Q-sort items to assess individual differences in infant-mother attachment was adapted for a Hispanic population of low-SES background. Completion of the Q-sort by observers and inner-city Hispanic mothers and testing of 43 infants with the Ainsworth Strange Situation established the Q-set's validity and indicated moderate reliability for…
ERIC Educational Resources Information Center
Lee, Yuri; Oh, Kyung Ja
2012-01-01
This study aimed to examine the validity of reasons for living (RFL) and the protective role they may play against suicidal ideation in college students in South Korea. A total of 277 undergraduate students participated by completing the College Student Reasons for Living Inventory (CS-RFL), along with measures of suicide risk including…
Concurrent Validity of LibQUAL+[TM] Scores: What Do LibQUAL+[TM] Scores Measure?
ERIC Educational Resources Information Center
Thompson, Bruce; Cook, Colleen; Kyrillidou, Martha
2005-01-01
The present study investigated the validity of LibQUAL+[TM] scores, and specifically how total and subscale LibQUAL+[TM] scores are associated with self-reported, library-related satisfaction and outcomes scores. Participants included 88,664 students and faculty who completed the American English (n[AE] = 69,494) or the British English (n[BE] =…
Further Validation of the Psychosocial Costs of Racism to Whites Scale among Employed Adults
ERIC Educational Resources Information Center
Poteat, V. Paul; Spanierman, Lisa B.
2008-01-01
To examine the validity and test the generalizability of the Psychosocial Costs of Racism to Whites Scale (PCRW) beyond the original college student sample, a geographically dispersed sample of employed White adults (N = 284) in eight states completed the measure to assess for White empathic reactions toward racism, White guilt, and White fear of…
The real relationship inventory: development and psychometric investigation of the client form.
Kelley, Frances A; Gelso, Charles J; Fuertes, Jairo N; Marmarosh, Cheri; Lanier, Stacey Holmes
2010-12-01
The development and validation of a client version of the Real Relationship Inventory (RRI-C) is reported. Using a sample of clients (n = 94) who were currently in psychotherapy, a 24-item measure was developed consisting of two subscales (Realism and Genuineness) and a total score. This 24-item version and other measures used for validation were completed by 93 additional clients. Results of the present study offer initial support for the validity and reliability of the RRI-C. The RRI-C correlated significantly in theoretically expected ways with measures of the client-rated working alliance and therapists' congruence, clients' observing ego, and client ratings of client and therapist real relationship on an earlier measure of the real relationship (Eugster & Wampold, 1996). A nonsignificant relation was found between the RRI-C and a measure of social desirability, providing support for discriminant validity. A confirmatory factor analysis supported the two theorized factors of the RRI-C. The authors discuss the importance of measuring clients' perceptions of the real relationship. (PsycINFO Database Record (c) 2010 APA, all rights reserved).
NASA Astrophysics Data System (ADS)
Adams, Elizabeth L.; Carrier, Sarah J.; Minogue, James; Porter, Stephen R.; McEachin, Andrew; Walkowiak, Temple A.; Zulli, Rebecca A.
2017-02-01
The Instructional Practices Log in Science (IPL-S) is a daily teacher log developed for K-5 teachers to self-report their science instruction. The items on the IPL-S are grouped into scales measuring five dimensions of science instruction: Low-level Sense-making, High-level Sense-making, Communication, Integrated Practices, and Basic Practices. As part of the current validation study, 206 elementary teachers completed 4137 daily log entries. The purpose of this paper is to provide evidence of validity for the IPL-S's scales, including (a) support for the theoretical framework; (b) cognitive interviews with logging teachers; (c) item descriptive statistics; (d) comparisons of 28 pairs of teacher and rater logs; and (e) an examination of the internal structure of the IPL-S. We present evidence to describe the extent to which the items and the scales are completed accurately by teachers and differentiate various types of science instructional strategies employed by teachers. Finally, we point to several practical implications of our work and potential uses for the IPL-S. Overall, results provide neutral to positive support for the validity of the groupings of items or scales.
Compelled to consume: the Implicit Association Test and automatic alcohol motivation.
Ostafin, Brian D; Palfai, Tibor P
2006-09-01
The Implicit Association Test (IAT; A. G. Greenwald, D. E. McGhee, & J. L. K. Schwartz, 1998) has recently been used to assess the role of alcohol-affect associations in drinking behavior. The current study examined the validity of an alcohol IAT with 88 hazardous-drinking college students who completed measures of drinking behavior, an explicit measure of alcohol motivation, and an IAT that assessed alcohol-motivation associations. Regression analyses indicated that IAT scores correlated with binge drinking and cue reactivity, replicating T. P. Palfai and B. D. Ostafin's (2003) results. Results also indicated convergent validity (the IAT was related to an explicit measure of alcohol motivation) and incremental validity (IAT scores were correlated with alcohol behavior after controlling for the explicit measure). Implications for understanding the self-regulation of drinking are discussed. ((c) 2006 APA, all rights reserved).
Shea, Beverley J; Hamel, Candyce; Wells, George A; Bouter, Lex M; Kristjansson, Elizabeth; Grimshaw, Jeremy; Henry, David A; Boers, Maarten
2009-10-01
Our purpose was to measure the agreement, reliability, construct validity, and feasibility of a measurement tool to assess systematic reviews (AMSTAR). We randomly selected 30 systematic reviews from a database. Each was assessed by two reviewers using: (1) the enhanced quality assessment questionnaire (Overview of Quality Assessment Questionnaire [OQAQ]); (2) Sacks' instrument; and (3) our newly developed measurement tool (AMSTAR). We report on reliability (interobserver kappas of the 11 AMSTAR items), intraclass correlation coefficients (ICCs) of the sum scores, construct validity (ICCs of the sum scores of AMSTAR compared with those of other instruments), and completion times. The interrater agreement of the individual items of AMSTAR was substantial with a mean kappa of 0.70 (95% confidence interval [CI]: 0.57, 0.83) (range: 0.38-1.0). Kappas recorded for the other instruments were 0.63 (95% CI: 0.38, 0.78) for enhanced OQAQ and 0.40 (95% CI: 0.29, 0.50) for the Sacks' instrument. The ICC of the total score for AMSTAR was 0.84 (95% CI: 0.65, 0.92) compared with 0.91 (95% CI: 0.82, 0.96) for OQAQ and 0.86 (95% CI: 0.71, 0.94) for the Sacks' instrument. AMSTAR proved easy to apply, each review taking about 15 minutes to complete. AMSTAR has good agreement, reliability, construct validity, and feasibility. These findings need confirmation by a broader range of assessors and a more diverse range of reviews.
Wei, Wei; Taormina, Robert J
2014-12-01
This study refined the concept of resilience and developed four valid and reliable subscales to measure resilience, namely, Determination, Endurance, Adaptability and Recuperability. The study also assessed their hypothesized relationships with six antecedent variables (worry, physiological needs satisfaction, organizational socialization, conscientiousness, future orientation and Chinese values) and with one outcome variable (nurses' career success). The four new 10-item subscale measures of personal resilience were constructed based on their operational definitions and tested for their validity and reliability. All items were included in a questionnaire completed by 244 full-time nurses at two hospitals in China. All four measures demonstrated concurrent validity and had high reliabilities (from 0.74 to 0.78). The hypothesized correlations with the personality and organizational variables were statistically significant and in the predicted directions. Regression analyses confirmed these relationships, which explained 25-32% of the variance for the four resilience facets and 27% of the variance for the nurses' career success. The results provided strong evidence that organizational socialization facilitates resilience, that resilience engenders career success and that identifying the four resilience facets permits a more complete understanding of personal resilience, which could benefit nurses, help nurse administrators with their work and also help in treating patients. © 2014 John Wiley & Sons Ltd.
Crosby, Richard A; Sanders, Stephanie A; Graham, Cynthia A; Milhausen, Robin; Yarber, William L; Mena, Leandro
2017-02-01
Reliable and valid scale measures of barriers to condom use are not available for young black men who have sex with men (YBMSM). The purpose of this study was to evaluate the Condom Barriers Scales for application with YBMSM. A clinic-based sample of 600 YBMSM completed a computer-assisted self-interview. The primary measure was a 14-item abbreviated version of the Condom Barriers Scale. Reliability and criterion validity were assessed. All 3 subscales were reliable: partner-related barriers (Cronbach α=0.73), sensation-related barriers (α=0.70), and motivation-related barriers (α =0.81). A complete absence of barriers was common: 47.0% (partner-related), 30.7% (sensation-related), and 46.5% (motivation-related). Dichotomized subscales were significantly associated with reporting any condomless insertive anal sex (all Ps < 0.001) and any condomless receptive anal sex (all Ps < 0.001). The subscales were significantly associated with these measures of condomless sex preserved at a continuous level (all Ps <0.001, except for sensation barriers associated with condomless receptive anal sex = 0.03). Further, the subscales were significantly associated with reporting any condom use problems (all Ps <0.001) and a measure of condomless oral sex (all Ps <0.001, except for partner-related barriers=0.31). Finally, the sensation-related barriers subscale was significantly associated with testing positive for Chlamydia and/or gonorrhea (P=0.049). The 3 identified subscales yielded adequate reliability and strong evidence of validity, thereby suggesting the utility of these brief measures for use in observational and experimental research with YBMSM.
Crosby, Richard; Sanders, Stephanie A.; Graham, Cynthia A.; Milhausen, Robin; Yarber, William L.; Mena, Leandro
2016-01-01
Background Reliable and valid scale measures of barriers to condom use are not available for young Black MSM (YBMSM). The purpose of this study was to evaluate the Condom Barriers Scales for application with YBMSM. Methods A clinic-based sample of 600 YBMSM completed a computer-assisted self-interview. The primary measure was a 14-item abbreviated version of the Condom Barriers Scale. Reliability and criterion validity were assessed. Results All three sub-scales were reliable: partner-related barriers (Cronbach’s alpha=.73), sensation-related barriers (alpha=.70), and motivation-related barriers (alpha=.81). A complete absence of barriers was common: 47.0% (partner-related), 30.7% (sensation-related), and 46.5% (motivation-related). Dichotomized sub-scales were significantly associated with reporting any condomless insertive anal sex (all=P < .001) and any condomless receptive anal sex (all=P < .001). The sub-scales were significantly associated with these measures of condomless sex preserved at a continuous level (all=P <.001, except for sensation barriers associated with condomless receptive anal sex =.03). Further, the sub-scales were significantly associated with reporting any condom use problems (all =P <.001) and a measure of condomless oral sex (all =P <.001, except for partner-related barriers =.31). Finally, the sensation-related barriers sub-scale was significantly associated with testing positive for Chlamydia and/or gonorrhea (P=.049). Conclusions The three identified sub-scales yielded adequate reliability and strong evidence of validity, thereby suggesting the utility of these brief measures for use in observational and experimental research with YBMSM. PMID:28081044
Brown, Heidi Wendell; Wise, Meg E.; Westenberg, Danielle; Schmuhl, Nicholas B.; Brezoczky, Kelly Lewis; Rogers, Rebecca G.; Constantine, Melissa L.
2017-01-01
Introduction and hypothesis Fewer than 30% of women with accidental bowel leakage (ABL) seek care, despite the existence of effective, minimally invasive therapies. We developed and validated a condition-specific instrument to assess barriers to care-seeking for ABL in women. Methods Adult women with ABL completed an electronic survey about condition severity, patient activation, previous care-seeking, and demographics. The Barriers to Care-seeking for Accidental Bowel Leakage (BCABL) instrument contained 42 potential items completed at baseline and again 2 weeks later. Paired t tests evaluated test–retest reliability. Factor analysis evaluated factor structure and guided item retention. Cronbach’s alpha evaluated internal consistency. Within and across factor item means generated a summary BCABL score used to evaluate scale validity with six external criterion measures. Results Among 1,677 click-throughs, 736 (44%) entered the survey; 95% of eligible female respondents (427 out of 458) provided complete data. Fifty-three percent of respondents had previously sought care for their ABL; median age was 62 years (range 27–89); mean Vaizey score was 12.8 (SD = 5.0), indicating moderate to severe ABL. Test–retest reliability was excellent for all items. Factor extraction via oblique rotation resulted in the final structure of 16 items in six domains, within which internal consistency was high. All six external criterion measures correlated significantly with BCABL score. Conclusions The BCABL questionnaire, with 16 items mapping to six domains, has excellent criterion validity and test–retest reliability when administered electronically in women with ABL. The BCABL can be used to identify care-seeking barriers for ABL in different populations, inform targeted interventions, and measure their effectiveness. PMID:28236039
Evidence of Validity for the Japanese Version of the Foot and Ankle Ability Measure
Uematsu, Daisuke; Suzuki, Hidetomo; Sasaki, Shogo; Nagano, Yasuharu; Shinozuka, Nobuyuki; Sunagawa, Norihiko; Fukubayashi, Toru
2015-01-01
Context: The Foot and Ankle Ability Measure (FAAM) is a valid, reliable, and self-reported outcome instrument for the foot and ankle region. Objective: To provide evidence for translation, cross-cultural adaptation, validity, and reliability of the Japanese version of the FAAM (FAAM-J). Design: Cross-sectional study. Setting: Collegiate athletic training/sports medicine clinical setting. Patients or Other Participants: Eighty-three collegiate athletes. Main Outcome Measure(s): All participants completed the Activities of Daily Living and Sports subscales of the FAAM-J and the Physical Functioning and Mental Health subscales of the Japanese version of the Short Form-36v2 (SF-36). Also, 19 participants (23%) whose conditions were expected to be stable completed another FAAM-J 2 to 6 days later for test-retest reliability. We analyzed the scores of those subscales for convergent and divergent validity, internal consistency, and test-retest reliability. Results: The Activities of Daily Living and Sports subscales of the FAAM-J had correlation coefficients of 0.86 and 0.75, respectively, with the Physical Functioning section of the SF-36 for convergent validity. For divergent validity, the correlation coefficients with Mental Health of the SF-36 were 0.29 and 0.27 for each subscale, respectively. Cronbach α for internal consistency was 0.99 for the Activities of Daily Living and 0.98 for the Sports subscale. A 95% confidence interval with a single measure was ±8.1 and ±14.0 points for each subscale. The test-retest reliability measures revealed intraclass correlation coefficient values of 0.87 for the Activities of Daily Living and 0.91 for the Sports subscales with minimal detectable changes of ±6.8 and ±13.7 for the respective subscales. Conclusions: The FAAM was successfully translated for a Japanese version, and the FAAM-J was adapted cross-culturally. Thus, the FAAM-J can be used as a self-reported outcome measure for Japanese-speaking individuals; however, the scores must be interpreted with caution, especially when applied to different populations and other types of injury than those included in this study. PMID:25310247
Rosmalen, J G M; Bos, E H; de Jonge, P
2012-12-01
Stress questionnaires are included in many epidemiological cohort studies but the psychometric characteristics of these questionnaires are largely unknown. The aim of this study was to describe these characteristics for two short questionnaires measuring the lifetime and past year occurrence of stress: the List of Threatening Events (LTE) as a measure of acute stress and the Long-term Difficulties Inventory (LDI) as a measure of chronic stress. This study was performed in a general population cohort consisting of 588 females (53.7%) and 506 males (46.3%), with a mean age of 53.5 years (s.d.=11.3 years). Respondents completed the LTE and the LDI for the past year, and for the age categories of 0-12, 13-18, 19-39, 40-60, and >60 years. They also completed questionnaires on perceived stress, psychological distress (the General Health Questionnaire, GHQ-12), anxiety and depression (the Symptom Checklist, SCL-8) and neuroticism (the Eysenck Personality Questionnaire - Revised Short Scale, EPQ-RSS-N). Approximately 2 years later, 976 respondents (89%) completed these questionnaires for a second time. The stability of the retrospective reporting of long-term difficulties and life events was satisfactory: 0.7 for the lifetime LDI and 0.6 for the lifetime LTE scores. The construct validity of these lists is indicated by their positive associations with psychological distress, mental health problems and neuroticism. This study in a large population-based sample shows that the LDI and LTE have sufficient validity and stability to include them in major epidemiological cohort studies.
Validation of the Modified Fatigue Impact Scale in Parkinson's disease.
Schiehser, Dawn M; Ayers, Catherine R; Liu, Lin; Lessig, Stephanie; Song, David S; Filoteo, J Vincent
2013-03-01
Fatigue is a common symptom in Parkinson's disease (PD); however, a multidimensional scale that measures the impact of fatigue on functioning has yet to be validated in this population. The aim of this study was to examine the validity of the Modified Fatigue Impact Scale (MFIS), a self-report measure that assesses the effects of fatigue on physical, cognitive, and psychosocial functioning, in a sample of nondemented PD patients. PD patients (N = 100) completed the MFIS, the Positive and Negative Affect Schedule (PANAS-X), and several additional measures of psychosocial, cognitive, and motor functioning. A Principal Component Analysis (PCA) and item analysis using Cronbach's alpha were conducted to determine structural validity and internal consistency of the MFIS. Correlational analyses were performed between the MFIS and the PANAS-X fatigue subscale to evaluate convergent validity and between the MFIS and measures of depression, anxiety, apathy, and disease-related symptoms to determine divergent validity. The PCA identified two viable MFIS subscales: a cognitive subscale and a combination of the original scale's physical and psychosocial subscales as one factor. Item analysis revealed high internal consistency of all 21 items and the items within the two subscales. The MFIS had strong convergent validity with the PANAS-X fatigue subscale and adequate divergent validity with measures of disease stage, motor function, and cognition. Overall, this study demonstrates that the MFIS is a valid multidimensional measure that can be used to evaluate the impact of fatigue on cognitive and physical/social functioning in PD patients without dementia. Published by Elsevier Ltd.
Barker, Matthew D; Purdy, Suzanne C
2016-01-01
This research investigates a novel method for identifying and measuring school-aged children with poor auditory processing through a tablet computer. Feasibility and test-retest reliability are investigated by examining the percentage of Group 1 participants able to complete the tasks and developmental effects on performance. Concurrent validity was investigated against traditional tests of auditory processing using Group 2. There were 847 students aged 5 to 13 years in group 1, and 46 aged 5 to 14 years in group 2. Some tasks could not be completed by the youngest participants. Significant correlations were found between results of most auditory processing areas assessed by the Feather Squadron test and traditional auditory processing tests. Test-retest comparisons indicated good reliability for most of the Feather Squadron assessments and some of the traditional tests. The results indicate the Feather Squadron assessment is a time-efficient, feasible, concurrently valid, and reliable approach for measuring auditory processing in school-aged children. Clinically, this may be a useful option for audiologists when performing auditory processing assessments as it is a relatively fast, engaging, and easy way to assess auditory processing abilities. Research is needed to investigate further the construct validity of this new assessment by examining the association between performance on Feather Squadron and objective evoked potential, lesion studies, and/or functional imaging measures of auditory function.
Language-based Measures of Mindfulness: Initial Validity and Clinical Utility
Collins, Susan E.; Chawla, Neharika; Hsu, Sharon H.; Grow, Joel; Otto, Jacqueline M.; Marlatt, G. Alan
2009-01-01
This study examined relationships among language use, mindfulness, and substance-use treatment outcomes in the context of an efficacy trial of mindfulness-based relapse prevention (MBRP) for adults with alcohol and other drug use (AOD) disorders (see Bowen, Chawla, Collins et al., in press). An expert panel generated two categories of mindfulness language (ML) describing the mindfulness state and the more encompassing “mindfulness journey,” which included words describing challenges of developing a mindfulness practice. MBRP participants (n=48) completed baseline sociodemographic and AOD measures, and participated in the 8-week MBRP program. AOD data were collected during the 4-month follow-up. A word count program assessed the frequency of ML and other linguistic markers in participants’ responses to open-ended questions about their postintervention impressions of mindfulness practice and MBRP. Findings supported concurrent validity of ML categories: ML words appeared more frequently in the MBRP manual compared to the 12-step Big Book. Further, ML categories correlated with other linguistic variables related to the mindfulness construct. Finally, predictive validity was supported: greater use of ML predicted fewer AOD use days during the 4-month follow-up. This study provided initial support for ML as a valid, clinically useful mindfulness measure. If future studies replicate these findings, ML could be used in conjunction with self-report to provide a more complete picture of the mindfulness experience. PMID:20025383
ERIC Educational Resources Information Center
Hoppe, Carl F.; Loevinger, Jane
1977-01-01
Self and peer evaluations and experimental measures of conformity were given to 107 adolescent private school boys. Student discipline records also indicated the number of demerits. The self-report measures and the demerits showed maximum conformity between the self-protective and conscientious ego stages as measured by the Sentence Completion…
A Multicomponent Measure of Writing Motivation with Basic College Writers
ERIC Educational Resources Information Center
MacArthur, Charles A.; Philippakos, Zoi A.; Graham, Steve
2016-01-01
The purpose of the current study was to develop and validate a measure of motivation for use with basic college writers that would measure self-efficacy, achievement goals, beliefs, and affect. As part of a design research project on curriculum for community college developmental writing classes, 133 students in 11 classes completed the motivation…
Fox, Benjamin; Henwood, Timothy; Keogh, Justin; Neville, Christine
2016-08-01
Confidence in findings can only be drawn from measurement tools that have sound psychometric properties for the population with which they are used. Within a dementia specific population, measures of physical function have been poorly justified in exercise intervention studies, with justification of measures based on validity or reliability studies from dissimilar clinical populations, such as people with bronchitis or healthy older adults without dementia. To review the reliability and validity of quantitative measures of pre-identified physical function, as commonly used within exercise intervention literature for adults with dementia. Participants were adults, aged 65 years and older, with a confirmed medical diagnosis of dementia. n/a Desired studies were observational and cross-sectional and that assessed measures from a pre-identified list of measures of physical function. Studies that assessed the psychometric constructs of reliability and validity were targeted. COSMIN taxology was used to define reliability and validity. This included, but were not limited to, Intra-Class Correlations, Kappa, Cronbach's Alpha, Chi Squared, Standard Error of Measurement, Minimal Detectable Change and Limits of Agreement. Published material was sourced from the following four databases: MEDLINE, EMBASE, CINAHL and ISI Web of Science. Grey literature was searched for using ALOIS, Google Scholar and ProQuest. The COSMIN checklist was used to assess methodological quality of included studies. Assessment was completed by two reviewers independently. Reliability and validity data was extracted from included studies using standardized Joanna Briggs Institute data collection forms. Extraction was completed by two reviewers. A narrative synthesis of measurement properties of the tools used to measure physical function was performed. Quantitative meta-analysis was conducted for Intra-Class Correlation Coefficients only. With respect to relative reliability, studies reporting assessed measures had intraclass correlation coefficients greater than 0.71, indicating their suitability for use at a group level. However, a consistent finding among studies that included assessment of absolute reliability was that intra individual variation was too large for meaningful measurement of individuals. This was indicated by large Minimal Detectable Change (MDC) scores. Walk Speed has the smallest reported Mimimal Detectable Change score at 0.11m/s. This represented a change of 35% before statistical variation could be eliminated as the cause for this change. All measures had large MDC values. Walk Speed had the smallest MDC values at 0.11m/s, which represented a necessary change of 35%. Only a limited number of studies assessed the validity of measures. This supports the use of these measures in a very narrow selection of circumstances (see Summary of Findings). In summary, measures have shown appropriate levels of relative reliability. This supports their use at the group level. However, large levels of intra-individual variation undermine their applicability at the individual level. Limited studies of validity were available to this review, which limits a conclusion on whether measures are valid for people with dementia.
Uggioni, Paula Lazzarin; Salay, Elisabete
2012-04-01
Validated and reliable instruments for measuring consumer attitudes regarding food quality certifications are lacking, but the measurement of consumer attitude could be an important tool for understanding consumer behavior. Thus the objective of this study was to develop an instrument for measuring consumer attitudes regarding private food safety certifications for commercial restaurants. To this end, the following steps were carried out: development of the interview items; complete pilot testing; item analyses (influence of social desirability and total-item correlation); reliability test (internal consistency and test-retest); and validity assessment (content and discriminative validity and exploratory and confirmatory factor analysis). The subjects, all over the age of 18 and drawn from six non-probabilistic samples (n=7-350) in the city of Campinas, Brazil, were all subjected to an interview. The final scale included 24 items and had a Cronbach's alpha coefficient of 0.79 and a content validation coefficient of 0.99, both within acceptable limits. The confirmatory factor analysis validated a model with five factors and the final instrument discriminated reasonably well between the groups and showed satisfactory reproducibility (r=0.955). Furthermore, the scale validity and reliability were satisfactory, suggesting it could also be applied to future studies. Copyright © 2011 Elsevier Ltd. All rights reserved.
de Groot, Janke F.; Backx, Frank J.G.; Benner, Joyce; Kruitwagen, Cas L.J.J.; Takken, Tim
2017-01-01
Abstract Background Testing aerobic fitness in youth is important because of expected relationships with health. Objective The purpose of the study was to estimate the validity and reliability of the Shuttle Ride Test in youth who have spina bifida and use a wheelchair for mobility and sport. Design Ths study is a validity and reliability study. Methods The Shuttle Ride Test, Graded Wheelchair Propulsion Test, and skill-related fitness tests were administered to 33 participants for the validity study (age = 14.5 ± 3.1 y) and to 28 participants for the reliability study (age = 14.7 ± 3.3 y). Results No significant differences were found between the Graded Wheelchair Propulsion Test and the Shuttle Ride Test for most cardiorespiratory responses. Correlations between the Graded Wheelchair Propulsion Test and the Shuttle Ride Test were moderate to high (r = .55–.97). The variance in peak oxygen uptake (VO2peak) could be predicted for 77% of the participants by height, number of shuttles completed, and weight, with large prediction intervals. High correlations were found between number of shuttles completed and skill-related fitness tests (CI = .73 to −.92). Intraclass correlation coefficients were high (.77–.98), with a smallest detectable change of 1.5 for number of shuttles completed and with coefficients of variation of 6.2% and 6.4% for absolute VO2peak and relative VO2peak, respectively. Conclusions When measuring VO2peak directly by using a mobile gas analysis system, the Shuttle Ride Test is highly valid for testing VO2peak in youth who have spina bifida and use a wheelchair for mobility and sport. The outcome measure of number of shuttles represents aerobic fitness and is also highly correlated with both anaerobic performance and agility. It is not possible to predict VO2peak accurately by using the number of shuttles completed. Moreover, the Shuttle Ride Test is highly reliable in youth with spina bifida, with a good smallest detectable change for the number of shuttles completed. PMID:29029556
Denning, John Henry
2014-01-01
Validity measures derived from the Test of Memory Malingering Trial 1 (TOMM1) and errors across the first 10 items of TOMM1 (TOMMe10) may be further enhanced by combining these scores with "embedded" behavioral responses while patients complete these measures. In a sample of nondemented veterans (n = 151), five possible behavioral responses observed during completion of the first 10 items of the TOMM were combined with TOMM1 and TOMMe10 to assess any increased sensitivity in predicting Medical Symptom Validity Test (MSVT) performance. Both TOMM1 and TOMMe10 alone were highly accurate overall in predicting MSVT performance (TOMM1 [area under the curve (AUC)] = .95, TOMMe10 [AUC] = .92). The combination of TOMM measures and behavioral responses did not increase overall accuracy rates; however, when specificity was held at approximately 90%, there was a slight increase in sensitivity (+7%) for both TOMM measures when combined with the number of "point and name" responses. Examples are provided demonstrating that at a given TOMM score (TOMM1 or TOMMe10), with an increase in "point and name" responses, there is an incremental increase in the probability of failing the MSVT. Exploring the utility of combining freestanding or embedded validity measures with behavioral features during test administration should be encouraged.
Dysphagia in Multiple Sclerosis: Evaluation and Validation of the DYMUS Questionnaire.
Alali, Dalal; Ballard, Kirrie; Vucic, Steve; Bogaardt, Hans
2018-06-01
The 10-item Dysphagia in Multiple Sclerosis (DYMUS) questionnaire is a self-administered tool used to identify swallowing problems in adults with MS. The questionnaire was not validated against other existing questionnaires to assess its convergent validity. Moreover, its test-retest reliability was not measured previously. Therefore, the purpose of this study was to assess the factor analysis, internal consistency and test-retest reliability of the DYMUS, as well as its convergent validity against an established and validated questionnaire, the EAT-10. English-speaking adults with MS in New South Wales, Australia who were seen for routine medical check-ups were invited to complete two questionnaires across two phases. One hundred participants completed phase 1, while 55 completed phase 2. Statistical analyses were performed to investigate the psychometric properties of the DYMUS questionnaire. Internal consistency (Cronbach's Alpha) reduced the DYMUS questionnaire from ten to five items. The shortened version of the DYMUS showed high internal consistency (alpha = 0.904). It also showed satisfactory reproducibility, and adequate correlation with the 10-item Eating Assessment Tool (EAT-10). Evaluation of the DYMUS resulted in a shortened version of the questionnaire with five questions related to dysphagia. This shortened version is considered an easy and useful tool in identifying patients with MS-related dysphagia.
Bell, Vaughan
2017-01-01
Background The experience of ‘sensed presence’—a feeling or sense that another entity, individual or being is present despite no clear sensory or perceptual evidence—is known to occur in the general population, appears more frequently in religious or spiritual contexts, and seems to be prominent in certain psychiatric or neurological conditions and may reflect specific functions of social cognition or body-image representation systems in the brain. Previous research has relied on ad-hoc measures of the experience and no specific psychometric scale to measure the experience exists to date. Methods Based on phenomenological description in the literature, we created the 16-item Sensed Presence Questionnaire (SenPQ). We recruited participants from (i) a general population sample, and; (ii) a sample including specific selection for religious affiliation, to complete the SenPQ and additional measures of well-being, schizotypy, social anxiety, social imagery, and spiritual experience. We completed an analysis to test internal reliability, the ability of the SenPQ to distinguish between religious and non-religious participants, and whether the SenPQ was specifically related to positive schizotypical experiences and social imagery. A factor analysis was also conducted to examine underlying latent variables. Results The SenPQ was found to be reliable and valid, with religious participants significantly endorsing more items than non-religious participants, and the scale showing a selective relationship with construct relevant measures. Principal components analysis indicates two potential underlying factors interpreted as reflecting ‘benign’ and ‘malign’ sensed presence experiences. Discussion The SenPQ appears to be a reliable and valid measure of sensed presence experience although further validation in neurological and psychiatric conditions is warranted. PMID:28367379
Perfectionism and the Five-Factor Model of Personality
ERIC Educational Resources Information Center
Rice, Kenneth G.; Ashby, Jeffrey S.; Slaney, Robert B.
2007-01-01
In this study of the discriminant, convergent, and incremental validity of the Almost Perfect Scale-Revised (APS-R), university students completed the APS-R, additional measures of perfectionism, the NEO Five-Factor Inventory-Form S, and measures of self-esteem and depression. The results revealed expected significant, but not completely…
Structural Integrity in Measures of Self Concept.
ERIC Educational Resources Information Center
Stenner, A. Jackson; Katzenmeyer, W.G.
Structural integrity of a measure is defined in terms of its replicability, constancy, invariance, and stability. Work completed in the development and validation of the Self Observation Scales (SOS) Primary Level (Stenner and Katzenmeyer, 1973) serves to illustrate one method of establishing structural integrity. The name of each scale of the SOS…
A Prospective Investigation of Suicidal Ideation in College Students: A Test of a Model.
ERIC Educational Resources Information Center
Bonner, Ronald L.; Rich, Alexander R.
1988-01-01
Tested predictive validity of stress-vulnerability model of suicide ideation and behavior. Undergraduates completed measures of social/emotional alienation, adaptive resources for living, and cognitive rigidity at beginning of semester. Measures of stress and cumulative negative life stress were obtained midterm. Found that combination of…
LeBeau, Richard T; Mesri, Bita; Craske, Michelle G
2016-10-30
With DSM-5, the APA began providing guidelines for anxiety disorder severity assessment that incorporates newly developed self-report scales. The scales share a common template, are brief, and are free of copyright restrictions. Initial validation studies have been promising, but the English-language versions of the scales have not been formally validated in clinical samples. Forty-seven individuals with a principal diagnosis of Social Anxiety Disorder (SAD) completed a diagnostic assessment, as well as the DSM-5 SAD severity scale and several previously validated measures. The scale demonstrated internal consistency, convergent validity, and discriminant validity. The next steps in the validation process are outlined. Copyright © 2016 Elsevier Ireland Ltd. All rights reserved.
Identifying customer-focused performance measures : final report 655.
DOT National Transportation Integrated Search
2010-10-01
The Arizona Department of Transportation (ADOT) completed a comprehensive customer satisfaction : assessment in July 2009. ADOT commissioned the assessment to acquire statistically valid data from residents : and community leaders to help it identify...
Spieker, Susan; Nelson, Elizabeth M.; Condon, Marie-Celeste
2010-01-01
A new observational measure of attachment strategies in the home, the Toddler Attachment Sort-45 (TAS-45) was completed for 59 18- to 36-month-old recipients of EHS. Mothers completed the Brief Infant Toddler Social and Emotional Assessment (BITSEA); children were tested on the Preschool Language Scale (PLS-4); and a mother-child snack was videotaped and coded for dyadic mutuality. The TAS-45 Security score was associated with more dyadic mutuality, higher language and competence scores, and lower problem scores. Discriminant validity was evidenced by a lack of associations with the TAS-45 Dependence score. The TAS-45 Disorganized “hotspot” (cluster) score also showed expected associations with these outcomes. Results are discussed in terms of next steps for use of the TAS-45 in research and practice. PMID:21240695
Keefer, Laurie; Kiebles, Jennifer L; Taft, Tiffany H
2011-02-01
Inflammatory bowel diseases (IBDs) require self-management skills that may be influenced by self-efficacy (SE). Self-efficacy represents an individual's perception of his or her ability to organize and execute the behaviors necessary to manage disease. The goal of this study was to develop a valid and reliable measure of IBD-specific SE that can be used in clinical and research contexts. One hundred and twenty-two adults with a verified IBD diagnosis participated in the study. Data were pooled from 2 sources: patients from an outpatient university gastroenterology clinic (n=42) and a sample of online respondents (n=80). All participants (N=122) completed the IBD Self-Efficacy Scale (IBD-SES) and the Inflammatory Bowel Disease Questionnaire. Additionally, online participants completed the Brief Symptom Inventory-18 and the Rosenberg Self-Esteem Scale, whereas those in the clinic sample completed the Perceived Health Competence Scale, the Perceived Stress Questionnaire, and the Short Form Version 2 Health Survey. The IBD-SES was initially constructed to identify 4 distinct theoretical domains of self-efficacy: (1) managing stress and emotions, (2) managing medical care, (3) managing symptoms and disease, and (4) maintaining remission. The 29-item IBD-SES has high internal consistency (r=0.96), high test-retest reliability (r=0.90), and demonstrates strong construct and concurrent validity with established measures. The IBD-SES is a critical first step toward addressing an important psychological construct that could influence treatment outcomes in IBD.
NASA Technical Reports Server (NTRS)
Piazza, Anthony; Hudson, Larry D.; Richards, W. Lance
2005-01-01
Fiber Optic Strain Measurements: a) Successfully attached silica fiber optic sensors to both metallics and composites; b) Accomplished valid EFPI strain measurements to 1850 F; c) Successfully attached EFPI sensors to large scale hot-structures; and d) Attached and thermally validated FBG bond and epsilon(sub app). Future Development a) Improve characterization of sensors on C-C and C-SiC substrates; b) Apply application to other composites such as SiC-SiC; c) Assist development of interferometer based Sapphire sensor currently being conducted under a Phase II SBIR; and d) Complete combined thermal/mechanical testing of FBG on composite substrates in controlled laboratory environment.
Pournik, Omid; Ghalichi, Leila; TehraniYazdi, Alireza; Tabatabaee, Seyed Mohammad; Ghaffari, Mostafa; Vingard, Eva
2015-01-01
Background: The effect of psychosocial work environment on personal and organizational aspects of employees is well-known; and it is of fundamental importance to have valid tools to evaluate them. This study aims to evaluate the reliability and validity of the Persian version of Copenhagen Psychosocial Questionnaire (COPSOQ). Methods: The questionnaire was translated into Persian and then back translated into English by two translators separately. The wording of the final Persian version was established by comparing the translated versions with the original questionnaire. One hundred three health care workers completed the questionnaire. Chronbach’s alpha was calculated, and factor analysis was performed. Results: Factor analysis revealed acceptable validity for the five contexts of the questionnaire. Cronbach’s alpha ranged from 0.73 to 0.82 in different contexts. Conclusion: This study revealed that the Persian version of COPSOQ is a reliable and valid instrument for measuring psychosocial factors at work. PMID:26478879
[Validation of the French translation of Beck's Sociotropy-Autonomy Scale].
Husky, Mathilde M; Grondin, Olivier S; Compagnone, Philippe D
2004-12-01
To validate the French version of the Sociotropy- Autonomy Scale (SAS) developed by Beck and others. The SAS is a self-questionnaire of 60 items divided into 2 dimensions measuring sociotropy and autonomy. The SAS was completed by 1028 students, 140 of whom jointly completed Robins' Personal Style Inventory-Revised, and 75 of whom completed the SAS again 3 months later. The principal-axes factor analysis conducted on all 60 items yielded 2 distinct dimensions: sociotropy and autonomy. The factor analysis of each dimension led us to identify 6 subdimensions, just as in the original instrument. The French translation features satisfying psychometric and conceptual characteristics and allows these dimensions to be studied in a French sample. Results are discussed with regards to adequacy when compared with the original Beck's version.
Validation of the Oxford Participation and Activities Questionnaire.
Morley, David; Dummett, Sarah; Kelly, Laura; Dawson, Jill; Fitzpatrick, Ray; Jenkinson, Crispin
2016-01-01
There is growing interest in the management of long-term conditions and in keeping people active and participating in the community. Testing the effectiveness of interventions that aim to affect activities and participation can be challenging without a well-developed, valid, and reliable instrument. This study therefore aims to develop a patient-reported outcome measure, the Oxford Participation and Activities Questionnaire (Ox-PAQ), which is theoretically grounded in the World Health Organization's International Classification of Functioning, Disability, and Health (ICF) and fully compliant with current best practice guidelines. Questionnaire items generated from patient interviews and based on the nine chapters of the ICF were administered by postal survey to 386 people with three neurological conditions: motor neuron disease, multiple sclerosis, and Parkinson's disease. Participants also completed the Medical Outcomes Study (MOS) 36-Item Short Form Health Survey (SF-36) and EQ-5D-5L. Thus, 334 participants completed the survey, a response rate of 86.5%. Factor analysis techniques identified three Ox-PAQ domains, consisting of 23 items, accounting for 72.8% of variance. Internal reliability for the three domains was high (Cronbach's α: 0.81-0.96), as was test-retest reliability (intraclass correlation: 0.83-0.92). Concurrent validity was demonstrated through highly significant relationships with relevant domains of the MOS SF-36 and the EQ- 5D-5L. Assessment of known-groups validity identified significant differences in Ox-PAQ scores among the three conditions included in the survey. Results suggest that the Ox-PAQ is a valid and reliable measure of participation and activity. The measure will now be validated in a range of further conditions, and additional properties, such as responsiveness, will also be assessed in the next phase of the instrument's development.
Validation of the Oxford Participation and Activities Questionnaire
Morley, David; Dummett, Sarah; Kelly, Laura; Dawson, Jill; Fitzpatrick, Ray; Jenkinson, Crispin
2016-01-01
Purpose There is growing interest in the management of long-term conditions and in keeping people active and participating in the community. Testing the effectiveness of interventions that aim to affect activities and participation can be challenging without a well-developed, valid, and reliable instrument. This study therefore aims to develop a patient-reported outcome measure, the Oxford Participation and Activities Questionnaire (Ox-PAQ), which is theoretically grounded in the World Health Organization’s International Classification of Functioning, Disability, and Health (ICF) and fully compliant with current best practice guidelines. Methods Questionnaire items generated from patient interviews and based on the nine chapters of the ICF were administered by postal survey to 386 people with three neurological conditions: motor neuron disease, multiple sclerosis, and Parkinson’s disease. Participants also completed the Medical Outcomes Study (MOS) 36-Item Short Form Health Survey (SF-36) and EQ-5D-5L. Results Thus, 334 participants completed the survey, a response rate of 86.5%. Factor analysis techniques identified three Ox-PAQ domains, consisting of 23 items, accounting for 72.8% of variance. Internal reliability for the three domains was high (Cronbach’s α: 0.81–0.96), as was test–retest reliability (intraclass correlation: 0.83–0.92). Concurrent validity was demonstrated through highly significant relationships with relevant domains of the MOS SF-36 and the EQ- 5D-5L. Assessment of known-groups validity identified significant differences in Ox-PAQ scores among the three conditions included in the survey. Conclusion Results suggest that the Ox-PAQ is a valid and reliable measure of participation and activity. The measure will now be validated in a range of further conditions, and additional properties, such as responsiveness, will also be assessed in the next phase of the instrument’s development. PMID:27366108
Sadri, Shalane K; McEvoy, Peter M; Pinto, Anthony; Anderson, Rebecca A; Egan, Sarah J
2018-03-01
Obsessive-compulsive personality disorder (OCPD) has been subject to numerous definition and classification changes, which has contributed to difficulties in reliable measurement of the disorder. Consequently, OCPD measures have yielded poor validity and inconsistent prevalence estimates. Reliable and valid measures of OCPD are needed. The aim of the current study was to examine the factor structure and psychometric properties of the Pathological Obsessive Compulsive Personality Scale (POPS). Participants (N = 571 undergraduates) completed a series of self-report measures online, including the POPS. Confirmatory factor analysis was used to compare the fit of unidimensional, five factor, and bifactor models of the POPS. Convergent and divergent validity were assessed in relation to other personality dimensions. A bifactor model provided the best fit to the data, indicating that the total POPS scale and four subscales can be scored to obtain reliable indicators of OCPD. The POPS was most strongly associated with a disorder-specific measure of OCPD, however there were also positive associations with theoretically disparate constructs, thus further research is needed to clarify validity of the scale.
Fitzsimmons-Craft, Ellen E; Bardone-Cone, Anna M
2014-01-01
This study examined the one-year temporal stability and the predictive and incremental validity of the Body, Eating, and Exercise Comparison Measure (BEECOM) in a sample of 237 college women who completed study measures at two time points about one year apart. One-year temporal stability was high for the BEECOM total and subscale (i.e., Body, Eating, and Exercise Comparison Orientation) scores. Additionally, the BEECOM exhibited predictive validity in that it accounted for variance in body dissatisfaction and eating disorder symptomatology one year later. These findings held even after controlling for body mass index and existing measures of social comparison orientation. However, results regarding the incremental validity of the BEECOM, or its ability to predict change in these constructs over time, were more mixed. Overall, this study demonstrated additional psychometric properties of the BEECOM among college women, further establishing the usefulness of this measure for more comprehensively assessing eating disorder-related social comparison. Copyright © 2013 Elsevier Ltd. All rights reserved.
Coupled CFD and Particle Vortex Transport Method: Wing Performance and Wake Validations
2008-06-26
the PVTM analysis. The results obtained using the coupled RANS/PVTM analysis compare well with experimental data , in particular the pressure...searching existing data sources, gathering and maintaining the data needed, and completing and reviewing the collection of information. Send comments...is validated against wind tunnel test data . Comparisons with measured pressure distribution, loadings, and vortex parameters, and the corresponding
USDA-ARS?s Scientific Manuscript database
This study assessed the feasibility, reliability and validity of reflection spectroscopy (RS) to assess skin carotenoids in a racially diverse sample. Study 1 was a cross-sectional study of corner store customers (n= 479) in Eastern North Carolina USA who completed the National Cancer Institute Frui...
Tang, Shih-Fen; Chen, I-Hui; Chiang, Hsin-Yu; Wu, Chien-Te; Hsueh, I-Ping; Yu, Wan-Hui; Hsieh, Ching-Lin
2017-11-27
We aimed to compare the test-retest agreement, random measurement error, practice effect, and ecological validity of the original and Tablet-based Symbol Digit Modalities Test (T-SDMT) over five serial assessments, and to examine the concurrent validity of the T-SDMT in patients with schizophrenia. Sixty patients with chronic schizophrenia completed five serial assessments (one week apart) of the SDMT and T-SDMT and one assessment of the Activities of Daily Living Rating Scale III at the first time point. Both measures showed high test-retest agreement, similar levels of random measurement error over five serial assessments. Moreover, the practice effects of the two measures did not reach a plateau phase after five serial assessments in young and middle-aged participants. Nevertheless, only the practice effect of the T-SDMT became trivial after the first assessment. Like the SDMT, the T-SDMT had good ecological validity. The T-SDMT also had good concurrent validity with the SDMT. In addition, only the T-SDMT had discriminative validity to discriminate processing speed in young and middle-aged participants. Compared to the SDMT, the T-SDMT had overall slightly better psychometric properties, so it can be an alternative measure to the SDMT for assessing processing speed in patients with schizophrenia. Copyright © 2017 Elsevier B.V. All rights reserved.
New measure for fathers of children with developmental challenges.
Ly, A R; Goldberg, W A
2014-05-01
There is a relative lack of measures tailored to the study of fathers of children with developmental challenges (DCs). The goal of the current study was to create and validate a brief measure designed to capture the perceptions and experiences of these fathers. The Fathers of Children with Developmental Challenges (FCDC) questionnaire was designed to assess fathers' perceptions of the supports for, and challenges to, their efforts to be involved in the rearing of their children. Participants were 101 fathers of children with DCs who completed an online survey. Scale validation included tests to determine reliability, validity and factor structure. Used to establish validity were measures of parenting stress, parenting commitment, parent personality and child social-communicative skills. Analyses indicated that the FCDC is reliable (α = 0.89), demonstrates content validity, construct validity and acts in theoretically expected ways. Factor analysis on the 20-item measure yielded two sub-scales: (1) impact on parenting, and (2) involvement with child intervention. The FCDC fills a gap in the literature by offering an easy-to-administer self-report measure of fathers' perceptions of supports for, and barriers to, their involvement with their children with DCs. The FCDC could assist professionals in delivering support services specifically for fathers of children with DCs. © 2013 The Authors. Journal of Intellectual Disability Research © 2013 John Wiley & Sons Ltd, MENCAP & IASSIDD.
Stone, Amanda L; Walker, Lynn S
2017-01-01
Evaluate psychometric properties of a measure of adolescents’ observations of parental pain behaviors and use this measure to test hypotheses regarding pain-specific social learning. We created a proxy-report of the Patient Reported Outcomes Measurement Information System (PROMIS) Pain Behavior–Short Form (PPB) for adolescents to report on parental pain behaviors, which we labeled the PPB-Proxy. Adolescents (n = 138, mean age = 14.20) with functional abdominal pain completed the PPB-Proxy and a parent completed the PPB. Adolescents and their parents completed measures of pain and disability during the adolescent’s clinic visit for abdominal pain. Adolescents subsequently completed a 7-day pain diary period. The PPB-Proxy moderately correlated with the PPB, evidencing that adolescents observe and can report on parental pain behaviors. Both the PPB-Proxy and PPB significantly correlated with adolescents’ pain-related disability. Parental modeling of pain behaviors could represent an important target for assessment and treatment in pediatric chronic pain patients.
Validity of instruments to assess students' travel and pedestrian safety.
Mendoza, Jason A; Watson, Kathy; Baranowski, Tom; Nicklas, Theresa A; Uscanga, Doris K; Hanfling, Marcus J
2010-05-18
Safe Routes to School (SRTS) programs are designed to make walking and bicycling to school safe and accessible for children. Despite their growing popularity, few validated measures exist for assessing important outcomes such as type of student transport or pedestrian safety behaviors. This research validated the SRTS school travel survey and a pedestrian safety behavior checklist. Fourth grade students completed a brief written survey on how they got to school that day with set responses. Test-retest reliability was obtained 3-4 hours apart. Convergent validity of the SRTS travel survey was assessed by comparison to parents' report. For the measure of pedestrian safety behavior, 10 research assistants observed 29 students at a school intersection for completion of 8 selected pedestrian safety behaviors. Reliability was determined in two ways: correlations between the research assistants' ratings to that of the Principal Investigator (PI) and intraclass correlations (ICC) across research assistant ratings. The SRTS travel survey had high test-retest reliability (kappa = 0.97, n = 96, p < 0.001) and convergent validity (kappa = 0.87, n = 81, p < 0.001). The pedestrian safety behavior checklist had moderate reliability across research assistants' ratings (ICC = 0.48) and moderate correlation with the PI (r = 0.55, p = < 0.01). When two raters simultaneously used the instrument, the ICC increased to 0.65. Overall percent agreement (91%), sensitivity (85%) and specificity (83%) were acceptable. These validated instruments can be used to assess SRTS programs. The pedestrian safety behavior checklist may benefit from further formative work.
McElhiney, Judith; Lohse, Matthew R; Arora, Amindra S; Peloquin, Joanna M; Geno, Debra M; Kuntz, Melissa M; Enders, Felicity B; Fredericksen, Mary; Abdalla, Adil A; Khan, Yulia; Talley, Nicholas J; Diehl, Nancy N; Beebe, Timothy J; Harris, Ann M; Farrugia, Gianrico; Graner, Darlene E; Murray, Joseph A; Locke, G Richard; Grothe, Rayna M; Crowell, Michael D; Francis, Dawn L; Grudell, April M B; Dabade, Tushar; Ramirez, Angelica; Alkhatib, MhdMaan; Alexander, Jeffrey A; Kimber, Jessica; Prasad, Ganapathy; Zinsmeister, Alan R; Romero, Yvonne
2010-09-01
The aim of this study was to develop the Mayo Dysphagia Questionnaire-30 Day (MDQ-30), a tool to measure esophageal dysphagia, by adapting items from validated instruments for use in clinical trials, and assess its feasibility, reproducibility, and concurrent validity. Outpatients referred to endoscopy for dysphagia or seen in a specialty clinic were recruited. Feasibility testing was done to identify problematic items. Reproducibility was measured by test-retest format. Concurrent validity reflects agreement between information gathered in a structured interview versus the patients' written responses. The MDQ-30, a 28-item instrument, took 10 min (range = 5-30 min) to complete. Four hundred thirty-one outpatients [210 (49%) men; mean age = 61 years] participated. Overall, most concurrent validity kappa values for dysphagia were very good to excellent with a median of 0.78 (min 0.28, max 0.95). The majority of reproducibility kappa values for dysphagia were moderate to excellent with a median kappa value of 0.66 (min 0.07, max 1.0). Overall, concurrent validity and reproducibility kappa values for gastroesophageal reflux disease (GERD) symptoms were 0.81 (95% CI = 0.72, 0.91) and 0.66 (95% CI = 0.55, 0.77), respectively. Individual item percent agreement was generally very good to excellent. Internal consistency was excellent. We conclude that the MDQ-30 is an easy-to-complete tool to evaluate reliably dysphagia symptoms over the last 30 days.
Starnes, Heather A; McDonough, Meghan H; Tamura, Kosuke; James, Peter; Laden, Francine; Troped, Philip J
2014-10-10
Using validated measures of individuals' perceptions of their neighborhood built environment is important for accurately estimating effects on physical activity. However, no studies to date have examined the factorial validity of a measure of perceived neighborhood environment among older adults in the United States. The purpose of this measurement study was to test the factorial validity of a version of the Abbreviated Neighborhood Environment Walkability Scale (NEWS-A) modified for seniors in the Nurses' Health Study (NHS). A random sample of 2,920 female nurses (mean age = 73 ± 7 years) in the NHS cohort from California, Massachusetts, and Pennsylvania completed a 36-item modified NEWS-A for seniors. Confirmatory factor analyses were conducted to test measurement models for both the modified NEWS-A for seniors and the original NEWS-A. Internal consistency within factors was examined using Cronbach's alpha. The hypothesized 7-factor measurement model was a poor fit for the modified NEWS-A for seniors. Overall, the best-fitting measurement model was the original 6-factor solution to the NEWS-A. Factors were correlated and internally consistent. This study provided support for the construct validity of the original NEWS-A for assessing perceptions of neighborhood environments in older women in the United States.
Brief report: development of the inflammatory bowel disease family responsibility questionnaire.
Greenley, Rachel Neff; Doughty, Alyssa; Stephens, Mike; Kugathasan, Subra
2010-03-01
To present psychometric data on youth and parent versions of the Inflammatory Bowel Disease-Family Responsibility Questionnaire (IBD-FRQ), a measure of family involvement in IBD management. Fifty-eight adolescents with inflammatory bowel disease (IBD), along with 55 mothers and 26 fathers completed the IBD-FRQ, a demographics questionnaire, and a measure of family involvement in decision making in non-IBD domains. Medical information was obtained via chart review. Support for the internal consistency of the IBD-FRQ was obtained. Evidence of validity was documented via moderate to high intercorrelations among reporters. Youth involvement increased with youth age, while maternal and paternal involvement decreased with youth age. Across all reporters, maternal involvement was higher than paternal involvement. Preliminary analyses offer support for the measure's reliability and validity. The measure shows promise as a means of assessing family involvement in IBD condition management; however, further validation studies are needed.
Aloba, Olutayo; Olabisi, Oluseyi; Aloba, Tolulope
2016-01-01
The 10-item Connor-Davidson Resilience Scale (CD-RISC) has demonstrated satisfactory psychometric properties as a measure of resilience in all the previous studies conducted in developed countries. The objective of this study was to explore the psychometric characteristics of the 10-item CD-RISC among students nurses in southwestern Nigeria. This descriptive cross-sectional study involved a total of 449 student nurses who completed the 10-item CD-RISC in addition to measures of self-esteem, depression, religiosity, and psychological distress. The scale demonstrated adequate reliability (Cronbach's α = .81) and satisfactory validity with significant correlations with the measures of self-esteem, depression, religiosity, and psychological distress. Factor analyses revealed that resilience was best explained by a two-factor construct. The scale is a valid measure of resilience among Nigerian student nurses. © The Author(s) 2016.
Assessment of the psychometric properties of the Family Management Measure.
Knafl, Kathleen; Deatrick, Janet A; Gallo, Agatha; Dixon, Jane; Grey, Margaret; Knafl, George; O'Malley, Jean
2011-06-01
This paper reports development of the Family Management Measure (FaMM) of parental perceptions of family management of chronic conditions. By telephone interview, 579 parents of children age 3 to 19 with a chronic condition (349 partnered mothers, 165 partners, 65 single mothers) completed the FaMM and measures of child functional status and behavioral problems and family functioning. Analyses addressed reliability, factor structure, and construct validity. Exploratory factor analysis yielded six scales: Child's Daily Life, Condition Management Ability, Condition Management Effort, Family Life Difficulty, Parental Mutuality, and View of Condition Impact. Internal consistency reliability ranged from .72 to .91, and test-retest reliability from .71 to .94. Construct validity was supported by significant correlations in hypothesized directions between FaMM scales and established measures. Results support FaMM's; reliability and validity, indicating it performs in a theoretically meaningful way and taps distinct aspects of family response to childhood chronic conditions.
Adopting software quality measures for healthcare processes.
Yildiz, Ozkan; Demirörs, Onur
2009-01-01
In this study, we investigated the adoptability of software quality measures for healthcare process measurement. Quality measures of ISO/IEC 9126 are redefined from a process perspective to build a generic healthcare process quality measurement model. Case study research method is used, and the model is applied to a public hospital's Entry to Care process. After the application, weak and strong aspects of the process can be easily observed. Access audibility, fault removal, completeness of documentation, and machine utilization are weak aspects and these aspects are the candidates for process improvement. On the other hand, functional completeness, fault ratio, input validity checking, response time, and throughput time are the strong aspects of the process.
Lin, Mau-Roung; Hwang, Hei-Fen; Hu, Ming-Hsia; Wu, Hong-Dar Isaac; Wang, Yi-Wei; Huang, Fu-Chao
2004-08-01
To compare the practicality, reliability, validity, and responsiveness of the timed up and go (TUG), one-leg stand (OLS), functional reach (FR), and Tinetti balance (TB) performance measures in people aged 65 and older. A prospective study. Shin-Sher Township of Taichung County, west-central Taiwan. Twelve hundred community-dwelling older people. During an initial assessment at their residences, participants were interviewed for demographics, cognition, fall history, use of a walking aid, and activities of daily living (ADLs), in addition to completing the four balance tests. Falls were ascertained by telephone every 3 months for a 1-year follow-up; the four balance measures and ADLs were also reassessed at the end of the follow-up year. Of the four balance measures, the OLS had the lowest participation rate, and participation of people who were cognitively impaired had fallen in the previous year, used a walking aid, or suffered from an ADL disability was lower than for their counterparts. The time to complete the tests ranged from 58 seconds for OLS, to 160 seconds for the TB. All four balance measures exhibited excellent test-retest reliability and discriminant validity but poor responsiveness to fall status. The TB showed better discriminant, convergent, and predictive validities and responsiveness to ADL changes than the other three tests. According to psychometric properties, the most suitable performance measure for evaluating balance in community-dwelling older people was the TB, followed by the TUG.
Dahlke, Jeffrey A; Kostal, Jack W; Sackett, Paul R; Kuncel, Nathan R
2018-05-03
We explore potential explanations for validity degradation using a unique predictive validation data set containing up to four consecutive years of high school students' cognitive test scores and four complete years of those students' college grades. This data set permits analyses that disentangle the effects of predictor-score age and timing of criterion measurements on validity degradation. We investigate the extent to which validity degradation is explained by criterion dynamism versus the limited shelf-life of ability scores. We also explore whether validity degradation is attributable to fluctuations in criterion variability over time and/or GPA contamination from individual differences in course-taking patterns. Analyses of multiyear predictor data suggest that changes to the determinants of performance over time have much stronger effects on validity degradation than does the shelf-life of cognitive test scores. The age of predictor scores had only a modest relationship with criterion-related validity when the criterion measurement occasion was held constant. Practical implications and recommendations for future research are discussed. (PsycINFO Database Record (c) 2018 APA, all rights reserved).
Chamberlain, Samuel R; Grant, Jon E
2018-05-07
Compulsivity refers to a tendency toward repetitive habitual behaviors. Multiple disorders have compulsive symptoms at their core, including substance use disorders, gambling disorder, and obsessive-compulsive disorder. The aim of this study was to validate a scale for the objective, transdiagnostic measurement of compulsivity. The 15-item Cambridge-Chicago Compulsivity Trait Scale (CHI-T) was developed for the rapid but comprehensive measurement of compulsivity. Adults aged 18-29y were recruited using media advertisements, and completed the CHI-T in addition to demographic, clinical, and cognitive assessment. The validity and psychometric properties of the scale were quantified. A total of 112 participants completed the study. The scale yielded a normal distribution with very few outliers. It had excellent psychometric properties, with high internal consistency (Cronbach's alpha=0.8), and excellent convergent validity against gold-standard assessments of compulsive symptoms (each p<0.001 for gambling disorder, obsessive-compulsive, and substance use disorder symptoms). Total scores on the scale correlated significantly with less risk-adjustment on the decision-making task (rigid response style), and divergent validity was confirmed against other cognitive domains (response inhibition and executive planning). The above significant findings withstood Bonferroni correction. Factor analysis suggested the existence of two latent factors: one related mainly to reward-seeking and the need for perfection, and the other relating to anxiolytic/soothing features of compulsivity. The CHI-T, a scale designed to measure transdiagnostic compulsivity, appears to show excellent psychometric properties in a normative population and merits further investigation in the context of clinical patient populations, including in treatment trials.
van Zijl, Floris V W J; Timman, Reinier; Datema, Frank R
2017-06-01
The nasal obstruction symptom evaluation (NOSE) scale is a validated disease-specific, self-completed questionnaire for the assessment of quality of life related to nasal obstruction. The aim of this study was to validate the Dutch (NL-NOSE) questionnaire. A prospective instrument validation study was performed in a tertiary academic referral center. Guidelines for the cross-cultural adaptation process from the original English language scale into a Dutch language version were followed. Patients undergoing functional septoplasty or septorhinoplasty and asymptomatic controls completed the questionnaire both before and 3 months after surgery to test reliability and validity. Additionally, we explored the possibility to reduce the NOSE scale even further using graded response models. 129 patients and 50 controls were included. Internal consistency (Cronbach's alpha 0.82) and test-retest reliability (intraclass correlation coefficient 0.89) were good. The instrument showed excellent between-group discrimination (Mann-Whitney U = 85, p < 0.001) and high response sensitivity to change (Wilcoxon rank p < 0.001). The NL-NOSE correlated well with the score on a visual analog scale measuring the subjective sensation of nasal obstruction, with exception of item 4 (trouble sleeping). Item 4 provided the least information to the total scale and item 3 (trouble breathing through nose) the most, particularly in the postoperative group. The Dutch version of the NOSE (NL-NOSE) demonstrated satisfactory reliability and validity. We recommend the use of the NL-NOSE as a validated instrument to measure subjective severity of nasal obstruction in Dutch adult patients.
Validation of the Italian translation of the Inflammatory Bowel Disease Questionnaire.
Ciccocioppo, Rachele; Klersy, Catherine; Russo, Maria Luisa; Valli, Monica; Boccaccio, Vincenzo; Imbesi, Venerina; Ardizzone, Sandro; Porro, Gabriele Bianchi; Corazza, Gino Roberto
2011-07-01
Health-related quality of life is an important measure of treatment outcome; its evaluation requires the use of internationally validated ad hoc questionnaires. The McMaster Inflammatory Bowel Disease Questionnaire (IBDQ) is the most used specific instrument. To assess the validity and reliability of the Italian translation of the IBDQ. The IBDQ underwent forward and backward translation; 13 patients were enrolled for cognitive testing of the Italian version to increase clarity. For field testing, 113 patients (65 with Crohn's disease and 48 with ulcerative colitis) completed both the IBDQ and the generic instrument 36-item Short Form Health Survey scale (SF-36). Data quality was optimal with high completeness and low floor and ceiling effect. Item internal consistency was satisfied for 100% of patients, while discriminant validity showed a few items with higher correlations with other scales. Cronbach's alpha coefficient was 0.96. Test-retest correlations indicated good reliability (Pearson R 0.81). Exploratory factor analysis indicated that the original grouping of the item was suboptimal. The score proved sensitive to disease activity, gender and quality of life as measured by the SF-36. The Italian translation of the McMaster Inflammatory Bowel Disease Questionnaire sounds natural and is easy to understand. A field test gave results comparable to other international validations, supporting its use in cross-national surveys. Copyright © 2011 Editrice Gastroenterologica Italiana S.r.l. Published by Elsevier Ltd. All rights reserved.
Web-Based Assessment of Visual and Visuospatial Symptoms in Parkinson's Disease
Amick, Melissa M.; Miller, Ivy N.; Neargarder, Sandy; Cronin-Golomb, Alice
2012-01-01
Visual and visuospatial dysfunction is prevalent in Parkinson's disease (PD). To promote assessment of these often overlooked symptoms, we adapted the PD Vision Questionnaire for Internet administration. The questionnaire evaluates visual and visuospatial symptoms, impairments in activities of daily living (ADLs), and motor symptoms. PD participants of mild to moderate motor severity (n = 24) and healthy control participants (HC, n = 23) completed the questionnaire in paper and web-based formats. Reliability was assessed by comparing responses across formats. Construct validity was evaluated by reference to performance on measures of vision, visuospatial cognition, ADLs, and motor symptoms. The web-based format showed excellent reliability with respect to the paper format for both groups (all P′s < 0.001; HC completing the visual and visuospatial section only). Demonstrating the construct validity of the web-based questionnaire, self-rated ADL and visual and visuospatial functioning were significantly associated with performance on objective measures of these abilities (all P′s < 0.01). The findings indicate that web-based administration may be a reliable and valid method of assessing visual and visuospatial and ADL functioning in PD. PMID:22530162
Prediction of the space adaptation syndrome
NASA Technical Reports Server (NTRS)
Reschke, M. F.; Homick, J. L.; Ryan, P.; Moseley, E. C.
1984-01-01
The univariate and multivariate relationships of provocative measures used to produce motion sickness symptoms were described. Normative subjects were used to develop and cross-validate sets of linear equations that optimally predict motion sickness in parabolic flights. The possibility of reducing the number of measurements required for prediction was assessed. After describing the variables verbally and statistically for 159 subjects, a factor analysis of 27 variables was completed to improve understanding of the relationships between variables and to reduce the number of measures for prediction purposes. The results of this analysis show that none of variables are significantly related to the responses to parabolic flights. A set of variables was selected to predict responses to KC-135 flights. A series of discriminant analyses were completed. Results indicate that low, moderate, or severe susceptibility could be correctly predicted 64 percent and 53 percent of the time on original and cross-validation samples, respectively. Both the factor analysis and the discriminant analysis provided no basis for reducing the number of tests.
Gros, Daniel F; Sarver, Nina Wong
2014-04-01
Despite the recent increase of measures developed to assess the cognitive symptoms of social anxiety disorder (SOC), their validation is still largely preliminary. Thus, the present studies sought to replicate and extend the psychometric evaluation of the Social Thoughts and Beliefs Scale (STABS). Study 1 involved both participants with SOC (n=206) and healthy controls (n=222) that completed the STABS and other related measures of anxiety. In Study 2, participants with SOC (n=66) completed exposure-based psychotherapy for SOC with the STABS used to track symptom changes. Together, the two studies provided additional support for the validity and reliability of the STABS as a measure of the cognitive symptoms of SOC. However, contrary to previous research with two subscales, a single total scale was suggested as the best interpretation of the STABS, as well as the possible general presentation of the cognitive symptoms of SOC. Published by Elsevier Ltd.
USDA-ARS?s Scientific Manuscript database
The objective was to determine the reliability and validity of scales measuring low-fat milk consumption self-efficacy and norms during school lunch among a cohort of 5th graders. Two hundred seventy-five students completed lunch food records and a psychosocial questionnaire measuring self-efficacy ...
Individuation and Parents as People: Measurement Concerns regarding Two Aspects of Autonomy
ERIC Educational Resources Information Center
Andersen, Brian; LaVoie, Joseph C.; Dunkel, Curt S.
2007-01-01
The focus of this study was on examining two assumed components of adolescent autonomy-individuation and perceiving parents as people and the validity of their measurement. Participating in the study were 67 students in grades 9 and 11 (ages 14-17 years) and 118 college students (ages 18-27 years). Each student completed two measures of…
ERIC Educational Resources Information Center
Carlson, Eve B.; Smith, Steve R.; Palmieri, Patrick A.; Dalenberg, Constance; Ruzek, Josef I.; Kimerling, Rachel; Burling, Thomas A.; Spain, David A.
2011-01-01
Although information about individuals' exposure to highly stressful events such as traumatic stressors is often very useful for clinicians and researchers, available measures are too long and complex for use in many settings. The Trauma History Screen (THS) was developed to provide a very brief and easy-to-complete self-report measure of exposure…
The Chronic Illness Problem Inventory as a measure of dysfunction in chronic pain patients.
Romano, J M; Turner, J A; Jensen, M P
1992-04-01
Assessment of physical and psychosocial dysfunction is recognized as essential in chronic pain patient evaluation. One instrument, the Sickness Impact Profile (SIP), has demonstrated good reliability and validity as a measure of dysfunction among chronic pain patients. An alternate measure, the Chronic Illness Problem Inventory (CIPI), is shorter and more easily scored than the SIP, but as yet has not been applied widely to chronic pain problems. In the present study, 95 chronic low back pain patients completed the SIP, the CIPI, activity diaries, the McGill Pain Questionnaire (MPQ), and the Center for Epidemiologic Studies-Depression scale (CES-D), before participating in a chronic pain treatment study. Overt pain behaviors were also coded from videotapes of a standardized assessment protocol. Seventy-five subjects completed the measures post-treatment. The results indicate that although the SIP and the CIPI are significantly correlated and appear to be measuring similar constructs, there is also substantial unshared variance between them, suggesting that they may tap somewhat different aspects of dysfunction in chronic pain. The CIPI shows promise as a useful alternative measure of dysfunction in chronic low back pain patients, but requires further validation for this purpose.
Validation of the Abdominal Pain Index using a revised scoring method.
Laird, Kelsey T; Sherman, Amanda L; Smith, Craig A; Walker, Lynn S
2015-06-01
Evaluate the psychometric properties of child- and parent-report versions of the four-item Abdominal Pain Index (API) in children with functional abdominal pain (FAP) and healthy controls, using a revised scoring method that facilitates comparisons of scores across samples and time. Pediatric patients aged 8-18 years with FAP and controls completed the API at baseline (N = 1,967); a subset of their parents (N = 290) completed the API regarding the child's pain. Subsets of patients completed follow-up assessments at 2 weeks (N = 231), 3 months (N = 330), and 6 months (N = 107). Subsets of both patients (N = 389) and healthy controls (N = 172) completed a long-term follow-up assessment (mean age at follow-up = 20.21 years, SD = 3.75). The API demonstrated good concurrent, discriminant, and construct validity, as well as good internal consistency. We conclude that the API, using the revised scoring method, is a useful, reliable, and valid measure of abdominal pain severity. © The Author 2015. Published by Oxford University Press on behalf of the Society of Pediatric Psychology. All rights reserved. For permissions, please e-mail: journals.permissions@oup.com.
Advancing implementation science through measure development and evaluation: a study protocol.
Lewis, Cara C; Weiner, Bryan J; Stanick, Cameo; Fischer, Sarah M
2015-07-22
Significant gaps related to measurement issues are among the most critical barriers to advancing implementation science. Three issues motivated the study aims: (a) the lack of stakeholder involvement in defining pragmatic measure qualities; (b) the dearth of measures, particularly for implementation outcomes; and (c) unknown psychometric and pragmatic strength of existing measures. Aim 1: Establish a stakeholder-driven operationalization of pragmatic measures and develop reliable, valid rating criteria for assessing the construct. Aim 2: Develop reliable, valid, and pragmatic measures of three critical implementation outcomes, acceptability, appropriateness, and feasibility. Aim 3: Identify Consolidated Framework for Implementation Research and Implementation Outcome Framework-linked measures that demonstrate both psychometric and pragmatic strength. For Aim 1, we will conduct (a) interviews with stakeholder panelists (N = 7) and complete a literature review to populate pragmatic measure construct criteria, (b) Q-sort activities (N = 20) to clarify the internal structure of the definition, (c) Delphi activities (N = 20) to achieve consensus on the dimension priorities, (d) test-retest and inter-rater reliability assessments of the emergent rating system, and (e) known-groups validity testing of the top three prioritized pragmatic criteria. For Aim 2, our systematic development process involves domain delineation, item generation, substantive validity assessment, structural validity assessment, reliability assessment, and predictive validity assessment. We will also assess discriminant validity, known-groups validity, structural invariance, sensitivity to change, and other pragmatic features. For Aim 3, we will refine our established evidence-based assessment (EBA) criteria, extract the relevant data from the literature, rate each measure using the EBA criteria, and summarize the data. The study outputs of each aim are expected to have a positive impact as they will establish and guide a comprehensive measurement-focused research agenda for implementation science and provide empirically supported measures, tools, and methods for accomplishing this work.
NASA Technical Reports Server (NTRS)
Ramanathan, V.; Inamdar, Anand K.
2005-01-01
Our main task was to validate and improve the generation of surface long wave fluxes from the CERES TOA window channel flux measurements. We completed this task successfully for the clear sky fluxes in the presence of aerosols including dust during the first year of the project. The algorithm we developed for CERES was remarkably successful for clear sky fluxes and we have no further tasks that need to be performed past the requested termination date of December 31, 2004. We found that the information contained in the TOA fluxes was not sufficient to improve upon the current CERES algorithm for cloudy sky fluxes. Given this development and given our success in clear sky fluxes, we do not see any reason to continue our validation work beyond what we have completed. Specific details are given.
Validation of the Gifted Rating Scales–School Form in China
Li, Huijun; Pfeiffer, Steven I.; Petscher, Yaacov; Kumtepe, Alper T.; Mo, Guofang
2015-01-01
The Gifted Rating Scales–School Form (GRS-S), a teacher-completed rating scale, is designed to identify five types of giftedness and motivation. This study examines the reliability and validity of a Chinese-translated version of the GRS-S with a sample of Chinese elementary and middle school students (N = 499). The Chinese GRSS was found to have high internal consistency. Results of the confirmatory factor analysis corroborated the six-factor solution of the original GRS-S. Comparison of the GRS-S scores and measures of academic performance provide preliminary support for the criterion validity of the Chinese-translated GRS-S. Significant age and gender differences on the Chinese GRS-S were found. Results provide preliminary support for the Chinese version of the GRS-S as a reliable and valid measure of giftedness for Chinese students. PMID:26346730
Incremental Validity of the Trait Emotional Intelligence Questionnaire-Short Form (TEIQue-SF).
Siegling, A B; Vesely, Ashley K; Petrides, K V; Saklofske, Donald H
2015-01-01
This study examined the incremental validity of the adult short form of the Trait Emotional Intelligence Questionnaire (TEIQue-SF) in predicting 7 construct-relevant criteria beyond the variance explained by the Five-factor model and coping strategies. Additionally, the relative contributions of the questionnaire's 4 subscales were assessed. Two samples of Canadian university students completed the TEIQue-SF, along with measures of the Big Five, coping strategies (Sample 1 only), and emotion-laden criteria. The TEIQue-SF showed consistent incremental effects beyond the Big Five or the Big Five and coping strategies, predicting all 7 criteria examined across the 2 samples. Furthermore, 2 of the 4 TEIQue-SF subscales accounted for the measure's incremental validity. Although the findings provide good support for the validity and utility of the TEIQue-SF, directions for further research are emphasized.
Tritium environmental transport studies at TFTR
NASA Astrophysics Data System (ADS)
Ritter, P. D.; Dolan, T. J.; Longhurst, G. R.
1993-06-01
Environmental tritium concentrations will be measured near the Tokamak Fusion Test Reactor (TFTR) to help validate dynamic models of tritium transport in the environment. For model validation the database must contain sequential measurements of tritium concentrations in key environmental compartments. Since complete containment of tritium is an operational goal, the supplementary monitoring program should be able to glean useful data from an unscheduled acute release. Portable air samplers will be used to take samples automatically every 4 hours for a week after an acute release, thus obtaining the time resolution needed for code validation. Samples of soil, vegetation, and foodstuffs will be gathered daily at the same locations as the active air monitors. The database may help validate the plant/soil/air part of tritium transport models and enhance environmental tritium transport understanding for the International Thermonuclear Experimental Reactor (ITER).
Brod, Meryl; Højbjerre, Lise; Adalsteinsson, Johan Erpur; Rasmussen, Michael Højby
2014-04-01
Approximately 50 000 adults in the United States are diagnosed with GH deficiency, which has negative impacts on cognitive functioning, psychological well-being, and quality of life. This paper presents development and validation of a patient-reported outcome measure (PRO), the Treatment-Related Impact Measure-Adult Growth Hormone Deficiency (TRIM-AGHD). The TRIM-AGHD was developed to measure the impact of GH deficiency and its treatment. The development and validation of the TRIM-AGHD was conducted according to the Food and Drug Administration guidance on the development of PROs. Concept elicitation, conducted in three countries included interviews with patients, clinical experts, and literature review. Qualitative data were analyzed based on grounded theory principles, and draft items were cognitively debriefed. The measure underwent psychometric validation in a US clinic-based population. An a priori statistical analysis plan included assessment of the measurement model, reliability, and validity. Item functioning was reviewed using item response theory analyses. Forty-eight patients and six clinical experts participated in concept elicitation and 169 patients completed the validation study. TRIM-AGHD was measured. Factor analysis resulted in four domains: energy level, physical health, emotional health, and cognitive ability. The item response theory confirmed adequate item fit and placement within their domain. Internal consistency ranged from 0.82 to 0.95 and test-retest ranged from 0.80 to 0.92. All prespecified hypotheses for convergent validity and all but two for discriminant validity were met. The final 26-item TRIM-AGHD can be considered a reliable and valid PRO of the impact of disease and treatment for adult GH deficiency.
Predicting Academic Success in Higher Education: What's More Important than Being Smart?
ERIC Educational Resources Information Center
Kappe, Rutger; van der Flier, Henk
2012-01-01
This study investigated the combined predictive validity of intelligence and personality factors on multiple measures of academic achievement. Students in a college of higher education in the Netherlands (N = 137) completed a survey that measured intelligence, the Big Five personality traits, motivation, and four specific personality traits.…
An Examination of College Students' Receptiveness to Alcohol-Related Information and Advice
ERIC Educational Resources Information Center
Leahy, Matthew M.; Jouriles, Ernest N.; Walters, Scott T.
2013-01-01
This project examined the reliability and validity of a newly developed measure of college students' receptiveness to alcohol related information and advice. Participants were 116 college students who reported having consumed alcohol at some point in their lifetime. Participants completed a measure of receptiveness to alcohol-related…
Comparison of Measures of Morphosyntactic Complexity in French-Speaking School-Aged Children
ERIC Educational Resources Information Center
Mimeau, Catherine; Plourde, Vickie; Ouellet, Andrée-Anne; Dionne, Ginette
2015-01-01
This study examined the validity and reliability of different measures of morphosyntactic complexity, including the Morphosyntactic Complexity Scale (MSCS), a novel adaptation of the Developmental Sentence Scoring, in French-speaking school-aged children. Seventy-three Quebec children from kindergarten to Grade 3 completed a definition task and a…
Development of a Scale Measuring Trait Anxiety in Physical Education
ERIC Educational Resources Information Center
Barkoukis, Vassilis; Rodafinos, Angelos; Koidou, Eirini; Tsorbatzoudis, Haralambos
2012-01-01
The aim of the present study was to examine the validity and reliability of a multi-dimensional measure of trait anxiety specifically designed for the physical education lesson. The Physical Education Trait Anxiety Scale was initially completed by 774 high school students during regular school classes. A confirmatory factor analysis supported the…
Starfelt, Louise Charlotte; Young, Ross McD; White, Katherine M; Palk, Gavan
2016-01-01
Alcohol expectancies likely play a role in people's perceptions of alcohol-involved sexual violence. However, no appropriate measure exists to examine this link comprehensively. The aim of this research was to develop an alcohol expectancy measure which captures young adults' beliefs about alcohol's role in sexual aggression and victimization. Two cross-sectional samples of young Australian adults (18-25 years) were recruited for scale development (Phase 1) and scale validation (Phase 2). In Phase 1, participants (N = 201; 38.3% males) completed an online survey with an initial pool of alcohol expectancy items stated in terms of three targets (self, men, women) to identify the scale's factor structure and most effective items. A revised alcohol expectancy scale was then administered online to 322 young adults (39.6% males) in Phase 2. To assess the predictive, convergent, and discriminant validity of the scale, participants also completed established measures of personality, social desirability, alcohol use, general and context-specific alcohol expectancies, and impulsiveness. Principal axis factoring (Phase 1) and confirmatory factor analysis (Phase 2) resulted in a target-equivalent five-factor structure for the final 66-item Drinking Expectancy Sexual Vulnerabilities Questionnaire (DESV-Q). The factors were labeled (1) Sexual Coercion, (2) Sexual Vulnerability, (3) Confidence, (4) Self-Centeredness, and (5) Negative Cognitive and Behavioral Changes. The measure demonstrated effective items, high internal consistency, and satisfactory predictive, convergent, and discriminant validity. The DESV-Q is a purpose-specific instrument that could be used in future research to elucidate people's attributions for alcohol-involved sexual aggression and victimization.
Predictors of validity and reliability of a physical activity record in adolescents
2013-01-01
Background Poor to moderate validity of self-reported physical activity instruments is commonly observed in young people in low- and middle-income countries. However, the reasons for such low validity have not been examined in detail. We tested the validity of a self-administered daily physical activity record in adolescents and assessed if personal characteristics or the convenience level of reporting physical activity modified the validity estimates. Methods The study comprised a total of 302 adolescents from an urban and rural area in Ecuador. Validity was evaluated by comparing the record with accelerometer recordings for seven consecutive days. Test-retest reliability was examined by comparing registrations from two records administered three weeks apart. Time spent on sedentary (SED), low (LPA), moderate (MPA) and vigorous (VPA) intensity physical activity was estimated. Bland Altman plots were used to evaluate measurement agreement. We assessed if age, sex, urban or rural setting, anthropometry and convenience of completing the record explained differences in validity estimates using a linear mixed model. Results Although the record provided higher estimates for SED and VPA and lower estimates for LPA and MPA compared to the accelerometer, it showed an overall fair measurement agreement for validity. There was modest reliability for assessing physical activity in each intensity level. Validity was associated with adolescents’ personal characteristics: sex (SED: P = 0.007; LPA: P = 0.001; VPA: P = 0.009) and setting (LPA: P = 0.000; MPA: P = 0.047). Reliability was associated with the convenience of completing the physical activity record for LPA (low convenience: P = 0.014; high convenience: P = 0.045). Conclusions The physical activity record provided acceptable estimates for reliability and validity on a group level. Sex and setting were associated with validity estimates, whereas convenience to fill out the record was associated with better reliability estimates for LPA. This tendency of improved reliability estimates for adolescents reporting higher convenience merits further consideration. PMID:24289296
Green, Jennifer Greif; Oblath, Rachel; Felix, Erika D; Furlong, Michael J; Holt, Melissa K; Sharkey, Jill D
2018-06-07
Childhood bullying is an important predictor of psychological and health outcomes in adulthood; however, validated retrospective measures of childhood bullying are lacking. This study investigates the psychometric properties of an adult retrospective version of the California Bullying Victimization Scale (CBVS). The CBVS self-report measure was developed for use with children and adolescents to assess the three definitional characteristics of bullying (aggression that is chronic, intentional, and involves an imbalance of power), without using the term "bullying." In the current study, we evaluate patterns of retrospective reports of bullying victimization, and compare results to a common definition-first measure of bullying. Concurrent validity and 4-year stability are addressed. In the fall of 2012, entering first-year students at 4 universities in the United States (N = 1,209; 65.2% female) completed the California Bullying Victimization Scale-Retrospective (CBVS-R) as part of an online survey. In spring of 2016, participants at 2 universities who provided contact information (N = 175) completed a 4-year follow-up survey. Results support the validity of the CBVS-R as a retrospective self-report measure of bullying victimization experienced in childhood. In particular, the percent of respondents classified as being bullied (27.9%) and age- and gender-related patterns of victimization were consistent with known patterns of childhood bullying. In addition, respondents reporting childhood victimization indicated increased psychological distress in adulthood. However, stability of reports across a 4-year follow-up period were lower than expected (κ = .38). Implications for the use of retrospective reports of childhood bullying victimization are discussed. (PsycINFO Database Record (c) 2018 APA, all rights reserved).
Alleva, Jessica M; Martijn, Carolien; Veldhuis, Jolanda; Tylka, Tracy L
2016-12-01
This paper describes a Dutch translation and validation of the Body Appreciation Scale-2 (BAS-2; Tylka & Wood-Barcalow, 2015a), an instrument for assessing key components of positive body image. Dutch-speaking female university students (N=310, M age =21.31, SD=3.04) completed the Dutch BAS-2. To assess its construct validity, participants also completed measures of appearance satisfaction, functionality satisfaction, self-objectification, self-esteem, and optimistic life orientation. Exploratory factor analysis revealed a one-dimensional factor structure of the Dutch BAS-2, substantiating the BAS-2 factor structure found in samples of U.S., Chinese, and Iranian university students and community adults. Dutch BAS-2 scores also demonstrated good internal consistency (α=.90), convergent validity, and incremental validity. In addition, lower body mass indices were associated with higher Dutch BAS-2 scores. The present findings support the cross-cultural equivalence of the BAS-2 and thus its promise in enabling research on positive body image in diverse cultural contexts. Copyright © 2016 Elsevier Ltd. All rights reserved.
Psychometric Evaluation of the Patient Health Questionnaire-4 in Hispanic Americans.
Mills, Sarah D; Fox, Rina S; Pan, Tonya M; Malcarne, Vanessa L; Roesch, Scott C; Sadler, Georgia Robins
2015-11-01
The present study evaluated the psychometric properties of the Patient Health Questionnaire-4 (PHQ-4), a screener of psychological distress, in English- and Spanish-speaking Hispanic Americans. Hispanic American adults ( N = 436) completed the PHQ-4, which yields two subscales (anxiety and depression) that can be summed to create a total score. Multiple-group confirmatory factor analysis was used to evaluate structural validity. The two-factor structure was the best fit to the data for both English- and Spanish-speaking Hispanic Americans and items loaded equivalently across groups, demonstrating measurement invariance. Internal consistency reliability was good as measured by coefficient alpha. Construct validity was evidenced by significant expected relationships with perceived stress. These findings provide support for the reliability and validity of the PHQ-4 as a brief measure of psychological distress for English- or Spanish-speaking Hispanic Americans.
Clayson, Peter E; Larson, Michael J
2012-05-01
Psychiatric and neurologic disorders are associated with deficits in the postconflict recruitment of cognitive control. The primary aim of this study was to validate the relationship between cognitive functioning and indices of conflict adaptation. Event-related potentials were obtained from 89 healthy individuals who completed an Eriksen flanker task. Neuropsychological domains tested included memory, verbal fluency, and attention/executive functioning. Behavioral measures and N2 amplitudes showed significant conflict adaptation (i.e., previous-trial congruencies influenced current-trial measures). Higher scores on the attention/executive functioning and verbal fluency domains were associated with larger incongruent-trial N2 conflict adaptation; measures of cognitive functioning were not related to behavioral indices. This study provides initial validation of N2 conflict adaptation effects as cognitive function-related aspects of cognitive control. Copyright © 2012 Society for Psychophysiological Research.
Hill, Jonathan C; Kang, Sujin; Benedetto, Elena; Myers, Helen; Blackburn, Steven; Smith, Stephanie; Dunn, Kate M; Hay, Elaine; Rees, Jonathan; Beard, David; Glyn-Jones, Sion; Barker, Karen; Ellis, Benjamin; Fitzpatrick, Ray; Price, Andrew
2016-08-05
Current musculoskeletal outcome tools are fragmented across different healthcare settings and conditions. Our objectives were to develop and validate a single musculoskeletal outcome measure for use throughout the pathway and patients with different musculoskeletal conditions: the Arthritis Research UK Musculoskeletal Health Questionnaire (MSK-HQ). A consensus workshop with stakeholders from across the musculoskeletal community, workshops and individual interviews with a broad mix of musculoskeletal patients identified and prioritised outcomes for MSK-HQ inclusion. Initial psychometric validation was conducted in four cohorts from community physiotherapy, and secondary care orthopaedic hip, knee and shoulder clinics. Stakeholders (n=29) included primary care, physiotherapy, orthopaedic and rheumatology patients (n=8); general practitioners, physiotherapists, orthopaedists, rheumatologists and pain specialists (n=7), patient and professional national body representatives (n=10), and researchers (n=4). The four validation cohorts included 570 participants (n=210 physiotherapy, n=150 hip, n=150 knee, n=60 shoulder patients). Outcomes included the MSK-HQ's acceptability, feasibility, comprehension, readability and responder burden. The validation cohort outcomes were the MSK-HQ's completion rate, test-retest reliability and convergent validity with reference standards (EQ-5D-5L, Oxford Hip, Knee, Shoulder Scores, and the Keele MSK-PROM). Musculoskeletal domains prioritised were pain severity, physical function, work interference, social interference, sleep, fatigue, emotional health, physical activity, independence, understanding, confidence to self-manage and overall impact. Patients reported MSK-HQ items to be 'highly relevant' and 'easy to understand'. Completion rates were high (94.2%), with scores normally distributed, and no floor/ceiling effects. Test-retest reliability was excellent, and convergent validity was strong (correlations 0.81-0.88). A new musculoskeletal outcome measure has been developed through a coproduction process with patients to capture prioritised outcomes for use throughout the pathway and with different musculoskeletal conditions. Four validation cohorts found that the MSK-HQ had high completion rates, excellent test-retest reliability and strong convergent validity with reference standards. Further validation studies are ongoing, including a cohort with rheumatoid/inflammatory arthritis. Published by the BMJ Publishing Group Limited. For permission to use (where not already granted under a licence) please go to http://www.bmj.com/company/products-services/rights-and-licensing/
Puhan, Milo A; Gaspoz, Jean-Michel; Bridevaux, Pierre-Olivier; Schindler, Christian; Ackermann-Liebrich, Ursula; Rochat, Thierry; Gerbase, Margaret W
2008-02-15
Few epidemiologic studies have assessed health-related quality of life (HRQL) of asthma patients from a general population and it is unclear which instrument is best suitable for this purpose. We investigated the validity of the Asthma Quality of Life Questionnaire (AQLQ) and the SF-36 completed by individuals with asthma from the population-based SAPALDIA (Swiss study on air pollution and lung diseases in adults) cohort. The study included 258 participants with a physician-diagnosed asthma who had completed the AQLQ and SF-36. We assessed floor and ceiling effects, internal consistency reliability and cross-sectional validity with a priori hypotheses that correlations between the specific HRQL domains (e.g. "symptoms" or "physical functioning") and the corresponding external validation measures (respiratory symptoms, need for doctor visits, limitation in activities due to asthma and lung function) would capture similar aspects and be correlated moderately (> or = 0.3) to strongly (> or = 0.5), whereas non-corresponding domains be correlated weakly with each other (<0.3). The AQLQ showed pronounced ceiling effects with all median domain scores above 6 (scores varied from 1-7). For the SF-36, ceiling effects were present in 5 out of 8 domains. Cronbach's alpha was >0.7 for all AQLQ and SF-36 domains. Correlations between the AQLQ domains "respiratory symptoms", "activity limitation" and "environmental exposure", and the validation measures ranged from 0.29-0.57. Correlations between the "emotional function" domain and the validation measures were also in this range (0.31-0.55) and not as low as we hypothesized. For the SF-36, correlations between "physical functioning" and "role physical", and the validation measures ranged from 0.25-0.56, whereas "role emotional" and "mental health" correlated with these measures from 0.01-0.23. The AQLQ and the SF-36 showed fairly good internal consistency. Both instruments are limited by ceiling effects, but they appear less pronounced in the SF-36, which also shows a better discrimination between different aspects of HRQL. The SF-36 may therefore be a more valid measure of HRQL than the AQLQ when applied to individuals with asthma from the general population.
Toomey, Marisa; Schwartz, Justin; Laverdiere, Michele; Tucker, Carole A; Bevans, Katherine; Forrest, Christopher B; Blum, Nathan J
To evaluate the content and construct validity of the existing PROMIS Pediatric Parent-Proxy Peer Relationships Measure in 5- to 12-year-old children with autism spectrum disorder (ASD). Parents of 121 children aged 5 to 12 years who met DSM-IV criteria for ASD completed the Peer Relationships Measure using computerized adaptive testing (CAT). Parents also completed the Social Responsiveness Scale, Second Edition (SRS-2) and a demographic form. Intelligence quotient test results were extracted from clinical or research records. Five parents participated in semi-structured interviews about their child's peer relationships and the item content on the Peer Relationships Measure. The children in the sample were primarily male (87%). The sample was racially and ethnically diverse, and parents were predominantly highly educated. The mean T-score (SD) on the Peer Relationships Measure was 36 (8), with a range from 15 to 62. For 98% of subjects, the CAT required administration of 5 items to reach a standard error of measurement of less than 4 T-score units. The Peer Relationships Measure demonstrated a large correlation with the SRS-2 (r = -0.60, p < .0001). In semi-structured interviews, parents reported that the items on the Peer Relationships Measure were relevant to the peer relationships of their child with ASD, but they reported a few challenges related to variability in their children's peer relationships over time and to somewhat limited knowledge of relationships in school. The PROMIS Pediatric Parent-Proxy Peer Relationships Measure may be an efficient, precise, and valid measure of peer relationships for 5- to 12-year-old children with ASD.
Franklin, Ashley E; Burns, Paulette; Lee, Christopher S
2014-10-01
In 2006, the National League for Nursing published three measures related to novice nurses' beliefs about self-confidence, scenario design, and educational practices associated with simulation. Despite the extensive use of these measures, little is known about their reliability and validity. The psychometric properties of the Student Satisfaction and Self-Confidence in Learning Scale, Simulation Design Scale, and Educational Practices Questionnaire were studied among a sample of 2200 surveys completed by novice nurses from a liberal arts university in the southern United States. Psychometric tests included item analysis, confirmatory and exploratory factor analyses in randomly-split subsamples, concordant and discordant validity, and internal consistency. All three measures have sufficient reliability and validity to be used in education research. There is room for improvement in content validity with the Student Satisfaction and Self-Confidence in Learning and Simulation Design Scale. This work provides robust evidence to ensure that judgments made about self-confidence after simulation, simulation design and educational practices are valid and reliable. Copyright © 2014 Elsevier Ltd. All rights reserved.
DOT National Transportation Integrated Search
2017-10-23
In support of the Federal Aviation Administrations Office of Environment and Energy, the Volpe Center Environmental Measurement and Modeling Division (Volpe) has completed validation of the digital recording and 1/3 octave band analysis components...
ERIC Educational Resources Information Center
Finn, Kevin J.; Saint-Maurice, Pedro F.; Karsai, István; Ihász, Ferenc; Csányi, Tamás
2015-01-01
Purpose: The purpose of this study was to test the convergent validity of Omron 306 using Biospace InBody 720. Method: A total of 267 participants (145 boys; aged 10.4-17.9 years) completed testing during a single session. Each measure provided percent body fat (%BF), while the InBody 720 included fat-free mass (FFM). The validity was examined…
Assessing medical students' self-regulation as aptitude in computer-based learning.
Song, Hyuksoon S; Kalet, Adina L; Plass, Jan L
2011-03-01
We developed a Self-Regulation Measure for Computer-based learning (SRMC) tailored toward medical students, by modifying Zimmerman's Self-Regulated Learning Interview Schedule (SRLIS) for K-12 learners. The SRMC's reliability and validity were examined in 2 studies. In Study 1, 109 first-year medical students were asked to complete the SRMC. Bivariate correlation analysis results indicated that the SRMC scores had a moderate degree of correlation with student achievement in a teacher-developed test. In Study 2, 58 third-year clerkship students completed the SRMC. Regression analysis results indicated that the frequency of medical students' usage of self-regulation strategies was associated with their general clinical knowledge measured by a nationally standardized licensing exam. These two studies provided evidence for the reliability and concurrent validity of the SRMC to assess medical students' self-regulation as aptitude. Future work should provide evidence to guide and improve instructional design as well as inform educational policy.
Validation of the Social Provisions Scale in people with multiple sclerosis.
Chiu, Chung-Yi; Motl, Robert W; Ditchman, Nicole
2016-08-01
This study examined the factorial and construct validity of the Social Provisions Scale (SPS) in a sample of people with multiple sclerosis (MS). Participants included 292 individuals with MS (83.9% women) recruited from the Greater Illinois, Gateway, and Indiana chapters of the National Multiple Sclerosis Society. Participants completed the SPS and pain, fatigue, depression, anxiety, MS self-efficacy, quality of life, and satisfaction with life measures. Factorial validity was tested using confirmatory factor analysis (CFA), and construct validity was examined based on the strength of bivariate correlations with scores on related measures. Findings from the CFA indicated that a first-order, 6-factor measurement model provided a good fit for the 24 items of the SPS (CFI = .94, TLI = .93, RMSEA = 0.07) and that the 6 factors could be described by a single, second-order factor of the overall social provisions (CFI = .93, TLI = .92, RMSEA = 0.08). Cronbach's alpha was .89 for the global score and between .66 and .81 for the 6 subscales. The SPS global and subscale scores correlated significantly with satisfaction with life, depression, anxiety, MS self-efficacy, and quality of life measures. Findings from this study support the factorial validity, construct validity, and reliability of the SPS as a measure of social provisions for use with people with MS. (PsycINFO Database Record (c) 2016 APA, all rights reserved).
Parpa, Efi; Galanopoulou, Natasa; Tsilika, Eleni; Galanos, Antonis; Mystakidou, Kyriaki
2017-08-01
To investigate the psychometric properties of the Greek 13-item measure of patients' satisfaction (FAMCARE-P13) in palliative care setting. A hundred patients completed the FAMCARE-P13. Exploratory factor analysis and confirmatory factor analysis (CFA) have been conducted. Two factors' solution was revealed from CFA. The questionnaire was administered to an initial validation sample and then for test-retest in a sample of 40 patients 3 days later. The Rosenberg Self-Esteem Scale measuring global self-esteem has been also used as a gold standard for construct validity. Subscale and known groups validity have also been tested for FAMCARE-P13s' validity. A reduced 13-item version of our measure (FAMCARE-P13) possessed 2-factor structure with high reliability. Patient satisfaction was correlated with physical distress, communication and relationship with health-care providers, and caregiver satisfaction. We recommend the use of the Greek FAMCARE-P13 to assess care satisfaction of patients with advanced-stage cancer.
Criterion and incremental validity of the emotion regulation questionnaire
Ioannidis, Christos A.; Siegling, A. B.
2015-01-01
Although research on emotion regulation (ER) is developing, little attention has been paid to the predictive power of ER strategies beyond established constructs. The present study examined the incremental validity of the Emotion Regulation Questionnaire (ERQ; Gross and John, 2003), which measures cognitive reappraisal and expressive suppression, over and above the Big Five personality factors. It also extended the evidence for the measure's criterion validity to yet unexamined criteria. A university student sample (N = 203) completed the ERQ, a measure of the Big Five, and relevant cognitive and emotion-laden criteria. Cognitive reappraisal predicted positive affect beyond personality, as well as experiential flexibility and constructive self-assertion beyond personality and affect. Expressive suppression explained incremental variance in negative affect beyond personality and in experiential flexibility beyond personality and general affect. No incremental effects were found for worry, social anxiety, rumination, reflection, and preventing negative emotions. Implications for the construct validity and utility of the ERQ are discussed. PMID:25814967
Maddison, Ralph; Jiang, Yannan; Dalleck, Lance; Löf, Marie
2013-01-01
Background Questionnaires are commonly used to assess physical activity in large population-based studies because of their low cost and convenience. Many self-report physical activity questionnaires have been shown to be valid and reliable measures, but they are subject to measurement errors and misreporting, often due to lengthy recall periods. Mobile phones offer a novel approach to measure self-reported physical activity on a daily basis and offer real-time data collection with the potential to enhance recall. Objective The aims of this study were to determine the convergent validity of a mobile phone physical activity (MobilePAL) questionnaire against accelerometry in people with cardiovascular disease (CVD), and to compare how the MobilePAL questionnaire performed compared with the commonly used self-recall International Physical Activity Questionnaire (IPAQ). Methods Thirty adults aged 49 to 85 years with CVD were recruited from a local exercise-based cardiac rehabilitation clinic in Auckland, New Zealand. All participants completed a demographics questionnaire and underwent a 6-minute walk test at the first visit. Subsequently, participants were temporarily provided a smartphone (with the MobilePAL questionnaire preloaded that asked 2 questions daily) and an accelerometer, which was to be worn for 7 days. After 1 week, a follow-up visit was completed during which the smartphone and accelerometer were returned, and participants completed the IPAQ. Results Average daily physical activity level measured using the MobilePAL questionnaire showed moderate correlation (r=.45; P=.01) with daily activity counts per minute (Acc_CPM) and estimated metabolic equivalents (MET) (r=.45; P=.01) measured using the accelerometer. Both MobilePAL (beta=.42; P=.008) and age (beta=–.48, P=.002) were significantly associated with Acc_CPM (adjusted R2=.40). When IPAQ-derived energy expenditure, measured in MET-minutes per week (IPAQ_met), was considered in the predicted model, both IPAQ_met (beta=.51; P=.001) and age (beta=–.36; P=.016) made unique contributions (adjusted R2=.47, F 2,27=13.58; P<.001).There was also a significant association between the MobilePAL and IPAQ measures (r=.49, beta=.51; P=.007). Conclusions A mobile phone–delivered questionnaire is a relatively reliable and valid measure of physical activity in a CVD cohort. Reliability and validity measures in the present study are comparable to existing self-report measures. Given their ubiquitous use, mobile phones may be an effective method for physical activity surveillance data collection. PMID:23524251
Test Bed Doppler Wind Lidar and Intercomparison Facility At NASA Langley Research Center
NASA Technical Reports Server (NTRS)
Kavaya, Michael J.; Koch, Grady J.; Petros, Mulugeta; Barnes, Bruce W.; Beyon, Jeffrey; Amzajerdian, Farzin; Yu, Ji-Rong; Singh, Upendra N.
2004-01-01
State of the art 2-micron lasers and other lidar components under development by NASA are being demonstrated and validated in a mobile test bed Doppler wind lidar. A lidar intercomparison facility has been developed to ensure parallel alignment of up to 4 Doppler lidar systems while measuring wind. Investigations of the new components; their operation in a complete system; systematic and random errors; the hybrid (joint coherent and direct detection) approach to global wind measurement; and atmospheric wind behavior are planned. Future uses of the VALIDAR (VALIDation LIDAR) mobile lidar may include comparison with the data from an airborne Doppler wind lidar in preparation for validation by the airborne system of an earth orbiting Doppler wind lidar sensor.
Schoemaker, Marina M; Niemeijer, Anuschka S; Flapper, Boudien C T; Smits-Engelsman, Bouwien C M
2012-04-01
The aim of this study was to investigate the validity and reliability of the Movement Assessment Battery for Children-2 Checklist (MABC-2). Teachers completed the Checklist for 383 children (age range 5-8y; mean age 6y 9mo; 190 males; 193 females) and the parents of 130 of these children completed the Developmental Disorder Coordination Questionnaire 2007 (DCDQ'07). All children were assessed with the MABC-2 Test. The internal consistency of the 30 items of the Checklist was determined to measure reliability. Construct validity was investigated using factor analysis and discriminative validity was assessed by comparing the scores of children with and without movement difficulties. Concurrent validity was measured by calculating correlations between the Checklist, Test, and the DCDQ'07. Incremental validity was assessed to determine whether the Checklist was a better predictor of motor impairment than the DCDQ'07. Sensitivity and specificity were investigated using the MABC-2 Test as reference standard (cut-off 15th centile). The Checklist items measure the same construct. Six factors were obtained after factor analysis. This implies that a broad range of functional activities can be assessed with the Checklist, which renders the Checklist useful for assessing criterion B of the diagnostic criteria for DCD. The mean Checklist scores for children with and without motor impairments significantly differed (p<0.001). The scores for the Checklist/Test and DCDQ'07 were significantly correlated (r(S) =-0.38 and p<0.001, and r(S) =-0.36 and p<0.001, respectively). The Checklist better predicted motor impairment than the DCDQ'07. Overall, the sensitivity was low (41%) and the specificity was acceptable (88%). The Checklist meets standards for validity and reliability. © The Authors. Developmental Medicine & Child Neurology © 2012 Mac Keith Press.
Modi, Avani C; Junger, Katherine F; Mara, Constance A; Kellermann, Tanja; Barrett, Lauren; Wagner, Janelle; Mucci, Grace A; Bailey, Laurie; Almane, Dace; Guilfoyle, Shanna M; Urso, Lauryn; Hater, Brooke; Hustzi, Heather; Smith, Gigi; Herrmann, Bruce; Perry, M Scott; Zupanc, Mary; Varni, James W
2017-11-01
To validate a brief and reliable epilepsy-specific, health-related quality of life (HRQOL) measure in children with various seizure types, treatments, and demographic characteristics. This national validation study was conducted across five epilepsy centers in the United States. Youth 5-18 years and caregivers of youth 2-18 years diagnosed with epilepsy completed the PedsQL Epilepsy Module and additional questionnaires to establish reliability and validity of the epilepsy-specific HRQOL instrument. Demographic and medical data were collected through chart reviews. Factor analysis was conducted, and internal consistency (Cronbach's alphas), test-retest reliability, and construct validity were assessed. Questionnaires were analyzed from 430 children with epilepsy (M age = 9.9 years; range 2-18 years; 46% female; 62% white: non-Hispanic; 76% monotherapy, 54% active seizures) and their caregivers. The final PedsQL Epilepsy Module is a 29-item measure with five subscales (i.e., Impact, Cognitive, Sleep, Executive Functioning, and Mood/Behavior) with parallel child and caregiver reports. Internal consistency coefficients ranged from 0.70-0.94. Construct validity and convergence was demonstrated in several ways, including strong relationships with seizure outcomes, antiepileptic drug (AED) side effects, and well-established measures of executive, cognitive, and emotional/behavioral functioning. The PedsQL Epilepsy Module is a reliable measure of HRQOL with strong evidence of its validity across the epilepsy spectrum in both clinical and research settings. Wiley Periodicals, Inc. © 2017 International League Against Epilepsy.
Validation of Yoon's Critical Thinking Disposition Instrument.
Shin, Hyunsook; Park, Chang Gi; Kim, Hyojin
2015-12-01
The lack of reliable and valid evaluation tools targeting Korean nursing students' critical thinking (CT) abilities has been reported as one of the barriers to instructing and evaluating students in undergraduate programs. Yoon's Critical Thinking Disposition (YCTD) instrument was developed for Korean nursing students, but few studies have assessed its validity. This study aimed to validate the YCTD. Specifically, the YCTD was assessed to identify its cross-sectional and longitudinal measurement invariance. This was a validation study in which a cross-sectional and longitudinal (prenursing and postnursing practicum) survey was used to validate the YCTD using 345 nursing students at three universities in Seoul, Korea. The participants' CT abilities were assessed using the YCTD before and after completing an established pediatric nursing practicum. The validity of the YCTD was estimated and then group invariance test using multigroup confirmatory factor analysis was performed to confirm the measurement compatibility of multigroups. A test of the seven-factor model showed that the YCTD demonstrated good construct validity. Multigroup confirmatory factor analysis findings for the measurement invariance suggested that this model structure demonstrated strong invariance between groups (i.e., configural, factor loading, and intercept combined) but weak invariance within a group (i.e., configural and factor loading combined). In general, traditional methods for assessing instrument validity have been less than thorough. In this study, multigroup confirmatory factor analysis using cross-sectional and longitudinal measurement data allowed validation of the YCTD. This study concluded that the YCTD can be used for evaluating Korean nursing students' CT abilities. Copyright © 2015. Published by Elsevier B.V.
Validation of an electronic version of the Mini Asthma Quality of Life Questionnaire.
Olajos-Clow, J; Minard, J; Szpiro, K; Juniper, E F; Turcotte, S; Jiang, X; Jenkins, B; Lougheed, M D
2010-05-01
The Mini Asthma Quality of Life Questionnaire (MiniAQLQ) is a validated disease-specific quality of life (QOL) paper (p) questionnaire. Electronic (e) versions enable inclusion of asthma QOL in electronic medical records and research databases. To validate an e-version of the MiniAQLQ, compare time required for completion of e- and p-versions, and determine which version participants prefer. Adults with stable asthma were randomized to complete either the e- or p-MiniAQLQ, followed by a 2-h rest period before completing the other version. Agreement between versions was measured using the intraclass correlation coefficient (ICC) and Bland-Altman analysis. Two participants with incomplete p-MiniAQLQ responses were excluded. Forty participants (85% female; age 47.7 +/- 14.9 years; asthma duration 22.6 +/- 16.1 years; FEV(1) 87.1 +/- 21.6% predicted) with both AQLQ scores <6.0 completed the study. Agreement between e- and p-versions for the overall score was acceptable (ICC=0.95) with no bias (difference (Delta) p-e=0.1; P=0.21). ICCs for the symptom, activity limitation, emotional function and environmental stimuli domains were 0.94, 0.89, 0.90, and 0.91 respectively. A small but significant bias (Delta=0.3; P=0.004) was noted in the activity limitation domain. Completion time was significantly longer for the e-version (3.8 +/- 1.9min versus 2.7 +/- 1.1min; P<0.0001). The majority of patients (57.5%) preferred the e-MiniAQLQ; 35% had no preference. This e-version of the MiniAQLQ is valid and was preferred by most participants despite taking slightly longer to complete. Generalizabilty may be limited in younger (12-17) and older (>65) adults.
RBANS Validity Indices: a Systematic Review and Meta-Analysis.
Shura, Robert D; Brearly, Timothy W; Rowland, Jared A; Martindale, Sarah L; Miskey, Holly M; Duff, Kevin
2018-05-16
Neuropsychology practice organizations have highlighted the need for thorough evaluation of performance validity as part of the neuropsychological assessment process. Embedded validity indices are derived from existing measures and expand the scope of validity assessment. The Repeatable Battery for the Assessment of Neuropsychological Status (RBANS) is a brief instrument that quickly allows a clinician to assess a variety of cognitive domains. The RBANS also contains multiple embedded validity indicators. The purpose of this study was to synthesize the utility of those indicators to assess performance validity. A systematic search was completed, resulting in 11 studies for synthesis and 10 for meta-analysis. Data were synthesized on four indices and three subtests across samples of civilians, service members, and veterans. Sufficient data for meta-analysis were only available for the Effort Index, and related analyses indicated optimal cutoff scores of ≥1 (AUC = .86) and ≥ 3 (AUC = .85). However, outliers and heterogeneity were present indicating the importance of age and evaluation context. Overall, embedded validity indicators have shown adequate diagnostic accuracy across a variety of populations. Recommendations for interpreting these measures and future studies are provided.
Schwartz, Seth J.; Unger, Jennifer B.; Lorenzo-Blanco, Elma I.; Des Rosiers, Sabrina E.; Villamar, Juan A.; Soto, Daniel W.; Pattarroyo, Monica; Baezconde-Garbanati, Lourdes; Szapocznik, José
2013-01-01
Context of reception has been discussed widely in the sociological and anthropological literature, but no measures of this construct exist. We designed a measure of perceived context of reception and provide initial support for the factorial validity, internal consistency reliability, and incremental and discriminant validity of scores generated by this measure. A sample of 302 recent-immigrant Hispanic parent-adolescent dyads from Miami and Los Angeles completed the new perceived context of reception measure, as well as measures of perceived discrimination; Hispanic/American cultural practices, values, and identifications; and depressive symptoms. In Phase 1, exploratory and confirmatory factor analyses extracted a factor for negative perceived context of reception. A subscale corresponding to this factor was used in Phase 2; for parents and adolescents, negative perceived context of reception and perceived discrimination were differentially associated with acculturation-related variables – suggesting discriminant validity between perceived discrimination and negative perceived context of reception. For adolescents at both sites and for parents in Los Angeles only, the negative perceived context of reception dimensions were significantly associated with depressive symptoms six months later, over and above the contribution made by perceived discrimination – suggesting incremental validity. Results are discussed in terms of perceived context of reception as a new and emerging construct. PMID:24099485
Schwartz, Seth J; Unger, Jennifer B; Lorenzo-Blanco, Elma I; Des Rosiers, Sabrina E; Villamar, Juan A; Soto, Daniel W; Pattarroyo, Monica; Baezconde-Garbanati, Lourdes; Szapocznik, José
2014-01-01
Context of reception has been discussed widely in the sociological and anthropological literature, but no measures of this construct exist. We designed a measure of perceived context of reception and provide initial support for the factorial validity, internal consistency reliability, and incremental and discriminant validity of scores generated by this measure. A sample of 302 recent-immigrant Hispanic parent-adolescent dyads from Miami and Los Angeles completed the new perceived context of reception measure, as well as measures of perceived discrimination; Hispanic/American cultural practices, values, and identifications; and depressive symptoms. In Phase 1, exploratory and confirmatory factor analyses extracted a factor for negative perceived context of reception. A subscale corresponding to this factor was used in Phase 2; for parents and adolescents, negative perceived context of reception and perceived discrimination were differentially associated with acculturation-related variables-suggesting discriminant validity between perceived discrimination and negative perceived context of reception. For adolescents at both sites and for parents in Los Angeles only, the negative perceived context of reception dimensions were significantly associated with depressive symptoms 6 months later, over and above the contribution made by perceived discrimination--suggesting incremental validity. Results are discussed in terms of perceived context of reception as a new and emerging construct.
Wells-Di Gregorio, Sharla; Porensky, Emily K; Minotti, Matthew; Brown, Susan; Snapp, Janet; Taylor, Robert M; Adolph, Michael D; Everett, Sherman; Lowther, Kenneth; Callahan, Kelly; Streva, Devita; Heinke, Vicki; Leno, Debra; Flower, Courtney; McVey, Anne; Andersen, Barbara Lee
2013-09-01
Selecting a measure for oncology distress screening can be challenging. The measure must be brief, but comprehensive, capturing patients' most distressing concerns. The measure must provide meaningful coverage of multiple domains, assess symptom and problem-related distress, and ideally be suited for both clinical and research purposes. From March 2006 to August 2012, the James Supportive Care Screening (SCS) was developed and validated in three phases including content validation, factor analysis, and measure validation. Exploratory factor analyses were completed with 596 oncology patients followed by a confirmatory factor analysis with 477 patients. Six factors were identified and confirmed including (i) emotional concerns; (ii) physical symptoms; (iii) social/practical problems; (iv) spiritual problems; (v) cognitive concerns; and (vi) healthcare decision making/communication issues. Subscale evaluation reveals good to excellent internal consistency, test-retest reliability, and convergent, divergent, and predictive validity. Specificity of individual items was 0.90 and 0.87, respectively, for identifying patients with DSM-IV-TR diagnoses of major depression and generalized anxiety disorder. Results support use of the James SCS to quickly detect the most frequent and distressing symptoms and concerns of cancer patients. The James SCS is an efficient, reliable, and valid clinical and research outcomes measure. Copyright © 2013 John Wiley & Sons, Ltd.
Burke, Kylie; McCarthy, Maria; Lowe, Cherie; Sanders, Matthew R; Lloyd, Erin; Bowden, Madeleine; Williams, Lauren
2017-03-01
Childhood cancer is associated with child adjustment difficulties including, eating and sleep disturbance, and emotional and other behavioral difficulties. However, there is a lack of validated instruments to measure the specific child adjustment issues associated with pediatric cancer treatments. The aim of this study was to develop and evaluate the reliability and validity of a parent-reported, child adjustment scale. One hundred thirty-two parents from two pediatric oncology centers who had children (aged 2-10 years) diagnosed with cancer completed the newly developed measure and additional measures of child behavior, sleep, diet, and quality of life. Children were more than 4 weeks postdiagnosis and less than 12 months postactive treatment. Factor structure, internal consistency, and construct (convergent) validity analyses were conducted. Principal component analysis revealed five distinct and theoretically coherent factors: Sleep Difficulties, Impact of Child's Illness, Eating Difficulties, Hospital-Related Behavior Difficulties, and General Behavior Difficulties. The final 25-item measure, the Children's Oncology Child Adjustment Scale (ChOCs), demonstrated good internal consistency (α = 0.79-0.91). Validity of the ChOCs was demonstrated by significant correlations between the subscales and measures of corresponding constructs. The ChOCs provides a new measure of child adjustment difficulties designed specifically for pediatric oncology. Preliminary analyses indicate strong theoretical and psychometric properties. Future studies are required to further examine reliability and validity of the scale, including test-retest reliability, discriminant validity, as well as change sensitivity and generalizability across different oncology samples and ages of children. The ChOCs shows promise as a measure of child adjustment relevant for oncology clinical settings and research purposes. © 2016 Wiley Periodicals, Inc.
Bryan, Angela; Rocheleau, Courtney A.; Robbins, Reuben N.; Hutchison, Kent E.
2005-01-01
The goal of this study was the exploration of distal effects of alcohol use on condom use. Criminally involved adolescents completed an initial measure of attitudes, beliefs, and prior behavior. Of the 300 who completed the initial measurement, 267 (89%) completed a behavioral assessment 6 months later. Analyses validated a theoretical model of condom use intentions and indicated that intentions and attitudes measured at baseline were significant predictors of condom use behavior 6 months later. Neither alcohol use nor alcohol problems moderated relationships among model variables or the influence of intentions and attitudes on behavior. The findings do not support a distal role for alcohol use in altering the cognitive correlates of condom use intentions and behavior among high-risk adolescents. PMID:15755227
The Multiple Sclerosis Self-Management Scale
Ghahari, Setareh; Khoshbin, Lana S.
2014-01-01
Background: The Multiple Sclerosis Self-Management Scale (MSSM) is currently the only measure that was developed specifically to address self-management among individuals with multiple sclerosis (MS). While good internal consistency (α = 0.85) and construct validity have been demonstrated, other psychometric properties have not been established. This study was undertaken to evaluate the criterion validity, test-retest reliability, and face validity of the MSSM. Methods: Thirty-one individuals with MS who met the inclusion criteria were recruited to complete a series of questionnaires at two time points. At Time 1, participants completed the MSSM and two generic self-management tools—the Partners in Health (PIH-12) and the Health Education Impact Questionnaire (heiQ)—as well as a short questionnaire to capture participants' opinions about the MSSM. At Time 2, approximately 2 weeks after Time 1, participants completed the MSSM again. Results: The available MSSM factors showed moderate to high correlations with both PIH-12 and heiQ and were deemed to have satisfactory test-retest reliability. Face validity pointed to areas of the MSSM that need to be revised in future work. As indicated by the participants, some dimensions of MS self-management are missing in the MSSM and some items such as medication are redundant. Conclusions: This study provides evidence for the reliability and validity of the MSSM; however, further changes are required for both researchers and clinicians to use the tool meaningfully in practice. PMID:25061429
Transcultural adaptation of the Breast Cancer Awareness Measure.
Al-Khasawneh, E M; Leocadio, M; Seshan, V; Siddiqui, S T; Khan, A N; Al-Manaseer, M M
2016-09-01
To overcome the lack of a validated and robust Arabic instrument to measure breast cancer awareness. Currently, there is no validated Arabic instrument for measuring breast cancer awareness levels. We adapted, translated and validated the Breast Cancer Awareness Measure developed by Cancer Research UK. The instrument was translated into Arabic and back-translated for validation. Validation and reliability tests were conducted using purposively sampled 972 Arab women older than 20 years, living in Oman. The adapted content was validated by a panel of medical, linguistic and cultural experts, followed by cognitive interviews (n = 10), behavioural coding (n = 30) and criterion validation (n = 646). The instrument was tested for acceptability and its subscales for internal consistency. Inter-rater reliability was estimated between two similar groups (n = 144 and n = 142) to test homogeneity. The adapted and translated instrument had a high acceptability (98.7% completed). The validation process shaped the adaptation, and resulted in strong criterion validity (R = 0.58, P < 0.01). The instrument subscales for risk factors and warning signs had high internal consistency (Cronbach's alpha 0.856 and 0.890, respectively), with all floor and ceiling effects less than 15%. The correlation measure for inter-rater reliability was 0.97 (P < 0.01). Through the incorporation of contextual characteristics and prevalent beliefs among Arab populations, the adapted Best Cancer Awareness Measure is a robust Arabic instrument for the measurement of breast cancer awareness and early detection practices among Arab women. The purposively selected sample may not be representative of the population. Improvement of awareness and early detection of breast cancer can contribute towards reducing mortality from the disease. The adapted instrument has policy implications, since measurement of awareness levels is essential towards breast health promotion policies in Arab countries. © 2016 International Council of Nurses.
Jarc, Anthony M; Curet, Myriam J
2017-03-01
Effective visualization of the operative field is vital to surgical safety and education. However, additional metrics for visualization are needed to complement other common measures of surgeon proficiency, such as time or errors. Unlike other surgical modalities, robot-assisted minimally invasive surgery (RAMIS) enables data-driven feedback to trainees through measurement of camera adjustments. The purpose of this study was to validate and quantify the importance of novel camera metrics during RAMIS. New (n = 18), intermediate (n = 8), and experienced (n = 13) surgeons completed 25 virtual reality simulation exercises on the da Vinci Surgical System. Three camera metrics were computed for all exercises and compared to conventional efficiency measures. Both camera metrics and efficiency metrics showed construct validity (p < 0.05) across most exercises (camera movement frequency 23/25, camera movement duration 22/25, camera movement interval 19/25, overall score 24/25, completion time 25/25). Camera metrics differentiated new and experienced surgeons across all tasks as well as efficiency metrics. Finally, camera metrics significantly (p < 0.05) correlated with completion time (camera movement frequency 21/25, camera movement duration 21/25, camera movement interval 20/25) and overall score (camera movement frequency 20/25, camera movement duration 19/25, camera movement interval 20/25) for most exercises. We demonstrate construct validity of novel camera metrics and correlation between camera metrics and efficiency metrics across many simulation exercises. We believe camera metrics could be used to improve RAMIS proficiency-based curricula.
Pilar Orive, Francisco Javier; Basabe Lozano, Jasone; López Zuñiga, Aurora; López Fernández, Yolanda M; Escudero Argaluza, Julene; Latour, Jos M
2017-11-03
Few validated surveys measuring parental satisfaction in the Paediatric Intensive Care Unit (PICU) are available, and none of them in Spanish language. The aim of this study is to translate and validate the questionnaire EMpowerment of PArents in THe Intensive Care (EMPATHIC). This questionnaire measures parental perceptions of paediatric intensive care-related satisfaction items in the Spanish language. A prospective cohort study was carried out using questionnaires completed by relatives of children (range 0-17 years old) admitted into a tertiary PICU. Inclusion criteria were a length of stay more than 24h, and a suitable understanding of Spanish language by parents or guardians. Exclusion criteria were re-admissions and deceased patients. The questionnaire was translated from English to Spanish language using a standardised procedure, after which it was used in a cross-sectional observational study was performed to confirm its validity and consistency. Reliability was estimated using Cronbach's α, and content validity using Spearman's correlation analysis. A total of 150 questionnaires were collected. A Cronbach's α was obtained for domains greater than 0.7, showing a high internal consistency from the questionnaire. Validity was measured by correlating 5 domains with 4 general satisfaction items, documenting an adequate correlation (Rs: 0.41-0.66, P<.05). The Spanish version of EMPHATIC 30 is a feasible, easy, and suitable tool in this specific environment, based on the results. EMPATHIC 30 is able to measure parental satisfaction, and may serve as a valid indicator to measure quality of care in Spanish PICUs. Copyright © 2017. Publicado por Elsevier España, S.L.U.
Uysal, Hilal; Ozcan, Şeyda
2011-06-01
Many new measuring devices have been developed so that broader psychometric measurements in the coronary artery disease, disease-specific health status measurements, and identification of the broader quality of life can be performed in the recent years. The study was intended to determine whether, and to what extent, MIDAS is a valid and reliable measurement to the patients suffering from myocardial infarction for the first time in Turkey. The research was conducted with the patients hospitalized and treated with myocardial infarction in the cardiology departments of 2 hospitals in Istanbul, Turkey, between 2007 and 2008. Psychometric evaluations of TR-MIDAS were used for validity studies; language validity, content validity, construct validity were examined. For reliability studies; the tool's internal consistency reliability, Cronbach's alpha reliability coefficient, and test-retest reliability were completed. The instrument's content validity index was determined to be "0.95". Principal component analysis revealed six factors with an eigenvalue >1.5. Cronbach's alpha was found to be 0.89 for total scale which was an acceptable value. The total's test-retest reliability was 0.51 (p<0.01). Data obtained at the end of the study supports that Turkish Myocardial Infarction Dimensional Assessment Scale is a valid and reliable instrument as a disease-specific scale to assess the patients' quality of life suffering from myocardial infarction in Turkey. Copyright © 2010 European Society of Cardiology. Published by Elsevier B.V. All rights reserved.
Wang, W; Lopez, V; Thompson, D R
2006-09-01
To evaluate the validity, reliability, and cultural relevance of the Chinese Mandarin version of Myocardial Infarction Dimensional Assessment Scale (MIDAS) as a disease-specific quality of life measure. The cultural relevance and content validity of the Chinese Mandarin version of the MIDAS (CM-MIDAS) was evaluated by an expert panel. Measurement performance was tested on 180 randomly selected Chinese MI patents. Thirty participants from the primary group completed the CM-MIDAS for test-retest reliability after 2 weeks. Reliability, validity and discriminatory power of the CM-MIDAS were calculated. Two items were modified as suggested by the expert panel. The overall CM-MIDAS had acceptable internal consistency with Cronbach's alpha coefficient 0.93 for the scale and 0.71-0.94 for the seven domains. Test-retest reliability by intraclass correlations was 0.85 for the overall scale and 0.74-0.94 for the seven domains. There was acceptable concurrent validity with significant (p < 0.05) correlations between the CM-MDAS and the Chinese Version of the Short Form 36. The principal components analysis extracted seven factors that explained 67.18% of the variance with high factor loading indicating good construct validity. Empirical data support CM-MIDAS as a valid and reliable disease-specific quality of life measure for Chinese Mandarin speaking patients with myocardial infarction.
Gorgey, Ashraf S; Dolbow, David R; Gater, David R
2012-07-01
To establish and validate prediction equations by using body weight to predict legs, trunk, and whole-body fat-free mass (FFM) in men with chronic complete spinal cord injury (SCI). Cross-sectional design. Research setting in a large medical center. Individuals with SCI (N=63) divided into prediction (n=42) and cross-validation (n=21) groups. Not applicable. Whole-body FFM and regional FFM were determined by using dual-energy x-ray absorptiometry. Body weight was measured by using a wheelchair weighing scale after subtracting the weight of the chair. Body weight predicted legs FFM (legs FFM=.09×body weight+6.1; R(2)=.25, standard error of the estimate [SEE]=3.1kg, P<.01), trunk FFM (trunk FFM=.21×body weight+8.6; R(2)=.56, SEE=3.6kg, P<.0001), and whole-body FFM (whole-body FFM=.288×body weight+26.3; R(2)=.53, SEE=5.3kg, P<.0001). The whole-body FFM(predicted) (FFM predicted from the derived equations) shared 86% of the variance in whole-body FFM(measured) (FFM measured using dual-energy x-ray absorptiometry scan) (R(2)=.86, SEE=1.8kg, P<.0001), 69% of trunk FFM(measured), and 66% of legs FFM(measured). The trunk FFM(predicted) shared 69% of the variance in trunk FFM(measured) (R(2)=.69, SEE=2.7kg, P<.0001), and legs FFM(predicted) shared 67% of the variance in legs FFM(measured) (R(2)=.67, SEE=2.8kg, P<.0001). Values of FFM did not differ between the prediction and validation groups. Body weight can be used to predict whole-body FFM and regional FFM. The predicted whole-body FFM improved the prediction of trunk FFM and legs FFM. Copyright © 2012 American Congress of Rehabilitation Medicine. Published by Elsevier Inc. All rights reserved.
Validity of instruments to assess students' travel and pedestrian safety
2010-01-01
Background Safe Routes to School (SRTS) programs are designed to make walking and bicycling to school safe and accessible for children. Despite their growing popularity, few validated measures exist for assessing important outcomes such as type of student transport or pedestrian safety behaviors. This research validated the SRTS school travel survey and a pedestrian safety behavior checklist. Methods Fourth grade students completed a brief written survey on how they got to school that day with set responses. Test-retest reliability was obtained 3-4 hours apart. Convergent validity of the SRTS travel survey was assessed by comparison to parents' report. For the measure of pedestrian safety behavior, 10 research assistants observed 29 students at a school intersection for completion of 8 selected pedestrian safety behaviors. Reliability was determined in two ways: correlations between the research assistants' ratings to that of the Principal Investigator (PI) and intraclass correlations (ICC) across research assistant ratings. Results The SRTS travel survey had high test-retest reliability (κ = 0.97, n = 96, p < 0.001) and convergent validity (κ = 0.87, n = 81, p < 0.001). The pedestrian safety behavior checklist had moderate reliability across research assistants' ratings (ICC = 0.48) and moderate correlation with the PI (r = 0.55, p =< 0.01). When two raters simultaneously used the instrument, the ICC increased to 0.65. Overall percent agreement (91%), sensitivity (85%) and specificity (83%) were acceptable. Conclusions These validated instruments can be used to assess SRTS programs. The pedestrian safety behavior checklist may benefit from further formative work. PMID:20482778
Patel, Amit S; Siegert, Richard J; Brignall, Katherine; Gordon, Patrick; Steer, Sophia; Desai, Sujal R; Maher, Toby M; Renzoni, Elisabetta A; Wells, Athol U; Higginson, Irene J; Birring, Surinder S
2012-09-01
Health status is impaired in patients with interstitial lung disease (ILD). There is a paucity of tools that assess health status in ILD. The objective of this study was to develop and validate the King's Brief Interstitial Lung Disease questionnaire (K-BILD), a new health status measure for patients with ILD. Patients with ILD were recruited from outpatient clinics. The development of the questionnaire consisted of three phases: item generation; item reduction, allocation to domains by factor analysis, Rasch analysis to create unidimensional scales and validation; and repeatability testing. 173 patients with ILD (49 with idiopathic pulmonary fibrosis) completed a preliminary 71-item questionnaire. 56 items were removed due to redundancy, low factor loadings or poor fit to the Rasch model. The final version of the K-BILD questionnaire consisted of 15 items and three domains (breathlessness and activities, chest symptoms and psychological). Internal consistency assessed with Cronbach's α coefficient was 0.94 for the K-BILD total score. Concurrent validity of the K-BILD questionnaire was high compared with St George's Respiratory Questionnaire (r=0.90) and moderate with lung function (vital capacity, r=0.50). The K-BILD questionnaire was repeatable over 2 weeks (n=44), with intraclass correlation coefficients for domains and total score 0.86-0.94. The K-BILD construct validity for patients with idiopathic pulmonary fibrosis was similar to that of other ILDs. The K-BILD questionnaire is a brief, valid, self-completed health status measure for ILD. It could be used in the clinic to assess ILD from the patients' perspective.
Tuğay, Baki Umut; Tuğay, Nazan; Güney, Hande; Kınıklı, Gizem İrem; Yüksel, İnci; Atilla, Bülent
2016-01-01
The Oxford Knee Score (OKS) is a valid, short, self-administered, and site- specific outcome measure specifically developed for patients with knee arthroplasty. This study aimed to cross-culturally adapt and validate the OKS to be used in Turkish-speaking patients with osteoarthritis of the knee. The OKS was translated and culturally adapted according to the guidelines in the literature. Ninety-one patients (mean age: 55.89±7.85 years) with knee osteoarthritis participated in the study. Patients completed the Turkish version of the Oxford Knee Score (OKS-TR), Short-Form 36 Health Survey (SF-36), and Western Ontario and McMaster Universities Index (WOMAC) questionnaires. Internal consistency was tested using Cronbach's α coefficient. Patients completed the OKS-TR questionnaire twice in 7 days to determine the reproducibility. Correlation between the total results of both tests was determined by Spearman's correlation coefficient and intraclass correlation coefficients (ICC). Validity was assessed by calculating Spearman's correlation coefficient between the OKS, WOMAC, and SF-36 scores. Floor and ceiling effects were analyzed. Internal consistency was high (Cronbach's α: 0.90). The reproducibility tested by 2 different methods showed no significant difference (p>0.05). The construct validity analyses showed a significant correlation between the OKS and the other scores (p<0.05). There was no floor or ceiling effect in total OKS score. The OKS-TR is a reliable and valid measure for the self-assessment of pain and function in Turkish-speaking patients with osteoarthritis of the knee.
Development and Validity of the Rating Scales of Academic Skills for Reading Comprehension
ERIC Educational Resources Information Center
Shapiro, Edward S.; Gebhardt, Sarah; Flatley, Katie; Guard, Kirra B.; Fu, Qiong; Leichman, Erin S.; Calhoon, Mary Beth; Hojnoski, Robin
2017-01-01
The development and psychometric qualities of a measure using teacher judgment to rate performance in reading comprehension for narrative text is described--the Rating Scales for Academic Skills-Reading Comprehension Narrative (RSAS-RCN). Sixty-five teachers from the third, fourth, and fifth grades of 8 elementary schools completed the measure on…
ERIC Educational Resources Information Center
Janus, Magdalena; Brinkman, Sally A.; Duku, Eric K.
2011-01-01
There is an increasing support from international organizations and the research community for stepping beyond infant or child mortality as the most common child level social indicator and progressing towards an international measure of child development. The Early Development Instrument (EDI) is a teacher-completed measure of children's…
ERIC Educational Resources Information Center
Oetzel, John; Wallerstein, Nina; Solimon, Audrey; Garcia, Bruce; Siemon, Mark; Adeky, Sarah; Apachito, Gracie; Caston, Elissa; Finster, Carolyn; Belone, Lorenda; Tafoya, Greg
2011-01-01
The purpose of this study was to develop a measure of community capacity for American Indian communities. The study included development and testing phases to ensure face, content, construct, and predictive validity. There were 500 participants in two southwest tribes who completed a detailed community profile, which contained 21 common items in…
ZEMEL, BABETTE S.; CAREY, LISA B.; PAULHAMUS, DONNA R.; STALLINGS, VIRGINIA A.; ITTENBACH, RICHARD F.
2014-01-01
Quantifying dietary behavior is difficult and can be intrusive. Calcium, an essential mineral for skeletal development during childhood, is difficult to assess. Few studies have examined the use of food frequency questionnaires (FFQs) for assessing calcium intake in school-age children. This study evaluated the validity and reliability of the Calcium Counts!© FFQ (CCFFQ) for estimating calcium intake in school children in the US. Healthy children, aged 7–10 years (n = 139) completed the CCFFQ and 7-day weighed food records. A subset of subjects completed a second CCFFQ within 3.6 months. Concurrent validity was determined using Pearson correlations between the CCFFQ and food record estimates of calcium intake, and the relationship between quintiles for the two measures. Predictive validity was determined using generalized linear regression models to explore the effects of age, race, and gender. Inter- and intra-individual variability in calcium intake was high (>300 mg/day). Calcium intake was ~300 mg/day higher by CCFFQ compared to food records. Concurrent validity was moderate (r = 0.61) for the entire cohort and higher for selected subgroups. Predictive validity estimates yielded significant relationships between CCFFQ and food record estimates of calcium intake alone and in the presence of such potential effect modifiers as age group, race, and gender. Test–retest reliability was high (r = 0.74). Although calcium intake estimated by the CCFFQ was greater than that measured by food records, the CCFFQ provides valid and reliable estimates of calcium intake in children. The CCFFQ is especially well-suited as a tool to identify children with low calcium intakes. PMID:19621431
Oetzel, John; Wallerstein, Nina; Solimon, Audrey; Garcia, Bruce; Siemon, Mark; Adeky, Sarah; Apachito, Gracie; Caston, Elissa; Finster, Carolyn; Belone, Lorenda; Tafoya, Greg
2011-06-01
The purpose of this study was to develop a measure of community capacity for American Indian communities. The study included development and testing phases to ensure face, content, construct, and predictive validity. There were 500 participants in two southwest tribes who completed a detailed community profile, which contained 21 common items in five dimensions (communication, sense of community, youth, elders, and language/culture). In addition, subscales of women and leadership were included in one tribe each. Confirmatory factor analysis primarily supported the factorial structure of the instruments, and the seven dimensions were found to correlate with previously validated measures of social capital, historical trauma, community influence, and physical health in expected directions.
Convergent Validity of the Early Memory Index in Two Primary Care Samples.
Porcerelli, John H; Cogan, Rosemary; Melchior, Katherine A; Jasinski, Matthew J; Richardson, Laura; Fowler, Shannon; Morris, Pierre; Murdoch, William
2016-01-01
Karliner, Westrich, Shedler, and Mayman (1996) developed the Early Memory Index (EMI) to assess mental health, narrative coherence, and traumatic experiences in reports of early memories. We assessed the convergent validity of EMI scales with data from 103 women from an urban primary care clinic (Study 1) and data from 48 women and 24 men from a suburban primary care clinic (Study 2). Patients provided early memory narratives and completed self-report measures of psychopathology, trauma, and health care utilization. In both studies, lower scores on the Mental Health scale and higher scores on the Traumatic Experiences scale were related to higher scores on measures of psychopathology and childhood trauma. Less consistent associations were found between the Mental Health and Traumatic Experiences scores and measures of health care utilization. The Narrative Coherence scale showed inconsistent relationships across measures in both samples. In analyses assessing the overall fit between hypothesized and actual correlations between EMI scores and measures of psychopathology, severity of trauma symptoms, and health care utilization, the Mental Health scale of the EMI demonstrated stronger convergent validity than the EMI Traumatic Experiences scale. The results provide support for the convergent validity of the Mental Health scale of the EMI.
Bartula, Iris; Sherman, Kerry A
2015-08-01
Sexual dysfunction following breast cancer treatment is common and screening for this is recommended. This study determined the reliability, validity, and acceptability of a breast cancer-specific adaptation of the Female Sexual Function Index, the FSFI-BC. This new measure addresses limitations in the FSFI when assessing sexual dysfunction of women with breast cancer regarding applicability to non-sexually active women, measuring distress and changes after cancer. Female breast cancer survivors (n = 596; 429 sexually active, 166 non-sexually active) completed an online survey including demographic/medical information, the FSFI-BC, and scales measuring sexual functioning, fatigue, body image, physical and mental health, and relationship adjustment (Time 1). Three weeks later, 326 women (245 sexually active; 81 non-sexually active) completed the Time 2 survey including the FSFI-BC, and questions regarding its acceptability and perceived change in sexual functioning. Reliability, construct validity, and acceptability were examined using standard scale validation techniques. Exploratory factor analysis delineated seven factors: Changes after cancer, desire/arousal, lubrication, orgasm, pain, satisfaction, and distress, accounting for 79.98 % (sexually active) and 77.19 % (non-active) variance in responses. Acceptable internal consistencies (non-active: α = 0.71-0.96; sexually active: α = 0.89-0.96) and test-retest reliabilities (non-active: r = 0.63-0.86; sexually active: r = 0.71-0.88) were evident. Inter-scale correlations provided evidence for convergent and divergent validities of the FSFI-BC. Both sexually active and non-active women provided positive feedback about the FSFI-BC. The optional partner questions demonstrated clinical utility. With desirable psychometric properties and acceptability to participants, the FSFI-BC is suitable for screening for sexual dysfunction in women with breast cancer.
NASA TLA workload analysis support. Volume 2: Metering and spacing studies validation data
NASA Technical Reports Server (NTRS)
Sundstrom, J. L.
1980-01-01
Four sets of graphic reports--one for each of the metering and spacing scenarios--are presented. The complete data file from which the reports were generated is also given. The data was used to validate the detail task of both the pilot and copilot for four metering and spacing scenarios. The output presents two measures of demand workload and a report showing task length and task interaction.
ERIC Educational Resources Information Center
Murphy, Joseph J.; Murphy, Marie H.; MacDonncha, Ciaran; Murphy, Niamh; Nevill, Alan M.; Woods, Catherine B.
2017-01-01
The purpose of this study was to compare the validity and reliability of three short physical activity self-report instruments to determine their potential for use with university student populations. The participants (N = 155; 44.5% male; 22.9 ± 5.13 years) wore an accelerometer for 9 consecutive days and completed a single-item measure, the a…
ERIC Educational Resources Information Center
Lakes, Kimberley D.; Swanson, James M.; Riggs, Matt
2012-01-01
Objective: To evaluate the reliability and validity of the English and Spanish versions of the Strengths and Weaknesses of ADHD-symptom and Normal-behavior (SWAN) rating scale. Method: Parents of preschoolers completed both a SWAN and the well-established Strengths and Difficulties Questionnaire (SDQ) on two separate occasions over a span of 3…
McLean, Rachael M; Farmer, Victoria L; Nettleton, Alice; Cameron, Claire M; Cook, Nancy R; Campbell, Norman R C
2017-12-01
Food frequency questionnaires (FFQs) are often used to assess dietary sodium intake, although 24-hour urinary excretion is the most accurate measure of intake. The authors conducted a systematic review to investigate whether FFQs are a reliable and valid way of measuring usual dietary sodium intake. Results from 18 studies are described in this review, including 16 validation studies. The methods of study design and analysis varied widely with respect to FFQ instrument, number of 24-hour urine collections collected per participant, methods used to assess completeness of urine collections, and statistical analysis. Overall, there was poor agreement between estimates from FFQ and 24-hour urine. The authors suggest a framework for validation and reporting based on a consensus statement (2004), and recommend that all FFQs used to estimate dietary sodium intake undergo validation against multiple 24-hour urine collections. ©2017 Wiley Periodicals, Inc.
Reliability and validity of the Parenting Scale of Inconsistency.
Yoshizumi, Takahiro; Murase, Satomi; Murakami, Takashi; Takai, Jiro
2006-08-01
The purposes of the present study were to develop a Parenting Scale of Inconsistency and to evaluate its initial reliability and validity. The 12 items assess the inconsistency among parents' moods, behaviors, and attitudes toward children. In the primary study, 517 participants completed three measures: the new Parenting Scale of Inconsistency, the Parental Bonding Instrument, and the Depression Scale of the General Health Questionnaire. The Parenting Scale of Inconsistency had good test-retest reliability of .85 and internal consistency of .88 (Cronbach coefficient alpha). Construct validity was good as Inconsistency scores were significantly correlated with the Care and Overprotection scores of the Parental Bonding Instrument and with the Depression scores. Moreover, Inconsistency scores' relation with a dimension of parenting style distinct from Care and Overprotection suggested that the Parenting Scale of Inconsistency had factorial validity. This scale seems a potential measure for examining the relationships between inconsistent parenting and the mental health of children.
Does the Defining Issues Test measure ethical judgment ability or political position?
Bailey, Charles D
2011-01-01
This article addresses the construct validity of the Defining Issues Test of ethical judgment (DIT/DIT-2). Alleging a political bias in the test, Emler and colleagues (1983, 1998, 1999, 2007), show that conservatives score higher when asked to fake as liberals, implying that they understand the reasoning associated with "higher" moral development but avoid items they see as liberally biased. DIT proponents challenge the internal validity of faking studies, advocating an explained-variance validation. This study takes a new approach: Adult participants complete the DIT-2, then evaluate the raw responses of others to discern political orientation and ethical development. Results show that individuals scoring higher on the DIT-2 rank others' ethical judgment in a way consistent with DIT-2-based rankings. Accuracy at assessing political orientation, however, is low. Results support the DIT-2's validity as a measure of ethical development, not an expression of political position.
Holmes, Jeffrey D; Jenkins, Mary E; Johnson, Andrew M; Hunt, Michael A; Clark, Ross A
2013-04-01
Impaired postural stability places individuals with Parkinson's at an increased risk for falls. Given the high incidence of fall-related injuries within this population, ongoing assessment of postural stability is important. To evaluate the validity of the Nintendo Wii(®) balance board as a measurement tool for the assessment of postural stability in individuals with Parkinson's. Twenty individuals with Parkinson's participated. Subjects completed testing on two balance tasks with eyes open and closed on a Wii(®) balance board and biomechanical force platform. Bland-Altman plots and a two-way, random-effects, single measure intraclass correlation coefficient model were used to assess concurrent validity of centre-of-pressure data. Concurrent validity was demonstrated to be excellent across balance tasks (intraclass correlation coefficients = 0.96, 0.98, 0.92, 0.94). This study suggests that the Wii(®) balance board is a valid tool for the quantification of postural stability among individuals with Parkinson's.
Roos, Margaret A; Reisman, Darcy S; Hicks, Gregory; Rose, William; Rudolph, Katherine S
2016-01-01
Adults with stroke have difficulty avoiding obstacles when walking, especially when a time constraint is imposed. The Four Square Step Test (FSST) evaluates dynamic balance by requiring individuals to step over canes in multiple directions while being timed, but many people with stroke are unable to complete it. The purposes of this study were to (1) modify the FSST by replacing the canes with tape so that more persons with stroke could successfully complete the test and (2) examine the reliability and validity of the modified version. Fifty-five subjects completed the Modified FSST (mFSST) by stepping over tape in all four directions while being timed. The mFSST resulted in significantly greater numbers of subjects completing the test than the FSST (39/55 [71%] and 33/55 [60%], respectively) (p < 0.04). The test-retest, intrarater, and interrater reliability of the mFSST were excellent (intraclass correlation coefficient ranges: 0.81-0.99). Construct and concurrent validity of the mFSST were also established. The minimal detectable change was 6.73 s. The mFSST, an ideal measure of dynamic balance, can identify progress in people with stroke in varied settings and can be completed by a wide range of people with stroke in approximately 5 min with the use of minimal equipment (tape, stop watch).
Bluck, Susan; Alea, Nicole
2011-07-01
Theory suggests that autobiographical remembering serves several functions. This research builds on previous empirical efforts (Bluck, Alea, Habermas, & Rubin, 2005) with the aim of constructing a brief, valid measure of three functions of autobiographical memory. Participants (N=306) completed 28 theoretically derived items concerning the frequency with which they use autobiographical memory to serve a variety of functions. To examine convergent and discriminant validity, participants rated their tendency to think about and talk about the past, and measures of future time orientation, self-concept clarity, and trait personality. Confirmatory factor analysis of the function items resulted in a respecified model with 15 items in three factors. The newly developed Thinking about Life Experiences scale (TALE) shows good internal consistency as well as convergent validity for three subscales: Self-Continuity, Social-Bonding, and Directing-Behaviour. Analyses demonstrate factorial equivalence across age and gender groups. Potential use and limitations of the TALE are discussed.
Psychometric Evaluation of the Patient Health Questionnaire–4 in Hispanic Americans
Mills, Sarah D.; Fox, Rina S.; Pan, Tonya M.; Malcarne, Vanessa L.; Roesch, Scott C.; Sadler, Georgia Robins
2017-01-01
The present study evaluated the psychometric properties of the Patient Health Questionnaire-4 (PHQ-4), a screener of psychological distress, in English- and Spanish-speaking Hispanic Americans. Hispanic American adults (N = 436) completed the PHQ-4, which yields two subscales (anxiety and depression) that can be summed to create a total score. Multiple-group confirmatory factor analysis was used to evaluate structural validity. The two-factor structure was the best fit to the data for both English- and Spanish-speaking Hispanic Americans and items loaded equivalently across groups, demonstrating measurement invariance. Internal consistency reliability was good as measured by coefficient alpha. Construct validity was evidenced by significant expected relationships with perceived stress. These findings provide support for the reliability and validity of the PHQ-4 as a brief measure of psychological distress for English- or Spanish-speaking Hispanic Americans. PMID:29097834
Evaluation of magical thinking: validation of the Illusory Beliefs Inventory.
Shihata, Sarah; Egan, Sarah J; Rees, Clare S
2014-01-01
Magical thinking has been related to obsessive-compulsive disorder; yet, little research has examined this construct in other anxiety disorders. The Illusory Beliefs Inventory (IBI) is a recently developed measure of magical thinking. The aim of this study was to investigate the psychometric properties of this new measure and to determine if magical thinking accounts for pathological worry beyond the well-researched constructs of intolerance of uncertainty (IU) and perfectionism. A sample of 502 participants completed an online survey. Confirmatory factor analysis identified a three-factor solution for the IBI, and the measure had good internal consistency (α = .92), test-retest reliability (r = .94) and discriminant validity. Magical thinking, IU, and perfectionism all predicted pathological worry; however, magical thinking accounted for less than 1% of unique variance in worry, suggesting that it is not strongly related to worry. Further investigation regarding the validity and clinical utility of the IBI is required.
Factor structure of a standards-based inventory of competencies in social work with groups.
Macgowan, Mark J; Dillon, Frank R; Spadola, Christine E
2018-01-01
This study extends previous findings on a measure of competencies based on Standards for Social Work Practice with Groups. The Inventory of Competencies in Social Work with Groups (ICSWG) measures confidence in performing the Standards. This study examines the latent structure of the Inventory, while illuminating the underlying structure of the Standards. A multinational sample of 586 persons completed the ICSWG. Exploratory factor analysis (EFA), reliability estimates, standard error of measurement estimates, and a range of validity tests were conducted. The EFA yielded a six-factor solution consisting of core values, mutuality/connectivity, collaboration, and three phases of group development (planning, beginnings/middles, endings). The alphas were .98 for the scale and ranged from .85 to .95 for the subscales. Correlations between the subscales and validators supported evidence of construct validity. The findings suggest key group work domains that should be taught and practiced in social work with groups.
Dutch translation and cross-cultural validation of the Adult Social Care Outcomes Toolkit (ASCOT).
van Leeuwen, Karen M; Bosmans, Judith E; Jansen, Aaltje Pd; Rand, Stacey E; Towers, Ann-Marie; Smith, Nick; Razik, Kamilla; Trukeschitz, Birgit; van Tulder, Maurits W; van der Horst, Henriette E; Ostelo, Raymond W
2015-05-13
The Adult Social Care Outcomes Toolkit was developed to measure outcomes of social care in England. In this study, we translated the four level self-completion version (SCT-4) of the ASCOT for use in the Netherlands and performed a cross-cultural validation. The ASCOT SCT-4 was translated into Dutch following international guidelines, including two forward and back translations. The resulting version was pilot tested among frail older adults using think-aloud interviews. Furthermore, using a subsample of the Dutch ACT-study, we investigated test-retest reliability and construct validity and compared response distributions with data from a comparable English study. The pilot tests showed that translated items were in general understood as intended, that most items were reliable, and that the response distributions of the Dutch translation and associations with other measures were comparable to the original English version. Based on the results of the pilot tests, some small modifications and a revision of the Dignity items were proposed for the final translation, which were approved by the ASCOT development team. The complete original English version and the final Dutch translation can be obtained after registration on the ASCOT website ( http://www.pssru.ac.uk/ascot ). This study provides preliminary evidence that the Dutch translation of the ASCOT is valid, reliable and comparable to the original English version. We recommend further research to confirm the validity of the modified Dutch ASCOT translation.
Hervás, Gonzalo; Vázquez, Carmelo
2013-04-22
We introduce the Pemberton Happiness Index (PHI), a new integrative measure of well-being in seven languages, detailing the validation process and presenting psychometric data. The scale includes eleven items related to different domains of remembered well-being (general, hedonic, eudaimonic, and social well-being) and ten items related to experienced well-being (i.e., positive and negative emotional events that possibly happened the day before); the sum of these items produces a combined well-being index. A distinctive characteristic of this study is that to construct the scale, an initial pool of items, covering the remembered and experienced well-being domains, were subjected to a complete selection and validation process. These items were based on widely used scales (e.g., PANAS, Satisfaction With Life Scale, Subjective Happiness Scale, and Psychological Well-Being Scales). Both the initial items and reference scales were translated into seven languages and completed via Internet by participants (N = 4,052) aged 16 to 60 years from nine countries (Germany, India, Japan, Mexico, Russia, Spain, Sweden, Turkey, and USA). Results from this initial validation study provided very good support for the psychometric properties of the PHI (i.e., internal consistency, a single-factor structure, and convergent and incremental validity). Given the PHI's good psychometric properties, this simple and integrative index could be used as an instrument to monitor changes in well-being. We discuss the utility of this integrative index to explore well-being in individuals and communities.
Linde, Jennifer A; Stringer, Deborah; Simms, Leonard J; Clark, Lee Anna
2013-08-01
The Schedule for Nonadaptive and Adaptive Personality-Youth Version (SNAP-Y) is a new, reliable self-report questionnaire that assesses 15 personality traits relevant to both normal-range personality and the alternative DSM-5 model for personality disorder. Community adolescents, 12 to 18 years old (N = 364), completed the SNAP-Y; 347 also completed the Big Five Inventory-Adolescent, 144 provided 2-week retest data, and 128 others completed the Minnesota Multiphasic Personality Inventory-Adolescent. Outpatient adolescents (N = 103) completed the SNAP-Y, and 97 also completed the Minnesota Multiphasic Personality Inventory-Adolescent. The SNAP-Y demonstrated strong psychometric properties, and structural, convergent, discriminant, and external validities. Consistent with the continuity of personality, results paralleled those in adult and college samples using the adult Schedule for Nonadaptive and Adaptive Personality-Second Edition (SNAP-2), from which the SNAP-Y derives and which has established validity in personality-trait assessment across the normal-abnormal continuum. The SNAP-Y thus provides a new, clinically useful instrument to assess personality traits and personality pathology in adolescents.
Development and Validation of the Appearance and Performance Enhancing Drug Use Schedule
Langenbucher, James W.; Lai, Justine Karmin; Loeb, Katharine L.; Hollander, Eric
2011-01-01
Appearance-and-performance enhancing drug (APED) use is a form of drug use that includes use of a wide range of substances such as anabolic-androgenic steroids (AASs) and associated behaviors including intense exercise and dietary control. To date, there are no reliable or valid measures of the core features of APED use. The present study describes the development and psychometric evaluation of the Appearance and Performance Enhancing Drug Use Schedule (APEDUS) which is a semi-structured interview designed to assess the spectrum of drug use and related features of APED use. Eighty-five current APED using men and women (having used an illicit APED in the past year and planning to use an illicit APED in the future) completed the APEDUS and measures of convergent and divergent validity. Inter-rater agreement, scale reliability, one-week test-retest reliability, convergent and divergent validity, and construct validity were evaluated for each of the APEDUS scales. The APEDUS is a modular interview with 10 sections designed to assess the core drug and non-drug phenomena associated with APED use. All scales and individual items demonstrated high inter-rater agreement and reliability. Individual scales significantly correlated with convergent measures (DSM-IV diagnoses, aggression, impulsivity, eating disorder pathology) and were uncorrelated with a measure of social desirability. APEDUS subscale scores were also accurate measures of AAS dependence. The APEDUS is a reliable and valid measure of APED phenomena and an accurate measure of the core pathology associated with APED use. Issues with assessing APED use are considered and future research considered. PMID:21640487
[Validity and Reliability of Korean Version of the Spiritual Care Competence Scale].
Chung, Mi Ja; Park, Youngrye; Eun, Young
2016-12-01
The aim of this study was to examine the validity and reliability of the Korean Version of the Spiritual Care Competence Scale (K-SCCS). A cross-sectional study design was used. The K-SCCS consisted of 26 questions to measure spiritual care competence of nurses. Participants, 228 nurses who had more than 3 years'experience as a nurse, completed the survey. Confirmatory factor analysis was used to examine the construct validity and correlations of K-SCCS and spiritual well-being (SWB) were used to examine the criterion validity of K-SCCS. Cronbach's alpha was used to test internal consistency. The construct and the criterion-related validity of K-SCCS were supported as measures of spiritual care competence. Cronbach's alpha was .95. Factor loadings of the 26 questions ranged from .60 to .96. Construct validity of K-SCCS was verified by confirmatory factor analysis (RMSEA=.08, CFI=.90, NFI=.85). Criterion validity compared to the SWB showed significant correlation (r=.44, p<.001). The findings suggest that K-SCCS serves as an appropriate measure of spiritual care competence with validity and reliability. However, further study is needed to retest the verification of the factor analysis related to factor 2 (professionalisation and improving the quality of spiritual care) and factor 3 (personal support and patient counseling). Therefore, we recommend using the total score without distinguishing subscales.
Terry, Paul E; Xi, Min
2010-12-01
The objective of this study was to assess the validity of 3 scoring techniques for presenteeism measures by exploring their relationship with patient activation, health, job satisfaction, and socioeconomic characteristics. The sample consisted of 631 employees from 2 predominantly white-collar employee groups in the northern Midwest. Employees completed the World Health Organization's Health and Work Performance Questionnaire, a wellness profile, and the Patient Activation Measure. Absolute measures reflect self-rated performance, while relative and stratified measures compare self-rated performance to that of co-workers. Multivariate analyses were used to validate scoring measures. All measures of presenteeism were positively correlated with being nonwhite, income, and smoking. The significance of age, employment, mental health, and patient activation depends on how presenteeism is defined. Practitioners must carefully consider which scoring method best addresses their program goals and objectives. Clearer measurement guidelines are needed.
Italian version of the M.D. Anderson Symptom Inventory--Head and Neck Module: linguistic validation.
Greco, A; Orlandi, E; Mirabile, A; Takanen, S; Fallai, C; Iacovelli, N A; Rimedio, A; Russi, E; Sala, M; Monzani, D; Rosenthal, D I; Gunn, G B; Steca, P; Licitra, L; Bossi, P
2015-12-01
Head and neck cancer (HNC) patients can experience symptoms due to the tumor itself or to the treatment, with an impact on health-related quality of life (HRQoL). Patient-reported outcome (PRO) measures pertaining to HRQoL are used in medical research and to support clinical decisions. PRO instrument applicability and cultural adaptation must be tested for each population. The aim of this study is to linguistically validate the Italian translation of the M.D. Anderson Symptom Inventory--Head and Neck Module (MDASI-HN). Following forward and backward translation of the items of the English MDASI-HN into Italian, it was administered along with a cognitive debriefing to HNC patients able to read and understand Italian language. Individual and group responses are presented using descriptive statistics. From May 2013 through September 2013, 56 patients with HNC (18 during curative treatment, 20 in palliative chemotherapy, and 18 in follow-up period) completed the MDASI-HN followed by accompanying cognitive debriefing. Ninety-nine percent of the individual MDASI-HN items were completed. Average time to complete the MDASI-HN was 8.5 min (range 3-15). Results suggested overall ease of completion, relevance, and comprehensibleness of this translated self-report instrument in this Italian patient population. The Italian version of the MDASI-HN is linguistically valid; future research should explore dimensionality, reliability, and convergent, discriminant, and predictive validity of this patient-reported instrument, in order to use this translated version in outcomes research and clinical settings.
Mungovan, Sean F; Peralta, Paula J; Gass, Gregory C; Scanlan, Aaron T
2018-04-12
To examine the test-retest reliability and criterion validity of a high-intensity, netball-specific fitness test. Repeated measures, within-subject design. Eighteen female netball players competing in an international competition completed a trial of the Net-Test, which consists of 14 timed netball-specific movements. Players also completed a series of netball-relevant criterion fitness tests. Ten players completed an additional Net-Test trial one week later to assess test-retest reliability using intraclass correlation coefficient (ICC), typical error of measurement (TEM), and coefficient of variation (CV). The typical error of estimate expressed as CV and Pearson correlations were calculated between each criterion test and Net-Test performance to assess criterion validity. Five movements during the Net-Test displayed moderate ICC (0.84-0.90) and two movements displayed high ICC (0.91-0.93). Seven movements and heart rate taken during the Net-Test held low CV (<5%) with values ranging from 1.7 to 9.5% across measures. Total time (41.63±2.05s) during the Net-Test possessed low CV and significant (p<0.05) correlations with 10m sprint time (1.98±0.12s; CV=4.4%, r=0.72), 20m sprint time (3.38±0.19s; CV=3.9%, r=0.79), 505 Change-of-Direction time (2.47±0.08s; CV=2.0%, r=0.80); and maximum oxygen uptake (46.59±2.58 mLkg -1 min -1 ; CV=4.5%, r=-0.66). The Net-Test possesses acceptable reliability for the assessment of netball fitness. Further, the high criterion validity for the Net-Test suggests a range of important netball-specific fitness elements are assessed in combination. Copyright © 2018 Sports Medicine Australia. Published by Elsevier Ltd. All rights reserved.
Patients' expectations of orthodontic treatment: part 1 - development of a questionnaire.
Sayers, M S; Newton, J T
2006-12-01
The development of a questionnaire to measure patients' and their parents' expectations before orthodontic treatment, and to test the reliability and validity of this measure. A two-stage methodology, with open-ended interviews to identify themes and concepts followed by development and testing of the questionnaire. GKT Orthodontic Department, King's College Dental Hospital. The sample consisted of 140 participants, 70 patients aged 12-14 years, who had been referred to the orthodontic department for treatment. One parent of each patient was also recruited. The study was in two phases. In the first phase 30 participants (15 new patients and their 15 parents) participated in open-ended interviews, which were analysed qualitatively. Information from these interviews was used to construct a questionnaire. During the second phase, the questionnaire was piloted on 10 participants, five new consecutive patients and their parents. The questionnaire was then distributed to 174 subjects (87 new patients and their 87 parents). Seventy-eight subjects (39 new patients and their 39 parents) completed the questionnaire before their orthodontic consultation. Another 96 subjects (48 new patients and their 48 parents) were invited to complete the questionnaire prior to and at their orthodontic consultation. Test-retest analysis was conducted on 22 participants (11 patients and their 11 parents), who completed the questionnaire previous to and at their orthodontic consultation, and contributed to the psychometric validation of this questionnaire. A questionnaire was devized using the key themes and concepts identified in the open-ended interviews. As a result, 10 questions, some with sub-questions were constructed using a visual analogue scale as the response format. The questionnaire developed had good face validity. Internal consistency of the questionnaire using Cronbach's alpha, produced an overall inter-item reliability > 0.7 along with item-total correlations > 0.3 in over 50% of questions. Test-retest reliability was statistically significant using Spearman's correlation. This study provides a valid and reliable measure of orthodontic expectations in participants aged 12-14 years and their parents.
Kerig, Patricia K; Charak, Ruby; Chaplo, Shannon D; Bennett, Diana C; Armour, Cherie; Modrowski, Crosby A; McGee, Andrew B
2016-09-01
The inclusion of a dissociative subtype in the Diagnostic and Statistical Manual of Mental Disorders (5th ed.; DSM–5 ) criteria for the diagnosis of posttraumatic stress disorder (PTSD) has highlighted the need for valid and reliable measures of dissociative symptoms across developmental periods. The Adolescent Dissociative Experiences Scale (A-DES) is 1 of the few measures validated for young persons, but previous studies have yielded inconsistent results regarding its factor structure. Further, research to date on the A-DES has been based upon nonclinical samples of youth or those without a known history of trauma. To address these gaps in the literature, the present study investigated the factor structure and construct validity of the A-DES in a sample of highly trauma-exposed youth involved in the juvenile justice system. A sample of 784 youth (73.7% boys) recruited from a detention center completed self-report measures of trauma exposure and the A-DES, a subset of whom (n = 212) also completed a measure of PTSD symptoms. Confirmatory factor analyses revealed a best fitting 3-factor structure comprised of depersonalization or derealization, amnesia, and loss of conscious control, with configural and metric invariance across gender. Logistic regression analyses indicated that the depersonalization or derealization factor effectively distinguished between those youth who did and did not likely meet criteria for a diagnosis of PTSD as well as those with PTSD who did and did not likely meet criteria for the dissociative subtype. These results provide support for the multidimensionality of the construct of posttraumatic dissociation and contribute to the understanding of the dissociative subtype of PTSD among adolescents. (PsycINFO Database Record PsycINFO Database Record (c) 2016 APA, all rights reserved
Robson, Joanna C.; Milman, Nataliya; Tomasson, Gunnar; Dawson, Jill; Cronholm, Peter F.; Kellom, Katherine; Shea, Judy; Ashdown, Susan; Boers, Maarten; Boonen, Annelies; Casey, George C.; Farrar, John T.; Gebhart, Don; Krischer, Jeffrey; Lanier, Georgia; McAlear, Carol A.; Peck, Jacqueline; Sreih, Antoine G.; Tugwell, Peter; Luqmani, Raashid A.; Merkel, Peter A.
2016-01-01
Objective Antineutrophil cytoplasmic antibody (ANCA)-associated vasculitis (AAV) is a group of linked multisystem life- and organ-threatening diseases. The Outcome Measures in Rheumatology (OMERACT) vasculitis working group has been at the forefront of outcome development in the field and has achieved OMERACT endorsement of a core set of outcomes for AAV. Patients with AAV report as important some manifestations of disease not routinely collected through physician-completed outcome tools; and they rate common manifestations differently from investigators. The core set includes the domain of patient-reported outcomes (PRO). However, PRO currently used in clinical trials of AAV do not fully characterize patients’ perspectives on their burden of disease. The OMERACT vasculitis working group is addressing the unmet needs for PRO in AAV. Methods Current activities of the working group include (1) evaluating the feasibility and construct validity of instruments within the PROMIS (Patient-Reported Outcome Measurement Information System) to record components of the disease experience among patients with AAV; (2) creating a disease-specific PRO measure for AAV; and (3) applying The International Classification of Functioning, Disability and Health to examine the scope of outcome measures used in AAV. Results The working group has developed a comprehensive research strategy, organized an investigative team, included patient research partners, obtained peer-reviewed funding, and is using a considerable research infrastructure to complete these interrelated projects to develop evidence-based validated outcome instruments that meet the OMERACT filter of truth, discrimination, and feasibility. Conclusion The OMERACT vasculitis working group is on schedule to achieve its goals of developing validated PRO for use in clinical trials of AAV. (First Release September 1 2015; J Rheumatol 2015;42:2204–9; doi:10.3899/jrheum.141143) PMID:26329344
Ward, Dianne S; Mazzucca, Stephanie; McWilliams, Christina; Hales, Derek
2015-09-26
Early care and education (ECE) centers are important settings influencing young children's diet and physical activity (PA) behaviors. To better understand their impact on diet and PA behaviors as well as to evaluate public health programs aimed at ECE settings, we developed and tested the Environment and Policy Assessment and Observation - Self-Report (EPAO-SR), a self-administered version of the previously validated, researcher-administered EPAO. Development of the EPAO-SR instrument included modification of items from the EPAO, community advisory group and expert review, and cognitive interviews with center directors and classroom teachers. Reliability and validity data were collected across 4 days in 3-5 year old classrooms in 50 ECE centers in North Carolina. Center teachers and directors completed relevant portions of the EPAO-SR on multiple days according to a standardized protocol, and trained data collectors completed the EPAO for 4 days in the centers. Reliability and validity statistics calculated included percent agreement, kappa, correlation coefficients, coefficients of variation, deviations, mean differences, and intraclass correlation coefficients (ICC), depending on the response option of the item. Data demonstrated a range of reliability and validity evidence for the EPAO-SR instrument. Reporting from directors and classroom teachers was consistent and similar to the observational data. Items that produced strongest reliability and validity estimates included beverages served, outside time, and physical activity equipment, while items such as whole grains served and amount of teacher-led PA had lower reliability (observation and self-report) and validity estimates. To overcome lower reliability and validity estimates, some items need administration on multiple days. This study demonstrated appropriate reliability and validity evidence for use of the EPAO-SR in the field. The self-administered EPAO-SR is an advancement of the measurement of ECE settings and can be used by researchers and practitioners to assess the nutrition and physical activity environments of ECE settings.
2011-01-01
Background In healthcare, a gap exists between what is known from research and what is practiced. Understanding this gap depends upon our ability to robustly measure research utilization. Objectives The objectives of this systematic review were: to identify self-report measures of research utilization used in healthcare, and to assess the psychometric properties (acceptability, reliability, and validity) of these measures. Methods We conducted a systematic review of literature reporting use or development of self-report research utilization measures. Our search included: multiple databases, ancestry searches, and a hand search. Acceptability was assessed by examining time to complete the measure and missing data rates. Our approach to reliability and validity assessment followed that outlined in the Standards for Educational and Psychological Testing. Results Of 42,770 titles screened, 97 original studies (108 articles) were included in this review. The 97 studies reported on the use or development of 60 unique self-report research utilization measures. Seven of the measures were assessed in more than one study. Study samples consisted of healthcare providers (92 studies) and healthcare decision makers (5 studies). No studies reported data on acceptability of the measures. Reliability was reported in 32 (33%) of the studies, representing 13 of the 60 measures. Internal consistency (Cronbach's Alpha) reliability was reported in 31 studies; values exceeded 0.70 in 29 studies. Test-retest reliability was reported in 3 studies with Pearson's r coefficients > 0.80. No validity information was reported for 12 of the 60 measures. The remaining 48 measures were classified into a three-level validity hierarchy according to the number of validity sources reported in 50% or more of the studies using the measure. Level one measures (n = 6) reported evidence from any three (out of four possible) Standards validity sources (which, in the case of single item measures, was all applicable validity sources). Level two measures (n = 16) had evidence from any two validity sources, and level three measures (n = 26) from only one validity source. Conclusions This review reveals significant underdevelopment in the measurement of research utilization. Substantial methodological advances with respect to construct clarity, use of research utilization and related theory, use of measurement theory, and psychometric assessment are required. Also needed are improved reporting practices and the adoption of a more contemporary view of validity (i.e., the Standards) in future research utilization measurement studies. PMID:21794144
Sexual Orientation Self-Concept Ambiguity: Scale Adaptation and Validation.
Talley, Amelia E; Stevens, Jordan E
2017-07-01
The current article describes the adaptation of a measure of sexual orientation self-concept ambiguity (SSA) from an existing measure of general self-concept clarity. Latent "trait" scores of SSA reflect the extent to which a person's beliefs about their own sexual orientation are perceived as inconsistent, unreliable, or incongruent. Sexual minority and heterosexual women ( n = 348), ages 18 to 30, completed a cross-sectional survey. Categorical confirmatory factor analysis guided the selection of items to form a 10-item, self-report measure of SSA. In the current report, we also examine (a) reliability of the 10-item scale score, (b) measurement invariance based on respondents' sexual identity status and age group, and (c) correlations with preexisting surveys that purport to measure similar constructs and theoretical correlates. Evidence for internal reliability, measurement invariance (based on respondent sex), and convergent validity was also investigated in an independent, validation sample. The lowest SSA scores were reported by women who self-ascribed an exclusively heterosexual or exclusively lesbian/gay sexual identity, whereas those who reported a bisexual, mostly lesbian/gay, or mostly heterosexual identity, reported relatively higher SSA scores.
Cardamone-Breen, Mairead C.; Jorm, Anthony F.; Lawrence, Katherine A.; Mackinnon, Andrew J.
2017-01-01
Background Despite substantial evidence demonstrating numerous parental risk and protective factors for the development of adolescent depression and anxiety disorders, there is currently no single measure that assesses these parenting factors. To address this gap, we developed the Parenting to Reduce Adolescent Depression and Anxiety Scale (PRADAS) as a criterion-referenced measure of parental concordance with a set of evidence-based parenting guidelines for the prevention of adolescent depression and anxiety disorders. In this paper, we used a sample of Australian parents of adolescents to: (1) validate the PRADAS as a criterion-referenced measure; (2) examine parental concordance with the guidelines in the sample; and (3) examine correlates of parental concordance with the guidelines. Methods Seven hundred eleven parents completed the PRADAS, as well as two established parenting measures, and parent-report measures of adolescent depression and anxiety symptoms. Six hundred sixty adolescent participants (aged 12–15) also completed the symptom measures. Concordance with the guidelines was assessed via nine subscale scores and a total score. Reliability of the scores was assessed with an estimate of the agreement coefficient, as well as 1-month test-retest reliability. Convergent validity was examined via correlations between the scale and two established parenting measures. Results One proposed subscale was removed from the final version of the scale, resulting in a total of eight subscales. Reliability was high for the total score, and acceptable to high for seven of the eight subscales. One-month test-retest reliability was acceptable to high for the total score. Convergent validity was supported by moderate to high correlations with two established measures of parenting. Overall, rates of parental concordance with the guidelines were low in our sample. Higher scores were associated with being female and higher levels of parental education. Greater parental concordance with the guidelines was associated with fewer symptoms of depression and anxiety in adolescent participants. Discussion This initial validation study provides preliminary support for the reliability and validity of the PRADAS. The scale has potential for use in both clinical and research settings. It may be used to identify parents’ strengths and potential targets for intervention, and as an outcome measure in studies of preventive parenting interventions. PMID:28951815
Olsen, L R; Jensen, D V; Noerholm, V; Martiny, K; Bech, P
2003-02-01
We have developed the Major Depression Inventory (MDI), consisting of 10 items, covering the DSM-IV as well as the ICD-10 symptoms of depressive illness. We aimed to evaluate this as a scale measuring severity of depressive states with reference to both internal and external validity. Patients representing the score range from no depression to marked depression on the Hamilton Depression Scale (HAM-D) completed the MDI. Both classical and modern psychometric methods were applied for the evaluation of validity, including the Rasch analysis. In total, 91 patients were included. The results showed that the MDI had an adequate internal validity in being a unidimensional scale (the total score an appropriate or sufficient statistic). The external validity of the MDI was also confirmed as the total score of the MDI correlated significantly with the HAM-D (Pearson's coefficient 0.86, P < or = 0.01, Spearman 0.80, P < or = 0.01). When used in a sample of patients with different states of depression the MDI has an adequate internal and external validity.
Ewing, Jane E; King, Madeleine T; Smith, Narelle F
2009-03-01
To validate two health-related quality of life (HRQOL) measures, the PedsQL Generic Core and Cancer Module adolescent forms (13-18 years), after modification for 16-25-year-old adolescents and young adults (AYA) with cancer or a blood disorder. AYA patients and nominated proxies were recruited from three Sydney hospitals. Modified forms were administered by telephone or in clinics/wards. Analyses included correlations, factor analysis, and analysis of variance of known-groups (defined by the Memorial Symptom Assessment Scale). Eighty-eight patients and 79 proxies completed questionnaires. Factor structures consistent with those of the unmodified forms confirmed construct validity. Cronbach's alpha ranged 0.81-0.98. Inter-scale correlations were as hypothesized, confirming discriminant validity. Statistically significant differences between groups with mild, moderate, and severe symptoms (P < 0.05) confirmed clinical validity. These modified forms provide reliable and valid measures of HRQOL in AYA with cancer or a blood disorder, suitable for clinical trials, research, and practice.
The Resilience Questionnaire for Bipolar Disorder: Development and validation.
Echezarraga, Ainara; Las Hayas, Carlota; González-Pinto, Ana María; Jones, Steven
2017-08-01
The goal of this research project was to develop a new questionnaire to assess resilience in Bipolar Disorder (BD), the Resilience Questionnaire for Bipolar Disorder (RBD). To examine its psychometric properties, a sample of 125 patients diagnosed with BD and a comparison sample of 107 people completed the new RBD and established measures of generic resilience and health-related outcomes. Exploratory factor analysis for the RBD yielded a 23-item 5-factor solution, and confirmatory factor analysis indicated adequate fit indices. Internal consistency, stability, concurrent validation and known-groups' validity were also supported. The RBD obtained higher responsiveness (6-month follow-up) than the generic resilience scale (BD sample). The RBD is a robust measure to monitor resilience in BD. Copyright © 2017 Elsevier Inc. All rights reserved.
Introducing a brief measure of cultural and religious identification in American Jewish identity.
Friedlander, Myrna L; Friedman, Michelle L; Miller, Matthew J; Ellis, Michael V; Friedlander, Lee K; Mikhaylov, Vadim G
2010-07-01
The authors conducted 3 studies to develop and investigate the psychometric properties of the American Jewish Identity Scales (AJIS), a brief self-report measure that assesses cultural identification and religious identification. Study 1 assessed the content validity of the item pool using an expert panel. In Study 2, 1,884 Jewish adults completed the initial AJIS and various measures of ethnic identity, collective self-esteem, and religiosity. Using confirmatory factor analyses, the authors selected and cross-validated 33 items that loaded highly and differentially on the 2 theorized latent factors. Study 3 assessed the AJIS's short-term stability and its relation to social desirability. Tests of reliability and construct validity provided initial psychometric support for the measure and confirmed the theorized primary salience of cultural identification. Participants reported significantly more private than public collective self-esteem, and the most Jewish-identified participants reported greater private self-esteem, acculturative stress, and perceived discrimination than did their more assimilated counterparts. (c) 2010 APA, all rights reserved.
Marshall, Paul; Schroeder, Ryan; O'Brien, Jeffrey; Fischer, Rebecca; Ries, Adam; Blesi, Brita; Barker, Jessica
2010-10-01
This study examines the effectiveness of symptom validity measures to detect suspect effort in cognitive testing and invalid completion of ADHD behavior rating scales in 268 adults referred for ADHD assessment. Patients were diagnosed with ADHD based on cognitive testing, behavior rating scales, and clinical interview. Suspect effort was diagnosed by at least two of the following: failure on embedded and free-standing SVT measures, a score > 2 SD below the ADD population average on tests, failure on an ADHD behavior rating scale validity scale, or a major discrepancy between reported and observed ADHD behaviors. A total of 22% of patients engaged in symptom exaggeration. The Word Memory test immediate recall and consistency score (both 64%), TOVA omission errors (63%) and reaction time variability (54%), CAT-A infrequency scale (58%), and b Test (47%) had good sensitivity as well as at least 90% specificity. Clearly, such measures should be used to help avoid making false positive diagnoses of ADHD.
Development and Validation of the Pediatric Diabetes Routines Questionnaire for Adolescents.
Pierce, Jessica S; Jordan, Sara S; Arnau, Randolph C
2018-04-06
This study describes the development and psychometric evaluation of an adolescent self-report version of the Pediatric Diabetes Routines Questionnaire (PDRQ:A), a measure of diabetes-specific routines for youth with type 1 diabetes, and further validation of the parent-version (PDRQ:P) in an adolescent sample. Participants included 120 parent-adolescent dyads (ages 12-17) and an additional 24 parents who completed measures of diabetes-specific adolescent routines, general adolescent routines, diabetes self-care, and family support of youth diabetes care. The PDRQ:P/A demonstrated good internal consistency, test-retest reliability, and parent-child agreement, and adequate validity coefficients. Confirmatory factor analysis supported a one-factor model. Promising results were obtained. The PDRQ:P/A is a clinically feasible parent- and self-report measure that can provide valuable information regarding how frequently adolescents engage in their diabetes management tasks in a consistent manner. Addition of an adolescent report format will enhance the utility of the measure for clinical and research use.
Evaluation of the Cardiac Depression Visual Analogue Scale in a medical and non-medical sample.
Di Benedetto, Mirella; Sheehan, Matthew
2014-01-01
Comorbid depression and medical illness is associated with a number of adverse health outcomes such as lower medication adherence and higher rates of subsequent mortality. Reliable and valid psychological measures capable of detecting a range of depressive symptoms found in medical settings are needed. The Cardiac Depression Visual Analogue Scale (CDVAS) is a recently developed, brief six-item measure originally designed to assess the range and severity of depressive symptoms within a cardiac population. The current study aimed to further investigate the psychometric properties of the CDVAS in a general and medical sample. The sample consisted of 117 participants, whose mean age was 40.0 years (SD = 19.0, range 18-84). Participants completed the CDVAS, the Cardiac Depression Scale (CDS), the Depression Anxiety Stress Scales (DASS) and a demographic and health questionnaire. The CDVAS was found to have adequate internal reliability (α = .76), strong concurrent validity with the CDS (r = .89) and the depression sub-scale of the DASS (r = .70), strong discriminant validity and strong predictive validity. The principal components analysis revealed that the CDVAS measured only one component, providing further support for the construct validity of the scale. Results of the current study indicate that the CDVAS is a short, simple, valid and reliable measure of depressive symptoms suitable for use in a general and medical sample.
Cha, Young Joo; Lee, Jae Jin; Kim, Do Hyun; You, Joshua Sung H
2017-10-23
Core stabilization plays an important role in the regulation of postural stability. To overcome shortcomings associated with pain and severe core instability during conventional core stabilization tests, we recently developed the dynamic neuromuscular stabilization-based heel sliding (DNS-HS) test. The purpose of this study was to establish the criterion validity and test-retest reliability of the novel DNS-HS test. Twenty young adults with core instability completed both the bilateral straight leg lowering test (BSLLT) and DNS-HS test for the criterion validity study and repeated the DNS-HS test for the test-retest reliability study. Criterion validity was determined by comparing hip joint angle data that were obtained from BSLLT and DNS-HS measures. The test-retest reliability was determined by comparing hip joint angle data. Criterion validity was (ICC2,3) = 0.700 (p< 0.05), suggesting a good relationship between the two core stability measures. Test-retest reliability was (ICC3,3) = 0.953 (p< 0.05), indicating excellent consistency between the repeated DNS-HS measurements. Criterion validity data demonstrated a good relationship between the gold standard BSLLT and DNS-HS core stability measures. Test-retest reliability data suggests that DNS-HS core stability was a reliable test for core stability. Clinically, the DNS-HS test is useful to objectively quantify core instability and allow early detection and evaluation.
Trakman, Gina Louise; Forsyth, Adrienne; Hoye, Russell; Belski, Regina
2018-01-01
The Nutrition for Sport Knowledge Questionnaire (NSKQ) is an 89-item, valid and reliable measure of sports nutrition knowledge (SNK). It takes 25 min to complete and has been subject to low completion and response rates. The aim of this study was to develop an abridged version of the NSKQ (A-NSKQ) and compare response rates, completion rates and NK scores of the NSKQ and A-NSKQ. Rasch analysis was used for the questionnaire validation. The sample ( n = 181) was the same sample that was used in the validation of the full-length NSKQ. Construct validity was assessed using the known-group comparisons method. Temporal stability was assessed using the test-retest reliability method. NK assessment was cross-sectional; responses were collected electronically from members of one non-elite Australian football (AF) and netball club, using Qualtrics Software (Qualtrics, Provo, UT). Validation - The A-NSKQ has 37 items that assess general ( n = 17) and sports ( n = 20) nutrition knowledge (NK). Both sections are unidimensional (Perc5% = 2.84% [general] and 3.41% [sport]). Both sections fit the Rasch Model (overall-interaction statistic mean (SD) = - 0.15 ± 0.96 [general] and 0.22 ± 1.11 [sport]; overall-person interaction statistic mean (SD) = - 0.11 ± 0.61 [general] and 0.08 ± 0.73 [sport]; Chi-Square probability = 0.308 [general] and 0.283 [sport]). Test-retest reliability was confirmed ( r = 0.8, P < 0.001 [general] and r = 0.7, P < 0.001 [sport]). Construct validity was demonstrated (nutrition students = 77% versus non-nutrition students = 60%, P < 0.001 [general] and nutrition students = 60% versus non-nutrition students = 40%, P < 0.001 [sport]. Assessment of NK - 177 usable survey responses from were returned. Response rates were low (7%) but completion rates were high (85%). NK scores on the A-NSKQ (46%) are comparable to results obtained in similar cohorts on the NSKQ (49%). The A-NSKQ took on average 12 min to complete, which is around half the time taken to complete the NSKQ (25 min). The A-NSKQ is a valid and reliable, brief questionnaire designed to assess general NK (GNK) and SNK.
Farhan, Bilal; Soltani, Tandis; Do, Rebecca; Perez, Claudia; Choi, Hanul; Ghoniem, Gamal
2018-05-02
Endoscopic injection of urethral bulking agents is an office procedure that is used to treat stress urinary incontinence secondary to internal sphincteric deficiency. Validation studies important part of simulator evaluation and is considered important step to establish the effectiveness of simulation-based training. The endoscopic needle injection (ENI) simulator has not been formally validated, although it has been used widely at University of California, Irvine. We aimed to assess the face, content, and construct validity of the UC, Irvine ENI simulator. Dissected female porcine bladders were mounted in a modified Hysteroscopy Diagnostic Trainer. Using routine endoscopic equipment for this procedure with video monitoring, 6 urologists (experts group) and 6 urology trainee (novice group) completed urethral bulking agents injections on a total of 12 bladders using ENI simulator. Face and content validities were assessed by using structured quantitative survey which rating the realism. Construct validity was assessed by comparing the performance, time of the procedure, and the occlusive (anatomical and functional) evaluations between the experts and novices. Trainees also completed a postprocedure feedback survey. Effective injections were evaluated by measuring the retrograde urethral opening pressure, visual cystoscopic coaptation, and postprocedure gross anatomic examination. All 12 participants felt the simulator was a good training tool and should be used as essential part of urology training (face validity). ENI simulator showed good face and content validity with average score varies between the experts and the novices was 3.9/5 and 3.8/5, respectively. Content validity evaluation showed that most aspects of the simulator were adequately realistic (mean Likert scores 3.9-3.8/5). However, the bladder does not bleed, and sometimes thin. Experts significantly outperformed novices (p < 001) across all measure of performance therefore establishing construct validity. The ENI simulator shows face, content and construct validities, although few aspects of simulator were not very realistic (e.g., bleeding).This study provides a base for the future formal validation for this simulator and for continuing use of this simulator in endourology training. Copyright © 2018 Association of Program Directors in Surgery. Published by Elsevier Inc. All rights reserved.
Nelson, Melissa C; Lytle, Leslie A
2009-04-01
Sweetened beverage and fast-food intake have been identified as important targets for obesity prevention. However, there are few brief dietary assessment tools available to evaluate these behaviors among adolescents. The objective of this research was to examine reliability and validity of a 22-item dietary screener assessing adolescent consumption of specific energy-containing and non-energy-containing beverages (nine items) and fast food (13 items). The screener was administered to adolescents (ages 11 to 18 years) recruited from the Minneapolis/St Paul, MN, metro region. One sample of adolescents completed test-retest reliability of the screener (n=33, primarily white adolescents). Another adolescent sample completed the screener along with three 24-hour dietary recalls to assess criterion validity (n=59 white adolescents). Test-retest assessments were completed approximately 7 to 14 days apart, and agreement between the two administrations of the screener was substantial, with most items yielding Spearman correlations and kappa statistics that were >0.60. When compared to the gold standard dietary recall data, findings indicate that the validity of the screener items assessing adolescents' intake of regular soda, sports drinks, milk, and water was fair. However, the differential assessment periods captured by the two methods (ie, 1 month for the screener vs 3 days for the recalls) posed challenges in analysis and made it impossible to assess the validity of some screener items. Overall while these screener items largely represent reliable measures with fair validity, our findings highlight the challenges inherent in the validation of brief dietary assessment tools.
Validation of an instrument to measure older adults' expectations regarding movement (ERM).
Dahodwala, Nabila; Karlawish, Jason; Shea, Judy A; Zubritsky, Cynthia; Stern, Matthew; Mandell, David S
2012-01-01
Many individuals with Parkinson's disease are not diagnosed and treated. Attitudes about aging and related help-seeking may affect the timely diagnosis of Parkinson's disease. Our objectives were to develop measures of older adults' expectations regarding movement with aging, specifically related to parkinsonism, and their beliefs about seeking healthcare for the diagnosis and treatment of parkinsonism. We established content and face validity from interviews with experts, review of the literature, and pre-testing with key informants. Two 9-item instruments resulted: Expectations Regarding Movement (ERM) and Healthcare Seeking Beliefs for parkinsonism (HSB). These instruments were administered to 210 older adults at senior centers to investigate internal consistency and construct validity. 192 (91%) of the older adults completed more than 90% of the survey. The mean age was 76; 17 (9%) reported parkinsonism. Both scales demonstrated good internal consistency (α = 0.90). Factor analysis supported construct validity of the ERM and HSB scores. Older age, lower education, worse self-reported health and African American race each were associated with lower ERM scores, but not HSB scores. The ERM, a brief measure of expectations regarding movement with aging, shows reliability and validity. This scale may be useful in identifying older adults at increased risk for under-identification of Parkinson's disease. Further work is needed to measure healthcare seeking for parkinsonism.
Validity test and its consistency in the construction of patient loyalty model
NASA Astrophysics Data System (ADS)
Yanuar, Ferra
2016-04-01
The main objective of this present study is to demonstrate the estimation of validity values and its consistency based on structural equation model. The method of estimation was then implemented to an empirical data in case of the construction the patient loyalty model. In the hypothesis model, service quality, patient satisfaction and patient loyalty were determined simultaneously, each factor were measured by any indicator variables. The respondents involved in this study were the patients who ever got healthcare at Puskesmas in Padang, West Sumatera. All 394 respondents who had complete information were included in the analysis. This study found that each construct; service quality, patient satisfaction and patient loyalty were valid. It means that all hypothesized indicator variables were significant to measure their corresponding latent variable. Service quality is the most measured by tangible, patient satisfaction is the most mesured by satisfied on service and patient loyalty is the most measured by good service quality. Meanwhile in structural equation, this study found that patient loyalty was affected by patient satisfaction positively and directly. Service quality affected patient loyalty indirectly with patient satisfaction as mediator variable between both latent variables. Both structural equations were also valid. This study also proved that validity values which obtained here were also consistence based on simulation study using bootstrap approach.
Zhong, Tao; Chung, Pak-Kwong; Liu, Jing Dong
2018-02-01
Independent from noise exposure, noise sensitivity plays a pivotal role in people's noise annoyance perception and concomitant health deteriorations. The present study empirically investigated the psychometric properties of the Chinese version of the Weinstein Noise Sensitivity Scale-Short Form (CNSS-SF), the widely used inventory measuring individual differences in noise perception. In total, 373 Chinese participants (age = 21.41 ± 3.36) completed the online, anonymous questionnaire package. Examination of the CNSS-SF's reliability (internal consistency), factorial validity through validation and cross-validation, nomological validity and measurement invariance across gender groups were undertaken. The Cronbach alpha coefficients and composite reliabilities indicated sufficient reliability of the CNSS-SF. Two confirmatory factor analyses (CFA), in two randomly partitioned groups of participants, substantiated the factorial validity of the scale. The nomological validity of the scale was also corroborated by the significant positive association of its score with the trait anxiety score. Measurement invariance of the CNSS-SF was also found across genders via multi-group CFA. Though not without limitations, findings from the present research provide promising evidence for the utility of the scale in measuring noise sensitivity among the Chinese population. The availability of the CNSS-SF can promote research related to environmental noise and health in China, as well as facilitate cross-cultural comparisons. Copyright © 2018 The Editorial Board of Biomedical and Environmental Sciences. Published by China CDC. All rights reserved.
Godier, Lauren R; Park, Rebecca J
2015-04-01
The characteristic relentless self-starvation behaviour seen in Anorexia Nervosa (AN) has been described as evidence of compulsivity, with increasing suggestion of transdiagnostic parallels with addictive behaviour. There is a paucity of standardised self-report measures of compulsive behaviour in eating disorders (EDs). Measures that index the concept of compulsive self-starvation in AN are needed to explore the suggested parallels with addictions. With this aim a novel measure of self-starvation was developed (the Self-Starvation Scale, SS). 126 healthy participants, and 78 individuals with experience of AN, completed the new measure along with existing measures of eating disorder symptoms, anxiety and depression. Initial validation in the healthy sample indicated good reliability and construct validity, and incremental validity in predicting eating disorder symptoms. The psychometric properties of the SS scale were replicated in the AN sample. The ability of this scale to predict ED symptoms was particularly strong in individuals currently suffering from AN. These results suggest the SS may be a useful index of compulsive food restriction in AN. The concept of 'starvation dependence' in those with eating disorders, as a parallel with addiction, may be of clinical and theoretical importance. Copyright © 2014 Elsevier Ltd. All rights reserved.
Castro-Díaz, D M; Esteban-Fuertes, M; Salinas-Casado, J; Bustamante-Alarma, S; Gago-Ramos, J L; Galacho-Bech, A; García-Matres, M J; Rodríguez-Toves, L A; Zubiaur-Líbano, C; Collado-Serra, A; Batista-Miranda, J E; Ortiz-Gámiz, A
2014-03-01
To evaluate the psychometric properties of the Spanish version of the ICIQ-Male Lower Urinary Tract Symptoms Questionnaire (ICIQ-MLUTS): Feasibility (% of completion and ceiling/ground effects), reliability (Test-retest), convergent validity (vs Bladder Control Self-Assessment Questionnaire [BSAQ] and vs International Prostate Symptom Score [I-PSS]) and criterion validity (according to presence or absence of symptoms). This was an observational, non-interventionist and multicenter study. 223 male patients with lower urinary tract symptoms (LUTS), predominantly storage symptoms and aged 18-65, took part in the study. Patients completed the ICIQ-MLUTS (test), I-PSS and BSAQ questionnaires and referred their urinary symptoms in a single visit, with the exception of a subgroup composed by 49 patients that completed the questionnaire again 15 days after initial visit to evaluate test-retest reliability. The questionnaire includes 13 items divided in 2 sub-scales: Voiding symptoms (V) from 0-20 and Incontinence symptoms (I) from 0-24. Percentage of patients that completed all items: 98.84%. Ground effect is 0 and ceiling effect was under 6% in both sub-scales. Test-retest reliability: Intraclass correlation coefficient (ICC) ranged from 0.68 to 0.88, except on Delay. Kappa shows a good agreement, between 0.60 and 0.81, except for Nocturia. Convergent validity: Correlation (Spearman) between the questionnaire sub-scales scores and the rest of measures is statistically significant (P < .01 and P < .05). Criterion validity: Statistically significant differences (P < .05) between scores on ICIQ-MLUTS, from patients that refer experiencing symptoms and those who do not. The Spanish version of the ICIQ-MLUTS questionnaire shows adequate feasibility, reliability and validity. Copyright © 2013 AEU. Published by Elsevier Espana. All rights reserved.
NASA Technical Reports Server (NTRS)
Monk, T. H.; Reynolds CF, 3. d.; Kupfer, D. J.; Buysse, D. J.; Coble, P. A.; Hayes, A. J.; Machen, M. A.; Petrie, S. R.; Ritenour, A. M.
1994-01-01
Increasingly, there is a need in both research and clinical practice to document and quantify sleep and waking behaviors in a comprehensive manner. The Pittsburgh Sleep Diary (PghSD) is an instrument with separate components to be completed at bedtime and waketime. Bedtime components relate to the events of the day preceding the sleep, waketime components to the sleep period just completed. Two-week PghSD data is presented from 234 different subjects, comprising 96 healthy young middle-aged controls, 37 older men, 44 older women, 29 young adult controls and 28 sleep disorders patients in order to demonstrate the usefulness, validity and reliability of various measures from the instrument. Comparisons are made with polysomnographic and actigraphic sleep measures, as well as personality and circadian type questionnaires. The instrument was shown to have sensitivity in detecting differences due to weekends, age, gender, personality and circadian type, and validity in agreeing with actigraphic estimates of sleep timing and quality. Over a 12-31 month delay, PghSD measures of both sleep timing and sleep quality showed correlations between 0.56 and 0.81 (n = 39, P < 0.001).
Validation of a Quality-of-Life Measure for Deaf or Hard of Hearing Youth
Patrick, Donald L.; Edwards, Todd C.; Skalicky, Anne H.; Schick, Brenda; Topolski, Tari D.; Kushalnagar, Poorna; Leng, Mei; O'Neill-Kemp, Aprille M.; Sie, Kathleen
2014-01-01
Objective Quailty-of-life (QOL) measures targeting youth with hearing loss are useful in population needs assessment, educational placement, and program design and evaluation. This study assesses the cross-sectional validity of the Youth Quality of Life Instrument–Deaf and Hard of Hearing Module (YQOL-DHH). Study Design Instrument development and cross-sectional survey. Setting Recruitment through schools, professional organizations, clinics, and programs for youth who are deaf or hard of hearing. Subjects and Methods Thirty-five candidate items were administered to 230 adolescents aged 11 to 18 years: 49% female, 61% white, 11% mild hearing loss, 20% moderate/moderate-severe, 41% severe/profound, and 28% with cochlear implants. Participants completed individual or group-administered questionnaires by paper and pencil (58%), Web-based English (29%), American Sign Language (ASL) or Pidgin Signed English (PSE) (9%) on DVD, or interviewer-supervised ASL or PSE DVD (4%). The Children's Depression Inventory (CDI-S) was also completed. Factor structure, reliability, construct validity, and respondent burden were assessed. Results Thirty-two Items were retained in the final instrument covering 3 domains: seif-acceptance/advocacy (14 items, Cronbach α = 0.84), perceived stigma (8 items, Cronbach α = 0.85), and participation (10 items, Cronbach α = 0.86). QOL was not significantly associated with hearing level. One-week test-retest coefficients were acceptable: self-acceptance/advocacy (0.70), perceived stigma (0.78), and participation (0.92). As predicted, the total CDI-S score was associated in the appropriate direction (P < .0001) with all YQOL-DHH domains. Time to complete the paper-and-pencil version was 12 minutes. Conclusion The YQOL-DHH shows good reliability and validity for assessing hearing-specific QOL in adolescents. PMID:21493349
Validation of a quality-of-life measure for deaf or hard of hearing youth.
Patrick, Donald L; Edwards, Todd C; Skalicky, Anne M; Schick, Brenda; Topolski, Tari D; Kushalnagar, Poorna; Leng, Mei; O'Neill-Kemp, Aprille M; Sie, Kathleen Sie
2011-07-01
Quality-of-life (QOL) measures targeting youth with hearing loss are useful in population needs assessment, educational placement, and program design and evaluation. This study assesses the cross-sectional validity of the Youth Quality of Life Instrument-Deaf and Hard of Hearing Module (YQOL-DHH). STUDY DESIGN. Instrument development and cross-sectional survey. Recruitment through schools, professional organizations, clinics, and programs for youth who are deaf or hard of hearing. SUBJECTS AND METHODS. Thirty-five candidate items were administered to 230 adolescents aged 11 to 18 years: 49% female, 61% white, 11% mild hearing loss, 20% moderate/moderate-severe, 41% severe/profound, and 28% with cochlear implants. Participants completed individual or group-administered questionnaires by paper and pencil (58%), Web-based English (29%), American Sign Language (ASL) or Pidgin Signed English (PSE) (9%) on DVD, or interviewer-supervised ASL or PSE DVD (4%). The Children's Depression Inventory (CDI-S) was also completed. Factor structure, reliability, construct validity, and respondent burden were assessed. Thirty-two items were retained in the final instrument covering 3 domains: self-acceptance/advocacy (14 items, Cronbach α = 0.84), perceived stigma (8 items, Cronbach α = 0.85), and participation (10 items, Cronbach α = 0.86). QOL was not significantly associated with hearing level. One-week test-retest coefficients were acceptable: self-acceptance/ advocacy (0.70), perceived stigma (0.78), and participation 0.92). As predicted, the total CDI-S score was associated in the appropriate direction (P < .0001) with all YQOL-DHH domains. Time to complete the paper-and-pencil version was 12 minutes. The YQOL-DHH shows good reliability and validity for assessing hearing-specific QOL in adolescents.
2012 Ground Testing Highlights
NASA Technical Reports Server (NTRS)
Buchholz, Steven J.
2012-01-01
As part of the Fundamental Aeronautics Program and a collaborative effort with Boeing, and Lockheed Martin this past year a series of sonic boom test were completed in the NASA Ames Unitary Plan Wind Tunnel (UPWT). One of the goals was to develop new test techniques and hardware for measuring sonic boom signatures in the transonic and supersonic regimes. Data for various model designs and configurations were collected and will be used to validate CFD predictions of sonic boom signatures. Reactivation of the NASA Ames Mitsubishi compressor system was completed this past year. The compressor is intended to replace and augment the existing UPWT Clark Compressor as the primary Make Up Air (MUA) source. The MUA system provides air and vacuum pumping capability to the Ames UPWT. It will improve productivity and reliability of the UPWT as a vital testing and research facility for the U.S. aerospace industry and NASA. Funding for this task was provided from the American Recovery Investment Act (ARRA). Installation and validation of a Noncontact Stress Monitoring System (NSMS) for the 3-stage compressor was completed at the 11-foot Transonic Wind Tunnel. The system, originally developed at AEDC, consists of 36 pairs of LED light sources with optic beam send and receive probes along a 1-per rev signal. The new system allows for continuous monitoring and recording of compressor blade bending and torsion stress during normal test operations. A very unusual test was completed in the 11 FT TWT to acquire aerodynamic and flow field data for the Crew Exploration Vehicle (CEV) Parachute Assembly System (CPAS) to validate CFD methods and tools. Surface pressure distribution measurements and velocity measurements in the wake of the command module back to the drogues parachute location were acquired. Testing methods included Particle Image Velocimetry (PIV), Pressure Sensitive Paint (PSP), Schlieren Infrared Imaging (IR) and boundary layer survey and skin friction.
Hung, Man; Baumhauer, Judith F; Latt, L Daniel; Saltzman, Charles L; SooHoo, Nelson F; Hunt, Kenneth J
2013-11-01
In 2012, the American Orthopaedic Foot & Ankle Society(®) established a national network for collecting and sharing data on treatment outcomes and improving patient care. One of the network's initiatives is to explore the use of computerized adaptive tests (CATs) for patient-level outcome reporting. We determined whether the CAT from the NIH Patient Reported Outcome Measurement Information System(®) (PROMIS(®)) Physical Function (PF) item bank provides efficient, reliable, valid, precise, and adequately covered point estimates of patients' physical function. After informed consent, 288 patients with a mean age of 51 years (range, 18-81 years) undergoing surgery for common foot and ankle problems completed a web-based questionnaire. Efficiency was determined by time for test administration. Reliability was assessed with person and item reliability estimates. Validity evaluation included content validity from expert review and construct validity measured against the PROMIS(®) Pain CAT and patient responses based on tradeoff perceptions. Precision was assessed by standard error of measurement (SEM) across patients' physical function levels. Instrument coverage was based on a person-item map. Average time of test administration was 47 seconds. Reliability was 0.96 for person and 0.99 for item. Construct validity against the Pain CAT had an r value of -0.657 (p < 0.001). Precision had an SEM of less than 3.3 (equivalent to a Cronbach's alpha of ≥ 0.90) across a broad range of function. Concerning coverage, the ceiling effect was 0.32% and there was no floor effect. The PROMIS(®) PF CAT appears to be an excellent method for measuring outcomes for patients with foot and ankle surgery. Further validation of the PROMIS(®) item banks may ultimately provide a valid and reliable tool for measuring patient-reported outcomes after injuries and treatment.
Mills, Sarah D; Kwakkenbos, Linda; Carrier, Marie-Eve; Gholizadeh, Shadi; Fox, Rina S; Jewett, Lisa R; Gottesman, Karen; Roesch, Scott C; Thombs, Brett D; Malcarne, Vanessa L
2018-01-17
Systemic sclerosis (SSc) is an autoimmune disease that can cause disfiguring changes in appearance. This study examined the structural validity, internal consistency reliability, convergent validity, and measurement equivalence of the Social Appearance Anxiety Scale (SAAS) across SSc disease subtypes. Patients enrolled in the Scleroderma Patient-centered Intervention Network Cohort completed the SAAS and measures of appearance-related concerns and psychological distress. Confirmatory factor analysis (CFA) was used to examine the structural validity of the SAAS. Multiple-group CFA was used to determine if SAAS scores can be compared across patients with limited and diffuse disease subtypes. Cronbach's alpha was used to examine internal consistency reliability. Correlations of SAAS scores with measures of body image dissatisfaction, fear of negative evaluation, social anxiety, and depression were used to examine convergent validity. SAAS scores were hypothesized to be positively associated with all convergent validity measures, with correlations significant and moderate to large in size. A total of 938 patients with SSc were included. CFA supported a one-factor structure (CFI: .92; SRMR: .04; RMSEA: .08), and multiple-group CFA indicated that the scalar invariance model best fit the data. Internal consistency reliability was good in the total sample (α = .96) and in disease subgroups. Overall, evidence of convergent validity was found with measures of body image dissatisfaction, fear of negative evaluation, social anxiety, and depression. The SAAS can be reliably and validly used to assess fear of appearance evaluation in patients with SSc, and SAAS scores can be meaningfully compared across disease subtypes. This article is protected by copyright. All rights reserved. This article is protected by copyright. All rights reserved.
Torabi, Hadi; Khoddami, Seyyedeh Maryam; Ansari, Noureddin Nakhostin; Dabirmoghaddam, Payman
2016-11-01
To cross-culturally adapt of Persian Vocal Tract Discomfort (VTDp) scale and evaluate its validity and reliability in the assessment of patients with muscle tension dysphonia (MTD). A cross-sectional and prospective cohort design was used to psychometrically test the VTDp. The VTD scale was cross-culturally adapted into Persian language following standard forward-backward translations. The VTDp scale was administrated to 100 patients with MTD (54 men and 46 women; mean age: 38.05 ± 10.02 years) and 50 healthy volunteers (26 men and 24 women; mean age: 36.50 ± 12.27 years). Forty-five patients with MTD completed the VTDp 7 days later for test-retest reliability. Patients also completed the Persian Voice Handicap Index (VHIp) to assess construct validity. The results of discriminative validity demonstrated that the VTDp was able to discriminate between patients with MTD and healthy participants. The internal consistency was confirmed with Cronbach α .77 and 0.73 for VTDp frequency and severity subscales, respectively. The test-retest reliability was excellent with an intraclass correlation coefficient (ICC agreement ) of 0.93 for the frequency subscale and 0.91 for the severity subscale. Construct validity of the VTDp was shown with significant correlations between the VTDp frequency and severity subscales and the VHIp total scores (0.36 and 0.37, respectively). The standard error of measurement and smallest detectable change values for VTDp frequency (2.11 and 5.85, respectively) and severity (2.25 and 6.23, respectively) were acceptable. The Bland-Altman analysis for assessing the agreement between test and retest measurements showed no systematic bias. The VTDp is a valid and reliable self-administered scale to measure patient's vocal tract sensations in Persian-speaking population. Copyright © 2016 The Voice Foundation. Published by Elsevier Inc. All rights reserved.
Moore, L; Tapper, K; Dennehy, A; Cooper, A
2005-07-01
To evaluate the validity, reliability and sensitivity of a computerised single day 24-h recall questionnaire designed for the comparison of children's fruit and snack consumption at the group (school) level. Relative validity and reliability were assessed in relation to (i) intake at school and (ii) intake throughout the whole day, using diary-assisted 24-h recall interviews and a 7-day test-retest procedure. Sensitivity was assessed in relation to intake by comparing results from schools with differing food policies, and by sex. Eight schools took part in the validity and reliability assessments, with 78 children completing the 24-h recall interviews and 195 children completing the test-retest procedure. A total of 43 schools (1890 children) took part in the sensitivity analysis. All children were aged 9-11 y. All schools were in South Wales and South-west England. For fruit intake at school, the questionnaire showed fair levels of validity at the individual level (kappa = 0.29). At the group level, there were little or no differences in fruit intake at school between the two measures and two occasions. The questionnaire was sufficiently sensitive to identify statistically significant differences between girls and boys, and between schools with different food policies. For snack intake at school, validity at the individual level was slightly lower (kappa = 0.220.25), but the data remained of value in analyses at the group level. For fruit and snack intake throughout the whole day there was little agreement at the individual level (kappa = 0.00-0.06), and at the group level there tended to be substantial differences between the two measures and two occasions. The computerised questionnaire is a quick and cost-effective means of assessing children's consumption of fruit at school. While further development is required to improve validity and reliability, it has the potential to be particularly useful in randomised controlled trials of school-based dietary interventions.
Thomas, Hannah J; Scott, James G; Coates, Jason M; Connor, Jason P
2018-05-03
Intervention on adolescent bullying is reliant on valid and reliable measurement of victimization and perpetration experiences across different behavioural expressions. This study developed and validated a survey tool that integrates measurement of both traditional and cyber bullying to test a theoretically driven multi-dimensional model. Adolescents from 10 mainstream secondary schools completed a baseline and follow-up survey (N = 1,217; M age = 14 years; 66.2% male). The Bullying and cyberbullying Scale for Adolescents (BCS-A) developed for this study comprised parallel victimization and perpetration subscales, each with 20 items. Additional measures of bullying (Olweus Global Bullying and the Forms of Bullying Scale [FBS]), as well as measures of internalizing and externalizing problems, school connectedness, social support, and personality, were used to further assess validity. Factor structure was determined, and then, the suitability of items was assessed according to the following criteria: (1) factor interpretability, (2) item correlations, (3) model parsimony, and (4) measurement equivalence across victimization and perpetration experiences. The final models comprised four factors: physical, verbal, relational, and cyber. The final scale was revised to two 13-item subscales. The BCS-A demonstrated acceptable concurrent and convergent validity (internalizing and externalizing problems, school connectedness, social support, and personality), as well as predictive validity over 6 months. The BCS-A has sound psychometric properties. This tool establishes measurement equivalence across types of involvement and behavioural forms common among adolescents. An improved measurement method could add greater rigour to the evaluation of intervention programmes and also enable interventions to be tailored to subscale profiles. © 2018 The British Psychological Society.
Agogo, George O; van der Voet, Hilko; van 't Veer, Pieter; Ferrari, Pietro; Muller, David C; Sánchez-Cantalejo, Emilio; Bamia, Christina; Braaten, Tonje; Knüppel, Sven; Johansson, Ingegerd; van Eeuwijk, Fred A; Boshuizen, Hendriek C
2016-10-13
Measurement error in self-reported dietary intakes is known to bias the association between dietary intake and a health outcome of interest such as risk of a disease. The association can be distorted further by mismeasured confounders, leading to invalid results and conclusions. It is, however, difficult to adjust for the bias in the association when there is no internal validation data. We proposed a method to adjust for the bias in the diet-disease association (hereafter, association), due to measurement error in dietary intake and a mismeasured confounder, when there is no internal validation data. The method combines prior information on the validity of the self-report instrument with the observed data to adjust for the bias in the association. We compared the proposed method with the method that ignores the confounder effect, and with the method that ignores measurement errors completely. We assessed the sensitivity of the estimates to various magnitudes of measurement error, error correlations and uncertainty in the literature-reported validation data. We applied the methods to fruits and vegetables (FV) intakes, cigarette smoking (confounder) and all-cause mortality data from the European Prospective Investigation into Cancer and Nutrition study. Using the proposed method resulted in about four times increase in the strength of association between FV intake and mortality. For weakly correlated errors, measurement error in the confounder minimally affected the hazard ratio estimate for FV intake. The effect was more pronounced for strong error correlations. The proposed method permits sensitivity analysis on measurement error structures and accounts for uncertainties in the reported validity coefficients. The method is useful in assessing the direction and quantifying the magnitude of bias in the association due to measurement errors in the confounders.
Detailed Validation of the Bidirectional Effect in Various Case 1 and Case 2 Waters
2012-03-26
of the viewing direction, i.e., they assumed a completely diffuse BRDF . Previous efforts to model / understand the actual BRDF [4-10] have produced...places. Second, the MAG2002 BRDF tables were developed from a radiative transfer (RT) model that used scattering particle phase functions that...situ measurements from just 3 locations to validate their model ; here we used a much larger data set across a wide variety of inherent optical
Brand, Pierre; Boulanger, Benoît; Segonds, Patricia; Petit, Yannick; Félix, Corinne; Ménaert, Bertrand; Taira, Takunori; Ishizuki, Hideki
2009-09-01
We validated the theory of angular quasi-phase-matching (AQPM) by performing measurements of second-harmonic generation and difference-frequency generation. A nonlinear least-squares fitting of these experimental data led to refine the Sellmeier equations of 5%MgO:PPLN that are now valid over the complete transparency range of the crystal. We also showed that AQPM exhibits complementary spectral ranges and acceptances compared with birefringence phase matching.
2013-01-01
Background and objectives Nephrotic syndrome (NS) represents a common disease in pediatric nephrology typified by a relapsing and remitting course and characterized by the presence of edema that can significantly affect the health-related quality of life in children and adolescents. The PROMIS pediatric measures were constructed to be publically available, efficient, precise, and valid across a variety of diseases to assess patient reports of symptoms and quality of life. This study was designed to evaluate the ability of children and adolescents with NS to complete the PROMIS assessment via computer and to initiate validity assessments of the short forms and full item banks in pediatric NS. Successful measurement of patient reported outcomes will contribute to our understanding of the impact of NS on children and adolescents. Design This cross-sectional study included 151 children and adolescents 8-17 years old with NS from 16 participating institutions in North America. The children completed the PROMIS pediatric depression, anxiety, social-peer relationships, pain interference, fatigue, mobility and upper extremity functioning measures using a web-based interface. Responses were compared between patients experiencing active NS (n = 53) defined by the presence of edema and patients with inactive NS (n = 96) defined by the absence of edema. Results All 151 children and adolescents were successfully able to complete the PROMIS assessment via computer. As hypothesized, the children and adolescents with active NS were significantly different on 4 self-reported measures (anxiety, pain interference, fatigue, and mobility). Depression, peer relationships, and upper extremity functioning were not different between children with active vs. inactive NS. Multivariate analysis showed that the PROMIS instruments remained sensitive to NS disease activity after adjusting for demographic characteristics. Conclusions Children and adolescents with NS were able to successfully complete the PROMIS instrument using a web-based interface. The computer based pediatric PROMIS measurement effectively discriminated between children and adolescents with active and inactive NS. The domain scores found in this study are consistent with previous reports investigating the health-related quality of life in children and adolescents with NS. This study establishes known-group validity and feasibility for PROMIS pediatric measures in children and adolescents with NS. PMID:23510630
Spencer, Robert J; Reckow, Jaclyn; Drag, Lauren L; Bieliauskas, Linas A
2016-12-01
We assessed the validity of a brief incidental learning measure based on the Similarities and Vocabulary subtests of the Wechsler Adult Intelligence Scale-Fourth Edition (WAIS-IV). Most neuropsychological assessments for memory require intentional learning, but incidental learning occurs without explicit instruction. Incidental memory tests such as the WAIS-III Symbol Digit Coding subtest have existed for many years, but few memory studies have used a semantically processed incidental learning model. We conducted a retrospective analysis of 37 veterans with traumatic brain injury, referred for outpatient neuropsychological testing at a Veterans Affairs hospital. As part of their evaluation, the participants completed the incidental learning tasks. We compared their incidental learning performance to their performance on traditional memory measures. Incidental learning scores correlated strongly with scores on the California Verbal Learning Test-Second Edition (CVLT-II) and Brief Visuospatial Memory Test-Revised (BVMT-R). After we conducted a partial correlation that controlled for the effects of age, incidental learning correlated significantly with the CVLT-II Immediate Free Recall, CVLT-II Short-Delay Recall, CVLT-II Long-Delay Recall, and CVLT-II Yes/No Recognition Hits, and with the BVMT-R Delayed Recall and BVMT-R Recognition Discrimination Index. Our incidental learning procedures derived from subtests of the WAIS-IV Edition are an efficient and valid way of measuring memory. These tasks add minimally to testing time and capitalize on the semantic encoding that is inherent in completing the Similarities and Vocabulary subtests.
Van, Connie; Costa, Daniel; Mitchell, Bernadette; Abbott, Penny; Krass, Ines
2012-01-01
Existing validated measures of pharmacist-physician collaboration focus on measuring attitudes toward collaboration and do not measure frequency of collaborative interactions. To develop and validate an instrument to measure the frequency of collaboration between pharmacists and general practitioners (GPs) from the pharmacist's perspective. An 11-item Pharmacist Frequency of Interprofessional Collaboration Instrument (FICI-P) was developed and administered to 586 pharmacists in 8 divisions of general practice in New South Wales, Australia. The initial items were informed by a review of the literature in addition to interviews of pharmacists and GPs. Items were subjected to principal component and Rasch analyses to determine each item's and the overall measure's psychometric properties and for any needed refinements. Two hundred and twenty four (38%) of pharmacist surveys were completed and returned. Principal component analysis suggested removal of 1 item for a final 1-factor solution. The refined 10-item FICI-P demonstrated internal consistency reliability at Cronbach's alpha=0.90. After collapsing the original 5-point response scale to a 4-point response scale, the refined FICI-P demonstrated fit to the Rasch model. Criterion validity of the FICI-P was supported by the correlation of FICI-P scores with scores on a previously validated Physician-Pharmacist Collaboration Instrument. Validity was also supported by predicted differences in FICI-P scores between subgroups of respondents stratified on age, colocation with GPs, and interactions during the intern-training period. The refined 10-item FICI-P was shown to have good internal consistency, criterion validity, and fit to the Rasch model. The creation of such a tool may allow for the measure of impact in the evaluation of interventions designed to improve interprofessional collaboration between GPs and pharmacists. Copyright © 2012 Elsevier Inc. All rights reserved.
NASA Technical Reports Server (NTRS)
Smith, Eric A.; Crosson, William L.; Tanner, Bertrand D.
1992-01-01
Attention is focused on in situ measurements taken during FIFE required to support the development and validation of a biosphere model. Seasonal time series of surface flux measurements obtained from two surface radiation and energy budget stations utilized to support the FIFE surface flux measurement subprogram are examined. Data collection and processing procedures are discussed along with the measurement analysis for the complete 1987 test period.
ERIC Educational Resources Information Center
Ovington, Linda A.; Saliba, Anthony J.; Goldring, Jeremy
2016-01-01
This article reports the development of a brief self-report measure of dispositional insight problem solving, the Dispositional Insight Scale (DIS). From a representative Australian database, 1,069 adults (536 women and 533 men) completed an online questionnaire. An exploratory and confirmatory factor analysis revealed a 5-item scale, with all…
ERIC Educational Resources Information Center
Douglas, Scott Roy
2015-01-01
Independent confirmation that vocabulary in use unfolds across levels of performance as expected can contribute to a more complete understanding of validity in standardized English language tests. This study examined the relationship between Lexical Frequency Profiling (LFP) measures and rater judgements of test-takers' overall levels of…
Clinton-McHarg, Tara; Carey, Mariko; Sanson-Fisher, Rob; D'Este, Catherine; Shakeshaft, Anthony
2012-01-30
Adolescents and young adult (AYA) cancer survivors may have unique physical, psychological and social needs due to their cancer occurring at a critical phase of development. The aim of this study was to develop a psychometrically rigorous measure of unmet need to capture the specific needs of this group. Items were developed following a comprehensive literature review, focus groups with AYAs, and feedback from health care providers, researchers and other professionals. The measure was pilot tested with 32 AYA cancer survivors recruited through a state-based cancer registry to establish face and content validity. A main sample of 139 AYA cancer patients and survivors were recruited through seven treatment centres and invited to complete the questionnaire. To establish test-retest reliability, a sub-sample of 34 participants completed the measure a second time. Exploratory factor analysis was performed and the measure was assessed for internal consistency, discriminative validity, potential responsiveness and acceptability. The Cancer Needs Questionnaire - Young People (CNQ-YP) has established face and content validity, and acceptability. The final measure has 70 items and six factors: Treatment Environment and Care (33 items); Feelings and Relationships (14 items); Daily Life (12 items); Information and Activities (5 items); Education (3 items); and Work (3 items). All domains achieved Cronbach's alpha values greater than 0.80. Item-to-item test-retest reliability was also high, with all but four items reaching weighted kappa values above 0.60. The CNQ-YP is the first multi-dimensional measure of unmet need which has been developed specifically for AYA cancer patients and survivors. The measure displays a strong factor structure, and excellent internal consistency and test-retest reliability. However, the small sample size has implications for the reliability of the statistical analyses undertaken, particularly the exploratory factor analysis. Future studies with a larger sample are recommended to confirm the factor structure of the measure. Longitudinal studies to establish responsiveness and predictive validity should also be undertaken.
2012-01-01
Background Adolescents and young adult (AYA) cancer survivors may have unique physical, psychological and social needs due to their cancer occurring at a critical phase of development. The aim of this study was to develop a psychometrically rigorous measure of unmet need to capture the specific needs of this group. Methods Items were developed following a comprehensive literature review, focus groups with AYAs, and feedback from health care providers, researchers and other professionals. The measure was pilot tested with 32 AYA cancer survivors recruited through a state-based cancer registry to establish face and content validity. A main sample of 139 AYA cancer patients and survivors were recruited through seven treatment centres and invited to complete the questionnaire. To establish test-retest reliability, a sub-sample of 34 participants completed the measure a second time. Exploratory factor analysis was performed and the measure was assessed for internal consistency, discriminative validity, potential responsiveness and acceptability. Results The Cancer Needs Questionnaire - Young People (CNQ-YP) has established face and content validity, and acceptability. The final measure has 70 items and six factors: Treatment Environment and Care (33 items); Feelings and Relationships (14 items); Daily Life (12 items); Information and Activities (5 items); Education (3 items); and Work (3 items). All domains achieved Cronbach's alpha values greater than 0.80. Item-to-item test-retest reliability was also high, with all but four items reaching weighted kappa values above 0.60. Conclusions The CNQ-YP is the first multi-dimensional measure of unmet need which has been developed specifically for AYA cancer patients and survivors. The measure displays a strong factor structure, and excellent internal consistency and test-retest reliability. However, the small sample size has implications for the reliability of the statistical analyses undertaken, particularly the exploratory factor analysis. Future studies with a larger sample are recommended to confirm the factor structure of the measure. Longitudinal studies to establish responsiveness and predictive validity should also be undertaken. PMID:22284545
The Validity and reliability of the Comprehensive Home Environment Survey (CHES).
Pinard, Courtney A; Yaroch, Amy L; Hart, Michael H; Serrano, Elena L; McFerren, Mary M; Estabrooks, Paul A
2014-01-01
Few comprehensive measures exist to assess contributors to childhood obesity within the home, specifically among low-income populations. The current study describes the modification and psychometric testing of the Comprehensive Home Environment Survey (CHES), an inclusive measure of the home food, physical activity, and media environment related to childhood obesity. The items were tested for content relevance by an expert panel and piloted in the priority population. The CHES was administered to low-income parents of children 5 to 17 years (N = 150), including a subsample of parents a second time and additional caregivers to establish test-retest and interrater reliabilities. Children older than 9 years (n = 95), as well as parents (N = 150) completed concurrent assessments of diet and physical activity behaviors (predictive validity). Analyses and item trimming resulted in 18 subscales and a total score, which displayed adequate internal consistency (α = .74-.92) and high test-retest reliability (r ≥ .73, ps < .01) and interrater reliability (r ≥ .42, ps < .01). The CHES score and a validated screener for the home environment were correlated (r = .37, p < .01; concurrent validity). CHES subscales were significantly correlated with behavioral measures (r = -.20-.55, p < .05; predictive validity). The CHES shows promise as a valid/reliable assessment of the home environment related to childhood obesity, including healthy diet and physical activity.
Assessment of Caregiver Inventory for Rett Syndrome
Lane, Jane B.; Salter, Amber R.; Jones, Nancy E.; Cutter, Gary; Horrigan, Joseph; Skinner, Steve A.; Kaufmann, Walter E.; Glaze, Daniel G.; Neul, Jeffrey L.; Percy, Alan K.
2017-01-01
Rett syndrome (RTT) requires total caregiver attention and leads to potential difficulties throughout life. The Caregiver Burden Inventory, designed for Alzheimer disease, was modified to a RTT Caregiver Inventory Assessment (RTT CIA). Reliability and face, construct, and concurrent validity were assessed in caregivers of individuals with RTT. Chi-square or Fisher’s exact test for categorical variables and t-tests or Wilcoxon two-sample tests for continuous variables were utilized. Survey completed by 198 caregivers; 70 caregivers completed follow-up assessment. Exploratory factor analysis revealed good agreement for Physical Burden, Emotional Burden, and Social Burden. Internal reliability was high (Cronbach’s alpha: 0.898). RTT CIA represents a reliable and valid measure, providing a needed metric of caregiver burden in this disorder. PMID:28132121
Validation of the oesophageal hypervigilance and anxiety scale for chronic oesophageal disease.
Taft, T H; Triggs, J R; Carlson, D A; Guadagnoli, L; Tomasino, K N; Keefer, L; Pandolfino, J E
2018-05-01
Oesophageal hypervigilance and anxiety can drive symptom experience in chronic oesophageal conditions, including gastro-oesophageal reflux disease, achalasia and functional oesophageal disorders. To date, no validated self-report measure exists to evaluate oesophageal hypervigilance and anxiety. This study aims to develop a brief and reliable questionnaire assessing these constructs, the oesophageal hypervigilance and anxiety scale (EHAS). Questions for the EHAS were drawn from 4 existing validated measures that assessed hypervigilance and anxiety adapted for the oesophagus. Patients who previously underwent high-resolution manometry testing at a university-based oesophageal motility clinic were retrospectively identified. Patients were included in the analysis if they completed the EHAS as well as questionnaires assessing symptom severity and health-related quality of life at the time of the high-resolution manometry. Nine hundred and eighty-two patients aged 18-85 completed the study. The EHAS demonstrates excellent internal consistency (α = 0.93) and split-half reliability (Guttman = 0.87). Inter-item correlations indicated multicollinearity was not achieved; thus, no items were removed from the original 15-item scale. Principal components factor analysis revealed two subscales measuring symptom-specific anxiety and symptom-specific hypervigilance. Construct validity for total and subscale scores was supported by positive correlations with symptom severity and negative correlations with health-related quality of life. The EHAS is a 15-item scale assessing oesophageal hypervigilance and symptom-specfic anxiety. The EHAS could be useful in evaluating the role of these constructs in several oesophageal conditions in which hypersensitivity, hypervigilance and anxiety may contribute to symptoms and impact treatment outcomes. © 2018 John Wiley & Sons Ltd.
Garoushi, Sabri; Johnson, Mark I; Tashani, Osama A
2017-12-01
In Libya neuropathic pain is rarely assessed in patients with diabetes. The Leeds Assessment of Neuropathic Symptoms and Signs (LANSS) pain scale is used worldwide to screen for neuropathic pain. There is no Arabic version of LANSS for use in Libya. The aim of this study was to develop an Arabic version of LANSS and to assess its validity and reliability in diabetic patients in Benghazi, Libya. LANSS was translated into Arabic by four bilingual translators and back translated to English by a university academic. Validity and reliability of the Arabic LANSS was assessed on 110 patients attending a Diabetes Centre in Benghazi. Concurrent validity was tested and compared with the Self-completed Leeds Assessment of Neuropathic Symptoms and Signs (S-LANSS). Test-retest reliability was conducted 1-2 weeks later. Internal consistency and inter-class correlation (ICC) between LANSS and S-LANSS was also tested. Internal consistency within first completion of the Arabic LANSS was acceptable (Cronbach's alpha = 0.793) and similar to the Arabic S-LANSS (0.796) and the second completion of the Arabic LANSS (0.795). ICC between the Arabic LANSS and the Arabic S-LANSS was 0.999 (p < 0.001). Test-retest reliability (ICC) between first and second completions of the Arabic LANSS was 0.999 (p < 0.001). Kappa measurement of agreement between the two Arabic LANSS completions and S-LANSS was high on all seven items (Kappa >0.95, p < 0.0001). We concluded that the Arabic version of LANSS pain scale was valid and reliable for use on Libyan diabetic patients. This study provided results suggesting that the S-LANSS could also be used on diabetic patients.
Ferguson, Gail M; Nguyen, Jacqueline; Iturbide, Maria I
2017-01-01
Cultural variability (CV) is introduced as an overlooked dimension of cultural identity development pertaining to emphasizing and de-emphasizing the influence of a single cultural identity (i.e., cultural influence [CI]) on daily interactions and behaviors. The Cultural IDentity Influence Measure (CIDIM) is introduced as a novel measure of CI and CV, and hypothesis-driven validation is conducted in two samples along with exploration of associations between CV and well-being. A multicultural sample of 242 emerging adults participated in a daily diary study (Mage = 19.95 years, SDage = 1.40) by completing up to eight daily online surveys containing the CIDIM, criterion measures (ethnic identity, other group orientation, ethnic identity salience and daily variability in salience, social desirability), and measures of personal and interpersonal well-being. A second validation sample (n = 245) completed a 1-time survey with the CIDIM and a subset of criterion measures. Results using both samples show evidence of CI and CV and demonstrate the validity, reliability, and domain-sensitivity of the CIDIM. Further, CV made unique and positive contributions to predicting interaction quality after accounting for ethnic salience and variability in ethnic salience. An analytic approach utilizing standard deviations produced near-identical results to multilevel modeling and is recommended for parsimony. Ethnic minority and majority individuals make daily adjustments to play up and play down the influence of cultural identity on their social interactions and behaviors, and these adjustments predict interpersonal well-being. Cultural influence and cultural variability contribute to our emerging understanding of cultural identity as dynamic and agentic. (PsycINFO Database Record (c) 2017 APA, all rights reserved).
Validation of a Measure of Normative Beliefs About Smokeless Tobacco Use
O’Connor, Richard J.; Bansal-Travers, Maansi; Cummings, K. Michael; Rees, Vaughan W.; Hatsukami, Dorothy K.
2016-01-01
Abstract Introduction: Validated methods to evaluate consumer responses to modified risk tobacco products (MRTPs) are needed. Guided by existing literature that demonstrates a relationship between normative beliefs and future intentions to use tobacco the current research sought to (1) develop a measure of normative beliefs about smokeless tobacco (ST) and establish the underlying factor structure, (2) evaluate the structure with confirmatory factor analysis utilizing an independent sample of youth, and (3) establish the measure’s concurrent validity. Methods: Respondents (smokers and nonsmokers aged 15–65; N = 2991) completed a web-based survey that included demographic characteristics, tobacco use history and dependence, and a measure of attitudes about ST adapted from the Normative Beliefs about Smoking scale. A second sample of youth (aged 14–17; N = 305) completed a similar questionnaire. Results: Exploratory factor analysis produced the anticipated three-factor solution and accounted for nearly three-quarters of the variance in the data reflecting (1) perceived prevalence of ST use, (2) popularity of ST among successful/elite, and (3) approval of ST use by parents/peers. Confirmatory factor analysis with data from the youth sample demonstrated good model fit. Logistic regression demonstrated that the scales effectively discriminate between ST users and nonusers and are associated with interest in trying snus. Conclusions: Assessment of MRTPs for regulatory purposes, which allows messages of reduced risk, should include measurement of social norms. Furthermore, surveillance efforts that track use of new MRTPs should include measures of social norms to determine how norms change with prevalence of use. PMID:26187390
Bamm, Elena L; Rosenbaum, Peter; Wilkins, Seanne; Stratford, Paul
2015-01-01
In recent years, client-centered care has been embraced as a new philosophy of care by many organizations around the world. Clinicians and researchers have identified the need for valid and reliable outcome measures that are easy to use to evaluate success of implementation of new concepts. The current study was developed to complete adaptation and field testing of the companion patient-reported measures of processes of care for adults (MPOC-A) and the service provider self-reflection measure of processes of care for service providers working with adult clients (MPOC-SP(A)). A validation study. In-patient rehabilitation facilities. MPOC-A and measure of processes of care for service providers working with adult clients (MPOC-SP(A)). Three hundred and eighty-four health care providers, 61 patients, and 16 family members completed the questionnaires. Good to excellent internal consistency (0.71-0.88 for health care professionals, 0.82-0.90 for patients, and 0.87-0.94 for family members), as well as moderate to good correlations between domains (0.40-0.78 for health care professionals and 0.52-0.84 for clients) supported internal reliability of the tools. Exploratory factor analysis of the MPOC-SP(A) responses supported the multidimensionality of the questionnaire. MPOC-A and MPOC-SP(A) are valid and reliable tools to assess patient and service-provider accounts, respectively, of the extent to which they experience, or are able to provide, client-centered service. Research should now be undertaken to explore in more detail the relationships between client experience and provider reports of their own behavior.
Becker, Stephen P
2014-09-01
Several child-report measures of sleep functioning have been developed but very few studies have examined the external validity of child self-reported sleep in relation to daytime functioning. This study examined child-reported sleep in relation to teacher-rated psychopathology symptoms and also tested the hypothesis that child-reported sleep would be associated with poorer child- and teacher-reported functioning after controlling for demographics and psychopathology symptoms that are known to be associated with adjustment. Participants were 175 children (81 boys, 94 girls) in 1st-6th grades (ages 6-13) and their teachers. Children completed the Sleep Self-Report. Teachers completed a measure of attention-deficit/hyperactivity disorder (ADHD), oppositional/conduct, and anxiety/depression symptoms. Children and teachers completed multiple measures of academic, behavioral, and social/peer functioning. Child-reported sleep was significantly associated with teacher-rated inattentive and internalizing symptoms, even after controlling for child demographics, hyperactivity-impulsivity, and conduct problems. Multilevel modeling analyses further indicated that, after controlling for child demographics and psychopathology symptoms, child-reported sleep problems were significantly associated with poorer child- and teacher-reported academic, behavioral, and social functioning (including increased reactive aggression, peer rejection, loneliness, and lower friendship satisfaction and self-worth). Findings provide initial support for the external validity of children's self-reported sleep functioning. Results of this study suggest that it may be clinically useful to screen for sleep problems by assessing for children's own perceptions of their sleep. Future studies should include both child- and parent-reported sleep functioning to further examine the utility of children's ratings of sleep functioning. Copyright © 2014 Elsevier B.V. All rights reserved.
Uswatte, Gitendra; Taub, Edward; Morris, David; Vignolo, Mary; McCulloch, Karen
2005-11-01
In research on Constraint-Induced Movement (CI) therapy, a structured interview, the Motor Activity Log (MAL), is used to assess how stroke survivors use their more-impaired arm outside the laboratory. This article examines the psychometrics of the 14-item version of this instrument in 2 chronic stroke samples with mild-to-moderate upper-extremity hemiparesis. Participants (n=41) in the first study completed MALs before and after CI therapy or a placebo control procedure. In addition, caregivers independently completed a MAL on the participants. Participants (n=27) in the second study completed MALs and wore accelerometers that monitored their arm movements for 3 days outside the laboratory before and after an automated form of CI therapy. Validity of the participant MAL Quality of Movement (QOM) scale was supported. Correlations between pretreatment-to-posttreatment change scores on the participant QOM scale and caregiver MAL QOM scale, caregiver MAL amount of use (AOU) scale, and accelerometer recordings were 0.70, 0.73, and 0.91 (P<0.01), respectively. Internal consistency (alpha>0.81), test-retest reliability (r>0.91), stability, and responsiveness (ratio>3) of the participant QOM scale were also supported. The participant AOU and caregiver QOM and AOU scales were internally consistent, stable, and sensitive, but were not reliable. The participant MAL QOM scale can be used exclusively to reliably and validly measure real-world, upper-extremity rehabilitation outcome and functional status in chronic stroke patients with mild-to-moderate hemiparesis.
A preliminary psychometric evaluation of Music in Dementia Assessment Scales (MiDAS).
McDermott, Orii; Orgeta, Vasiliki; Ridder, Hanne Mette; Orrell, Martin
2014-06-01
Music in Dementia Assessment Scales (MiDAS), an observational outcome measure for music therapy with people with moderate to severe dementia, was developed from qualitative data of focus groups and interviews. Expert and peer consultations were conducted at each stage of the scale development to maximize its content validity. This study aimed to evaluate the psychometric properties of MiDAS. Care home residents with dementia attended weekly group music therapy for up to ten sessions. Music therapists and care home staff were requested to complete weekly MiDAS ratings. The Quality of Life Scale (QoL-AD) was completed at three time-points. A total of 629 (staff = 306, therapist = 323) MiDAS forms were completed. The statistical analysis revealed that MiDAS has high therapist inter-rater reliability, low staff inter-rater reliability, adequate staff test-retest reliability, adequate concurrent validity, and good construct validity. High factor loadings between the five MiDAS Visual Analogue Scale (VAS) items, levels of Interest, Response, Initiation, Involvement, and Enjoyment, were found. This study indicates that MiDAS has good psychometric properties despite the small sample size. Future research with a larger sample size could provide a more in-depth psychometric evaluation, including further exploration of the underlying factors. MiDAS provides a measure of engagement with musical experience and offers insight into who is likely to benefit on other outcomes such as quality of life or reduction in psychiatric symptoms.
Russell, Alexandra C; Stone, Amanda L; Wang, Andi; Walker, Lynn S
2018-06-01
The objective of this study was to develop a pediatric measure of chronic nausea severity, the Nausea Severity Scale (NSS), and evaluate its reliability and validity in youth with abdominal pain-related functional gastrointestinal disorders (AP-FGID). Pediatric patients (aged 11⁻17 years-old, n = 236) presenting to an outpatient clinic for evaluation of abdominal pain completed the NSS, Children's Somatization Inventory (CSI), Functional Disability Inventory (FDI), Abdominal Pain Index (API), Patient-Report Outcomes Measurement Information System (PROMIS), Anxiety and Depression Scales and the Pediatric Rome III Questionnaire for FGIDs. The NSS demonstrated good concurrent, discriminant, and construct validity, as well as good internal consistency. One-third (34%) of AP-FGID patients reported experiencing nausea "most" or "every day" in the previous two weeks. The severity of nausea was higher in females than males and correlated significantly with the severity of somatic symptoms, functional disability, anxiety, and depression. The NSS is a valid and reliable measure of nausea in children with AP-FGID.
Claire Mölbert, Simone; Hautzinger, Martin; Karnath, Hans-Otto; Zipfel, Stephan; Giel, Katrin
2017-02-01
The Physical Appearance Comparison Scale (PACS [14]) is the most commonly used validated measure of body-related social comparison habits. Here we investigate reliability and construct validity of the PACS in a German sample. Participants (n=75 men, n=75 women and n=25 women with a confirmed diagnosis of anorexia nervosa) completed the PACS along with measures of eating disorder pathology, body image and self-esteem. Results show an adequate internal consistency of the PACS for the female subgroups and medium to high correlations with eating disorder pathology, body image and self-esteem. PACS total score differed significantly between groups, with men scoring lowest and women with anorexia nervosa scoring highest. We conclude that the PACS is a sufficiently reliable and valid measure of body-related social comparison habits in women. In men, it should only be used with special care. The PACS is generally suitable to promote patient studies testing the role of social comparisons for the patho-mechanisms of eating disorders. © Georg Thieme Verlag KG Stuttgart · New York.
Glaister, Mark; Stone, Michael H; Stewart, Andrew M; Hughes, Michael; Moir, Gavin L
2004-08-01
The purpose of the present study was to assess the reliability and validity of fatigue measures, as derived from 4 separate formulae, during tests of repeat sprint ability. On separate days over a 3-week period, 2 groups of 7 recreationally active men completed 6 trials of 1 of 2 maximal (20 x 5 seconds) intermittent cycling tests with contrasting recovery periods (10 or 30 seconds). All trials were conducted on a friction-braked cycle ergometer, and fatigue scores were derived from measures of mean power output for each sprint. Apart from formula 1, which calculated fatigue from the percentage difference in mean power output between the first and last sprint, all remaining formulae produced fatigue scores that showed a reasonably good level of test-retest reliability in both intermittent test protocols (intraclass correlation range: 0.78-0.86; 95% likely range of true values: 0.54-0.97). Although between-protocol differences in the magnitude of the fatigue scores suggested good construct validity, within-protocol differences highlighted limitations with each formula. Overall, the results support the use of the percentage decrement score as the most valid and reliable measure of fatigue during brief maximal intermittent work.
Bedewy, Dalia
2015-01-01
The development of a scale to measure perceived sources of academic stress among university students. Based on empirical evidence and recent literature review, we developed an 18-item scale to measure perceptions of academic stress and its sources. Experts (n = 12) participated in the content validation process of the instrument before it was administered to (n = 100) students. The developed instrument has internal consistency reliability of 0.7 (Cronbach’s alpha), there was evidence for content validity, and factor analysis resulted in four correlated and theoretically meaningful factors. We developed and tested a scale to measure academic stress and its sources. This scale takes 5 minutes to complete. PMID:28070363
Face validity, construct validity and training benefits of a virtual reality TURP simulator.
Bright, Elizabeth; Vine, Samuel; Wilson, Mark R; Masters, Rich S W; McGrath, John S
2012-01-01
To assess face validity, construct validity and the training benefits of a virtual reality TURP simulator. 11 novices (no TURP experience) and 7 experts (>200 TURP's) completed a virtual reality median lobe prostate resection task on the TURPsim™ (Simbionix USA Corp., Cleveland, OH). Performance indicators (percentage of prostate resected (PR), percentage of capsular resection (CR) and time diathermy loop active without tissue contact (TAWC) were recorded via the TURPsim™ and compared between novices and experts to assess construct validity. Verbal comments provided by experts following task completion were used to assess face validity. Repeated attempts of the task by the novices were analysed to assess the training benefits of the TURPsim™. Experts resected a significantly greater percentage of prostate per minute (p < 0.01) and had significantly less active diathermy time without tissue contact (p < 0.01) than novices. After practice, novices were able to perform the simulation more effectively, with significant improvement in all measured parameters. Improvement in performance was noted in novices following repetitive training, as evidenced by improved TAWC scores that were not significantly different from the expert group (p = 0.18). This study has established face and construct validity for the TURPsim™. The potential benefit in using this tool to train novices has also been demonstrated. Copyright © 2012 Surgical Associates Ltd. Published by Elsevier Ltd. All rights reserved.
Bottesi, Gioia; Ghisi, Marta; Altoè, Gianmarco; Conforti, Erica; Melli, Gabriele; Sica, Claudio
2015-07-01
The Depression Anxiety Stress Scales-21 (DASS-21) is the short version of a self-report measure that was originally developed to provide maximum differentiation between depressive and anxious symptoms. Despite encouraging evidence, the factor structure and other features of the DASS-21 are yet to be firmly established. A community sample of 417 participants and two clinical groups (32 depressive patients and 25 anxious patients) completed the Italian version of the DASS-21 along with several measures of psychopathology. Confirmatory factor analyses suggested that the DASS-21 is a measure of general distress plus three additional orthogonal dimensions (anxiety, depression, and stress). The internal consistency and temporal stability of the measure were good; each DASS-21 scale correlated more strongly with a measure of a similar construct, demonstrating good convergent and divergent validity. Lastly, the DASS-21 demonstrated good criterion-oriented validity. The validity of the Italian DASS-21 and its utility, both for community and clinical individuals, are supported. Copyright © 2015 Elsevier Inc. All rights reserved.
The Nature Contact Questionnaire: a measure of healthy workplace exposure.
Largo-Wight, Erin; Chen, W William; Dodd, Virginia; Weiler, Robert
2011-01-01
Understanding and promoting healthy workplaces is an important and growing area of interest in occupational health. Nature contact is a central component to the study of and promotion of healthy places. Previous findings suggest that nature contact influences health via stress appraisal process. Currently, there are no known comprehensive valid and reliable measures of nature contact, which presents obstacles to research and worksite health promotion. This study was designed to develop and test an instrument to measure nature contact at work, entitled the Nature Contact Questionnaire (NCQ), 16-item self-reported checklist to measure actual exposure. A sample of 503 (30% response rate) office staff completed the questionnaire. Office staff were sent an email with a link to the electronic survey twice, two weeks apart. Content and construct validity (KMO=0.68), internal consistency (Alpha=0.64), and test-retest reliability (r=0.85, p<0.01) were established. The NCQ is the first known comprehensive, reliable and valid survey to measure nature contact, which allows research to compare forms of nature contact to best inform practice and design of healthy places.
Sirota, Miroslav; Juanchich, Marie
2018-03-27
The Cognitive Reflection Test, measuring intuition inhibition and cognitive reflection, has become extremely popular because it reliably predicts reasoning performance, decision-making, and beliefs. Across studies, the response format of CRT items sometimes differs, based on the assumed construct equivalence of tests with open-ended versus multiple-choice items (the equivalence hypothesis). Evidence and theoretical reasons, however, suggest that the cognitive processes measured by these response formats and their associated performances might differ (the nonequivalence hypothesis). We tested the two hypotheses experimentally by assessing the performance in tests with different response formats and by comparing their predictive and construct validity. In a between-subjects experiment (n = 452), participants answered stem-equivalent CRT items in an open-ended, a two-option, or a four-option response format and then completed tasks on belief bias, denominator neglect, and paranormal beliefs (benchmark indicators of predictive validity), as well as on actively open-minded thinking and numeracy (benchmark indicators of construct validity). We found no significant differences between the three response formats in the numbers of correct responses, the numbers of intuitive responses (with the exception of the two-option version, which had a higher number than the other tests), and the correlational patterns of the indicators of predictive and construct validity. All three test versions were similarly reliable, but the multiple-choice formats were completed more quickly. We speculate that the specific nature of the CRT items helps build construct equivalence among the different response formats. We recommend using the validated multiple-choice version of the CRT presented here, particularly the four-option CRT, for practical and methodological reasons. Supplementary materials and data are available at https://osf.io/mzhyc/ .
The prone bridge test: Performance, validity, and reliability among older and younger adults.
Bohannon, Richard W; Steffl, Michal; Glenney, Susan S; Green, Michelle; Cashwell, Leah; Prajerova, Kveta; Bunn, Jennifer
2018-04-01
The prone bridge maneuver, or plank, has been viewed as a potential alternative to curl-ups for assessing trunk muscle performance. The purpose of this study was to assess prone bridge test performance, validity, and reliability among younger and older adults. Sixty younger (20-35 years old) and 60 older (60-79 years old) participants completed this study. Groups were evenly divided by sex. Participants completed surveys regarding physical activity and abdominal exercise participation. Height, weight, body mass index (BMI), and waist circumference were measured. On two occasions, 5-9 days apart, participants held a prone bridge until volitional exhaustion or until repeated technique failure. Validity was examined using data from the first session: convergent validity by calculating correlations between survey responses, anthropometrics, and prone bridge time, known groups validity by using an ANOVA comparing bridge times of younger and older adults and of men and women. Test-retest reliability was examined by using a paired t-test to compare prone bridge times for Session1 and Session 2. Furthermore, an intraclass correlation coefficient (ICC) was used to characterize relative reliability and minimal detectable change (MDC 95% ) was used to describe absolute reliability. The mean prone bridge time was 145.3 ± 71.5 s, and was positively correlated with physical activity participation (p ≤ 0.001) and negatively correlated with BMI and waist circumference (p ≤ 0.003). Younger participants had significantly longer plank times than older participants (p = 0.003). The ICC between testing sessions was 0.915. The prone bridge test is a valid and reliable measure for evaluating abdominal performance in both younger and older adults. Copyright © 2017 Elsevier Ltd. All rights reserved.
Cook, Karon F; Kallen, Michael A; Buckenmaier, Chester; Flynn, Diane M; Hanling, Steven R; Collins, Teresa S; Joltes, Kristin; Kwon, Kyung; Medina-Torne, Sheila; Nahavandi, Parisa; Suen, Joshua; Gershon, Richard
2017-07-01
In 2009, the Army Pain Management Task Force was chartered. On the basis of their findings, the Department of Defense recommended a comprehensive pain management strategy that included development of a standardized pain assessment system that would collect patient-reported outcomes data to inform the patient-provider clinical encounter. The result was the Pain Assessment Screening Tool and Outcomes Registry (PASTOR). The purpose of this study was to assess the validity and response burden of the patient-reported outcome measures in PASTOR. Data for analyses were collected from 681 individuals who completed PASTOR at baseline and follow-up as part of their routine clinical care. The survey tool included self-report measures of pain severity and pain interference (measured using the National Institutes of Health Patient-Reported Outcome Measurement Information System [PROMIS] and the Defense and Veterans Pain Rating scale). PROMIS measures of pain correlates also were administered. Validation analyses included estimation of score associations among measures, comparison of scores of known groups, responsiveness, ceiling and floor effects, and response burden. Results of psychometric testing provided substantial evidence for the validity of PASTOR self-report measures in this population. Expected associations among scores largely supported the concurrent validity of the measures. Scores effectively distinguished among respondents on the basis of their self-reported impressions of general health. PROMIS measures were administered using computer adaptive testing and each, on average, required less than 1 minute to administer. Statistical and graphical analyses demonstrated the responsiveness of PASTOR measures over time. Reprint & Copyright © 2017 Association of Military Surgeons of the U.S.
Soleimani, Mohammad Ali; Yaghoobzadeh, Ameneh; Bahrami, Nasim; Sharif, Saeed Pahlevan; Sharif Nia, Hamid
2016-10-01
In this study, 398 Iranian cancer patients completed the 15-item Templer's Death Anxiety Scale (TDAS). Tests of internal consistency, principal components analysis, and confirmatory factor analysis were conducted to assess the internal consistency and factorial validity of the Persian TDAS. The construct reliability statistic and average variance extracted were also calculated to measure construct reliability, convergent validity, and discriminant validity. Principal components analysis indicated a 3-component solution, which was generally supported in the confirmatory analysis. However, acceptable cutoffs for construct reliability, convergent validity, and discriminant validity were not fulfilled for the three subscales that were derived from the principal component analysis. This study demonstrated both the advantages and potential limitations of using the TDAS with Persian-speaking cancer patients.
Reliability and validity of a questionnaire for self-assessment of complete dentures.
Komagamine, Yuriko; Kanazawa, Manabu; Kaiba, Yoshinori; Sato, Yusuke; Minakuchi, Shunsuke
2014-05-02
Demand for complete denture treatment is expected to rise over several decades. However, to date, no questionnaire on complete dentures, as evaluated by edentulous patients, has been shown to be reliable and valid. This study sought to assess the reliability and validity of Patient's Denture Assessment (PDA), which provides a multidimensional evaluation of dentures among edentulous patients. Patients, who had new complete dentures fabricated at the University Hospital of Dentistry, Tokyo Medical and Dental University through 2009 to 2010, were enrolled. The reliability of the PDA was determined by examining internal consistency and test-retest reliability. Internal consistency for all of the question items and the six subscales was measured using Cronbach's α and average inter-item correlation coefficients among 93 participants. For 33 of these participants, test-retest reliability was determined at a 2 month-interval using the interclass correlation coefficients (ICCs) and 95% confidence interval for the summary scores and the six subscale scores. The PDA was validated in 93 participants by examining the difference in the summary score and the six subscale scores of the PDA before and after replacement with new dentures by the paired t-test. Ability to detect change was also tested in 93 patients using effect size. The Cronbach's α for the PDA ranged from 0.56 to 0.93. The average inter-item correlation coefficients ranged from 0.28 to 0.83. ICCs for the PDA ranged from 0.37 to 0.83. The paired t-test showed a significant difference between the summary score and the six subscale scores before and after replacement with new dentures (p < 0.05) and the effect size was 0.97. The PDA demonstrated good reliability by assessing internal consistency and test-retest reliability. In addition, the PDA demonstrated good validity by assessing discriminant validity. Thus, the PDA could help dentists obtain a detailed understanding of the patients' perceptions in using their dentures.
Paap, Kenneth R.; Sawi, Oliver
2014-01-01
A sample of 58 bilingual and 62 monolingual university students completed four tasks commonly used to test for bilingual advantages in executive functioning (EF): antisaccade, attentional network test, Simon, and color-shape switching. Across the four tasks, 13 different indices were derived that are assumed to reflect individual differences in inhibitory control, monitoring, or switching. The effects of bilingualism on the 13 measures were explored by directly comparing the means of the two language groups and through regression analyses using a continuous measure of bilingualism and multiple demographic characteristics as predictors. Across the 13 different measures and two types of data analysis there were very few significant results and those that did occur supported a monolingual advantage. An equally important goal was to assess the convergent validity through cross-task correlations of indices assume to measure the same component of executive functioning. Most of the correlations using difference-score measures were non-significant and many near zero. Although modestly higher levels of convergent validity are sometimes reported, a review of the existing literature suggests that bilingual advantages (or disadvantages) may reflect task-specific differences that are unlikely to generalize to important general differences in EF. Finally, as cautioned by Salthouse, assumed measures of executive functioning may also be threatened by a lack of discriminant validity that separates individual or group differences in EF from those in general fluid intelligence or simple processing speed. PMID:25249988
Wind reconstruction algorithm for Viking Lander 1
NASA Astrophysics Data System (ADS)
Kynkäänniemi, Tuomas; Kemppinen, Osku; Harri, Ari-Matti; Schmidt, Walter
2017-06-01
The wind measurement sensors of Viking Lander 1 (VL1) were only fully operational for the first 45 sols of the mission. We have developed an algorithm for reconstructing the wind measurement data after the wind measurement sensor failures. The algorithm for wind reconstruction enables the processing of wind data during the complete VL1 mission. The heater element of the quadrant sensor, which provided auxiliary measurement for wind direction, failed during the 45th sol of the VL1 mission. Additionally, one of the wind sensors of VL1 broke down during sol 378. Regardless of the failures, it was still possible to reconstruct the wind measurement data, because the failed components of the sensors did not prevent the determination of the wind direction and speed, as some of the components of the wind measurement setup remained intact for the complete mission. This article concentrates on presenting the wind reconstruction algorithm and methods for validating the operation of the algorithm. The algorithm enables the reconstruction of wind measurements for the complete VL1 mission. The amount of available sols is extended from 350 to 2245 sols.
Vézina-Im, Lydi-Anne; Godin, Gaston; Couillard, Charles; Perron, Julie; Lemieux, Simone; Robitaille, Julie
2016-09-15
Short instruments measuring frequency of specific foods, such as fruit and vegetable (FV), are increasingly used in interventions. The objective of the study was to verify the validity and test-retest reliability of such an instrument among pregnant women. Pregnant women from the region of Quebec City, Quebec, Canada, were recruited through e-mails sent to female students and employees of the local university from October 2014 to April 2015. To assess the validity of the fruit and vegetable questionnaire (FVQ) developed by Godin et al. (Can J Public Health 99: 494-498, 2008), pregnant women were asked in a first mailing to complete the FVQ assessing FV intake over the past 7 days and a 3-day estimated food record. A subsample (n = 33) also gave a fasting blood sample and completed a validated semi-quantitative FFQ administered by a trained registered dietitian during a visit at the research center. FV intakes for all instruments were calculated in terms of servings of FV based on Canada's Food Guide definition of a serving of fruit or vegetable. In order to assess its test-retest reliability, respondents were asked to complete the FVQ 14 days later in a second mailing. Forty-eight pregnant women from all three trimesters completed the questionnaires in the first mailing. FV intake assessed using the FVQ was correlated to FV consumption measured using the food record (r = 0.34, p = 0.0180) and the FFQ (r = 0.61, p = 0.0002). Results were similar when controlling for energy intake and the experience of nausea in the past month. Only β-cryptoxanthin was significantly correlated to FV intake assessed by the FFQ when adjusted for the presence of nausea (r = 0.35, p = 0.0471). Data on the test-retest reliability was available for 44 women and the intra-class coefficient for the FVQ was 0.72 at a mean 28-day interval. The FVQ has acceptable validity and test-retest reliability values, but seems to underestimate FV servings in pregnant women. It represents an interesting alternative for researchers or clinicians interested in estimating quickly FV intake among pregnant women, such as in large trials or during prenatal visits. The FVQ should however be coupled with other self-reported measures, such as a food record, for assessing precise individual FV intake.
Lin, Steve; Turgulov, Anuar; Taher, Ahmed; Buick, Jason E; Byers, Adam; Drennan, Ian R; Hu, Samantha; J Morrison, Laurie
2016-10-01
Cardiopulmonary resuscitation (CPR) process measures research and quality assurance has traditionally been limited to the first 5 minutes of resuscitation due to significant costs in time, resources, and personnel from manual data abstraction. CPR performance may change over time during prolonged resuscitations, which represents a significant knowledge gap. Moreover, currently available commercial software output of CPR process measures are difficult to analyze. The objective was to develop and validate a software program to help automate the abstraction and transfer of CPR process measures data from electronic defibrillators for complete episodes of cardiac arrest resuscitation. We developed a software program to facilitate and help automate CPR data abstraction and transfer from electronic defibrillators for entire resuscitation episodes. Using an intermediary Extensible Markup Language export file, the automated software transfers CPR process measures data (electrocardiogram [ECG] number, CPR start time, number of ventilations, number of chest compressions, compression rate per minute, compression depth per minute, compression fraction, and end-tidal CO 2 per minute). We performed an internal validation of the software program on 50 randomly selected cardiac arrest cases with resuscitation durations between 15 and 60 minutes. CPR process measures were manually abstracted and transferred independently by two trained data abstractors and by the automated software program, followed by manual interpretation of raw ECG tracings, treatment interventions, and patient events. Error rates and the time needed for data abstraction, transfer, and interpretation were measured for both manual and automated methods, compared to an additional independent reviewer. A total of 9,826 data points were each abstracted by the two abstractors and by the software program. Manual data abstraction resulted in a total of six errors (0.06%) compared to zero errors by the software program. The mean ± SD time measured per case for manual data abstraction was 20.3 ± 2.7 minutes compared to 5.3 ± 1.4 minutes using the software program (p = 0.003). We developed and validated an automated software program that efficiently abstracts and transfers CPR process measures data from electronic defibrillators for complete cardiac arrest episodes. This software will enable future cardiac arrest studies and quality assurance programs to evaluate the impact of CPR process measures during prolonged resuscitations. © 2016 by the Society for Academic Emergency Medicine.
Centeredness Theory: Understanding and Measuring Well-Being Across Core Life Domains
Bloch-Jorgensen, Zephyr T.; Cilione, Patrick J.; Yeung, William W. H.; Gatt, Justine M.
2018-01-01
Background: Centeredness Theory (CT) is proposed as a new mental health paradigm that focuses on well-being at a systems-level, across the core life domains of the self, the family unit, relationships, community, and work. The current studies aimed to validate the psychometric properties of a new scale that measures CT against existing well-being and mental health measures. Methods: Study 1 included 488 anonymous online respondents (46% females, 28% males, 25% unknown with median age between 31 and 35 years) across 38 countries who completed the CT scale. Study 2 included 49 first-year psychology students (90% females, mean age of 19 years) from Sydney Australia that completed the CT scale and other well-being and mental health questionnaires at baseline and 2-weeks follow-up. Results: Exploratory and confirmatory factor analyses resulted in a refined 60-item CT scale with five domains, each with four sub-domains. The CT scale demonstrated good internal consistency reliability and test-retest reliability, and showed evidence of convergent validity against other well-being measures (e.g., COMPAS-W Wellbeing Scale, SWLS scale, and Ryff's Psychological Well-being scale). Conclusions: The CT scale appears to be a reliable measure of well-being at a systems-level. Future studies need to confirm these findings in larger heterogeneous samples. PMID:29765344
Assessing Medical Students’ Self-regulation as Aptitude in Computer-based Learning
Song, Hyuksoon S.; Kalet, Adina L.; Plass, Jan L.
2013-01-01
We developed a Self-Regulation Measure for Computer-based learning (SRMC) tailored toward medical students, by modifying Zimmerman’s Self-Regulated Learning Interview Schedule (SRLIS) for K-12 learners. The SRMC’s reliability and validity were examined in 2 studies. In Study 1, 109 first-year medical students were asked to complete the SRMC. Bivariate correlation analysis results indicated that the SRMC scores had a moderate degree of correlation with student achievement in a teacher-developed test. In Study 2, 58 third-year clerkship students completed the SRMC. Regression analysis results indicated that the frequency of medical students’ usage of self-regulation strategies was associated with their general clinical knowledge measured by a nationally standardized licensing exam. These two studies provided evidence for the reliability and concurrent validity of the SRMC to assess medical students’ self-regulation as aptitude. Future work should provide evidence to guide and improve instructional design as well as inform educational policy. PMID:20872071
Validation of a Measure of Normative Beliefs About Smokeless Tobacco Use.
Adkison, Sarah E; O'Connor, Richard J; Bansal-Travers, Maansi; Cummings, K Michael; Rees, Vaughan W; Hatsukami, Dorothy K
2016-05-01
Validated methods to evaluate consumer responses to modified risk tobacco products (MRTPs) are needed. Guided by existing literature that demonstrates a relationship between normative beliefs and future intentions to use tobacco the current research sought to (1) develop a measure of normative beliefs about smokeless tobacco (ST) and establish the underlying factor structure, (2) evaluate the structure with confirmatory factor analysis utilizing an independent sample of youth, and (3) establish the measure's concurrent validity. Respondents (smokers and nonsmokers aged 15-65; N = 2991) completed a web-based survey that included demographic characteristics, tobacco use history and dependence, and a measure of attitudes about ST adapted from the Normative Beliefs about Smoking scale. A second sample of youth (aged 14-17; N = 305) completed a similar questionnaire. Exploratory factor analysis produced the anticipated three-factor solution and accounted for nearly three-quarters of the variance in the data reflecting (1) perceived prevalence of ST use, (2) popularity of ST among successful/elite, and (3) approval of ST use by parents/peers. Confirmatory factor analysis with data from the youth sample demonstrated good model fit. Logistic regression demonstrated that the scales effectively discriminate between ST users and nonusers and are associated with interest in trying snus. Assessment of MRTPs for regulatory purposes, which allows messages of reduced risk, should include measurement of social norms. Furthermore, surveillance efforts that track use of new MRTPs should include measures of social norms to determine how norms change with prevalence of use. © The Author 2015. Published by Oxford University Press on behalf of the Society for Research on Nicotine and Tobacco. All rights reserved. For permissions, please e-mail: journals.permissions@oup.com.
Systematic behavioural observation of executive performance after brain injury.
Lewis, Mark W; Babbage, Duncan R; Leathem, Janet M
2017-01-01
To develop an ecologically valid measure of executive functioning (i.e. Planning and Organization, Executive Memory, Initiation, Cognitive Shifting, Impulsivity, Sustained and Directed Attention, Error Detection, Error Correction and Time Management) during a functional chocolate brownie cooking task. In Study 1, the inter-rater reliability of a novel behavioural observation assessment method was assessed with 10 people with traumatic brain injury (TBI). In Study 2, 27 people with TBI and 16 healthy controls completed the functional task along with other measures of executive functioning to assess validity. Intraclass correlation coefficients for six of the nine aspects of executive functioning ranged from .54 to 1.00. Percentage agreements for the remaining aspects ranged from 70% to 90%. Significant and non-significant, moderate, correlations were found between the functional cooking task and standard neuropsychological measures. The healthy control group performed better than the TBI group in six areas (d = 0.56 to 1.23). In this initial trial of a novel assessment method, adequate inter-rater reliability was found. The measure was associated with standard neuropsychological measures, and our healthy control group performed better than the TBI group. The measure appears to be an ecologically valid measure of executive functioning.
Lucas, Todd; Michalopoulou, Georgia; Falzarano, Pamela; Menon, Shanti; Cunningham, Windy
2008-03-01
Health researchers have proposed that provider cultural competency may contribute to health disparities. Yet, this belief continues to lack empirical support, and this is due in part to measurement issues that have plagued the cultural competency construct. In the present research, we report on the development of a theoretically grounded, generally applicable, and patient report measure of provider cultural competency. Samples of predominantly African American patients (N=310) were recruited from three urban medical clinics to complete a survey about their relationship with their physician. We examined the factor structure, validity and other psychometric characteristics of a newly proposed patient report measure of provider cultural competency. Psychometric analyses supported a tripartite model of cultural competency that was comprised of patient judgments of their physician's cultural knowledge, awareness, and skill. In addition, this result was replicated across multiple clinical contexts, while also demonstrating convergent and incremental validity when correlated with measures of trust, satisfaction and discrimination. This newly proposed measure addresses prior limitations in cultural competency measurement and may enhance future research by providing a standardized tool for use in multiple clinical and cultural contexts. Copyright (c) 2008 APA, all rights reserved.
The City MISS: development of a scale to measure stigma of perinatal mental illness.
Moore, Donna; Ayers, Susan; Drey, Nicholas
2017-07-01
This study aimed to develop and validate a scale to measure perceived stigma for perinatal mental illness in women. Stigma is one of the most frequently cited barriers to seeking treatment and many women with perinatal mental illness fail to get the treatment they need. However, there is no psychometric scale that measures how women may experience the unique aspects of perinatal mental illness stigma. A draft scale of 30 items was developed from a literature review. Women with perinatal mental illness (n = 279) were recruited to complete the City Mental Illness Stigma Scale. Concurrent validity was measured using the Internalised Stigma of Mental Illness Scale. Factor analysis was used to create the final scale. The final 15-item City Mental Illness Stigma Scale has a three-factor structure: perceived external stigma, internal stigma and disclosure stigma. The scale accounted for 54% of the variance and had good internal reliability and concurrent validity. The City Mental Illness Stigma Scale appears to be a valid measure which provides a potentially useful tool for clinical practice and research in stigma and perinatal mental illness, including assessing the prevalence and characteristics of stigma. This research can be used to inform interventions to reduce or address the stigma experienced by some women with perinatal mental illness.
Organizational capacity for change in health care: Development and validation of a scale.
Spaulding, Aaron; Kash, Bita A; Johnson, Christopher E; Gamm, Larry
We do not have a strong understanding of a health care organization's capacity for attempting and completing multiple and sometimes competing change initiatives. Capacity for change implementation is a critical success factor as the health care industry is faced with ongoing demands for change and transformation because of technological advances, market forces, and regulatory environment. The aim of this study was to develop and validate a tool to measure health care organizations' capacity to change by building upon previous conceptualizations of absorptive capacity and organizational readiness for change. A multistep process was used to develop the organizational capacity for change survey. The survey was sent to two populations requesting answers to questions about the organization's leadership, culture, and technologies in use throughout the organization. Exploratory and confirmatory factor analyses were conducted to validate the survey as a measurement tool for organizational capacity for change in the health care setting. The resulting organizational capacity for change measurement tool proves to be a valid and reliable method of evaluating a hospital's capacity for change through the measurement of the population's perceptions related to leadership, culture, and organizational technologies. The organizational capacity for change measurement tool can help health care managers and leaders evaluate the capacity of employees, departments, and teams for change before large-scale implementation.
Mohamed, Rachid; Raman, Maitreyi; Anderson, John; McLaughlin, Kevin; Rostom, Alaa; Coderre, Sylvain
2014-03-01
Although workplace workload assessments exist in different fields, an endoscopy-specific workload assessment tool is lacking. To validate such a workload tool and use it to map the progression of novice trainees in gastroenterology in performing their first endoscopies. The National Aeronautics and Space Administration Task Load Index (NASA-TLX) workload assessment tool was completed by eight novice trainees in gastroenterology and 10 practicing gastroenterologists⁄surgeons. An exploratory factor analysis was performed to construct a streamlined endoscopy-specific task load index, which was subsequently validated. The 'Endoscopy Task Load Index' was used to monitor progression of trainee exertion and self-assessed performance over their first 40 procedures. From the factor analysis of the NASA-TLX, two principal components emerged: a measure of exertion and a measure of self-efficacy. These items became the components of the newly validated Endoscopy Task Load Index. There was a steady decline in self-perceived exertion over the training period, which was more rapid for gastroscopy than colonoscopy. The self-efficacy scores for gastroscopy rapidly increased over the first few procedures, reaching a plateau after this period of time. For colonoscopy, there was a progressive increase in reported self-efficacy over the first three quartiles of procedures, followed by a drop in self-efficacy scores over the final quartile. The present study validated an Endoscopy Task Load Index that can be completed in <1 min. Practical implications of such a tool in endoscopy education include identifying periods of higher perceived exertion among novice endoscopists, facilitating appropriate levels of guidance from trainers.
Psychometric properties of the Brunel Mood Scale in Chinese adolescents and adults.
Zhang, Chun-Qing; Si, Gangyan; Chung, Pak-Kwong; Du, Mengmeng; Terry, Peter C
2014-01-01
Building on the work of Terry and colleagues (Terry, P. C., Lane, A. M., Lane, H. J., & Keohane, L. (1999). Development and validation of a mood measure for adolescents. Journal of Sports Sciences, 17, 861-872; Terry, P. C., Lane, A. M., & Fogarty, G. J. (2003). Construct validity of the Profile of Mood States-Adolescents for use with adults. Psychology of Sport & Exercise, 4, 125-139.), the present study examined the validity and internal consistency reliability of the Chinese version of the Brunel Mood Scale (BRUMS-C) among 2,548 participants, comprising adolescent athletes (n = 520), adult athletes (n = 434), adolescent students (n = 673), and adult students (n = 921). Both adolescent and adult athletes completed the BRUMS-C before, during, or after regular training and both adolescent and adult students completed the BRUMS-C in a classroom setting. Confirmatory factor analyses (CFAs) provided support for the factorial validity of a 23-item six-factor model, with one item removed from the hypothesised measurement model. Internal consistency reliabilities were satisfactory for all subscales across each of the four samples. Criterion validity was supported with strong relationships between the BRUMS-C, abbreviated POMS, and Chinese Affect Scale consistent with theoretical predictions. Multi-sample CFAs showed the BRUMS-C to be invariant at the configural, metric, strong, and structural levels for all samples. Furthermore, latent mean difference analyses showed that athletes reported significantly higher levels of fatigue than students while maintaining almost the same levels of vigour, and adolescent students reported significantly higher levels of depressed mood than the other three samples.
2013-01-01
Purpose We introduce the Pemberton Happiness Index (PHI), a new integrative measure of well-being in seven languages, detailing the validation process and presenting psychometric data. The scale includes eleven items related to different domains of remembered well-being (general, hedonic, eudaimonic, and social well-being) and ten items related to experienced well-being (i.e., positive and negative emotional events that possibly happened the day before); the sum of these items produces a combined well-being index. Methods A distinctive characteristic of this study is that to construct the scale, an initial pool of items, covering the remembered and experienced well-being domains, were subjected to a complete selection and validation process. These items were based on widely used scales (e.g., PANAS, Satisfaction With Life Scale, Subjective Happiness Scale, and Psychological Well-Being Scales). Both the initial items and reference scales were translated into seven languages and completed via Internet by participants (N = 4,052) aged 16 to 60 years from nine countries (Germany, India, Japan, Mexico, Russia, Spain, Sweden, Turkey, and USA). Results Results from this initial validation study provided very good support for the psychometric properties of the PHI (i.e., internal consistency, a single-factor structure, and convergent and incremental validity). Conclusions Given the PHI’s good psychometric properties, this simple and integrative index could be used as an instrument to monitor changes in well-being. We discuss the utility of this integrative index to explore well-being in individuals and communities. PMID:23607679
Rosneck, James S; Hughes, Joel; Gunstad, John; Josephson, Richard; Noe, Donald A; Waechter, Donna
2014-01-01
This article describes the systematic construction and psychometric analysis of a knowledge assessment instrument for phase II cardiac rehabilitation (CR) patients measuring risk modification disease management knowledge and behavioral outcomes derived from national standards relevant to secondary prevention and management of cardiovascular disease. First, using adult curriculum based on disease-specific learning outcomes and competencies, a systematic test item development process was completed by clinical staff. Second, a panel of educational and clinical experts used an iterative process to identify test content domain and arrive at consensus in selecting items meeting criteria. Third, the resulting 31-question instrument, the Cardiac Knowledge Assessment Tool (CKAT), was piloted in CR patients to ensure use of application. Validity and reliability analyses were performed on 3638 adults before test administrations with additional focused analyses on 1999 individuals completing both pretreatment and posttreatment administrations within 6 months. Evidence of CKAT content validity was substantiated, with 85% agreement among content experts. Evidence of construct validity was demonstrated via factor analysis identifying key underlying factors. Estimates of internal consistency, for example, Cronbach's α = .852 and Spearman-Brown split-half reliability = 0.817 on pretesting, support test reliability. Item analysis, using point biserial correlation, measured relationships between performance on single items and total score (P < .01). Analyses using item difficulty and item discrimination indices further verified item stability and validity of the CKAT. A knowledge instrument specifically designed for an adult CR population was systematically developed and tested in a large representative patient population, satisfying psychometric parameters, including validity and reliability.
DOE Office of Scientific and Technical Information (OSTI.GOV)
Blanchat, Thomas K.; Jernigan, Dann A.
A set of experiments and test data are outlined in this report that provides radiation intensity data for the validation of models for the radiative transfer equation. The experiments were performed with lightly-sooting liquid hydrocarbon fuels that yielded fully turbulent fires 2 m diameter). In addition, supplemental measurements of air flow and temperature, fuel temperature and burn rate, and flame surface emissive power, wall heat, and flame height and width provide a complete set of boundary condition data needed for validation of models used in fire simulations.
Development and validation of the Perceived Game-Specific Soccer Competence Scale.
Forsman, Hannele; Gråstén, Arto; Blomqvist, Minna; Davids, Keith; Liukkonen, Jarmo; Konttinen, Niilo
2016-07-01
The objective of this study was to create a valid, self-reported, game-specific soccer competence scale. A structural model of perceived competence, performance measures and motivation was tested as the basis for the scale. A total of 1321 soccer players (261 females, 1060 males) ranging from 12 to 15 years (13.4 ± 1.0 years) participated in the study. They completed the Perceived Game-Specific Soccer Competence Scale (PGSSCS), self-assessments of tactical skills and motivation, as well as technical and speed and agility tests. Results of factor analyses, tests of internal consistency and correlations between PGSSCS subscales, performance measures and motivation supported the reliability and validity of the PGSSCS. The scale can be considered a suitable instrument to assess perceived game-specific competence among young soccer players.
Zhu, Ping; Jafari, Rana; Jones, Travis; Trebino, Rick
2017-10-02
We introduce a simple delay-scanned complete spatiotemporal intensity-and-phase measurement technique based on wavelength-multiplexed holography to characterize long, complex pulses in space and time. We demonstrate it using pulses emerging from multi-mode fiber. This technique extends the temporal range and spectral resolution of the single-frame STRIPED FISH technique without using an otherwise-required expensive ultranarrow-bandpass filter. With this technique, we measured the complete intensity and phase of up to ten fiber modes from a multi-mode fiber (normalized frequency V ≈10) over a ~3ps time range. Spatiotemporal complexities such as intermodal delay, modal dispersion, and material dispersion were also intuitively displayed by the retrieved results. Agreement between the reconstructed color movies and the monitored time-averaged spatial profiles confirms the validity to this delay-scanned STRIPED FISH method.
Bell, Nicole S.; Williams, Jeffrey O.; Senier, Laura; Strowman, Shelley R.; Amoroso, Paul J.
2007-01-01
Background The reliability and validity of self-reported drinking behaviors from the Army Health Risk Appraisal (HRA) survey are unknown. Methods We compared demographics and health experiences of those who completed the HRA with those who did not (1991–1998). We also evaluated the reliability and validity of eight HRA alcohol-related items, including the CAGE, weekly drinking quantity, and drinking and driving measures. We used Cohen’s κ and Pearson’s r to assess reliability and convergent validity. To assess criterion (predictive) validity, we used proportional hazards and logistical regression models predicting alcohol-related hospitalizations and alcohol-related separations from the Army, respectively. Results A total of 404,966 soldiers completed an HRA. No particular demographic group seems to be over- or underrepresented. Although few respondents skipped alcohol items, those who did tended to be older and of minority race. The alcohol items demonstrate a reasonable degree of reliability, with Cronbach’s α = 0.69 and test-retest reliability associations in the 0.75–0.80 range for most items over 2- to 30-day interims between surveys. The alcohol measures showed good criterion-related validity: those consuming more than 21 drinks per week were at 6 times the risk for subsequent alcohol-related hospitalization versus those who abstained from drinking (hazard ratio, 6.36; 95% confidence interval=5.79, 6.99). Those who said their friends worried about their drinking were almost 5 times more likely to be discharged due to alcoholism (risk ratio, 4.9; 95% confidence interval=4.00, 6.04) and 6 times more likely to experience an alcohol-related hospitalization (hazard ratio, 6.24; 95% confidence interval=5.74, 6.77). Conclusions The Army’s HRA alcohol items seem to elicit reliable and valid responses. Because HRAs contain identifiers, alcohol use can be linked with subsequent health and occupational outcomes, making the HRA a useful epidemiological research tool. Associations between perceived peer opinions of drinking and subsequent problems deserve further exploration. PMID:12766628
Development of a Research Participants’ Perception Survey to Improve Clinical Research
Yessis, Jennifer L.; Kost, Rhonda G.; Lee, Laura M.; Coller, Barry S.; Henderson, David K.
2012-01-01
Abstract Introduction: Clinical research participants’ perceptions regarding their experiences during research protocols provide outcome‐based insights into the effectiveness of efforts to protect rights and safety, and opportunities to enhance participants’ clinical research experiences. Use of validated surveys measuring patient‐centered outcomes is standard in hospitals, yet no instruments exist to assess outcomes of clinical research processes. Methods: We derived survey questions from data obtained from focus groups comprised of research participants and professionals. We assessed the survey for face/content validity, and privacy/confidentiality protections and fielded it to research participants at 15 centers. We conducted analyses of response rates, sample characteristics, and psychometrics, including survey and item completion and analysis, internal consistency, item internal consistency, criterion‐related validity, and item usefulness. Responses were tested for fit into existing patient‐centered dimensions of care and new clinical research dimensions using Cronbach's alpha coefficient. Results: Surveys were mailed to 18,890 individuals; 4,961 were returned (29%). Survey completion was 89% overall; completion rates exceeded 90% for 88 of 93 evaluable items. Questions fit into three dimensions of patient‐centered care and two novel clinical research dimensions (Cronbach's alpha for dimensions: 0.69–0.85). Conclusions: The validated survey offers a new method for assessing and improving outcomes of clinical research processes. Clin Trans Sci 2012; Volume 5: 452–460 PMID:23253666
Takahashi, Natsuko; Suzukamo, Yoshimi; Nakamura, Motonobu; Miyachi, Yoshiki; Green, Joseph; Ohya, Yukihiro; Finlay, Andrew Y; Fukuhara, Shunichi
2006-08-03
Patient-reported quality of life is strongly affected by some dermatologic conditions. We developed a Japanese version of the Dermatology Life Quality Index (DLQI-J) and used psychometric methods to examine its validity and reliability. The Japanese version of the DLQI was created from the original (English) version, using a standard method. The DLQI-J was then completed by 197 people, to examine its validity and reliability. Some participants completed the DLQI-J a second time, 3 days later, to examine the reproducibility of their responses. In addition to the DLQI-J, the participants completed parts of the SF-36 and gave data on their demographic and clinical characteristics. Their physicians provided information on the location and clinical severity of the skin disease. The participants reported no difficulties in answering the DLQI-J items. Their mean age was 24.8 years, 77.2% were female, and 78.7% had acne vulgaris. The mean score of DLQI was 3.99(SD: 3.99). The responses were found to be reproducible and stable. Results of principal-component and factor analysis suggested that this scale measured one construct. The correlations of DLQI-J scores with sex or age were very poor, but those with SF-36 scores and with clinical severity were high. The DLQI-J provides valid and reliable data despite having only a small number of items.
Web-based education in systems-based practice: a randomized trial.
Kerfoot, B Price; Conlin, Paul R; Travison, Thomas; McMahon, Graham T
2007-02-26
All accredited US residency programs are expected to offer curricula and evaluate their residents in 6 general competencies. Medical schools are now adopting similar competency frameworks. We investigated whether a Web-based program could effectively teach and assess elements of systems-based practice. We enrolled 276 medical students and 417 residents in the fields of surgery, medicine, obstetrics-gynecology, and emergency medicine in a 9-week randomized, controlled, crossover educational trial. Participants were asked to sequentially complete validated Web-based modules on patient safety and the US health care system. The primary outcome measure was performance on a 26-item validated online test administered before, between, and after the participants completed the modules. Six hundred forty (92.4%) of the 693 enrollees participated in the study; 512 (80.0%) of the participants completed all 3 tests. Participants' test scores improved significantly after completion of the first module (P<.001). Overall learning from the 9-week Web-based program, as measured by the increase in scores (posttest scores minus pretest scores), was 16 percentage points (95% confidence interval, 14-17 percentage points; P<.001) in public safety topics and 22 percentage points (95% confidence interval, 20-23 percentage points; P<.001) in US health care system topics. A Web-based educational program on systems-based practice competencies generated significant and durable learning across a broad range of medical students and residents.
Zimmerman, Mark; Chelminski, Iwona; Young, Diane; Dalrymple, Kristy; Walsh, Emily; Rosenstein, Lia
2014-06-01
To acknowledge the clinical significance of anxiety in depressed patients, DSM-5 included criteria for an anxious distress specifier for major depressive disorder. In the present report from the Rhode Island Methods to Improve Diagnostic Assessment and Services (MIDAS) project, we modified our previously published depression scale to include a subscale assessing the DSM-5 anxious distress specifier. From December 1995 to August 2013, 773 psychiatric outpatients with major depressive disorder completed the Clinically Useful Depression Outcome Scale (CUDOS) supplemented with questions for the DSM-5 anxious distress specifier (CUDOS-A). To examine discriminant and convergent validity, the patients were rated on clinician severity indices of depression, anxiety, and irritability. Discriminant and convergent validity was further examined in a subset of patients who completed other self-report symptom severity scales. Test-retest reliability was examined in a subset who completed the CUDOS-A twice. We compared patients who did and did not meet the DSM-5 anxious distress specifier on indices of psychosocial functioning and quality of life. The CUDOS-A subscale had high internal consistency and test-retest reliability; was more highly correlated with other self-report measures of anxiety than with measures of depression, substance use problems, eating disorders, and anger; and was more highly correlated with clinician severity ratings of anxiety than depression and irritability. CUDOS-A scores were significantly higher in depressed outpatients with a current anxiety disorder than in depressed patients without a comorbid anxiety disorder (P < .001). Finally, patients who met the DSM-5 anxious distress specifier reported poorer psychosocial functioning and quality of life than patients who did not meet the anxious distress specifier. In the present study of a large sample of psychiatric outpatients, the CUDOS-A was a reliable and valid measure of the DSM-5 anxious distress specifier for major depressive disorder. © Copyright 2014 Physicians Postgraduate Press, Inc.
Meltzer, Lisa J.; Brimeyer, Chasity; Russell, Kathryn; Avis, Kristin T.; Biggs, Sarah; Reynolds, Amy C.; Crabtree, Valerie McLaughlin
2014-01-01
Objective Sleep is critical for adolescent health and well-being. However, there are a limited number of validated self-report measures of sleep for adolescents, and no well-validated measures of sleep that can be used across middle childhood and adolescence. The Children's Report of Sleep Patterns (CRSP) has already been validated in children ages 8-12 years. The purpose of this study was to examine the psychometric properties of the CRSP as a multidimensional, self-report sleep measure for adolescents. Methods Participants included 570 adolescents aged 13 – 18 years, 60% female, recruited from pediatricians’ offices, sleep clinics, children's hospitals, schools, and the general population. A multi-method, multi-reporter approach was used to validate the CRSP. Along with the CRSP, a subset of the sample completed the Adolescent Sleep Hygiene Scale (ASHS), with a different subset of adolescents undergoing polysomnography. Results The CRSP demonstrated good reliability and validity. Group differences on the CRSP were found for adolescents presenting to a sleep or medical clinic (vs. community sample), for older adolescents (vs. younger adolescents), those who regularly napped (vs. infrequently napped), and those with poor sleep quality (vs. good sleep quality). Self-reported sleep quality in adolescents was also associated with higher apnea-hypopnea index scores from polysomnography. Finally, the CRSP Sleep Hygiene Indices were significantly correlated with indices of the ASHS. Conclusions The CRSP is a valid and reliable measure of adolescent sleep hygiene and sleep disturbances. With a parallel version for middle childhood (8-12 years), the CRSP likely provides clinicians and researchers the ability to measure self-reported sleep across development. PMID:25441749
Psychometric Evaluation of the PSQI in U.S. College Students
Dietch, Jessica R.; Taylor, Daniel J.; Sethi, Kevin; Kelly, Kimberly; Bramoweth, Adam D.; Roane, Brandy M.
2016-01-01
Study Objectives: Examine the psychometric properties of the PSQI in two U.S. college samples. Methods: Study I assessed convergent and divergent validity in 866 undergraduates who completed a sleep diary, PSQI, and other sleep and psychosocial measures. Study II assessed PSQI insomnia diagnostic accuracy in a separate sample of 147 healthy undergraduates with and without insomnia. Results: The PSQI global score had only moderate convergent validity with sleep diary sleep efficiency (prospective global measure of sleep continuity; r = 0.53), the Insomnia Severity Index (r = 0.63), and fatigue (r = 0.44). The PSQI global score demonstrated good divergent validity with measures of excessive daytime sleepiness (r = 0.18), circadian preference (r = −0.08), alcohol (r = 0.08) and marijuana (r = 0.05) abuse scales, and poor divergent validity with depression (r = 0.48), anxiety (r = 0.40), and perceived stress (r = 0.33). Examination of other analogous PSQI and sleep diary components showed low to moderate convergent validity: sleep latency (r = 0.70), wake after sleep onset (r = 0.37), sleep duration (r = 0.51), and sleep efficiency (r = −0.32). Diagnostic accuracy of the PSQI to detect insomnia was very high (area under the curve = 0.999). Sensitivity and specificity were maximized at a cutoff of 6. Conclusions: The PSQI demonstrated moderate convergent validity compared to measures of insomnia and fatigue and good divergent validity with measures of daytime sleepiness, circadian phase preference, and alcohol and marijuana use. The PSQI demonstrated considerable overlap with depression, anxiety, and perceived stress. Therefore, caution should be used with interpretation. Citation: Dietch JR, Taylor DJ, Sethi K, Kelly K, Bramoweth AD, Roane BM. Psychometric evaluation of the PSQI in U.S. college students. J Clin Sleep Med 2016;12(8):1121–1129. PMID:27166299
O'Neil, Margaret E; Fragala-Pinkham, Maria; Lennon, Nancy; George, Ameeka; Forman, Jeffrey; Trost, Stewart G
2016-01-01
Physical therapy for youth with cerebral palsy (CP) who are ambulatory includes interventions to increase functional mobility and participation in physical activity (PA). Thus, reliable and valid measures are needed to document PA in youth with CP. The purpose of this study was to evaluate the inter-instrument reliability and concurrent validity of 3 accelerometer-based motion sensors with indirect calorimetry as the criterion for measuring PA intensity in youth with CP. Fifty-seven youth with CP (mean age=12.5 years, SD=3.3; 51% female; 49.1% with spastic hemiplegia) participated. Inclusion criteria were: aged 6 to 20 years, ambulatory, Gross Motor Function Classification System (GMFCS) levels I through III, able to follow directions, and able to complete the full PA protocol. Protocol activities included standardized activity trials with increasing PA intensity (resting, writing, household chores, active video games, and walking at 3 self-selected speeds), as measured by weight-relative oxygen uptake (in mL/kg/min). During each trial, participants wore bilateral accelerometers on the upper arms, waist/hip, and ankle and a portable indirect calorimeter. Intraclass coefficient correlations (ICCs) were calculated to evaluate inter-instrument reliability (left-to-right accelerometer placement). Spearman correlations were used to examine concurrent validity between accelerometer output (activity and step counts) and indirect calorimetry. Friedman analyses of variance with post hoc pair-wise analyses were conducted to examine the validity of accelerometers to discriminate PA intensity across activity trials. All accelerometers exhibited excellent inter-instrument reliability (ICC=.94-.99) and good concurrent validity (rho=.70-.85). All accelerometers discriminated PA intensity across most activity trials. This PA protocol consisted of controlled activity trials. Accelerometers provide valid and reliable measures of PA intensity among youth with CP. © 2016 American Physical Therapy Association.
NASA Astrophysics Data System (ADS)
Campbell, J. L.; Burrows, S.; Gower, S. T.; Cohen, W. B.
1999-09-01
The BigFoot Project is funded by the Earth Science Enterprise to collect and organize data to be used in the EOS Validation Program. The data collected by the BigFoot Project are unique in being ground-based observations coincident with satellite overpasses. In addition to collecting data, the BigFoot project will develop and test new algorithms for scaling point measurements to the same spatial scales as the EOS satellite products. This BigFoot Field Manual Mill be used to achieve completeness and consistency of data collected at four initial BigFoot sites and at future sites that may collect similar validation data. Therefore, validation datasets submitted to the ORNL DAAC that have been compiled in a manner consistent with the field manual will be especially valuable in the validation program.
ERIC Educational Resources Information Center
Bijlenga, Denise; van der Heijden, Kristiaan B.; Breuk, Minda; van Someren, Eus J. W.; Lie, Maria E. H.; Boonstra, A. Marije; Swaab, Hanna J. T.; Kooij, J. J. Sandra
2013-01-01
Objective: The authors explored associations between ADHD symptoms, seasonal depressive symptoms, lifestyle, and health. Method: Adult ADHD patients ("n" = 202) and controls ("n" = 189) completed the ASESA questionnaire involving lifestyle, eating pattern, and physical and psychological health, and validated measures on ADHD…
Psychometric properties of ADHD rating scales among children with mental retardation.
Miller, Michael L; Fee, Virginia E; Jones, Christie J
2004-01-01
The validity of hyperactivity rating scales in children with mental retardation was evaluated. Forty-eight children with mental retardation were rated by parents, teachers and teaching assistants on rating scales measuring Attention Deficit/Hyperactivity Disorder (ADHD) as part of a related investigation. In addition, direct observations were conducted using the Abikoff Classroom Observation Code. The concurrent validity of each scale was examined. Scales completed by both teachers and teaching assistants were found to provide valid information for the assessment of ADHD in mentally retarded children. Results provided the best support for the ABC-C in the assessment of ADHD in mentally retarded children.
Psychometrics of the PHQ-9 as a measure of depressive symptoms in patients with heart failure.
Hammash, Muna H; Hall, Lynne A; Lennie, Terry A; Heo, Seongkum; Chung, Misook L; Lee, Kyoung Suk; Moser, Debra K
2013-10-01
Depression in patients with heart failure commonly goes undiagnosed and untreated. The Patient Health Questionnaire-9 (PHQ-9) is a simple, valid measure of depressive symptoms that may facilitate clinical assessment. It has not been validated in patients with heart failure. To test the reliability, and concurrent and construct validity of the PHQ-9 in patients with heart failure. A total of 322 heart failure patients (32% female, 61 ± 12 years, 56% New York Heart Association class III/IV) completed the PHQ-9, the Beck Depression Inventory-II (BDI-II), and the Control Attitudes Scale (CAS). Cronbach's alpha of .83 supported the internal consistency reliability of the PHQ-9 in this sample. Inter-item correlations (range .22-.66) and item-total correlation (except item 9) supported homogeneity of the PHQ-9. Spearman's rho of .80, (p < .001) between the PHQ-9 and the BDI-II supported the concurrent validity as did the agreement between the PHQ-9 and the BDI-II (Kappa = 0.64, p < .001). At cut-off score of 10, the PHQ-9 was 70% sensitive and 92% specific in identifying depressive symptoms, using the BDI-II scores as the criterion for comparison. Differences in PHQ-9 scores by level of perceived control measured by CAS (t(318) = -5.05, p < .001) supported construct validity. The PHQ-9 is a reliable, valid measure of depressive symptoms in patients with heart failure.
Validity and Reliability of a New Instrument to Measure Cancer-Related Fatigue in Adolescents
Hinds, Pamela S.; Hockenberry, Marilyn; Tong, Xin; Rai, Shesh N.; Gattuso, Jamie S.; McCarthy, Kathleen; Pui, Ching-Hon; Srivastava, Deo Kumar
2008-01-01
Adolescents undergoing treatment for cancer rate fatigue as their most prevalent and intense cancer- and treatment-related effect. Parents and staff rate it similarly. Despite its reported prevalence, intensity, and distressing effects, cancer-related fatigue in adolescents is not routinely assessed during or after cancer treatment. We contend that the insufficient clinical attention is primarily due to the lack of a reliable and valid self-report instrument with which adolescent cancer-related fatigue can be measured. Our aim was to determine the reliability and construct validity of a new instrument and its ability to measure change in fatigue over time. Initial testing involved 64 adolescents undergoing curative treatment of cancer who completed the Fatigue Scale-Adolescent (FS-A) at two to four key points in treatment in one of four studies. Internal consistency estimates ranged from 0.67 to 0.95. Validity estimates involving the FS-A with the parent version ranged from 0.13 to 0.76; estimates involving the staff version and the Reynolds Depression Scale were 0.27 and 0.87 respectively. Additional validity findings included significant fatigue differences between anemic and non-anemic patients (P = 0.042) and the emergence of four factors in an exploratory factor analysis. Findings further indicate that the FS-A can be used to measure change over time (t = 2.55, P <0.01). In summary, the FS-A has moderate to strong reliability and impressive validity coefficients for a new research instrument. PMID:17629669
Sheffield, Alexandra; Waller, Glenn; Emanuelli, Francesca; Murray, James
2006-01-01
Recent studies support the reliability and validity of the Young Parenting Inventory-Revised (YPI-R) and its use in investigating the role of parenting in the aetiology and maintenance of eating pathology. However, criterion validity has yet to be fully established. To investigate one aspect of criterion validity, this study examines the association between parenting and comorbid problems in the eating disorders (including general psychopathology and impulsivity). The participants were 124 women with eating disorders. They completed the YPI-R and the Brief Symptom Inventory (BSI; a measure of general psychopathology). They were also interviewed about their use of a number of impulsive behaviours. YPI-R scales were significant predictors of one of the nine BSI scales, and distinguished those patients who did or did not use specific impulsive behaviours. The criterion validity of the YPI-R is partially supported with regards to general psychopathology and impulsivity. The findings highlight the specificity of the parenting styles measured by the YPI-R, and the need for further research using this tool.
Reliability and validity of the Lithuanian Tinnitus Handicap Inventory.
Ulozienė, Ingrida; Balnytė, Renata; Alzbutienė, Giedrė; Arechvo, Irina; Vaitkus, Antanas; Šileikaitė, Milda; Šaferis, Viktoras; Ulozas, Virgilijus
2016-01-01
The aim of this study was to determine the reliability and validity of the Lithuanian version of the Tinnitus Handicap Inventory (THI), a self-report measure of perceived tinnitus handicap. A cross-sectional psychometric validation study was performed in the University Hospital. A total of 248 subjects reporting chronic tinnitus as their primary complaint or secondary to hearing loss were encluded in the study and filled in the Lithuanian version of THI. For assessment of construct validity a subgroup of 55 participants completed the Lithuanian version of the Hospital Anxiety and Depression Scale as a measure of self-perceived levels of anxiety and depression. Test-retest and internal consistency reliability as well as construct validity were calculated. The Lithuanian version of the THI and its subscales showed a robust internal consistency reliability (Cronbach's alpha=0.93) comparable to the original version. Statistically significant correlations were observed between the Lithuanian translation of the THI and the measures of self-perceived levels of anxiety and depression using HADS. Confirmatory factor analysis demonstrated that the three subscales of the THI Lithuanian version corresponded to three different factors, which strongly correlated between themselves. The results suggest that the Lithuanian version of THI maintains its original validity and may serve as reliable and valid measure of general tinnitus related distress that can be used in a clinical setting to quantify the impact of tinnitus on daily living. Copyright © 2016 The Lithuanian University of Health Sciences. Production and hosting by Elsevier Urban & Partner Sp. z o.o. All rights reserved.
Validation of the Epworth Sleepiness Scale for Children and Adolescents using Rasch analysis.
Janssen, Kitty C; Phillipson, Sivanes; O'Connor, Justen; Johns, Murray W
2017-05-01
A validated measure of daytime sleepiness for adolescents is needed to better explore emerging relationships between sleepiness and the mental and physical health of adolescents. The Epworth Sleepiness Scale (ESS) is a widely used scale for daytime sleepiness in adults but contains references to alcohol and driving. The Epworth Sleepiness Scale for Children and Adolescents (ESS-CHAD) has been proposed as the official modified version of the ESS for children and adolescents. This study describes the psychometric analysis of the ESS-CHAD as a measure of daytime sleepiness for adolescents. The ESS-CHAD was completed by 297 adolescents, 12-18 years old, from two independent schools in Victoria, Australia. Exploratory factor analysis and Rasch analysis was conducted to determine the validity of the scale. Exploratory factor analysis and Rasch analysis indicated that ESS-CHAD has internal validity and a unidimensional structure with good model fit. Rasch analysis of four subgroups based on gender and year-level were consistent with the overall results. The results were consistent with published ESS results, which strongly indicates that the changes to the scale do not affect the scale's capacity to measure daytime sleepiness. It is concluded that the ESS-CHAD is a reliable and internally valid measure of daytime sleepiness in adolescents 12-18 years old. Further studies are needed to establish the internal validity of the ESS-CHAD for children under 12 years, and to establish external validity and accurate cut-off points for children and adolescents. Copyright © 2017 Elsevier B.V. All rights reserved.
Dahm, Jane; Wong, Dana; Ponsford, Jennie
2013-10-01
Anxiety and depression following traumatic brain injury (TBI) are associated with poorer outcomes. A brief self-report questionnaire would assist in identifying those at risk, however validity of such measures is complicated by confounding symptoms of the injury. This study investigated the validity of the Depression Anxiety Stress Scales (DASS) and Hospital Anxiety and Depression Scale (HADS), in screening for clinical diagnoses of anxiety and mood disorders following TBI. One hundred and twenty-three participants with mild to severe TBI were interviewed using the SCID (Axis I) and completed the DASS and HADS. The DASS, DASS21 and HADS scales demonstrated validity compared with SCID diagnoses of anxiety and mood disorders as measured by Area Under ROC Curve, sensitivity and specificity. Validity of the DASS depression scale benefited from items reflecting symptoms of devaluation of life, self-deprecation, and hopelessness that are not present on the HADS. Validity of the HADS anxiety scale benefited from items reflecting symptoms of tension and worry that are measured separately for the DASS on the stress scale. Participants were predominantly drawn from a rehabilitation centre which may limit the extent to which results can be generalized. Scores for the DASS21 were derived from the DASS rather than being administered separately. The DASS, DASS21 and HADS demonstrated validity as screening measures of anxiety and mood disorders in this TBI sample. The findings support use of these self-report questionnaires for individuals with TBI to identify those who should be referred for clinical diagnostic follow-up. © 2013 Elsevier B.V. All rights reserved.
Validation of learning style measures: implications for medical education practice.
Chapman, Dane M; Calhoun, Judith G
2006-06-01
It is unclear which learners would most benefit from the more individualised, student-structured, interactive approaches characteristic of problem-based and computer-assisted learning. The validity of learning style measures is uncertain, and there is no unifying learning style construct identified to predict such learners. This study was conducted to validate learning style constructs and to identify the learners most likely to benefit from problem-based and computer-assisted curricula. Using a cross-sectional design, 3 established learning style inventories were administered to 97 post-Year 2 medical students. Cognitive personality was measured by the Group Embedded Figures Test, information processing by the Learning Styles Inventory, and instructional preference by the Learning Preference Inventory. The 11 subscales from the 3 inventories were factor-analysed to identify common learning constructs and to verify construct validity. Concurrent validity was determined by intercorrelations of the 11 subscales. A total of 94 pre-clinical medical students completed all 3 inventories. Five meaningful learning style constructs were derived from the 11 subscales: student- versus teacher-structured learning; concrete versus abstract learning; passive versus active learning; individual versus group learning, and field-dependence versus field-independence. The concurrent validity of 10 of 11 subscales was supported by correlation analysis. Medical students most likely to thrive in a problem-based or computer-assisted learning environment would be expected to score highly on abstract, active and individual learning constructs and would be more field-independent. Learning style measures were validated in a medical student population and learning constructs were established for identifying learners who would most likely benefit from a problem-based or computer-assisted curriculum.
Heron, Kristin E; Mason, Tyler B; Sutton, Tiphanie G; Myers, Taryn A
2015-09-01
Perceptions of physical appearance, or body image, can affect psychosocial functioning and quality of life (QOL). The present study evaluated the real-world predictive validity of the Body Image Quality of Life Inventory (BIQLI) using Ecological Momentary Assessment (EMA). College women reporting subclinical disordered eating/body dissatisfaction (N=131) completed the BIQLI and related measures. For one week they then completed five daily EMA surveys of mood, social interactions, stress, and eating behaviors on palmtop computers. Results showed better body image QOL was associated with less negative affect, less overwhelming emotions, more positive affect, more pleasant social interactions, and higher self-efficacy for handling stress. Lower body image QOL was marginally related to less overeating and lower loss of control over eating in daily life. To our knowledge, this is the first study to support the real-world predictive validity of the BIQLI by identifying social, affective, and behavioral correlates in everyday life using EMA. Copyright © 2015 Elsevier Ltd. All rights reserved.
López, Diego M; Blobel, Bernd; Gonzalez, Carolina
2010-01-01
Requirement analysis, design, implementation, evaluation, use, and maintenance of semantically interoperable Health Information Systems (HIS) have to be based on eHealth standards. HIS-DF is a comprehensive approach for HIS architectural development based on standard information models and vocabulary. The empirical validity of HIS-DF has not been demonstrated so far. Through an empirical experiment, the paper demonstrates that using HIS-DF and HL7 information models, semantic quality of HIS architecture can be improved, compared to architectures developed using traditional RUP process. Semantic quality of the architecture has been measured in terms of model's completeness and validity metrics. The experimental results demonstrated an increased completeness of 14.38% and an increased validity of 16.63% when using the HIS-DF and HL7 information models in a sample HIS development project. Quality assurance of the system architecture in earlier stages of HIS development presumes an increased quality of final HIS systems, which supposes an indirect impact on patient care.
De Caluwé, Elien; Verbeke, Lize; van Aken, Marcel; van der Heijden, Paul T; De Clercq, Barbara
2018-02-22
The inclusion of a dimensional trait model of personality pathology in DSM-5 creates new opportunities for research on developmental antecedents of personality pathology. The traits of this model can be measured with the Personality Inventory for DSM-5 (PID-5), initially developed for adults, but also demonstrating validity in adolescents. The present study adds to the growing body of literature on the psychometrics of the PID-5, by examining its structure, validity, and reliability in 187 psychiatric-referred late adolescents and emerging adults. PID-5, Big Five Inventory, and Kidscreen self-reports were provided, and 88 non-clinical matched controls completed the PID-5. Results confirm the PID-5's five-factor structure, indicate adequate psychometric properties, and underscore the construct and criterion validity, showing meaningful associations with adaptive traits and quality of life. Results are discussed in terms of the PID-5's applicability in vulnerable populations who are going through important developmental transition phases, such as the step towards early adulthood.
Development and Testing of the Nurse Manager EBP Competency Scale.
Shuman, Clayton J; Ploutz-Snyder, Robert J; Titler, Marita G
2018-02-01
The purpose of this study was to develop and evaluate the validity and reliability of an instrument to measure nurse manager competencies regarding evidence-based practice (EBP). The Nurse Manager EBP Competency Scale consists of 16 items for respondents to indicate their perceived level of competency on a 0 to 3 Likert-type scale. Content validity was demonstrated through expert panel review and pilot testing. Principal axis factoring and Cronbach's alpha evaluated construct validity and internal consistency reliability, respectively. Eighty-three nurse managers completed the scale. Exploratory factor analysis resulted in a 16-item scale with two subscales, EBP Knowledge ( n = 6 items, α = .90) and EBP Activity ( n = 10 items, α = .94). Cronbach's alpha for the entire scale was .95. The Nurse Manager EBP Competency Scale is a brief measure of nurse manager EBP competency with evidence of validity and reliability. The scale can enhance our understanding in future studies regarding how nurse manager EBP competency affects implementation.
Campbell, Clare E; Maisto, Stephen A
2018-03-22
Research is needed to establish the psychometric properties of brief screens in university primary care settings. This study aimed to assess the construct validity of one such screen, the Alcohol Use Disorders Identification Test-Consumption (AUDIT-C), for detecting at-risk drinking among students who have utilized on-campus primary care. 389 students recently seen in university primary care completed a confidential online survey in December 2014. Bivariate correlations between the AUDIT-C and measures of alcohol consumption and negative drinking consequences provided concurrent evidence for construct validity. Receiver Operating Characteristic curve analyses determined optimal cut-off scores for at-risk drinking. The AUDIT-C significantly correlated with measures of alcohol consumption and negative drinking consequences (p < .001). Analyses support optimal AUDIT-C cut-off scores of 5 for females and 7 for males. The AUDIT-C is a valid screen for at-risk drinking among students who utilize university primary care.
Vittadello, Fabio; Mischo-Kelling, Maria; Wieser, Heike; Cavada, Luisa; Lochner, Lukas; Naletto, Carla; Fink, Verena; Reeves, Scott
2018-05-01
This article presents a study that aimed to validate a translation of a multiple-group measurement scale for interprofessional collaboration (IPC). We used survey data gathered over a three month period as part of a mixed methods study that explored the nature of IPC in Northern Italy. Following a translation from English into Italian and German the survey was distributed online to over 5,000 health professionals (dieticians, nurses, occupational therapists, physicians, physiotherapists, speech therapists and psychologists) based in one regional health trust. In total, 2,238 different health professions completed the survey. Based on the original scale, three principal components were extracted and confirmed as relevant factors for IPC (communication, accommodation and isolation). A confirmatory analysis (3-factor model) was applied to the data of physicians and nurses by language group. In conclusion, the validation of the German and Italian IPC scale has provided an instrument of acceptable reliability and validity for the assessment of IPC involving physicians and nurses.
The prevalence of the Middle-Eastern extreme ideologies among some Canadians.
Loza, Wagdy
2011-05-01
A total of 183 Canadian participants of different religious backgrounds completed the Belief Diversity Scale (BDS). The BDS is an 80-item, 6-subscale instrument designed to quantitatively measure the religious attitudes, beliefs, and ideologies of Middle-Eastern extremists' on risk areas that are reported in the literature. The results demonstrated the reliability and validity of the BDS as well as indicated the prevalence of Middle-Eastern extremists' ideologies among Muslim Canadians. Results were similar to those obtained from similar study completed on South African participants. These findings suggested that the BDS has the potential to be used as an objective tool to measure Middle-Eastern religious extremism.
Katerelos, Marina; Hawley, Lance L; Antony, Martin M; McCabe, Randi E
2008-07-01
This study explored the psychometric properties and utility of the exposure hierarchy as a measure of treatment outcome for social anxiety disorder (SAD). An exposure hierarchy was created for each of 103 individuals with a diagnosis of SAD who completed a course of cognitive behavioral group therapy. Exposure hierarchy ratings were collected on a weekly basis, and a series of self-report measures were collected before and after treatment. Results indicated that the exposure hierarchy demonstrated high test-retest reliability, as well as significant convergent validity, as participants' exposure hierarchy ratings correlated positively with scores on conceptually related measures. Hierarchy ratings were significantly associated with changes in SAD symptoms over time. However, exposure hierarchy ratings were correlated to general measures of psychopathology, suggesting limited discriminant validity. The study highlights the clinical and scientific utility of the exposure hierarchy.
The development and validation of the major life changing decision profile (MLCDP)
2013-01-01
Background Chronic diseases may influence patients taking major life changing decisions (MLCDs) concerning for example education, career, relationships, having children and retirement. A validated measure is needed to evaluate the impact of chronic diseases on MLCDs, improving assessment of their life-long burden. The aims of this study were to develop a validated questionnaire, the “Major Life Changing Decision Profile” (MLCDP) and to evaluate its psychometric properties. Methods 50 interviews with dermatology patients and 258 questionnaires, completed by cardiology, rheumatology, nephrology, diabetes and respiratory disorder patients, were analysed for qualitative data using Nvivo8 software. Content validation was carried out by a panel of experts. The first version of the MLCDP was completed by 210 patients and an iterative process of multiple Exploratory Factor Analyses and item prevalence was used to guide item reduction. Face validity and practicability was assessed by patients. Results 48 MLCDs were selected from analysis of the transcripts and questionnaires for the first version of the MLCDP, and reduced to 45 by combination of similar themes. There was a high intraclass correlation coefficient (0.7) between the 13 members of the content validation panel. Four more items were deleted leaving a 41-item MLCDP that was completed by 210 patients. The most frequently recorded MLCDs were decisions to change eating habits (71.4%), to change smoking/drinking alcohol habits (58.5%) and not to travel or go for holidays abroad (50.9%). Factor analysis suggested item number reduction from 41 to 34, to 29, then 23 items. However after taking into account item prevalence data as well as factor analysis results, 32 items were retained. The 32-item MLCDP has five domains education (3 items), job/career (9), family/relationships (5), social (10) and physical (5). The MLCDP score is expressed as the absolute number of decisions that have been affected. Conclusions The 32-item (5 domains) MLCDP has been developed as an easy to complete generic tool for use in clinical practice and for quality of life and epidemiological research. Further validation is required. PMID:23656829
The validation of a home food inventory.
Fulkerson, Jayne A; Nelson, Melissa C; Lytle, Leslie; Moe, Stacey; Heitzler, Carrie; Pasch, Keryn E
2008-11-04
Home food inventories provide an efficient method for assessing home food availability; however, few are validated. The present study's aim was to develop and validate a home food inventory that is easily completed by research participants in their homes and includes a comprehensive range of both healthful and less healthful foods that are associated with obesity. A home food inventory (HFI) was developed and tested with two samples. Sample 1 included 51 adult participants and six trained research staff who independently completed the HFI in participants' homes. Sample 2 included 342 families in which parents completed the HFI and the Diet History Questionnaire (DHQ) and students completed three 24-hour dietary recall interviews. HFI items assessed 13 major food categories as well as two categories assessing ready-access to foods in the kitchen and the refrigerator. An obesogenic household food availability score was also created. To assess criterion validity, participants' and research staffs' assessment of home food availability were compared (staff = gold standard). Criterion validity was evaluated with kappa, sensitivity, and specificity. Construct validity was assessed with correlations of five HFI major food category scores with servings of the same foods and associated nutrients from the DHQ and dietary recalls. Kappa statistics for all 13 major food categories and the two ready-access categories ranged from 0.61 to 0.83, indicating substantial agreement. Sensitivity ranged from 0.69 to 0.89, and specificity ranged from 0.86 to 0.95. Spearman correlations between staff and participant major food category scores ranged from 0.71 to 0.97. Correlations between the HFI scores and food group servings and nutrients on the DHQ (parents) were all significant (p < .05) while about half of associations between the HFI and dietary recall interviews (adolescents) were significant (p < .05). The obesogenic home food availability score was significantly associated (p < .05) with energy intake of both parents and adolescents. This new home food inventory is valid, participant-friendly, and may be useful for community-based behavioral nutrition and obesity prevention research. The inventory builds on previous measures by including a wide range of healthful and less healthful foods rather than foods targeted for a specific intervention.
Fermont, Jilles M; Blazeby, Jane M; Rogers, Chris A; Wordsworth, Sarah
2017-01-01
Bariatric surgery is considered an effective treatment for individuals with severe and complex obesity. Besides reducing weight and improving obesity related comorbidities such as diabetes, bariatric surgery could improve patients' health-related quality of life. However, the frequently used instrument to measure quality of life, the EQ-5D has not been validated for use in bariatric surgery, which is a major limitation to its use in this clinical context. Our study undertook a psychometric validation of the 5 level EQ-5D (EQ-5D-5L) using clinical trial data to measure health-related quality of life in patients with severe and complex obesity undergoing bariatric surgery. Health-related quality of life was assessed at baseline (before randomisation) and six months later in 189 patients in a randomised controlled trial of bariatric surgery. Patients completed two generic health-related quality of life instruments, the EQ-5D-5L and SF-12, which were used together for the validation using data from all patients in the trial as the trial is ongoing. Psychometric analyses included construct and criterion validity and responsiveness to change. Of the 189 validation patients, 141 (75%) were female, the median age was 49 years old (range 23-70 years) and body mass index ranged from 33-70 kg/m2. For construct validity, there were significant improvements in the distribution of responses in all EQ-5D dimensions between baseline and 6 months after randomisation. For criterion validity, the highest degree of correlation was between the EQ-5D pain/discomfort and SF-12 bodily pain domain. For responsiveness the EQ-5D and SF-12 showed statistically significant improvements in health-related quality of life between baseline and 6 months after randomisation. The EQ-5D-5L is a valid generic measure for measuring health-related quality of life in bariatric surgery patients.
An international measure of awareness and beliefs about cancer: development and testing of the ABC
Simon, Alice E; Forbes, Lindsay J L; Boniface, David; Warburton, Fiona; Brain, Kate E; Dessaix, Anita; Donnelly, Michael; Haynes, Kerry; Hvidberg, Line; Lagerlund, Magdalena; Petermann, Lisa; Tishelman, Carol; Vedsted, Peter; Vigmostad, Maria Nyre; Wardle, Jane; Ramirez, Amanda J
2012-01-01
Objectives To develop an internationally validated measure of cancer awareness and beliefs; the awareness and beliefs about cancer (ABC) measure. Design and setting Items modified from existing measures were assessed by a working group in six countries (Australia, Canada, Denmark, Norway, Sweden and the UK). Validation studies were completed in the UK, and cross-sectional surveys of the general population were carried out in the six participating countries. Participants Testing in UK English included cognitive interviewing for face validity (N=10), calculation of content validity indexes (six assessors), and assessment of test–retest reliability (N=97). Conceptual and cultural equivalence of modified (Canadian and Australian) and translated (Danish, Norwegian, Swedish and Canadian French) ABC versions were tested quantitatively for equivalence of meaning (≥4 assessors per country) and in bilingual cognitive interviews (three interviews per translation). Response patterns were assessed in surveys of adults aged 50+ years (N≥2000) in each country. Main outcomes Psychometric properties were evaluated through tests of validity and reliability, conceptual and cultural equivalence and systematic item analysis. Test–retest reliability used weighted-κ and intraclass correlations. Construction and validation of aggregate scores was by factor analysis for (1) beliefs about cancer outcomes, (2) beliefs about barriers to symptomatic presentation, and item summation for (3) awareness of cancer symptoms and (4) awareness of cancer risk factors. Results The English ABC had acceptable test–retest reliability and content validity. International assessments of equivalence identified a small number of items where wording needed adjustment. Survey response patterns showed that items performed well in terms of difficulty and discrimination across countries except for awareness of cancer outcomes in Australia. Aggregate scores had consistent factor structures across countries. Conclusions The ABC is a reliable and valid international measure of cancer awareness and beliefs. The methods used to validate and harmonise the ABC may serve as a methodological guide in international survey research. PMID:23253874
Exploring the reliability and validity of the social-moral awareness test.
Livesey, Alexandra; Dodd, Karen; Pote, Helen; Marlow, Elizabeth
2012-11-01
The aim of the study was to explore the validity of the social-moral awareness test (SMAT) a measure designed for assessing socio-moral rule knowledge and reasoning in people with learning disabilities. Comparisons between Theory of Mind and socio-moral reasoning allowed the exploration of construct validity of the tool. Factor structure, reliability and discriminant validity were also assessed. Seventy-one participants with mild-moderate learning disabilities completed the two scales of the SMAT and two False Belief Tasks for Theory of Mind. Reliability of the SMAT was very good, and the scales were shown to be uni-dimensional in factor structure. There was a significant positive relationship between Theory of Mind and both SMAT scales. There is early evidence of the construct validity and reliability of the SMAT. Further assessment of the validity of the SMAT will be required. © 2012 Blackwell Publishing Ltd.
Validation of the insomnia severity index as a web-based measure.
Thorndike, Frances P; Ritterband, Lee M; Saylor, Drew K; Magee, Joshua C; Gonder-Frederick, Linda A; Morin, Charles M
2011-01-01
Although the Insomnia Severity Index (ISI) is already administered online, this frequently used instrument has not been validated for Web delivery. This study compares online and paper-and-pencil ISI versions completed by participants in a randomized controlled trial testing an Internet-delivered intervention for insomnia. Forty-three adults with insomnia completed both ISI versions during pre- (Assessment 1) and post-intervention (Assessment 2). Correlations between total scores of both versions were significant (rs ≥ .98, ps < .001). For both ISI versions, internal consistency was acceptable (Assessment 1, α = .61; Assessment 2, α ≥ .88). Among participants not receiving the parent study intervention, correlations between 1 format at Assessment 1 and the alternative format at Assessment 2 were generally significant (rs = .26-.82). Together, findings suggest the ISI can be delivered online.
Strand, Julia F; Brown, Violet A; Merchant, Madeleine B; Brown, Hunter E; Smith, Julia
2018-06-19
Listening effort (LE) describes the attentional or cognitive requirements for successful listening. Despite substantial theoretical and clinical interest in LE, inconsistent operationalization makes it difficult to make generalizations across studies. The aims of this large-scale validation study were to evaluate the convergent validity and sensitivity of commonly used measures of LE and assess how scores on those tasks relate to cognitive and personality variables. Young adults with normal hearing (N = 111) completed 7 tasks designed to measure LE, 5 tests of cognitive ability, and 2 personality measures. Scores on some behavioral LE tasks were moderately intercorrelated but were generally not correlated with subjective and physiological measures of LE, suggesting that these tasks may not be tapping into the same underlying construct. LE measures differed in their sensitivity to changes in signal-to-noise ratio and the extent to which they correlated with cognitive and personality variables. Given that LE measures do not show consistent, strong intercorrelations and differ in their relationships with cognitive and personality predictors, these findings suggest caution in generalizing across studies that use different measures of LE. The results also indicate that people with greater cognitive ability appear to use their resources more efficiently, thereby diminishing the detrimental effects associated with increased background noise during language processing.
Cheng, Shu-Fen; Rose, Susan
2009-01-01
This study investigated the technical adequacy of curriculum-based measures of written expression (CBM-W) in terms of writing prompts and scoring methods for deaf and hard-of-hearing students. Twenty-two students at the secondary school-level completed 3-min essays within two weeks, which were scored for nine existing and alternative curriculum-based measurement (CBM) scoring methods. The technical features of the nine scoring methods were examined for interrater reliability, alternate-form reliability, and criterion-related validity. The existing CBM scoring method--number of correct minus incorrect word sequences--yielded the highest reliability and validity coefficients. The findings from this study support the use of the CBM-W as a reliable and valid tool for assessing general writing proficiency with secondary students who are deaf or hard of hearing. The CBM alternative scoring methods that may serve as additional indicators of written expression include correct subject-verb agreements, correct clauses, and correct morphemes.
Andersen, L Frost; Tomten, H; Haggarty, P; Løvø, A; Hustvedt, B-E
2003-02-01
The validation of dietary assessment methods is critical in the evaluation of the relation between dietary intake and health. The aim of this study was to assess the validity of a food frequency questionnaire by comparing energy intake with energy expenditure measured with the doubly labelled water method. Total energy expenditure was measured with the doubly labelled water (DLW) method during a 10 day period. Furthermore, the subjects filled in the food frequency questionnaire about 18-35 days after the DLW phase of the study was completed. Twenty-one healthy, non-pregnant females volunteered to participate in the study; only 17 subjects completed the study. The group energy intake was on average 10% lower than the energy expenditure, but the difference was not statistically significant. However, there was a wide range in reporting accuracy: seven subjects were identified as acceptable reporters, eight as under-reporters and two were identified as over-reporters. The width of the 95% confidence limits of agreement in a Bland and Altman plot for energy intake and energy expenditure varied from -5 to 3 MJ. The data showed that there was substantial variability in the accuracy of the food frequency questionnaire at the individual level. Furthermore, the results showed that the questionnaire was more accurate for groups than individuals.
Validating indicators of treatment response: application to trichotillomania.
Nelson, Samuel O; Rogers, Kate; Rusch, Natalie; McDonough, Lauren; Malloy, Elizabeth J; Falkenstein, Martha J; Banis, Maria; Haaga, David A F
2014-09-01
Different studies of the treatment of trichotillomania (TTM) have used varying standards to determine the proportion of patients who obtain clinically meaningful benefits, but there is little information on the similarity of results yielded by these methods or on their comparative validity. Data from a stepped-care (Step 1: Web-based self-help; Step 2: Individual behavior therapy; N = 60) treatment study of TTM were used to evaluate 7 potential standards: complete abstinence, ≥ 25% symptom reduction, recovery of normal functioning, and clinical significance (recovery + statistically reliable change), each of the last 3 being measured by self-report (Massachusetts General Hospital Hairpulling Scale; MGH-HPS) or interview (Psychiatric Institute Trichotillomania Scale). Depending on the metric, response rates ranged from 25 to 68%. All standards were significantly associated with one another, though less strongly for the 25% symptom reduction metrics. Concurrent (with deciding to enter Step 2 treatment) and predictive (with 3-month follow-up treatment satisfaction, TTM-related impairment, quality of life, and diagnosis) validity results were variable but generally strongest for clinical significance as measured via self-report. Routine reporting of the proportion of patients who make clinically significant improvement on the MGH-HPS, supplemented by data on complete abstinence, would bolster the interpretability of TTM treatment outcome findings. PsycINFO Database Record (c) 2014 APA, all rights reserved.
Schepens, Stacey; Goldberg, Allon; Wallace, Melissa
2010-01-01
A shortened version of the ABC 16-item scale (ABC-16), the ABC-6, has been proposed as an alternative balance confidence measure. We investigated whether the ABC-6 is a valid and reliable measure of balance confidence and examined its relationship to balance impairment and falls in older adults. Thirty-five community-dwelling older adults completed the ABC-16, including the 6 questions of the ABC-6. They also completed the following clinical balance tests: unipedal stance time (UST), functional reach (FR), Timed Up and Go (TUG), and maximum step length (MSL). Participants reported 12-month falls history. Balance confidence on the ABC-6 was significantly lower than on the ABC-16, however scores were highly correlated. Fallers reported lower balance confidence than non-fallers as measured by the ABC-6 scale, but confidence did not differ between the groups with the ABC-16. The ABC-6 significantly correlated with all balance tests assessed and number of falls. The ABC-16 significantly correlated with all balance tests assessed, but not with number of falls. Test-retest reliability for the ABC-16 and ABC-6 was good to excellent. The ABC-6 is a valid and reliable measure of balance confidence in community-dwelling older adults, and shows stronger relationships to falls than does the ABC-16. The ABC-6 may be a more useful balance confidence assessment tool than the ABC-16. Copyright 2009 Elsevier Ireland Ltd. All rights reserved.
Kimhy, David; Delespaul, Philippe; Ahn, Hongshik; Cai, Shengnan; Shikhman, Marina; Lieberman, Jeffrey A; Malaspina, Dolores; Sloan, Richard P
2010-11-01
Psychosis has been repeatedly suggested to be affected by increases in stress and arousal. However, there is a dearth of evidence supporting the temporal link between stress, arousal, and psychosis during "real-world" functioning. This paucity of evidence may stem from limitations of current research methodologies. Our aim is to the test the feasibility and validity of a novel methodology designed to measure concurrent stress and arousal in individuals with psychosis during "real-world" daily functioning. Twenty patients with psychosis completed a 36-hour ambulatory assessment of stress and arousal. We used experience sampling method with palm computers to assess stress (10 times per day, 10 AM → 10 PM) along with concurrent ambulatory measurement of cardiac autonomic regulation using a Holter monitor. The clocks of the palm computer and Holter monitor were synchronized, allowing the temporal linking of the stress and arousal data. We used power spectral analysis to determine the parasympathetic contributions to autonomic regulation and sympathovagal balance during 5 minutes before and after each experience sample. Patients completed 79% of the experience samples (75% with a valid concurrent arousal data). Momentary increases in stress had inverse correlation with concurrent parasympathetic activity (ρ = -.27, P < .0001) and positive correlation with sympathovagal balance (ρ = .19, P = .0008). Stress and heart rate were not significantly related (ρ = -.05, P = .3875). The findings support the feasibility and validity of our methodology in individuals with psychosis. The methodology offers a novel way to study in high time resolution the concurrent, "real-world" interactions between stress, arousal, and psychosis. The authors discuss the methodology's potential applications and future research directions.
Khetani, Mary; Marley, Jenifer; Baker, Megan; Albrecht, Erin; Bedell, Gary; Coster, Wendy; Anaby, Dana; Law, Mary
2014-04-01
Participation in home, school, and community activities is an important indicator of child health and well-being. Evaluating environmental influences on children's participation can inform efforts to develop sustainable built environments, but few validated measures exist. To examine the concurrent validity and utility of the Participation and Environment Measure for Children and Youth (PEM-CY) for Health Impact Assessment in non-urban sustainable development projects affecting children with disabilities. Eighty-nine parents of children and youth with disabilities who identified as residing in a small town or rural community were sampled. Sixty-six caregivers completed the PEM-CY online, and 23 caregivers completed the PEM-CY and CHIEF-CP paper forms. Spearman correlational analyses were conducted to establish the concurrent validity of the PEM-CY environment sections against the CHIEF-CP. Group comparisons by child's age, number of functional limitations, and annual household income were used to examine differences in summary and item-level responses on the PEM-CY community section. Moderate to strong associations were found between CHIEF-CP Total Product and Magnitude Scores and all PEM-CY Environment Summary Scores. CHIEF-CP Physical/Structural and Policies Subscale Scores were most consistently associated with PEM-CY Environment Summary Scores. Group differences by household income were found for participation frequency and number of supports, including perceived availability and adequacy of money and information about programs and services, even when controlling child's age and number of functional limitations. Study results lend support to the use of the PEM-CY in HIA to reliably assess for environmental impact on children's participation. Implications for using the PEM-CY to inform decision-making in non-urban sustainable development projects affecting families of children and youth with disabilities are discussed. Published by Elsevier Inc.
Kaushik, A; Papachristou, E; Dima, D; Fewings, S; Kostaki, E; Ploubidis, G B; Kyriakopoulos, M
2017-06-01
Research on the impact of stigma associated with mental illness in children is scarce. Considering the known negative effects of stigma associated with mental illness in adults, it is crucial to explore the stigma experienced by children who access mental health treatment. However, no scale measuring self-stigmatization in younger children is available to date. This study aimed to develop and validate such a scale, the Paediatric Self-Stigmatization Scale (PaedS). A total of 156 children (119 receiving outpatient and 37 receiving inpatient treatment), aged 8-12 years, completed the PaedS, the Self-Perception Profile for Children and the Pediatric Quality of Life Inventory (PedsQL - Child Report, ages 8-12). In addition, parents completed the PedsQL (Parent Report for Children, ages 8-12), the Strengths and Difficulties Questionnaire (SDQ) and a modified subscale of the PaedS measuring the children's rejection by others due to their mental health difficulties. A confirmatory factor analysis showed that a four-factor structure, comprising Societal Devaluation, Personal Rejection, Self-Stigma and Secrecy scales, had excellent fit to the data (CFI=0.95; TLI=0.95; RMSEA=0.05). Child-reported PaedS scores were positively correlated with parental-reported PaedS scores and negatively with PedsQL, the SDQ, and 5 out of 6 subscales of the Self-Perception Profile for Children, suggesting adequate convergent validity (all P-values<0.05). The PaedS is a valid instrument, which is hoped to advance the understanding of self-stigmatization in children with mental health difficulties and contribute to its prevention. Copyright © 2017 Elsevier Masson SAS. All rights reserved.
Zhou, Ting; Yang, Kaixiang; Thapa, Sudip; Fu, Qiang; Jiang, Yongsheng; Yu, Shiying
2017-04-01
The assessment of quality of life (QOL) is an important part of cachexia management for cancer patients. Functional assessment of anorexia-cachexia therapy (FAACT), a specific QOL instrument for cachexia patients, has not been validated in Chinese population. The aim of this study was to validate the FAACT scale in Chinese cancer patients for its future use. Eligible cancer patients were included in our study. Patients' demographic and clinical characteristics were collected from the electronic medical records. Patients were asked to complete the Chinese version of FAACT scale and the MD Anderson symptom inventory (MDASI), and then the reliability and validity were analyzed. A total of 285 patients were enrolled in our study, data of 241 patients were evaluated. Coefficients of Cronbach's alpha, test-retest and split-half analyses were all greater than 0.8, which indicated an excellent reliability for FAACT scale. In item-subscale correlation analysis and factor analysis, good construct validity for FAACT scale was found. The correlation between FAACT and MDASI interference subscale showed reasonable criterion-related validity, and for further clinical validation, the FAACT scale showed excellent discriminative validity for distinguishing patients in different cachexia status and in different performance status. The Chinese version of FAACT scale has good reliability and validity and is suitable for measuring QOL of cachexia patients in Chinese population.
Reliability and Validity of the Behavioral Addiction Measure for Video Gaming.
Sanders, James L; Williams, Robert J
2016-01-01
Most tests of video game addiction have weak construct validity and limited ability to correctly identify people in denial. The purpose of the present research was to investigate the reliability and validity of a new test of video game addiction (Behavioral Addiction Measure-Video Gaming [BAM-VG]) that was developed in part to address these deficiencies. Regular adult video gamers (n = 506) were recruited from a Canadian online panel and completed a survey containing three measures of excessive video gaming (BAM-VG; DSM-5 criteria for Internet Gaming Disorder [IGD]; and the IGD-20), as well as questions concerning extensiveness of video game involvement and self-report of problems associated with video gaming. One month later, they were reassessed for the purposes of establishing test-retest reliability. The BAM-VG demonstrated good internal consistency as well as 1 month test-retest reliability. Criterion-related validity was demonstrated by significant correlations with the following: time spent playing, self-identification of video game problems, and scores on other instruments designed to assess video game addiction (DSM-5 IGD, IGD-20). Consistent with the theory, principal component analysis identified two components underlying the BAM-VG that roughly correspond with impaired control and significant negative consequences deriving from this impaired control. Together with its excellent construct validity and other technical features, the BAM-VG represents a reliable and valid test of video game addiction.
Using the Rasch Measurement Model in Psychometric Analysis of the Family Effectiveness Measure
McCreary, Linda L.; Conrad, Karen M.; Conrad, Kendon J.; Scott, Christy K; Funk, Rodney R.; Dennis, Michael L.
2013-01-01
Background Valid assessment of family functioning can play a vital role in optimizing client outcomes. Because family functioning is influenced by family structure, socioeconomic context, and culture, existing measures of family functioning--primarily developed with nuclear, middle class European American families--may not be valid assessments of families in diverse populations. The Family Effectiveness Measure was developed to address this limitation. Objectives To test the Family Effectiveness Measure with data from a primarily low-income African American convenience sample, using the Rasch measurement model. Method A sample of 607 adult women completed the measure. Rasch analysis was used to assess unidimensionality, response category functioning, item fit, person reliability, differential item functioning by race and parental status, and item hierarchy. Criterion-related validity was tested using correlations with five other variables related to family functioning. Results The Family Effectiveness Measure measures two separate constructs: The effective family functioning construct was a psychometrically sound measure of the target construct that was more efficient due to the deletion of 22 items. The ineffective family functioning construct consisted of 16 of those deleted items but was not as strong psychometrically. Items in both constructs evidenced no differential item functioning by race. Criterion-related validity was supported for both. Discussion In contrast to the prevailing conceptualization that family functioning is a single construct, assessed by positively and negatively worded items, use of the Rasch analysis suggested the existence of two constructs. While the effective family functioning is a strong and efficient measure of family functioning, the ineffective family functioning will require additional item development and psychometric testing. PMID:23636342
Lee, Joey A; Williams, Skip M; Brown, Dale D; Laurson, Kelly R
2015-01-01
Activity monitors are frequently used to assess activity in many settings. But as technology advances, so do the mechanisms used to estimate activity causing a continuous need to validate newly developed monitors. The purpose of this study was to examine the step count validity of the Yamax Digiwalker SW-701 pedometer (YX), Omron HJ-720 T pedometer (OP), Polar Active accelerometer (PAC) and Actigraph gt3x+ accelerometer (AG) under controlled and free-living conditions. Participants completed five stages of treadmill walking (n = 43) and a subset of these completed a 3-day free-living wear period (n = 37). Manually counted (MC) steps provided a criterion measure for treadmill walking, whereas the comparative measure during free-living was the YX. During treadmill walking, the OP was the most accurate monitor across all speeds (±1.1% of MC steps), while the PAC underestimated steps by 6.7-16.0% per stage. During free-living, the OP and AG counted 97.5% and 98.5% of YX steps, respectively. The PAC overestimated steps by 44.0%, or 5,265 steps per day. The Omron pedometer seems to provide the most reliable and valid estimate of steps taken, as it was the best performer under lab-based conditions and provided comparable results to the YX in free-living. Future studies should consider these monitors in additional populations and settings.
Development of the Daily Activities of Infants Scale: a measure supporting early motor development.
Bartlett, Doreen J; Fanning, Jamie Kneale; Miller, Linda; Conti-Becker, Angela; Doralp, Samantha
2008-08-01
We describe the development and preliminary psychometric testing of the Daily Activities of Infants Scale (DAIS), a parent-completed measure of opportunities parents provide infants for development of postural control and movement. First we obtained 1300 photographs of typical activities from 17 families with infants aged 4 to 11 months. Through consensus we established nine dimensions of activities, graded across three levels of opportunity for development. Pilot testing supported content validity of the DAIS. Subsequently, 50 parents of infants born preterm aged 4 to 11 months participated in psychometric testing. There were 25 male and 25 female infant participants with a mean gestational age of 29.4 weeks (SD 3.6) and a mean birthweight of 1266 grams (SD 635). We found that completion of the DAIS over 1 day was representative of data collected over 3 sequential days. Older infants obtained significantly higher DAIS scores than younger infants, providing preliminary evidence for discriminant validity. The DAIS scores demonstrated a part-correlation of 0.20 (p<0.01) with scores on the Alberta Infant Motor Scale obtained concurrently, providing some evidence for convergent validity. The intraclass correlation coefficients reflecting interrater reliability and test-retest reliability of the total DAIS score were 0.76 (95% confidence interval [CI] 0.60-0.86) and 0.77 (95% CI 0.60-0.87) respectively. The DAIS has sufficient reliability and validity for use in clinical practice and research.
The German linguistic validation of the Ureteral Stent Symptoms Questionnaire (USSQ).
Abt, Dominik; Dötzer, Kristina; Honek, Patrick; Müller, Karolina; Engeler, Daniel Stephan; Burger, Maximilian; Schmid, Hans-Peter; Knoll, Thomas; Sanguedolce, Francesco; Joshi, Hrishi B; Fritsche, Hans-Martin
2017-03-01
We developed and validated the German version of the Ureteral Stent Symptoms Questionnaire (USSQ) for male and female patients with indwelling ureteral stents. The German version of the USSQ was developed following a well-established multistep process. A total of 101 patients with indwelling ureteral stents completed the German USSQ as well as the validated questionnaires International Prostate Symptom Score (IPSS) or International Consultation on Incontinence Questionnaire (ICIQ) and the Short Form Health Survey (SF-36). Patients completed questionnaires at 1 and 2-4 weeks after stent insertion and 4 weeks after stent removal. Statistical analyses were performed to assess the psychometric properties of the questionnaire. The German version of the USSQ showed good internal consistency (Cronbach's α = .72-.88) and test-retest reliability [intraclass correlation coefficient (ICC) = .81-.92]. Inter-domain associations within the USSQ showed substantial correlations between different USSQ domains, indicating a high conceptual relationship of the domains. Except from urinary symptoms and general quality of life, German USSQ showed good convergent validity with the corresponding validated questionnaires. All USSQ domains showed significant sensitivity to change (p ≤ .001). The new German version of the USSQ proved to be a reliable and robust instrument for the evaluation of ureteral stent-associated morbidity for both male and female patients. It is expected to be a valid outcome measure in the future stent research.
Measuring Implementation Fidelity in a Community-Based Parenting Intervention
Breitenstein, Susan M.; Fogg, Louis; Garvey, Christine; Hill, Carri; Resnick, Barbara; Gross, Deborah
2012-01-01
Background Establishing the feasibility and validity of implementation fidelity monitoring strategies is an important methodological step in implementing evidence-based interventions on a large scale. Objectives The objective of the study was to examine the reliability and validity of the Fidelity Checklist, a measure designed to assess group leader adherence and competence delivering a parent training intervention (the Chicago Parent Program) in child care centers serving low-income families. Method The sample included 9 parent groups (12 group sessions each), 12 group leaders, and 103 parents. Independent raters reviewed 106 audiotaped parent group sessions and coded group leaders’ fidelity on the Adherence and Competence Scales of the Fidelity Checklist. Group leaders completed self-report adherence checklists and a measure of parent engagement in the intervention. Parents completed measures of consumer satisfaction and child behavior. Results High interrater agreement (Adherence Scale = 94%, Competence Scale = 85%) and adequate intraclass correlation coefficients (Adherence Scale = .69, Competence Scale = .91) were achieved for the Fidelity Checklist. Group leader adherence changed over time, but competence remained stable. Agreement between group leader self-report and independent ratings on the Adherence Scale was 85%; disagreements were more frequently due to positive bias in group leader self-report. Positive correlations were found between group leader adherence and parent attendance and engagement in the intervention and between group leader competence and parent satisfaction. Although child behavior problems improved, improvements were not related to fidelity. Discussion The results suggest that the Fidelity Checklist is a feasible, reliable, and valid measure of group leader implementation fidelity in a group-based parenting intervention. Future research will be focused on testing the Fidelity Checklist with diverse and larger samples and generalizing to other group-based interventions using a similar intervention model. PMID:20404777
Barrett, Frederick S; Johnson, Matthew W; Griffiths, Roland R
2015-11-01
The 30-item revised Mystical Experience Questionnaire (MEQ30) was previously developed within an online survey of mystical-type experiences occasioned by psilocybin-containing mushrooms. The rated experiences occurred on average eight years before completion of the questionnaire. The current paper validates the MEQ30 using data from experimental studies with controlled doses of psilocybin. Data were pooled and analyzed from five laboratory experiments in which participants (n=184) received a moderate to high oral dose of psilocybin (at least 20 mg/70 kg). Results of confirmatory factor analysis demonstrate the reliability and internal validity of the MEQ30. Structural equation models demonstrate the external and convergent validity of the MEQ30 by showing that latent variable scores on the MEQ30 positively predict persisting change in attitudes, behavior, and well-being attributed to experiences with psilocybin while controlling for the contribution of the participant-rated intensity of drug effects. These findings support the use of the MEQ30 as an efficient measure of individual mystical experiences. A method to score a "complete mystical experience" that was used in previous versions of the mystical experience questionnaire is validated in the MEQ30, and a stand-alone version of the MEQ30 is provided for use in future research. © The Author(s) 2015.
Validation of the revised Mystical Experience Questionnaire in experimental sessions with psilocybin
Barrett, Frederick S; Johnson, Matthew W; Griffiths, Roland R
2016-01-01
The 30-item revised Mystical Experience Questionnaire (MEQ30) was previously developed within an online survey of mystical-type experiences occasioned by psilocybin-containing mushrooms. The rated experiences occurred on average eight years before completion of the questionnaire. The current paper validates the MEQ30 using data from experimental studies with controlled doses of psilocybin. Data were pooled and analyzed from five laboratory experiments in which participants (n=184) received a moderate to high oral dose of psilocybin (at least 20 mg/70 kg). Results of confirmatory factor analysis demonstrate the reliability and internal validity of the MEQ30. Structural equation models demonstrate the external and convergent validity of the MEQ30 by showing that latent variable scores on the MEQ30 positively predict persisting change in attitudes, behavior, and well-being attributed to experiences with psilocybin while controlling for the contribution of the participant-rated intensity of drug effects. These findings support the use of the MEQ30 as an efficient measure of individual mystical experiences. A method to score a “complete mystical experience” that was used in previous versions of the mystical experience questionnaire is validated in the MEQ30, and a stand-alone version of the MEQ30 is provided for use in future research. PMID:26442957
Wolf, Timothy J; Dahl, Abigail; Auen, Colleen; Doherty, Meghan
2017-07-01
The objective of this study was to evaluate the inter-rater reliability, test-retest reliability, concurrent validity, and discriminant validity of the Complex Task Performance Assessment (CTPA): an ecologically valid performance-based assessment of executive function. Community control participants (n = 20) and individuals with mild stroke (n = 14) participated in this study. All participants completed the CTPA and a battery of cognitive assessments at initial testing. The control participants completed the CTPA at two different times one week apart. The intra-class correlation coefficient (ICC) for inter-rater reliability for the total score on the CTPA was .991. The ICCs for all of the sub-scores of the CTPA were also high (.889-.977). The CTPA total score was significantly correlated to Condition 4 of the DKEFS Color-Word Interference Test (p = -.425), and the Wechsler Test of Adult Reading (p = -.493). Finally, there were significant differences between control subjects and individuals with mild stroke on the total score of the CTPA (p = .007) and all sub-scores except interpretation failures and total items incorrect. These results are also consistent with other current executive function performance-based assessments and indicate that the CTPA is a reliable and valid performance-based measure of executive function.
The Child Dissociative Checklist: Preliminary Findings of a Screening Measure.
ERIC Educational Resources Information Center
Wherry, Jeffrey N.; And Others
1994-01-01
Reports on the use of a screening instrument for dissociative behaviors in two separate but related studies. Results of a concurrent validity study between the Child Dissociative Checklist (CDC) and the Child Behavior Checklist indicate significant, positive correlations. A second study found that parent-completed CDC scores differentiate between…
An Empirical Assessment of the Communication Components Inventory
ERIC Educational Resources Information Center
Keaton, Shaughan A.; Bodie, Graham D.
2012-01-01
This article attempts to demonstrate the psychometric properties and evidence of validity for a measure recently proposed in this journal, the Communication Components Inventory (CCI). Across two studies, a total of 903 undergraduate students completed one of the two response formats--dichotomous and scaled--of the CCI and the Multiple…
Computer-Based and Paper-Based Measurement of Semantic Knowledge
1989-01-01
of Personality Assessment , 34, 353-361. McArthur, D. L., & Choppin, B. H. (1984). Computerized diagnostic testing. Journal 15 of Educational...Computers in Human Behavior, 1, 49-58. Lushene, R. E., O’Neii, H. F., & Dunn, T. (1974). Equivalent validity of a completely computerized MMPI. Journal
Psychometric Properties of the Commitment to Physical Activity Scale
ERIC Educational Resources Information Center
DeBate, Rita DiGioacchino; Huberty, Jennifer; Pettee, Kelley
2009-01-01
Objective: To assess psychometric properties of the Commitment to Physical Activity Scale (CPAS). Methods: Girls in third to fifth grades (n = 932) completed the CPAS before and after a physical activity intervention. Psychometric measures included internal consistency, factor analysis, and concurrent validity. Results: Three CPAS factors emerged:…
Albrecht, Helmut; Vernon, Margaret; Solomon, Gail
2012-12-27
Guaifenesin is a component of medicines used to improve symptoms associated with upper respiratory tract infections. Patient-reported outcome instruments are valuable for evaluating symptom improvements; however, a validated tool to assess efficacy of mucoactive drugs does not exist. We compared the efficacy of extended-release guaifenesin with placebo for treatment of symptoms of upper respiratory tract infection using subjective efficacy assessments in a pilot study and confirmed precision of assessments in a validation study. The pilot study was a randomized, double-blind study where patients were dosed with either 1200 mg extended-release guaifenesin (n = 188) or placebo (n = 190), every 12 hours for 7 days. Efficacy was assessed using subjective measures including the Daily Cough and Phlegm Diary, the Spontaneous Symptom Severity Assessment and the Wisconsin Upper Respiratory Symptom Survey. End-of-study assessments were completed by patients and investigator. The validation study consisted of two phases. In Phase I, subjects completed interviews to gather evidence to support the content validity of the Daily Cough and Phlegm Diary, the Spontaneous Symptom Severity Assessment and Patient's End-of-Treatment Assessment. Phase II examined the psychometric properties of assessments evaluated in Phase I of the validation study using data from the pilot study. Subjective measures of efficacy at Day 4 showed the most prominent difference between treatment groups, in favor of guaifenesin. The 8-symptom related questions (SUM8) in the Daily Cough and Phlegm Diary, analyzed as a composite score appeared to be the strongest candidate endpoint for further evaluation. Results from the interviews in Phase I supported the content of the assessments which were validated during Phase II. Treatments were well tolerated. Results from the clinical pilot and validation studies showed that the SUM8 diary scores were robust and reliable for use as efficacy endpoints in studies of mucoactive drugs. The study was registered with clinicaltrials.gov (NCT01046136).
Sánchez-Margallo, Juan A; Sánchez-Margallo, Francisco M; Oropesa, Ignacio; Enciso, Silvia; Gómez, Enrique J
2017-02-01
The aim of this study is to present the construct and concurrent validity of a motion-tracking method of laparoscopic instruments based on an optical pose tracker and determine its feasibility as an objective assessment tool of psychomotor skills during laparoscopic suturing. A group of novice ([Formula: see text] laparoscopic procedures), intermediate (11-100 laparoscopic procedures) and experienced ([Formula: see text] laparoscopic procedures) surgeons performed three intracorporeal sutures on an ex vivo porcine stomach. Motion analysis metrics were recorded using the proposed tracking method, which employs an optical pose tracker to determine the laparoscopic instruments' position. Construct validation was measured for all 10 metrics across the three groups and between pairs of groups. Concurrent validation was measured against a previously validated suturing checklist. Checklists were completed by two independent surgeons over blinded video recordings of the task. Eighteen novices, 15 intermediates and 11 experienced surgeons took part in this study. Execution time and path length travelled by the laparoscopic dissector presented construct validity. Experienced surgeons required significantly less time ([Formula: see text]), travelled less distance using both laparoscopic instruments ([Formula: see text]) and made more efficient use of the work space ([Formula: see text]) compared with novice and intermediate surgeons. Concurrent validation showed strong correlation between both the execution time and path length and the checklist score ([Formula: see text] and [Formula: see text], [Formula: see text]). The suturing performance was successfully assessed by the motion analysis method. Construct and concurrent validity of the motion-based assessment method has been demonstrated for the execution time and path length metrics. This study demonstrates the efficacy of the presented method for objective evaluation of psychomotor skills in laparoscopic suturing. However, this method does not take into account the quality of the suture. Thus, future works will focus on developing new methods combining motion analysis and qualitative outcome evaluation to provide a complete performance assessment to trainees.
2012-01-01
Background Guaifenesin is a component of medicines used to improve symptoms associated with upper respiratory tract infections. Patient-reported outcome instruments are valuable for evaluating symptom improvements; however, a validated tool to assess efficacy of mucoactive drugs does not exist. We compared the efficacy of extended-release guaifenesin with placebo for treatment of symptoms of upper respiratory tract infection using subjective efficacy assessments in a pilot study and confirmed precision of assessments in a validation study. Methods The pilot study was a randomized, double-blind study where patients were dosed with either 1200 mg extended-release guaifenesin (n = 188) or placebo (n = 190), every 12 hours for 7 days. Efficacy was assessed using subjective measures including the Daily Cough and Phlegm Diary, the Spontaneous Symptom Severity Assessment and the Wisconsin Upper Respiratory Symptom Survey. End-of-study assessments were completed by patients and investigator. The validation study consisted of two phases. In Phase I, subjects completed interviews to gather evidence to support the content validity of the Daily Cough and Phlegm Diary, the Spontaneous Symptom Severity Assessment and Patient’s End-of-Treatment Assessment. Phase II examined the psychometric properties of assessments evaluated in Phase I of the validation study using data from the pilot study. Results Subjective measures of efficacy at Day 4 showed the most prominent difference between treatment groups, in favor of guaifenesin. The 8-symptom related questions (SUM8) in the Daily Cough and Phlegm Diary, analyzed as a composite score appeared to be the strongest candidate endpoint for further evaluation. Results from the interviews in Phase I supported the content of the assessments which were validated during Phase II. Treatments were well tolerated. Conclusions Results from the clinical pilot and validation studies showed that the SUM8 diary scores were robust and reliable for use as efficacy endpoints in studies of mucoactive drugs. Trial registration The study was registered with clinicaltrials.gov (NCT01046136). PMID:23270519
Deon, Keila Cristiane; Santos, Danielle Maria de Souza Sério dos; Bullinger, Monika; Santos, Claudia Benedita dos
2011-12-01
To assess preliminary psychometric properties of the Brazilian Portuguese version of a questionnaire for measuring health-related quality of life in children and adolescents with atopic dermatitis. Cross-sectional study with a sample consisting of 52 children and adolescents aged 8 to 18 diagnosed with atopic dermatitis, and their parents or caregivers, selected at the dermatology department of a university hospital in the city of São Paulo, Southeast Brazil, in 2009. Construct validity, internal consistency and agreement between the responses of children and adolescents and their parents or caregivers were assessed in the Brazilian Portuguese version of the DISABKIDS-Atopic Dermatitis Module (ADM). Adequate internal consistency was found with Cronbach's alpha coefficients of 0.7024/0.8124 and 0.7239/0.8604. The multitrait multimethod analysis for assessing convergent validity showed measures higher than 0.30 for all items. The analysis showed good discriminant validity. Agreement between child self-report and parent proxy-report was evaluated using intra-class correlation with measures impact and social stigma of disease of 0.8173 and 0.7629, respectively. The study results showed that the DISABKIDS-ADM can be used by Brazilian researchers after its complete validation as it showed adequate preliminary psychometric properties and can be considered a valid, reliable instrument.
Rater reliability and construct validity of a mobile application for posture analysis
Szucs, Kimberly A.; Brown, Elena V. Donoso
2018-01-01
[Purpose] Measurement of posture is important for those with a clinical diagnosis as well as researchers aiming to understand the impact of faulty postures on the development of musculoskeletal disorders. A reliable, cost-effective and low tech posture measure may be beneficial for research and clinical applications. The purpose of this study was to determine rater reliability and construct validity of a posture screening mobile application in healthy young adults. [Subjects and Methods] Pictures of subjects were taken in three standing positions. Two raters independently digitized the static standing posture image twice. The app calculated posture variables, including sagittal and coronal plane translations and angulations. Intra- and inter-rater reliability were calculated using the appropriate ICC models for complete agreement. Construct validity was determined through comparison of known groups using repeated measures ANOVA. [Results] Intra-rater reliability ranged from 0.71 to 0.99. Inter-rater reliability was good to excellent for all translations. ICCs were stronger for translations versus angulations. The construct validity analysis found that the app was able to detect the change in the four variables selected. [Conclusion] The posture mobile application has demonstrated strong rater reliability and preliminary evidence of construct validity. This application may have utility in clinical and research settings. PMID:29410561
Health Service Quality Scale: Brazilian Portuguese translation, reliability and validity.
Rocha, Luiz Roberto Martins; Veiga, Daniela Francescato; e Oliveira, Paulo Rocha; Song, Elaine Horibe; Ferreira, Lydia Masako
2013-01-17
The Health Service Quality Scale is a multidimensional hierarchical scale that is based on interdisciplinary approach. This instrument was specifically created for measuring health service quality based on marketing and health care concepts. The aim of this study was to translate and culturally adapt the Health Service Quality Scale into Brazilian Portuguese and to assess the validity and reliability of the Brazilian Portuguese version of the instrument. We conducted a cross-sectional, observational study, with public health system patients in a Brazilian university hospital. Validity was assessed using Pearson's correlation coefficient to measure the strength of the association between the Brazilian Portuguese version of the instrument and the SERVQUAL scale. Internal consistency was evaluated using Cronbach's alpha coefficient; the intraclass (ICC) and Pearson's correlation coefficients were used for test-retest reliability. One hundred and sixteen consecutive postoperative patients completed the questionnaire. Pearson's correlation coefficient for validity was 0.20. Cronbach's alpha for the first and second administrations of the final version of the instrument were 0.982 and 0.986, respectively. For test-retest reliability, Pearson's correlation coefficient was 0.89 and ICC was 0.90. The culturally adapted, Brazilian Portuguese version of the Health Service Quality Scale is a valid and reliable instrument to measure health service quality.
Marsh, Herbert W; Vallerand, Robert J; Lafrenière, Marc-André K; Parker, Philip; Morin, Alexandre J S; Carbonneau, Noémie; Jowett, Sophia; Bureau, Julien S; Fernet, Claude; Guay, Frédéric; Salah Abduljabbar, Adel; Paquet, Yvan
2013-09-01
The passion scale, based on the dualistic model of passion, measures 2 distinct types of passion: Harmonious and obsessive passions are predictive of adaptive and less adaptive outcomes, respectively. In a substantive-methodological synergy, we evaluate the construct validity (factor structure, reliability, convergent and discriminant validity) of Passion Scale responses (N = 3,571). The exploratory structural equation model fit to the data was substantially better than the confirmatory factor analysis solution, and resulted in better differentiated (less correlated) factors. Results from a 13-model taxonomy of measurement invariance supported complete invariance (factor loadings, factor correlations, item uniquenesses, item intercepts, and latent means) over language (French vs. English; the instrument was originally devised in French, then translated into English) and gender. Strong measurement partial invariance over 5 passion activity groups (leisure, sport, social, work, education) indicates that the same set of items is appropriate for assessing passion across a wide variety of activities--a previously untested, implicit assumption that greatly enhances practical utility. Support was found for the convergent and discriminant validity of the harmonious and obsessive passion scales, based on a set of validity correlates: life satisfaction, rumination, conflict, time investment, activity liking and valuation, and perceiving the activity as a passion.
Yildirim, Yücel; Ergin, Gülbin
2013-01-01
Fatigue is primarily a subjective experience and self-report is the most common approach used to measure fatigue. Numerous self-report instruments have been developed to measure fatigue. Unfortunately, each of these measures was tailored for the situation in which fatigue was studied. Therefore, the aim of this study was to determine the reliability and validity of the Turkish language version of the Multidimensional Assessment of Fatigue Scale (MAF-T) in chronic musculoskeletal physical therapy patients. The MAF-T was supplied by the MAPI Research Institute, and 69 chronic musculoskeletal physical therapy patients were evaluated. To validate MAF-T, all participants completed the MAF-T and Short Form-36 (SF-36). The MAF was administered again one week later to assess test-retest reliability. Using Cronbach α, the internal consistency reliability of the MAF-T was 0.90, the Intraclass Correlation Coefficient (ICC) reliability was 0.96. Item-discriminant validity was calculated between r=0.14 and r=0.82. The correlations between the total scores of the MAF-T scale and the subscale scores of SF-36 were negative and significant (p< 0.01). The MAF-T is a valid and reliable scale for assessing fatigue in chronic musculoskeletal physical therapy patients.
Francis, Heather M; Osborne-Crowley, Katherine; McDonald, Skye
2017-01-01
To describe the reliability and validity of a new measure, the Social Skills Questionnaire for Traumatic Brain Injury (SSQ-TBI). Fifty-one adults with severe TBI completed the SSQ-TBI questionnaire. Scores were compared to informant- and self-report on questionnaires addressing frontal lobe mediated behaviour, as well as performance on an objective measure of social cognition and neuropsychological tasks, in order to provide evidence of concurrent, divergent and predictive validity. Internal consistency was excellent at α = 0.90. Convergent validity was good, with informant ratings on the SSQ-TBI significantly correlated with Neuropsychiatric Inventory Disinhibition sub-scales (r = 0.50-63), the Current Behaviour Scale (r = 0.39-0.48) and Frontal Systems Behaviour Scale (r = 0.60-0.83). However, no relationship was seen with an objective measure of social skills or neuropsychological tasks of disinhibition. There was a significant relationship with real-world psychosocial outcomes on the Sydney Psychosocial Reintegration Scale-2 (r = -0.38--0.69) Conclusions: This study provides preliminary findings of good internal consistency and convergent and predictive validity of a social skills questionnaire adapted to be appropriate for individuals with TBI. Further assessment of psychometric properties such as test-re-test reliability and factor structure is warranted.
Rater reliability and construct validity of a mobile application for posture analysis.
Szucs, Kimberly A; Brown, Elena V Donoso
2018-01-01
[Purpose] Measurement of posture is important for those with a clinical diagnosis as well as researchers aiming to understand the impact of faulty postures on the development of musculoskeletal disorders. A reliable, cost-effective and low tech posture measure may be beneficial for research and clinical applications. The purpose of this study was to determine rater reliability and construct validity of a posture screening mobile application in healthy young adults. [Subjects and Methods] Pictures of subjects were taken in three standing positions. Two raters independently digitized the static standing posture image twice. The app calculated posture variables, including sagittal and coronal plane translations and angulations. Intra- and inter-rater reliability were calculated using the appropriate ICC models for complete agreement. Construct validity was determined through comparison of known groups using repeated measures ANOVA. [Results] Intra-rater reliability ranged from 0.71 to 0.99. Inter-rater reliability was good to excellent for all translations. ICCs were stronger for translations versus angulations. The construct validity analysis found that the app was able to detect the change in the four variables selected. [Conclusion] The posture mobile application has demonstrated strong rater reliability and preliminary evidence of construct validity. This application may have utility in clinical and research settings.
Nursing Home Administrator Quality Improvement Self-Efficacy Scale.
Siegel, Elena O; Zisberg, Anna; Bakerjian, Debra; Zysberg, Leehu
Nursing home (NH) quality improvement (QI) is challenging. The critical role of NH leaders in successful QI is well established; however, current options for assessing the QI capabilities of leaders such as the licensed NH administrator are limited. This article presents the development and preliminary validation of an instrument to measure NH administrator self-efficacy in QI. We used a mixed-methods cross-sectional design to develop and test the measure. For item generation, 39 NH leaders participated in qualitative interviews. Item reduction and content validity were established with a sample of eight subject matter experts. A random sample of 211 administrators from NHs with the lowest and highest Centers for Medicare and Medicaid Services Five-Star Quality ratings completed the measure. We conducted exploratory and confirmatory factor analyses and tested the measure for internal reliability and convergent, discriminant, and known group validity. The final measure included five subscales and 32 items. Confirmatory factor analysis reaffirmed the factorial structure with good fit indices. The new measure's subscales correlated with valid measures of self-efficacy and locus of control, supporting the measure's convergent and discriminant validity. Significant differences in most of the subscales were found between the objective (Centers for Medicare and Medicaid Services Five-Star Quality rating) and subjective (Self-Rated Facility QI Index) quality outcomes, supporting the measure's known group validity. The instrument has usefulness to both NH organizations and individual NH administrators as a diagnostic tool to identify administrators with higher/lower chances of successfully implementing QI. Organizations and individuals can use this diagnostic to identify the administrator's professional development needs for QI, in general, and specific to the instrument's five subscales, informing directions for in-house training, mentoring, and outside professional development. Attending to NH administrators' QI professional development needs prior to implementing QI holds promise to enhance the chances for successful implementation of QI, which is urgently needed in many NHs.
Iverach, Lisa; Menzies, Ross; Jones, Mark; O'Brian, Sue; Packman, Ann; Onslow, Mark
2011-01-01
In an initial validation study, the Unhelpful Thoughts and Beliefs About Stuttering (UTBAS I) scale, demonstrated excellent psychometric properties as a self-report measure of the frequency of unhelpful cognitions associated with social anxiety for adults who stutter. The aim was to further validate the original UTBAS I scale, and to develop two additional scales to assess beliefs (UTBAS II) and anxiety (UTBAS III) associated with negative thoughts. A total of 140 adults seeking speech-restructuring treatment for stuttering completed the original UTBAS I scale, the newly developed UTBAS II and III scales, and self-report measures of psychological functioning. Participants also completed a first-stage screener for the presence of anxious personality disorder, and a diagnostic assessment to evaluate the presence of social phobia, according to criteria of the Diagnostic and Statistical Manual of Mental Disorders (DSM-IV) and the International Classification of Diseases (ICD-10). The mean UTBAS I score for the present sample did not differ significantly from the mean score reported in the original UTBAS I validation study. Convergent validity was confirmed by significant correlations between the UTBAS Total score and all anxiety-related measures. Discriminant validity was established by the absence of strong correlations between the UTBAS Total score and some of the self-report measures of unrelated constructs, although it was found to tap into the negative cognitions associated with depression and life problems. Approximately one-quarter of participants met criteria for a diagnosis of DSM-IV or ICD-10 social phobia (23.5% and 27.2% respectively), and nearly one-third met first-stage screening criteria for anxious personality disorder (30%). The mean UTBAS scores for participants who met criteria for these disorders were significantly higher than scores for participants who did not, confirming known-groups validity. The present study demonstrates the validity and utility of the UTBAS scales in assessing negative cognitions associated with speech-related anxiety among adults who stutter. Results also confirm previous evidence of a high rate of social phobia among adults who stutter, and reveal that the UTBAS discriminates between adults with and without social phobia. In terms of clinical applications, the UTBAS scales could be used to screen for indicators of social phobia among adults who stutter, and may prove useful in identifying negative cognitions which have the potential to impact treatment outcomes. © 2011 Royal College of Speech & Language Therapists.
Blair, Stephanie; Duthie, Grant; Robertson, Sam; Hopkins, William; Ball, Kevin
2018-05-17
Wearable inertial measurement systems (IMS) allow for three-dimensional analysis of human movements in a sport-specific setting. This study examined the concurrent validity of a IMS (Xsens MVN system) for measuring lower extremity and pelvis kinematics in comparison to a Vicon motion analysis system (MAS) during kicking. Thirty footballers from Australian football (n = 10), soccer (n = 10), rugby league and rugby union (n = 10) clubs completed 20 kicks across four conditions. Concurrent validity was assessed using a linear mixed-modelling approach, which allowed the partition of between and within-subject variance from the device measurement error. Results were expressed in raw and standardised units for assessments of differences in means and measurement error, and interpreted via non-clinical magnitude-based inferences. Trivial to small differences were found in linear velocities (foot and pelvis), angular velocities (knee, shank and thigh), sagittal joint (knee and hip) and segment angle (shank and pelvis) means (mean difference: 0.2-5.8%) between the IMS and MAS in Australian football, soccer and the rugby codes. Trivial to small measurement errors (from 0.1 to 5.8%) were found between the IMS and MAS in all kinematic parameters. The IMS demonstrated acceptable levels of concurrent validity compared to a MAS when measuring kicking biomechanics across the four football codes. Wearable IMS offers various benefits over MAS, such as, out-of-laboratory testing, larger measurement range and quick data output, to help improve the ecological validity of biomechanical testing and the timing of feedback. The results advocate the use of IMS to quantify biomechanics of high-velocity movements in sport-specific settings. Copyright © 2018 Elsevier Ltd. All rights reserved.
IsHak, Waguih W; Pan, Dana; Steiner, Alexander J; Feldman, Edward; Mann, Amy; Mirocha, James; Danovitch, Itai; Melmed, Gil Y
2017-05-01
Patients with inflammatory bowel disease (IBD) are at risk for psychiatric disorders that impact symptom experience and health-related quality of life (HRQOL). Therefore, comprehensive biopsychosocial assessments should be considered in ambulatory care settings. Patient-Reported Outcomes Measurement Information System (PROMIS) measures created by the National Institutes of Health have shown construct validity in a large IBD internet-based cohort, but their validity in ambulatory settings has not been examined. We sought to validate PROMIS patient-reported measures of HRQOL, functioning, and psychiatric symptom severity at a tertiary IBD clinic. Adult patients (n = 110) completed the PROMIS Global Health scale, PROMIS-29, SF-12, and WHODAS 2.0. Pearson's correlation coefficients (r) determined the relationships between scores to validate the PROMIS Global Health Physical and Mental metrics, compared with the SF-12 and WHODAS 2.0. We compared these measures by disease subtype of Crohn's disease or ulcerative colitis. PROMIS measures were highly correlated (r range = 0.64-0.82) with standard measures of HRQOL and functioning. On the PROMIS Global Health measures, 20.9% had impaired physical health, and 13.7% had impaired mental health. Impairments were reported in pain interference (20% of patients), anxiety (18.2%), satisfaction with social role (15.5%), physical functioning (10.9%), fatigue (10%), depression (7.3%), and sleep disturbance (5.5%). Patients with Crohn's disease had worse scores than those with ulcerative colitis on measures of the global physical health (P = 0.027), physical functioning (P = 0.047), and pain interference (P = 0.0009). PROMIS instruments provide valid assessment of HRQOL and functioning in ambulatory adults with IBD. Of note, patients with Crohn's disease demonstrated significantly worse impairments than those with ulcerative colitis.
Bertisch, Hilary; Rivara, Frederick P; Kisala, Pamela A; Wang, Jin; Yeates, Keith Owen; Durbin, Dennis; Zonfrillo, Mark R; Bell, Michael J; Temkin, Nancy; Tulsky, David S
2017-07-01
The primary objective is to provide evidence of convergent and discriminant validity for the pediatric and parent-proxy versions of the Patient-Reported Outcomes Measurement Information System (PROMIS) Anxiety, Depression, Anger, Peer Relations, Mobility, Pain Interference, and Fatigue item banks, the Neurology Quality of Life measurement system (Neuro-QOL) Cognition-General Concerns and Stigma item banks, and the Traumatic Brain Injury Quality of Life (TBI-QOL) Executive Function and Headache item banks in a pediatric traumatic brain injury (TBI) sample. Participants were 134 parent-child (ages 8-18 years) days. Children all sustained TBI and the dyads completed outcome ratings 6 months after injury at one of six medical centers across the United States. Ratings included PROMIS, Neuro-QOL, and TBI-QOL item banks, as well as the Pediatric Quality of Life inventory (PedsQL), the Health Behavior Inventory (HBI), and the Strengths and Difficulties Questionnaire (SDQ) as legacy criterion measures against which these item banks were validated. The PROMIS, Neuro-QOL, and TBI-QOL item banks demonstrated good convergent validity, as evidenced by moderate to strong correlations with comparable scales on the legacy measures. PROMIS, Neuro-QOL, and TBI-QOL item banks showed weaker correlations with ratings of unrelated constructs on legacy measures, providing evidence of discriminant validity. Our results indicate that the constructs measured by the PROMIS, Neuro-QOL, and TBI-QOL item banks are valid in our pediatric TBI sample and that it is appropriate to use these standardized scores for our primary study analyses.
Development and assessment of the Alberta Context Tool.
Estabrooks, Carole A; Squires, Janet E; Cummings, Greta G; Birdsell, Judy M; Norton, Peter G
2009-12-15
The context of healthcare organizations such as hospitals is increasingly accepted as having the potential to influence the use of new knowledge. However, the mechanisms by which the organizational context influences evidence-based practices are not well understood. Current measures of organizational context lack a theory-informed approach, lack construct clarity and generally have modest psychometric properties. This paper presents the development and initial psychometric validation of the Alberta Context Tool (ACT), an eight dimension measure of organizational context for healthcare settings. Three principles guided the development of the ACT: substantive theory, brevity, and modifiability. The Promoting Action on Research Implementation in Health Services (PARiHS) framework and related literature were used to guide selection of items in the ACT. The ACT was required to be brief enough to be tolerated in busy and resource stretched work settings and to assess concepts of organizational context that were potentially modifiable. The English version of the ACT was completed by 764 nurses (752 valid responses) working in seven Canadian pediatric care hospitals as part of its initial validation. Cronbach's alpha, exploratory factor analysis, analysis of variance, and tests of association were used to assess instrument reliability and validity. Factor analysis indicated a 13-factor solution (accounting for 59.26% of the variance in 'organizational context'). The composition of the factors was similar to those originally conceptualized. Cronbach's alpha for the 13 factors ranged from .54 to .91 with 4 factors performing below the commonly accepted alpha cut off of .70. Bivariate associations between instrumental research utilization levels (which the ACT was developed to predict) and the ACT's 13 factors were statistically significant at the 5% level for 12 of the 13 factors. Each factor also showed a trend of increasing mean score ranging from the lowest level to the highest level of instrumental research use, indicating construct validity. To date, no completely satisfactory measures of organizational context are available for use in healthcare. The ACT assesses several core domains to provide a comprehensive account of organizational context in healthcare settings. The tool's strengths are its brevity (allowing it to be completed in busy healthcare settings) and its focus on dimensions of organizational context that are modifiable. Refinements of the instrument for acute, long term care, and home care settings are ongoing.
Development and assessment of the Alberta Context Tool
2009-01-01
Background The context of healthcare organizations such as hospitals is increasingly accepted as having the potential to influence the use of new knowledge. However, the mechanisms by which the organizational context influences evidence-based practices are not well understood. Current measures of organizational context lack a theory-informed approach, lack construct clarity and generally have modest psychometric properties. This paper presents the development and initial psychometric validation of the Alberta Context Tool (ACT), an eight dimension measure of organizational context for healthcare settings. Methods Three principles guided the development of the ACT: substantive theory, brevity, and modifiability. The Promoting Action on Research Implementation in Health Services (PARiHS) framework and related literature were used to guide selection of items in the ACT. The ACT was required to be brief enough to be tolerated in busy and resource stretched work settings and to assess concepts of organizational context that were potentially modifiable. The English version of the ACT was completed by 764 nurses (752 valid responses) working in seven Canadian pediatric care hospitals as part of its initial validation. Cronbach's alpha, exploratory factor analysis, analysis of variance, and tests of association were used to assess instrument reliability and validity. Results Factor analysis indicated a 13-factor solution (accounting for 59.26% of the variance in 'organizational context'). The composition of the factors was similar to those originally conceptualized. Cronbach's alpha for the 13 factors ranged from .54 to .91 with 4 factors performing below the commonly accepted alpha cut off of .70. Bivariate associations between instrumental research utilization levels (which the ACT was developed to predict) and the ACT's 13 factors were statistically significant at the 5% level for 12 of the 13 factors. Each factor also showed a trend of increasing mean score ranging from the lowest level to the highest level of instrumental research use, indicating construct validity. Conclusions To date, no completely satisfactory measures of organizational context are available for use in healthcare. The ACT assesses several core domains to provide a comprehensive account of organizational context in healthcare settings. The tool's strengths are its brevity (allowing it to be completed in busy healthcare settings) and its focus on dimensions of organizational context that are modifiable. Refinements of the instrument for acute, long term care, and home care settings are ongoing. PMID:20003531
New graduate RN work satisfaction after completing an interactive nurse residency.
Anderson, Teresa; Linden, Lois; Allen, Marsha; Gibbs, Elizabeth
2009-04-01
The aims of this study were to measure job satisfaction and engagement perceptions of new nurses after completing interactive residency modules and to test the reliability and validity of the Halfer-Graf Job/Work Environment Nursing Satisfaction Survey. US nursing shortages are estimated to increase to 36% by 2020, requiring emphasis on hiring new graduate nurses. Improved retention of new graduates through innovative orientations such as interactive nurse residencies is one option. This mixed qualitative and quantitative study compared perceived job satisfaction and employee engagement of 90 new graduate nurses completing an interactive nurse residency. Reliability and validity of the Halfer-Graf tool were supported. Qualitative analysis yielded trends related to satisfiers (patients, patient outcomes, and teamwork) and dissatisfiers (staffing/scheduling, lack of teamwork, and physician disrespect). Simulation scenarios, debriefing, and e-mail communication with peers ranked high as beneficial teaching strategies. Study findings support previous research. An interactive learning environment was perceived as beneficial. First and second year nurse retention was consistent with previous residency programming.
Validation of virtual reality as a tool to understand and prevent child pedestrian injury.
Schwebel, David C; Gaines, Joanna; Severson, Joan
2008-07-01
In recent years, virtual reality has emerged as an innovative tool for health-related education and training. Among the many benefits of virtual reality is the opportunity for novice users to engage unsupervised in a safe environment when the real environment might be dangerous. Virtual environments are only useful for health-related research, however, if behavior in the virtual world validly matches behavior in the real world. This study was designed to test the validity of an immersive, interactive virtual pedestrian environment. A sample of 102 children and 74 adults was recruited to complete simulated road-crossings in both the virtual environment and the identical real environment. In both the child and adult samples, construct validity was demonstrated via significant correlations between behavior in the virtual and real worlds. Results also indicate construct validity through developmental differences in behavior; convergent validity by showing correlations between parent-reported child temperament and behavior in the virtual world; internal reliability of various measures of pedestrian safety in the virtual world; and face validity, as measured by users' self-reported perception of realism in the virtual world. We discuss issues of generalizability to other virtual environments, and the implications for application of virtual reality to understanding and preventing pediatric pedestrian injuries.
ERIC Educational Resources Information Center
O'Neill, Daniela K.
2007-01-01
Purpose: To demonstrate the internal reliability and discriminative validity of the Language Use Inventory for Young Children (LUI; D. K. O'Neill, 2002), a newly developed parent-report measure designed to assess pragmatic language development in 18-47-month-olds. Method: To examine internal reliability, the LUI was completed by mail by 177…
Cole, Jason C; Ito, Diane; Chen, Yaozhu J; Cheng, Rebecca; Bolognese, Jennifer; Li-McLeod, Josephine
2014-09-04
There is a lack of validated instruments to measure the level of burden of Alzheimer's disease (AD) on caregivers. The Impact of Alzheimer's Disease on Caregiver Questionnaire (IADCQ) is a 12-item instrument with a seven-day recall period that measures AD caregiver's burden across emotional, physical, social, financial, sleep, and time aspects. Primary objectives of this study were to evaluate psychometric properties of IADCQ administered on the Web and to determine most appropriate scoring algorithm. A national sample of 200 unpaid AD caregivers participated in this study by completing the Web-based version of IADCQ and Short Form-12 Health Survey Version 2 (SF-12v2™). The SF-12v2 was used to measure convergent validity of IADCQ scores and to provide an understanding of the overall health-related quality of life of sampled AD caregivers. The IADCQ survey was also completed four weeks later by a randomly selected subgroup of 50 participants to assess test-retest reliability. Confirmatory factor analysis (CFA) was implemented to test the dimensionality of the IADCQ items. Classical item-level and scale-level psychometric analyses were conducted to estimate psychometric characteristics of the instrument. Test-retest reliability was performed to evaluate the instrument's stability and consistency over time. Virtually none (2%) of the respondents had either floor or ceiling effects, indicating the IADCQ covers an ideal range of burden. A single-factor model obtained appropriate goodness of fit and provided evidence that a simple sum score of the 12 items of IADCQ can be used to measure AD caregiver's burden. Scales-level reliability was supported with a coefficient alpha of 0.93 and an intra-class correlation coefficient (for test-retest reliability) of 0.68 (95% CI: 0.50-0.80). Low-moderate negative correlations were observed between the IADCQ and scales of the SF-12v2. The study findings suggest the IADCQ has appropriate psychometric characteristics as a unidimensional, Web-based measure of AD caregiver burden and is supported by strong model fit statistics from CFA, high degree of item-level reliability, good internal consistency, moderate test-retest reliability, and moderate convergent validity. Additional validation of the IADCQ is warranted to ensure invariance between the paper-based and Web-based administration and to determine an appropriate responder definition.
Development and Initial Validation of a Rock Climbing Craving Questionnaire (RCCQ)
Roderique-Davies, Gareth; Heirene, Robert M.; Mellalieu, Stephen; Shearer, David A.
2018-01-01
Conceptual similarities have been identified between experiences of extreme sports athletes and those with drug and behavioral addictions. Evidence suggests rock climbers experience craving and other withdrawal-like states when abstinent from their sport. However, no studies have attempted to quantitatively measure the craving experienced by participants of any extreme sports. Such a measure could allow a greater understanding of the craving experienced by extreme sports athletes and a comparison of these across sports (e.g., surfing) and activities (e.g., drug-use). Therefore, using validated craving measures as a template, the aim of the two studies outlined here was to design and preliminarily validate a subjective multidimensional inventory that could be used to measure craving in the sports of rock-climbing and mountaineering (“RCCQ”). The aim of the first study was to investigate the factor structure of a preliminary measure of craving. Climbers (n = 407) completed the RCCQ. A 3-factor model explained 53.65% of the total variance in item scores. All three factors comprised five items each, which were conceptually labeled as “urge to climb” “negative reinforcement” and “positive reinforcement.” The aim of the second study was to validate the 15-item 3-factor RCCQ resulting from Study 1 using confirmatory factor analysis (CFA). Climbers (n = 254) completed the questionnaire under a climbing-related cue condition or a cue-neutral condition. CFA revealed a good model fit and that all individual parameter estimates were significant and standard errors were within reasonable limits once item 13 was removed from Factor 1. Study 1 supports the multi-dimensional nature of rock climbing craving and shows parallels with substance-related craving in reflecting intention and positive (desire) and negative (withdrawal) reinforcement. Study 2 confirms this factor structure and gives initial validation to the measure with evidence that these factors are sensitive to cue exposure. Given the preliminary nature of the data, any practical implications are tentative. However, if as shown here, craving for climbing (and potentially other extreme sports) is similar to that experienced by drug-users and addicts, there is the potential that climbing and other extreme sports could be used as a replacement therapy for drug users. PMID:29520248
Predictors of assistive technology use: the importance of personal and psychosocial factors.
Scherer, Marcia J; Sax, Caren; Vanbiervliet, Alan; Cushman, Laura A; Scherer, John V
2005-11-15
To validate an assistive technology (AT) baseline and outcomes measure and to quantify the measure's value in determining the best match of consumer and AT considering consumer ratings of their subjective quality of life, mood, support from others, motivation for AT use, program/therapist reliance, and self-determination/self-esteem. Prospective multi-cohort study. Vocational rehabilitation offices and community. Over 150 vocational rehabilitation counselors in 25 U.S. states with one consumer each receiving new AT. Counselor training in the Matching Person and Technology (MPT) Model and consumer completion of the MPT measure, Assistive Technology Device Predisposition Assessment (ATD PA). Total and subscale scores on the ATD PA as well as counselor-completed questionnaires. ATD PA items differentiated consumer predispositions to AT use as well as AT and user match. There were no significant differences due to gender, physical locality, or age within this sample of working-age adult consumers. Vocational rehabilitation counselors exposed to training in the MPT Model achieved enhanced AT service delivery outcomes. The ATD PA is a valid measure of predisposition to use an AT and the subsequent match of AT and user. Rehabilitation practitioners who use the ATD PA will achieve evidence-based practice and can expect to see enhanced AT service delivery outcomes.
Severity of anxiety and work-related outcomes of patients with anxiety disorders.
Erickson, Steven R; Guthrie, Sally; Vanetten-Lee, Michelle; Himle, Joseph; Hoffman, Jody; Santos, Susana F; Janeck, Amy S; Zivin, Kara; Abelson, James L
2009-01-01
This study examined associations between anxiety and work-related outcomes in an anxiety disorders clinic population, examining both pretreatment links and the impact of anxiety change over 12 weeks of treatment on work outcomes. Four validated instruments were used to also allow examination of their psychometric properties, with the goal of improving measurement of work-related quality of life in this population. Newly enrolled adult patients seeking treatment in a university-based anxiety clinic were administered four work performance measures: Work Limitations Questionnaire (WLQ), Work Productivity and Activity Impairment Questionnaire (WPAI), Endicott Work Productivity Scale (EWPS), and Functional Status Questionnaire Work Performance Scale (WPS). Anxiety severity was determined using the Beck Anxiety Inventory (BAI). The Clinical Global Impressions, Global Improvement Scale (CGI-I) was completed by patients to evaluate symptom change at a 12-week follow-up. Two severity groups (minimal/mild vs. moderate/severe, based on baseline BAI score) were compared to each other on work measures. Eighty-one patients provided complete baseline data. Anxiety severity groups did not differ in job type, time on job, job satisfaction, or job choice. Patients with greater anxiety generally showed lower work performance on all instruments. Job advancement was impaired for the moderate/severe group. The multi-item performance scales demonstrated better validity and internal consistency. The WLQ and the WPAI detected change with symptom improvement. Level of work performance was generally associated with severity of anxiety. Of the instruments tested, the WLQ and the WPAI questionnaire demonstrated acceptable validity and internal reliability.
Development and preliminary validation of the young adult alcohol consequences questionnaire.
Read, Jennifer P; Kahler, Christopher W; Strong, David R; Colder, Craig R
2006-01-01
A substantial proportion of U.S. college students drink alcoholic beverages and report significant deleterious effects. The present study describes the development and initial validation of a measure designed to capture a broad range of alcohol-related consequences experienced by male and female college students. College students (N=340, 176 women) completed a self-report questionnaire battery consisting of information about demographic characteristics, drinking behaviors, and drinking consequences. Drinking consequences were assessed with a composite measure based on the Drinker Inventory of Consequences, the Young Adult Alcohol Problem Screening Test (YAAPST) and items developed by the researchers. To assess concurrent validity, a subset of the total sample (n=126) also completed the Rutgers Alcohol Problem Index (RAPI). Confirmatory factor analyses supported an eight-factor solution (Social-Interpersonal Consequences, Impaired Control, Self-Perception, Self-Care, Risk Behaviors, Academic/Occupational Consequences, Physical Dependence, and Blackout Drinking), with all factors loading on a single, higher-order factor. YAACQ total scores correlated with alcohol quantity and frequency, and the RAPI. Gender comparisons suggest that the YAACQ assesses constructs of interest equally well for women and men. These results offer preliminary support for this measure. Research and clinical applications include the potential to predict future problems by specific type of consequence and to offer detailed feedback about drinking consequences to students as part of a preventive intervention. As such, the YAACQ may serve as an aid in both the description of and intervention for heavy drinking in college.
Validity evidence for the situational judgment test paradigm in emotional intelligence measurement.
Libbrecht, Nele; Lievens, Filip
2012-01-01
To date, various measurement approaches have been proposed to assess emotional intelligence (EI). Recently, two new EI tests have been developed based on the situational judgment test (SJT) paradigm: the Situational Test of Emotional Understanding (STEU) and the Situational Test of Emotion Management (STEM). Initial attempts have been made to examine the construct-related validity of these new tests; we extend these findings by placing the tests in a broad nomological network. To this end, 850 undergraduate students completed a personality inventory, a cognitive ability test, a self-report EI test, a performance-based EI measure, the STEU, and the STEM. The SJT-based EI tests were not strongly correlated with personality and fluid cognitive ability. Regarding their relation with existing EI measures, the tests did not capture the same construct as self-report EI measures, but corresponded rather to performance-based EI measures. Overall, these results lend support for the SJT paradigm for measuring EI as an ability.
Calibration of NMR well logs from carbonate reservoirs with laboratory NMR measurements and μXRCT
Mason, Harris E.; Smith, Megan M.; Hao, Yue; ...
2014-12-31
The use of nuclear magnetic resonance (NMR) well log data has the potential to provide in-situ porosity, pore size distributions, and permeability of target carbonate CO₂ storage reservoirs. However, these methods which have been successfully applied to sandstones have yet to be completely validated for carbonate reservoirs. Here, we have taken an approach to validate NMR measurements of carbonate rock cores with independent measurements of permeability and pore surface area to volume (S/V) distributions using differential pressure measurements and micro X-ray computed tomography (μXRCT) imaging methods, respectively. We observe that using standard methods for determining permeability from NMR data incorrectlymore » predicts these values by orders of magnitude. However, we do observe promise that NMR measurements provide reasonable estimates of pore S/V distributions, and with further independent measurements of the carbonate rock properties that universally applicable relationships between NMR measured properties may be developed for in-situ well logging applications of carbonate reservoirs.« less
Calibration of NMR well logs from carbonate reservoirs with laboratory NMR measurements and μXRCT
DOE Office of Scientific and Technical Information (OSTI.GOV)
Mason, Harris E.; Smith, Megan M.; Hao, Yue
The use of nuclear magnetic resonance (NMR) well log data has the potential to provide in-situ porosity, pore size distributions, and permeability of target carbonate CO₂ storage reservoirs. However, these methods which have been successfully applied to sandstones have yet to be completely validated for carbonate reservoirs. Here, we have taken an approach to validate NMR measurements of carbonate rock cores with independent measurements of permeability and pore surface area to volume (S/V) distributions using differential pressure measurements and micro X-ray computed tomography (μXRCT) imaging methods, respectively. We observe that using standard methods for determining permeability from NMR data incorrectlymore » predicts these values by orders of magnitude. However, we do observe promise that NMR measurements provide reasonable estimates of pore S/V distributions, and with further independent measurements of the carbonate rock properties that universally applicable relationships between NMR measured properties may be developed for in-situ well logging applications of carbonate reservoirs.« less
Life Participation for Parents: a tool for family-centered occupational therapy.
Fingerhut, Patricia E
2013-01-01
This study describes the continued development of the Life Participation for Parents (LPP), a measurement tool to facilitate family-centered pediatric practice. LPP questionnaires were completed by 162 parents of children with special needs receiving intervention at 15 pediatric private practice clinics. Results were analyzed to establish instrument reliability and validity. Good internal consistency (α = .90) and test-retest reliability (r = .89) were established. Construct validity was examined through assessment of internal structure and comparison of the instrument to related variables. A principal components analysis resulted in a two-factor model accounting for 43.81% of the variance. As hypothesized, the LPP correlated only moderately with the Parenting Stress Index-Short Form (r = .54). The variables of child's diagnoses, age, and time in therapy did not predict parental responses. The LPP is a reliable and valid instrument for measuring satisfaction with parental participation in life occupations. Copyright © 2013 by the American Occupational Therapy Association, Inc.
Barbe, Tammy
2015-01-01
The purpose of this study was to examine psychometric properties of the Perceived Value of Certification Tool© with a focus on nurse educator certification (PVCT-NE) in a sample of nurse educators. Greater understanding of faculty perceptions of certification is necessary to facilitate a strong cadre of nursing faculty; however, research around nurse educator certification is limited by a lack of reliable and valid instruments to measure such perceptions. Twenty-four nursing faculty from one university participated in the psychometric study, which involved completion of the PVCT-NE in a web-based survey format. Internal consistency reliability was excellent. Cronbach's alpha for the total PVCT-NE was .94 (.93 for the intrinsic subscale and .86 for the extrinsic subscale). A content validity index of .95 was obtained. There is preliminary evidence that the PVCT-NE is a reliable and valid instrument to measure perceived value of certification in nurse educators.
Hinton, Pamela S; Kubas, Karen L
2005-01-01
Female athletes may be at greater risk for disordered eating than their nonathletic peers, but the psychological antecedents of this dysfunctional behavior in athletes have yet to be elucidated. The objective of this study was to develop an athletics-oriented measure of psychological predictors of disordered eating and to test its initial reliability and validity. Female athletes from 3 National Collegiate Athletics Association (NCAA) Division I universities completed the ATHLETE, a written questionnaire designed to assess psychosocial factors associated with disordered eating in athletes. Five distinct and internally consistent factors (Drive for Thinness and Performance, Social Pressure on Eating, Performance Perfectionism, Social Pressure on Body Shape, and Team Trust) were positively associated with and predictive of disordered eating behaviors in female athletes. The ATHLETE is a reliable and valid measure of psychological predictors of disordered eating in athletics and will be useful in studying the etiology of disordered eating in female athletes.
Kneebone, Ian I.; Dewar, Sophie J.
2016-01-01
Background: The current study aimed to examine the psychometric properties of an attributional style measure that can be administered remotely, to people who have multiple sclerosis (MS). Methods: A total of 495 participants with MS were recruited. Participants completed the Attributional Style Questionnaire-Survey (ASQ-S) and two comparison measures of cognitive variables via postal survey on three occasions, each 12 months apart. Internal reliability, test-retest reliability and congruent validity were considered. Results: The internal reliability of the ASQ-S was good (α > 0.7). The test-retest correlations were significant, but failed to reach the 0.7 set. The congruent validity of the ASQ-S was established relative to the comparisons. Conclusions: The psychometric properties of the ASQ-S indicate that it shows promise as a tool for researchers investigating depression in people with MS and is likely sound to use clinically in this population. PMID:28450893
Measuring Empathy in Pharmacy Students
Van Winkle, Lon J.; Hojat, Mohammadreza
2011-01-01
Objective. To validate the Jefferson Scale of Empathy-Health Profession Students version (JSE-HPS) in pharmacy students. Methods. The JSE-HPS (20 items), adapted from the original Jefferson Scale of Empathy for use among students in the healthcare professions, was completed by 187 first-year pharmacy students at Midwestern University Chicago College of Pharmacy. Results. Two factors, “perspective-taking” and “compassionate care,” emerged from factor analysis in this study, accounting for 31% and 8% of the variance, respectively. These factors are similar to the prominent ones reported in previous research involving physicians and medical students, supporting the construct validity of this instrument for pharmacy students. In the current study, mean JSE-HPS score was comparable to those reported for medical students, and consistent with previous findings with medical students and physicians. Women scored significantly higher than men. Conclusions. Findings support the construct validity and reliability of the JSE-HPS for measuring empathy in pharmacy students. PMID:21931447
Validation of a measure of the Satter eating competence model with low-income females
2011-01-01
Background The purpose of this study was to evaluate the construct validity of a version of the ecSatter Inventory (ecSI), a measure of eating competence (EC), as adapted for use in a low-income (LI) population. Methods Females (n = 507), aged 18 to 45 years, living in households with a history of participating in the Supplemental Nutrition Assistance Program completed a web-based survey that included the ecSI for LI (ecSI/LI) and valid measures of cognitive and affective eating behavior, food preference and practice, and food preparation. Results Most correlations and differences between eating competent and non-eating competent categories and among EC tertiles were compatible with hypothesized relationships. ecSI/LI scores were positively related with self-reported physical activity, food acceptance, fruit and vegetable intake, and food planning/resource management. ecSI/LI scores were negatively associated with body mass index, dissatisfaction with body weight, tendency to overeat in response to external or emotional stimuli, and indices of psychosocial attributes related to disordered eating. Conclusions The ecSI/LI is a valid measure of EC for low-income females and provides a tool for researchers and educators to assess intervention outcomes and further explore the EC construct. PMID:21473765
McEvoy, Peter M; Burgess, Melissa M; Page, Andrew C; Nathan, Paula; Fursland, Anthea
2013-06-01
Integrative models of psychopathology suggest that quality of interpersonal relationships is a key determinant of psychological well-being. However, there is a relative paucity of research evaluating the association between interpersonal problems and psychopathology within cognitive behavioural therapy. Partly, this may be due to lack of brief, well-validated, and easily interpretable measures of interpersonal problems that can be used within clinical settings. The aim of the present study was to evaluate the psychometric properties, factor invariance, and external validity of the Inventory of Interpersonal Problems 32 (IIP-32) across anxiety, depression, and eating disorders. Two treatment-seeking samples with principal anxiety and depressive disorders (AD sample, n = 504) and eating disorders (ED sample, n = 339) completed the IIP-32 along with measures of anxiety, depression, and eating disorder symptoms, as well as quality of life (QoL). The previously established eight-factor structure of the IIP-32 provided the best fit for both the AD and ED groups, and was robustly invariant across the two samples. The IIP-32 also demonstrated excellent external validity against well-validated measures of anxiety, depression, and eating disorder symptoms, as well as QoL. The IIP-32 provides a clinically useful measure of interpersonal problems across emotional and ED. © Commonwealth of Australia 2012.
Ciucci, Enrica; Baroncelli, Andrea; Grazzani, Ilaria; Ornaghi, Veronica; Caprin, Claudia
2016-03-01
The ability to understand and manage emotional experience is critical to children's health. This study confirmed the validity of the How I Feel (HIF) Questionnaire, a measure of children's emotional arousal and regulation, exploring its associations with measures of emotional and social functioning. The sample was comprised of 1379 Italian students (aged 8 to 12 years) who attended schools interested in the study aims. Participants completed the 30-item HIF scale, and measures of emotional self-efficacy and social desirability (SD). Factor structures were assessed using confirmatory factor analysis. Invariance by age and gender, internal consistency, temporal stability, and concurrent validity were also tested. A 3-factor model was identified: frequency and intensity of (1) positive emotion--PE (8 items, α = .82), (2) negative emotion--NE (12 items, α = .86), and (3) positive and negative emotion control--EC (10 items, α = .77). This factor structure was invariant across age and gender groups. The HIF displayed moderate longitudinal stability over a 15-month period and a low social desirability effect. Positive emotion was positively associated with social acceptance and visibility, and negatively with social withdrawal. The HIF is a reliable and valid measure for research and school intervention promoting students' emotional and mental health. © 2016, American School Health Association.
Validation of a measure of the Satter eating competence model with low-income females.
Krall, Jodi S; Lohse, Barbara
2011-04-07
The purpose of this study was to evaluate the construct validity of a version of the ecSatter Inventory (ecSI), a measure of eating competence (EC), as adapted for use in a low-income (LI) population. Females (n=507), aged 18 to 45 years, living in households with a history of participating in the Supplemental Nutrition Assistance Program completed a web-based survey that included the ecSI for LI (ecSI/LI) and valid measures of cognitive and affective eating behavior, food preference and practice, and food preparation. Most correlations and differences between eating competent and non-eating competent categories and among EC tertiles were compatible with hypothesized relationships. ecSI/LI scores were positively related with self-reported physical activity, food acceptance, fruit and vegetable intake, and food planning/resource management. ecSI/LI scores were negatively associated with body mass index, dissatisfaction with body weight, tendency to overeat in response to external or emotional stimuli, and indices of psychosocial attributes related to disordered eating. The ecSI/LI is a valid measure of EC for low-income females and provides a tool for researchers and educators to assess intervention outcomes and further explore the EC construct. © 2011 Krall and Lohse; licensee BioMed Central Ltd.
Hogg, Melissa E; Tam, Vernissia; Zenati, Mazen; Novak, Stephanie; Miller, Jennifer; Zureikat, Amer H; Zeh, Herbert J
Hepatobiliary surgery is a highly complex, low-volume specialty with long learning curves necessary to achieve optimal outcomes. This creates significant challenges in both training and measuring surgical proficiency. We hypothesize that a virtual reality curriculum with mastery-based simulation is a valid tool to train fellows toward operative proficiency. This study evaluates the content and predictive validity of robotic simulation curriculum as a first step toward developing a comprehensive, proficiency-based pathway. A mastery-based simulation curriculum was performed in a virtual reality environment. A pretest/posttest experimental design used both virtual reality and inanimate environments to evaluate improvement. Participants self-reported previous robotic experience and assessed the curriculum by rating modules based on difficulty and utility. This study was conducted at the University of Pittsburgh Medical Center (Pittsburgh, PA), a tertiary care academic teaching hospital. A total of 17 surgical oncology fellows enrolled in the curriculum, 16 (94%) completed. Of 16 fellows who completed the curriculum, 4 fellows (25%) achieved mastery on all 24 modules; on average, fellows mastered 86% of the modules. Following curriculum completion, individual test scores improved (p < 0.0001). An average of 2.4 attempts was necessary to master each module (range: 1-17). Median time spent completing the curriculum was 4.2 hours (range: 1.1-6.6). Total 8 (50%) fellows continued practicing modules beyond mastery. Survey results show that "needle driving" and "endowrist 2" modules were perceived as most difficult although "needle driving" modules were most useful. Overall, 15 (94%) fellows perceived improvement in robotic skills after completing the curriculum. In a cohort of board-certified general surgeons who are novices in robotic surgery, a mastery-based simulation curriculum demonstrated internal validity with overall score improvement. Time to complete the curriculum was manageable. Published by Elsevier Inc.
Abma, Femke I; van der Klink, Jac J L; Bültmann, Ute
2013-03-01
The promotion of a sustainable, healthy and productive working life attracts more and more attention. Recently the Work Role Functioning Questionnaire (WRFQ) has been cross-culturally translated and adapted to Dutch. This questionnaire aims to measure the health-related work functioning of workers with health problems. The aim of this study is to evaluate the reliability, validity (including five new items) and responsiveness of the WRFQ 2.0 in the working population. A longitudinal study was conducted among workers. The reliability (internal consistency, test-retest reliability, measurement error), validity (structural validity-factor analysis, construct validity by means of hypotheses testing) and responsiveness of the WRFQ 2.0 were evaluated. A total of N = 553 workers completed the survey. The final WRFQ 2.0 has four subscales and showed very good internal consistency, moderate test-retest reliability, good construct validity and moderate responsiveness in the working population. The WRFQ was able to distinguish between groups with different levels of mental health, physical health, fatigue and need for recovery. A moderate correlation was found between WRFQ and related constructs respectively work ability and work productivity. A weak relationship was found with general self-rated health, work engagement and work involvement. The WRFQ 2.0 is a reliable and valid instrument to measure health-related work functioning in the working population. Further validation in larger samples is recommended, especially for test-retest reliability, responsiveness and the questionnaire's ability to predict the future course of health-related work functioning.
Development and validation of the Body and Appearance Self-Conscious Emotions Scale (BASES).
Castonguay, Andrée L; Sabiston, Catherine M; Crocker, Peter R E; Mack, Diane E
2014-03-01
The purpose of these studies was to develop a psychometrically sound measure of shame, guilt, authentic pride, and hubristic pride for use in body and appearance contexts. In Study 1, 41 potential items were developed and assessed for item quality and comprehension. In Study 2, a panel of experts (N=8; M=11, SD=6.5 years of experience) reviewed the scale and items for evidence of content validity. Participants in Study 3 (n=135 males, n=300 females) completed the BASES and various body image, personality, and emotion scales. A separate sample (n=155; 35.5% male) in Study 3 completed the BASES twice using a two-week time interval. The BASES subscale scores demonstrated evidence for internal consistency, item-total correlations, concurrent, convergent, incremental, and discriminant validity, and 2-week test-retest reliability. The 4-factor solution was a good fit in confirmatory factor analysis, reflecting body-related shame, guilt, authentic and hubristic pride subscales of the BASES. The development and validation of the BASES may help advance body image and self-conscious emotion research by providing a foundation to examine the unique antecedents and outcomes of these specific emotional experiences. Copyright © 2014 Elsevier Ltd. All rights reserved.
Zimmerman, Mark; Chelminski, Iwona; Young, Diane; Dalrymple, Kristy; Martinez, Jennifer H
2014-10-01
To acknowledge the clinical significance of manic features in depressed patients, DSM-5 included criteria for a mixed features specifier for major depressive disorder (MDD). In the present report from the Rhode Island Methods to Improve Diagnostic Assessment and Services (MIDAS) project we modified our previously published depression scale to include a subscale assessing the DSM-5 mixed features specifier. More than 1100 psychiatric outpatients with MDD or bipolar disorder completed the Clinically Useful Depression Outcome Scale (CUDOS) supplemented with questions for the DSM-5 mixed features specifier (CUDOS-M). To examine discriminant and convergent validity the patients were rated on clinician severity indices of depression, anxiety, agitation, and irritability. Discriminant and convergent validity was further examined in a subset of patients who completed other self-report symptom severity scales. Test-retest reliability was examined in a subset who completed the CUDOS-M twice. We compared CUDOS-M scores in patients with MDD, bipolar depression, and hypomania. The CUDOS-M subscale had high internal consistency and test-retest reliability, was more highly correlated with another self-report measure of mania than with measures of depression, anxiety, substance use problems, eating disorders, and anger, and was more highly correlated with clinician severity ratings of agitation and irritability than anxiety and depression. CUDOS-M scores were significantly higher in hypomanic patients than depressed patients, and patients with bipolar depression than patients with MDD. The study was cross-sectional, thus we did not examine whether the CUDOS-M detects emerging mixed symptoms when depressed patients are followed over time. Also, while we examined the correlation between the CUDOS-M and clinician ratings of agitation and irritability, we did not examine the association with a clinician measure of manic symptomatology such as the Young Mania Rating Scale In the present study of a large sample of psychiatric outpatients, the CUDOS-M was a reliable and valid measure of the DSM-5 mixed features specifier for MDD. Copyright © 2014 Elsevier B.V. All rights reserved.
Hanish, Alyson E; Lin-Dyken, Deborah C; Han, Joan C
The National Institutes of Health Patient-Reported Outcomes Measurement Information System (PROMIS) has self-reported health measures available for both pediatric and adult populations, but no pediatric measures are available currently in the sleep domains. The purpose of this observational study was to perform preliminary validation studies on age-appropriate, self-reported sleep measures in healthy adolescents. This study examined 25 healthy adolescents' self-reported daytime sleepiness, sleep disturbance, sleep-related impairment, and sleep patterns. Healthy adolescents completed a physical exam at the National Institutes of Health Clinical Center (Bethesda, MD), had no chronic medical conditions, and were not taking any chronic medications. The Cleveland Adolescent Sleepiness Questionnaire (CASQ), PROMIS Sleep Disturbance (v. 1.0; 8a), and PROMIS Sleep-Related Impairment (v. 1.0; 8b) questionnaires were completed, and sleep patterns were assessed using actigraphy. Total scores on the three sleep questionnaires were correlated (all Spearman's r > .70, p < .001). Total sleep time determined by actigraphy was negatively correlated with the CASQ (p = .01), PROMIS Sleep Disturbance (p = .02), and PROMIS Sleep-Related Impairment (p = .02). The field of pediatric sleep is rapidly expanding, and researchers and clinicians will benefit from well-designed, psychometrically sound sleep questionnaires. Findings suggest the potential research and clinical utility of adult versions of PROMIS sleep measures in adolescents. Future studies should include larger, more diverse samples and explore additional psychometric properties of PROMIS sleep measures to provide age-appropriate, validated, and reliable measures of sleep in adolescents.
DOE Office of Scientific and Technical Information (OSTI.GOV)
Titt, U; Suzuki, K
Purpose: The PTCH is preparing the ocular proton beam nozzle for clinical use. Currently commissioning measurements are being performed using films, diodes and ionization chambers. In parallel, a Monte Carlo model of the beam line was created for integration into the automated Monte Carlo treatment plan computation system, MC{sup 2}. This work aims to compare Monte Carlo predictions to measured proton doses in order to validate the Monte Carlo model. Methods: A complete model of the double scattering ocular beam line has been created and is capable of simulating proton beams with a comprehensive set of beam modifying devices, includingmore » eleven different range modulator wheels. Simulations of doses in water were scored and compare to ion chamber measurements of depth doses, lateral dose profiles extracted from half beam block exposures of films, and diode measurements of lateral penumbrae at various depths. Results: All comparison resulted in an average relative entrance dose difference of less than 3% and peak dose difference of less than 2%. All range differences were smaller than 0.2 mm. The differences in the lateral beam profiles were smaller than 0.2 mm, and the differences in the penumbrae were all smaller than 0.4%. Conclusion: All available data shows excellent agreement of simulations and measurements. More measurements will have to be performed in order to completely and systematically validate the model. Besides simulating and measuring PDDs and lateral profiles of all remaining range modulator wheels, the absolute dosimetry factors in terms of number of source protons per monitor unit have to be determined.« less
Greenfield, Thomas K.; Nayak, Madhabika B.; Bond, Jason; Patel, Vikram; Trocki, Karen; Pillai, Aravind
2010-01-01
Assessment of heavy drinking patterns is vital for HIV/AIDs studies in India and developing countries. A population survey in northern Goa included urban and rural male drinkers (n = 743) who completed a new Fractional Graduated Frequencies (F-GF) alcohol patterns measure assessing 7 beverage types and drink sizes for the largest daily amount, then drinking frequencies at fractional amounts. The new measure was compared to a simpler quantity-frequency (QF) summary and in a validity subsample of hazardous drinkers (n=56), 28-day diaries of drinking events. Approximately 56% of total volume came from peak drinking (averaging 60 g ethanol/day). For AUDIT-based Hazardous Drinkers, QF and F-GF volumes (drinks/day) were not significantly different from diary volume (correlations .65 and .57, respectively). F-GF well captured the profile of daily amounts in drinking event data. In addition, the F-GF showed evidence of better predicting any sexual risk behavior or partner violence perpetration than the QF measure. Summary drinking pattern measures, especially the new F-GF, are more cost efficient than intensive event records, and appear valid when carefully assessing quantities with local beverage types and drink ethanol content. PMID:20567894
The Compensatory ADHD Behaviors Scale (CABS): Development and Initial Validation.
Castagna, Peter J; Roye, Scott; Calamia, Matthew
2018-05-01
Several measures are available that assess inattention, hyperactivity/impulsivity, and executive functioning deficits. Treatments for adults with attention-deficit/hyperactivity disorder (ADHD) and skill-based academic interventions focus on improving compensatory strategies to ameliorate functional impairment; however, no measure exists that examines the compensatory behaviors adults utilize to compensate for the functional deficits associated with inattention and hyperactivity/impulsivity. The current study aimed to determine the psychometric properties of the Compensatory ADHD Behaviors Scale (CABS). Five-hundred participants ( M age = 36.83, SD = 11.57) completed measures of ADHD symptomatology, executive functioning, functional impairment, mood disorder symptoms, and the CABS. Analyses revealed that scales assessing both use and effectiveness of compensatory behaviors subscales had similar factor structures, reflecting present- and future-oriented behaviors. The present-, but not future-oriented, behaviors significantly related to ADHD symptomatology, executive dysfunction, and functional impairment; effectiveness of present-oriented compensatory behaviors demonstrated incremental validity in predicting impairment. Compensatory strategies may be a useful variable to measure when examining functional impairment associated with inattention and hyperactivity/impulsivity. The current study provides preliminary evidence of the ability of CABS to validly measure various strategies associated with (clinical and subclinical) ADHD symptomatology, executive functioning, and overall impairment.
Validation of the three web quality dimensions of a minimally invasive surgery e-learning platform.
Ortega-Morán, Juan Francisco; Pagador, J Blas; Sánchez-Peralta, Luisa Fernanda; Sánchez-González, Patricia; Noguera, José; Burgos, Daniel; Gómez, Enrique J; Sánchez-Margallo, Francisco M
2017-11-01
E-learning web environments, including the new TELMA platform, are increasingly being used to provide cognitive training in minimally invasive surgery (MIS) to surgeons. A complete validation of this MIS e-learning platform has been performed to determine whether it complies with the three web quality dimensions: usability, content and functionality. 21 Surgeons participated in the validation trials. They performed a set of tasks in the TELMA platform, where an e-MIS validity approach was followed. Subjective (questionnaires and checklists) and objective (web analytics) metrics were analysed to achieve the complete validation of usability, content and functionality. The TELMA platform allowed access to didactic content with easy and intuitive navigation. Surgeons performed all tasks with a close-to-ideal number of clicks and amount of time. They considered the design of the website to be consistent (95.24%), organised (90.48%) and attractive (85.71%). Moreover, they gave the content a high score (4.06 out of 5) and considered it adequate for teaching purposes. The surgeons scored the professional language and content (4.35), logo (4.24) and recommendations (4.20) the highest. Regarding functionality, the TELMA platform received an acceptance of 95.24% for navigation and 90.48% for interactivity. According to the study, it seems that TELMA had an attractive design, innovative content and interactive navigation, which are three key features of an e-learning platform. TELMA successfully met the three criteria necessary for consideration as a website of quality by achieving more than 70% of agreements regarding all usability, content and functionality items validated; this constitutes a preliminary requirement for an effective e-learning platform. However, the content completeness, authoring tool and registration process required improvement. Finally, the e-MIS validity methodology used to measure the three dimensions of web quality in this work can be applied to other clinical areas or training fields. Copyright © 2017 Elsevier B.V. All rights reserved.
Modification and Evaluation of a Velopharyngeal Insufficiency Quality of Life Instrument
Skirko, Jonathan R.; Weaver, Edward M; Perkins, Jonathan; Kinter, Sara; Sie, Kathleen C.Y.
2018-01-01
Objective Modify the existing 45-item velopharyngeal insufficiency (VPI) quality of life (QOL) instrument (VPIQL), assess the modified instrument for reliability and provide further validation. There are patient and parent versions of the instrument. Design Validation convenience sample from a previously conducted pilot study. Setting Two academic tertiary referral medical centers. Participants De-identified data were used from 29 subjects with VPI and 29 control subjects age 5–17 years, and parents. Outcome measures Subjects and parents completed VPIQL and a generic pediatric QOL instrument (PedsQL4-0). Data Analysis Twenty-two items were removed from the VPIQL for ceiling effects, floor effects, and redundancy, to produce the modified instrument, VPI Effects on Life Outcomes (VELO) instrument. VELO was tested for internal consistency (Chronbach’s alpha), discriminant validity (paired t-test with control subjects), and concurrent validity (Pearson correlation with the PedsQL4-0). These analyses were also completed for parents. Results The 45-item VPIQL instrument was reduced to the 23-item VELO instrument. The VELO had excellent internal consistency (Chronbach’s alpha 0.96 for parents and 0.95 for VPI subjects). The VELO discriminated well between VPI and control subjects, with mean score (SD) was significantly lower (worse) for VPI subjects (67.6 [23.9]) than for control subjects (97.0 [5.2]) (p<0.0001). The VELO total score was significantly correlated with the PedsQL4.0 (r=0.73) among subjects with VPI. Similar results were seen in parent responses. Conclusions The VELO is a 23-item QOL instrument that was designed to measure and follow QOL in subjects with VPI, with less burden than the original VPIQL. VELO demonstrates internal consistency, disciminant validty, and concurrent validity with the PedsQL4-0. PMID:23069823
Mohamed, Rachid; Raman, Maitreyi; Anderson, John; McLaughlin, Kevin; Rostom, Alaa; Coderre, Sylvain
2014-01-01
BACKGROUND: Although workplace workload assessments exist in different fields, an endoscopy-specific workload assessment tool is lacking. OBJECTIVE: To validate such a workload tool and use it to map the progression of novice trainees in gastroenterology in performing their first endoscopies. METHODS: The National Aeronautics and Space Administration Task Load Index (NASA-TLX) workload assessment tool was completed by eight novice trainees in gastroenterology and 10 practicing gastroenterologists/surgeons. An exploratory factor analysis was performed to construct a streamlined endoscopy-specific task load index, which was subsequently validated. The ‘Endoscopy Task Load Index’ was used to monitor progression of trainee exertion and self-assessed performance over their first 40 procedures. RESULTS: From the factor analysis of the NASA-TLX, two principal components emerged: a measure of exertion and a measure of self-efficacy. These items became the components of the newly validated Endoscopy Task Load Index. There was a steady decline in self-perceived exertion over the training period, which was more rapid for gastroscopy than colonoscopy. The self-efficacy scores for gastroscopy rapidly increased over the first few procedures, reaching a plateau after this period of time. For colonoscopy, there was a progressive increase in reported self-efficacy over the first three quartiles of procedures, followed by a drop in self-efficacy scores over the final quartile. DISCUSSION: The present study validated an Endoscopy Task Load Index that can be completed in <1 min. Practical implications of such a tool in endoscopy education include identifying periods of higher perceived exertion among novice endoscopists, facilitating appropriate levels of guidance from trainers. PMID:24619638
Boyle, Michael P
2015-03-01
This study was set up to further establish the construct validity of the Self-Stigma of Stuttering Scale (4S) by demonstrating its associations with other established scales and replicating its original factor structure and reliability estimates. Web surveys were completed by 354 adults who stutter recruited from Board Certified Specialists in Fluency Disorders, and adult chapters of the National Stuttering Association. Participants completed a series of psychometrically validated scales measuring self-stigma, hope, empowerment, quality of life, social support, anxiety, depression, and self-rated speech disruption. Higher subscale and total stigma scores on the 4S were associated with significantly lower levels of hope, empowerment, quality of life, and social support, and significantly higher levels of anxiety, depression, and self-rated speech disruption. The original factor structure of the 4S was replicated, and reliability estimates of the subscales ranged from adequate to excellent. The findings of this study support the construct validity of the 4S and its use by clinicians and researchers intending to measure the construct of self-stigma in adults who stutter. Readers should be able to: (a) distinguish between the various components of self-stigma; (b) describe how the various components of the self-stigma model relate to hope, empowerment, quality of life, and social support, self-rated speech disruption, anxiety, and depression; (c) summarize the psychometric properties of the Self-Stigma of Stuttering Scale (4S) in terms of reliability, factor structure, and construct validity; (d) discuss how the 4S could be used in research and clinical practice. Copyright © 2015 Elsevier Inc. All rights reserved.
Validation of a new mixing chamber system for breath-by-breath indirect calorimetry.
Kim, Do-Yeon; Robergs, Robert Andrew
2012-02-01
Limited validation research exists for applications of breath-by-breath systems of expired gas analysis indirect calorimetry (EGAIC) during exercise. We developed improved hardware and software for breath-by-breath indirect calorimetry (NEW) and validated this system as well as a commercial system (COM) against 2 methods: (i) mechanical ventilation with known calibration gas, and (ii) human subjects testing for 5 min each at rest and cycle ergometer exercise at 100 and 175 W. Mechanical calibration consisted of medical grade and certified calibration gas ((4.95% CO(2), 12.01% O(2), balance N(2)), room air (20.95% O(2), 0.03% CO(2), balance N(2)), and 100% nitrogen), and an air flow turbine calibrated with a 3-L calibration syringe. Ventilation was mimicked manually using complete 3-L calibration syringe manouvers at a rate of 10·min(-1) from a Douglas bag reservoir of calibration gas. The testing of human subjects was completed in a counterbalanced sequence based on 5 repeated tests of all conditions for a single subject. Rest periods of 5 and 10 min followed the 100 and 175 W conditions, respectively. COM and NEW had similar accuracy when tested with known ventilation and gas fractions. However, during human subjects testing COM significantly under-measured carbon dioxide gas fractions, over-measured oxygen gas fractions and minute ventilation, and resulted in errors to each of oxygen uptake, carbon dioxide output, and respiratory exchange ratio. These discrepant findings reveal that controlled ventilation and gas fractions are insufficient to validate breath-by-breath, and perhaps even time-averaged, systems of EGAIC. The errors of the COM system reveal the need for concern over the validity of commercial systems of EGAIC.
The development and validation of the Bronchiectasis Health Questionnaire.
Spinou, Arietta; Siegert, Richard J; Guan, Wei-Jie; Patel, Amit S; Gosker, Harry R; Lee, Kai K; Elston, Caroline; Loebinger, Michael R; Wilson, Robert; Garrod, Rachel; Birring, Surinder S
2017-05-01
Health-related quality of life or health status is significantly impaired in bronchiectasis. There is a paucity of brief, simple-to-use, disease-specific health status measures. The aim of this study was to develop and validate the Bronchiectasis Health Questionnaire (BHQ), a new health status measure that is brief and generates a single overall score.Patients with bronchiectasis were recruited from two outpatient clinics, during a clinically stable stage. The development of the questionnaire followed three phases: item generation and item reduction using Rasch analysis, validation, and repeatability testing. The BHQ was translated into 11 languages using standardised methodology.206 patients with bronchiectasis completed a preliminary 65-item questionnaire. 55 items were removed due to redundancy or poor fit to the Rasch model. The final version of the BHQ consisted of 10 items. Internal consistency was good (Cronbach's α=0.85). Convergent validity of the BHQ with the St George's Respiratory Questionnaire was high (r= -0.82; p<0.001) and moderate with lung function (forced expiratory volume in 1 s % predicted r= -0.27; p=0.001). There was a significant association between BHQ scores and number of exacerbations of bronchiectasis in the last 12 months (p<0.001), hospital admissions (p=0.001) and computed tomography scan bronchiectasis pulmonary lobe counts (p<0.001). BHQ scores were significantly worse in patients with sputum bacterial colonisation versus no colonisation (p=0.048). The BHQ was highly repeatable after 2 weeks (intraclass correlation coefficient 0.89).The BHQ is a brief, valid and repeatable, self-completed health status questionnaire for bronchiectasis that generates a single total score. It can be used in the clinic to assess bronchiectasis from the patient's perspective. Copyright ©ERS 2017.
Bulley, Catherine; Coutts, Fiona; Blyth, Christine; Jack, Wilma; Chetty, Udi; Barber, Matthew; Tan, Chee Wee
2014-04-01
This study aimed to investigate validity of a newly developed Morbidity Screening Tool (MST) to screen for fatigue, pain, swelling (lymphedema) and arm function after breast cancer treatment. A cross-sectional study included women attending reviews after completing treatment (surgery, chemotherapy and radiotherapy), without recurrence, who could read English. They completed the MST and comparator questionnaires: Disability of the Arm, Shoulder and Hand questionnaire (DASH), Chronic Pain Grade Questionnaire (CPGQ), Lymphedema and Breast Cancer Questionnaire (LBCQ) and Functional Assessment of Cancer Therapy questionnaire with subscales for fatigue (FACT F) and breast cancer (FACT B + 4). Bilateral combined shoulder ranges of motion were compared (upward reach; hand behind back) and percentage upper limb volume difference (%LVD =/>10% diagnosed as lymphedema) measured with the vertical perometer (400T). 613 of 617 participants completed questionnaires (mean age 62.3 years, SD 10.0; mean time since treatment 63.0 months, SD 46.6) and 417 completed objective testing. Morbidity prevalence was estimated as 35.8%, 21.9%, 19.8% and 34.4% for fatigue, impaired upper limb function, lymphedema and pain respectively. Comparing those self-reporting the presence or absence of each type of morbidity, statistically significant differences in comparator variables supported validity of the MST. Statistically significant correlations resulted between MST scores focussing on impact of morbidity, and comparator variables that reflect function and quality of life. Analysis supports the validity of all four short-forms of the MST as providing indications of both presence of morbidity and impacts on participants' lives. This may facilitate early and appropriate referral for intervention. Copyright © 2013 Elsevier Ltd. All rights reserved.
Creighton, Alexandra S; Davison, Tanya E; Kissane, David W
2018-02-22
Limited research has been conducted into the identification of a valid and reliable screening measure for anxiety in aged care settings, despite it being one of the most common psychological conditions. This study aimed to determine an appropriate anxiety screening tool for aged care by comparing the reliability and validity of three commonly used measures and identifying specific cut-offs for the identification of generalized anxiety disorder (GAD). One-hundred and eighty nursing home residents (M age = 85.39 years) completed the GAI, HADS-A, and RAID, along with a structured diagnostic interview. Twenty participants (11.1%) met DSM-5 criteria for GAD. All measures had good psychometric properties , although reliability estimates for the HADS-A were sub-optimal. Privileging sensitivity , the GAI cut-off score of 9 gave sensitivity of 90.0% and specificity of 86.3%; HADS-A cut-off of 6 gave sensitivity of 90.0% and specificity of 80.6%; and RAID cut-off of 11 gave sensitivity of 85.0% and specificity of 72.5%. While all three measures had adequate reliability, validity, and cut-scores with high levels of sensitivity and specificity to detect anxiety within aged care, the GAI was the most consistently reliable and valid measure for screening for GAD.
Validity of the Perceived Health Competence Scale in a UK primary care setting.
Dempster, Martin; Donnelly, Michael
2008-01-01
The Perceived Health Competence Scale (PHCS) is a measure of self-efficacy regarding general health-related behaviour. This brief paper examines the psychometric properties of the PHCS in a UK context. Questionnaires containing the PHCS, the SF-36 and questions about perceived health needs were posted to 486 patients randomly selected from a GP practice list. Complete questionnaires were returned by 320 patients. Analyses of these responses provide strong evidence for the validity of the PHCS in this setting. Consequently, we conclude that the PHCS is a useful addition to measures of global self-efficacy and measures of self-efficacy regarding specific behaviours in the toolkit of health psychologists. This range of self-efficacy assessment tools will ensure that psychologists can match the level of specificity of the measure of expectancy beliefs to the level of specificity of the outcome of interest.
Frankel, Leslie; Fisher, Jennifer O; Power, Thomas G; Chen, Tzu-An; Cross, Matthew B; Hughes, Sheryl O
2015-08-01
Assessing parent affect is important because studies examining the parent-child dyad have shown that parent affect has a profound impact on parent-child interactions and related outcomes. Although some measures that assess general affect during daily lives exist, to date there are only few tools that assess parent affect in the context of feeding. The aim of this study was to develop an instrument to measure parent affect specific to the feeding context and determine its validity and reliability. A brief instrument consisting of 20 items was developed that specifically asks how parents feel during the feeding process. This brief instrument draws on the structure of a well-validated general affect measure. A total of 296 Hispanic and Black Head Start parents of preschoolers completed the Feeding Emotions Scale along with other parent-report measures as part of a larger study designed to better understand feeding interactions during the dinner meal. Confirmatory factor analysis supported a two-factor model with independent subscales of positive affect and negative affect (Cronbach's alphas of 0.85 and 0.84, respectively). Concurrent and convergent construct validity was evaluated by correlating the subscales of the Feeding Emotions Scale with positive emotionality and negative emotionality from the Differential Emotions Scale - a measure of general adult emotions. Concurrent and convergent criterion validity was evaluated by testing mean differences in affect across parent feeding styles using ANOVA. A significant difference was found across maternal weight status for positive feeding affect. The resulting validated measure can be used to assess parent affect in studies of feeding to better understand how interactions during feeding may impact the development of child eating behaviors and possibly weight status. Copyright © 2015 Elsevier Ltd. All rights reserved.
West, Roianne; Mills, Kyly; Rowland, Dale; Creedy, Debra K
2018-05-01
Health professional graduates require the capacity to work safely, both clinically and culturally, when delivering care to Indigenous peoples worldwide. In the Australian context, the Aboriginal and Torres Strait Islander Health Curriculum Framework (The Framework) provides guidance for health professional programs to integrate, teach and assess Aboriginal and Torres Strait Islander peoples' (First Peoples) health content. There is, however, a lack of validated tools that measure the development of students' cultural capabilities. To validate the Cultural Capability Measurement Tool with a cohort of health professional students. A descriptive cohort design was used. All students (N = 753) enrolled in a discrete First Peoples Health course at an Australian university were invited to complete the Cultural Capability Measurement Tool. The tool was tested for reliability, content and construct validity using confirmatory factor analysis; and concurrent validity using and the Cultural Understanding Self-Assessment Tool. A sample of 418 (73% response rate) was recruited. Most participants were enrolled in the Bachelor of Nursing program (n = 369, 82%). The Cultural Capability Measurement Tool had a Cronbach's alpha coefficient of 0.86. A five-factor solution was confirmed which reflected the cultural capability domains and accounted for 51% of the variance. Scores correlated with students' cultural understanding (r = 0.28, p < 0.001). Successful implementation of The Framework requires instruments to measure changes in students' cultural capabilities. Measuring nursing students' cultural capabilities can inform their development, identify areas of strengths and deficits for educators, and will ultimately contribute to the development of a culturally safe nursing workforce. Copyright © 2018 Elsevier Ltd. All rights reserved.
Validation of a measurement tool to assess awareness of breast cancer.
Linsell, Louise; Forbes, Lindsay J L; Burgess, Caroline; Kapari, Marcia; Thurnham, Angela; Ramirez, Amanda J
2010-05-01
Until now, there has been no universally accepted and validated measure of breast cancer awareness. This study aimed to validate the new Breast Cancer Awareness Measure (BCAM) which assesses, using a self-complete questionnaire, knowledge of breast cancer symptoms and age-related risk, and frequency of breast checking. We measured the psychometric properties of the BCAM in 1035 women attending the NHS Breast Screening Programme: acceptability was assessed using a feedback questionnaire (n=292); sensitivity to change after an intervention promoting breast cancer awareness (n=576), and test-retest reliability (n=167). We also assessed readability, and construct validity using the 'known-groups' method. The readability of the BCAM was high. Over 90% of women found it acceptable. The BCAM was sensitive to change: there was an increase in the proportion of women obtaining the full score for breast cancer awareness one month after receiving the intervention promoting breast cancer awareness; this was greater among those who received a more intensive version (less intensive version (booklet): 9.3%, 95% confidence interval (CI): 4.5-14.1%; more intensive version (interaction with health professional plus booklet): 30%, 95% CI: 23.4-36.6%). Test-retest reliability of the BCAM was moderate to good for most items. Cancer experts had higher levels of cancer awareness than non-medical academics (50% versus 6%, p=0.001), indicating good construct validity. The BCAM is a valid and robust measure of breast cancer awareness suitable for use in surveys of breast cancer awareness in the general population and to evaluate the impact of awareness-raising interventions. Copyright (c) 2010 Elsevier Ltd. All rights reserved.