Cross-Cultural Adaptation of the Profile Fitness Mapping Neck Questionnaire to Brazilian Portuguese: Internal Consistency, Reliability, and Construct and Structural Validity.

PubMed

Ferreira, Mariana Cândido; Björklund, Martin; Dach, Fabiola; Chaves, Thais Cristina

The purpose of this study was to adapt and evaluate the psychometric properties of the ProFitMap-neck to Brazilian Portuguese. The cross-cultural adaptation consisted of 5 stages, and 180 female patients with chronic neck pain participated in the study. A subsample (n = 30) answered the pretest, and another subsample (n = 100) answered the questionnaire a second time. Internal consistency, test-retest reliability, and construct validity (hypothesis testing and structural validity) were estimated. For construct validity, the scores of the questionnaire were correlated with the Neck Disability Index (NDI), and the Hospital Anxiety and Depression Scale (HADS), the Tampa Scale of Kinesiophobia (TSK), and the 36-item Short-Form Health Survey (SF-36). Internal consistency was determined by adequate Cronbach's α values (α > 0.70). Strong reliability was identified by high intraclass correlation coefficients (ICC > 0.75). Construct validity was identified by moderate and strong correlations of the Br-ProFitMap-neck with total NDI score (-0.56 validity was determined by percentage of cumulative variance >50%, Kaiser-Meyer-Olkin index > 0.50, eigenvalue > 1, and factor loadings > 0.2. Br-ProFitMap-neck had adequate psychometric properties and can be used in clinical settings, as well as research, in patients with chronic neck pain. Copyright © 2017. Published by Elsevier Inc.

Construct Validity of the Nepalese School Leaving English Reading Test

ERIC Educational Resources Information Center

Dawadi, Saraswati; Shrestha, Prithvi N.

2018-01-01

There has been a steady interest in investigating the validity of language tests in the last decades. Despite numerous studies on construct validity in language testing, there are not many studies examining the construct validity of a reading test. This paper reports on a study that explored the construct validity of the English reading test in…

Construct validity and internal consistency in the Leisure Practices Scale (EPL) for adults.

PubMed

Andrade, Rubian Diego; Schwartz, Gisele Maria; Tavares, Giselle Helena; Pelegrini, Andreia; Teixeira, Clarissa Stefani; Felden, Érico Pereira Gomes

2018-02-01

This study proposes and analyzes the construct validity and internal consistency of the Leisure Practices Scale (EPL). This survey seeks to identify the preferences and involvement in in different leisure practices in adults. The instrument was formed based on the cultural leisure content (artistic, manual, physical, sports, intellectual, social, tourist, virtual and contemplation/leisure). The validation process was conducted with: a) content analysis by leisure experts, who evaluated the instrument for clarity of language and practical relevance, which allowed the calculation of the content validity coefficient (CVC); b) reproducibility test-retest with 51 subjects to calculate the temporal variation coefficient; c) internal consistency analysis with 885 participants. The evaluation presented appropriate coefficients, both with respect to language clarity (CVCt = 0.883) and practical relevance (CVCt = 0.879). The reproducibility coefficients were moderate to excellent. The scale showed adequate internal consistency (0.72). The EPL has psychometric quality and acceptable values in its structure, and can be used to investigate adult involvement in leisure activities.

Validity of Sensory Systems as Distinct Constructs

PubMed Central

Su, Chia-Ting

2014-01-01

This study investigated the validity of sensory systems as distinct measurable constructs as part of a larger project examining Ayres’s theory of sensory integration. Confirmatory factor analysis (CFA) was conducted to test whether sensory questionnaire items represent distinct sensory system constructs. Data were obtained from clinical records of two age groups, 2- to 5-yr-olds (n = 231) and 6- to 10-yr-olds (n = 223). With each group, we tested several CFA models for goodness of fit with the data. The accepted model was identical for each group and indicated that tactile, vestibular–proprioceptive, visual, and auditory systems form distinct, valid factors that are not age dependent. In contrast, alternative models that grouped items according to sensory processing problems (e.g., over- or underresponsiveness within or across sensory systems) did not yield valid factors. Results indicate that distinct sensory system constructs can be measured validly using questionnaire data. PMID:25184467

Construct validity of the Korean Women's Abuse Intolerance Scale.

PubMed

Choi, Myunghan; Phillips, Linda R; Figueredo, Aurelio José; Insel, Katheleen; Min, Sung-Kil

2008-01-01

Domestic violence against married women has persisted throughout Korean history. However, very little empirical research has been conducted in Korea about domestic violence, its causes, or women's responses. To develop and test psychometrically the Korean Women's Abuse Intolerance Scale (KWAIS) to measure women's propensity or desire to leave abusive husbands in Korea. The first phase of the investigation involved qualitative research to explore the themes of women's responses to domestic violence and the development of the instrument. The second phase was a preliminary study conducted to examine women's responses to domestic violence. In the third phase, construct validity of the scale was established, using a sample of 184 married women living in Korea. The KWAIS adequately supported the underlying theory of women's responses to domestic violence, demonstrating strong content validity, high internal consistency (Cronbach's alpha of .98), and criterion-related validity evidenced by significant correlations that supported hypotheses among abuse intolerance and abuse (r = .69), traditional family ideology (r = -.78), marital satisfaction (r = -.85), attitude toward power ascription (r = .63), and collectivism (r = -.88). Factor analysis yielded a four-factor structure, explaining 78.4% of the common variance. Factor loadings ranged from .65 to .93. The findings for the psychometric properties of the KWAIS established its potential as a research instrument in measuring Korean women's propensity or desire to leave abusive husbands. Future studies need to focus on determining the predictive validity of the KWAIS and evaluating cross-cultural differences in women's propensity or desire to leave abusive husbands.

Student mathematical imagination instruments: construction, cultural adaptation and validity

NASA Astrophysics Data System (ADS)

Dwijayanti, I.; Budayasa, I. K.; Siswono, T. Y. E.

2018-03-01

Imagination has an important role as the center of sensorimotor activity of the students. The purpose of this research is to construct the instrument of students’ mathematical imagination in understanding concept of algebraic expression. The researcher performs validity using questionnaire and test technique and data analysis using descriptive method. Stages performed include: 1) the construction of the embodiment of the imagination; 2) determine the learning style questionnaire; 3) construct instruments; 4) translate to Indonesian as well as adaptation of learning style questionnaire content to student culture; 5) perform content validation. The results stated that the constructed instrument is valid by content validation and empirical validation so that it can be used with revisions. Content validation involves Indonesian linguists, english linguists and mathematics material experts. Empirical validation is done through a legibility test (10 students) and shows that in general the language used can be understood. In addition, a questionnaire test (86 students) was analyzed using a biserial point correlation technique resulting in 16 valid items with a reliability test using KR 20 with medium reability criteria. While the test instrument test (32 students) to find all items are valid and reliability test using KR 21 with reability is 0,62.

Validation of the French Version of the Yale Food Addiction Scale: An Examination of Its Factor Structure, Reliability, and Construct Validity in a Nonclinical Sample

PubMed Central

Brunault, Paul; Ballon, Nicolas; Gaillard, Philippe; Réveillère, Christian; Courtois, Robert

2014-01-01

Objective: The concept of food addiction has recently been proposed by applying the Diagnostic and Statistical Manual of Mental Disorders, Fourth Edition, Text Revision, criteria for substance dependence to eating behaviour. Food addiction has received increased attention given that it may play a role in binge eating, eating disorders, and the recent increase in obesity prevalence. Currently, there is no psychometrically sound tool for assessing food addiction in French. Our study aimed to test the psychometric properties of a French version of the Yale Food Addiction Scale (YFAS) by establishing its factor structure and construct validity in a nonclinical population. Method: A total of 553 participants were assessed for food addiction (French version of the YFAS) and binge eating behaviour (Bulimic Investigatory Test Edinburgh and Binge Eating Scale). We tested the scale’s factor structure (factor analysis for dichotomous data based on tetrachoric correlation coefficients), internal consistency, and construct validity with measures of binge eating. Results: Our results supported a 1-factor structure, which accounted for 54.1% of the variance. This tool had adequate reliability and high construct validity with measures of binge eating in this population, both in its diagnosis and symptom count version. A 2-factor structure explained an additional 9.1% of the variance, and could differentiate between patients with high, compared with low, levels of insight regarding addiction symptoms. Conclusions: In our study, we validated a psychometrically sound French version of the YFAS, both in its symptom count and diagnostic version. Future studies should validate this tool in clinical samples. PMID:25007281

Validation of the French version of the yale food addiction scale: an examination of its factor structure, reliability, and construct validity in a nonclinical sample.

PubMed

Brunault, Paul; Ballon, Nicolas; Gaillard, Philippe; Réveillère, Christian; Courtois, Robert

2014-05-01

The concept of food addiction has recently been proposed by applying the Diagnostic and Statistical Manual of Mental Disorders, Fourth Edition, Text Revision, criteria for substance dependence to eating behaviour. Food addiction has received increased attention given that it may play a role in binge eating, eating disorders, and the recent increase in obesity prevalence. Currently, there is no psychometrically sound tool for assessing food addiction in French. Our study aimed to test the psychometric properties of a French version of the Yale Food Addiction Scale (YFAS) by establishing its factor structure and construct validity in a nonclinical population. A total of 553 participants were assessed for food addiction (French version of the YFAS) and binge eating behaviour (Bulimic Investigatory Test Edinburgh and Binge Eating Scale). We tested the scale's factor structure (factor analysis for dichotomous data based on tetrachoric correlation coefficients), internal consistency, and construct validity with measures of binge eating. Our results supported a 1-factor structure, which accounted for 54.1% of the variance. This tool had adequate reliability and high construct validity with measures of binge eating in this population, both in its diagnosis and symptom count version. A 2-factor structure explained an additional 9.1% of the variance, and could differentiate between patients with high, compared with low, levels of insight regarding addiction symptoms. In our study, we validated a psychometrically sound French version of the YFAS, both in its symptom count and diagnostic version. Future studies should validate this tool in clinical samples.

Measurement Invariance of the UTAUT Constructs in the Caribbean

ERIC Educational Resources Information Center

Thomas, Troy D.; Singh, Lenandlar; Gaffar, Kemuel; Thakur, Dhanaraj; Jackman, Grace-Ann; Thomas, Michael; Gajraj, Roger; Allen, Claudine; Tooma, Keron

2014-01-01

This article employs confirmatory factor analysis to evaluate the factorial validity and the cross-national comparability of the UTAUT constructs with respect to mobile learning in higher education in four Caribbean countries. Except for the measurement of one factor, the UTAUT constructs exhibit adequate reliability and validity. Though full…

Construct validity of the items on the Stroke Specific Quality of Life (SS-QOL) questionnaire that evaluate the participation component of the International Classification of Functioning, Disability and Health.

PubMed

Silva, Soraia Micaela; Corrêa, Fernanda Ishida; Pereira, Gabriela Santos; Faria, Christina Danielli Coelho de Morais; Corrêa, João Carlos Ferrari

2018-01-01

Analyze the construct validity and internal consistency of the Stroke Specific Quality of Life (SS-QOL) items that address the participation component of the ICF as well as analyze the ceiling and floor effects. One hundred subjects were analyzed: 85 community-dwelling and 15 institutionalized individuals. The analysis of construct validity was performed using classic psychometrics: (1) the comparison of known groups (individuals without restriction to participation vs. those with restriction to participation) using the Mann-Whitney test and (2) convergent validity - correlation between the scores on the SS-QOL items that address participation and the subscale scores of measures used to evaluate the similar constructs and concepts [the Short-Form Health Survey (SF-36), Functional Independence Measure (FIM) and grip strength test]. Spearman's correlation coefficients were calculated for this analysis. Cronbach's α was used for the analysis of internal consistency and both the ceiling and floor effects were analyzed. The level of significance for all analyses was α = 0.05. The a priori hypotheses regarding construct validity were partially demonstrated, as only five of the eight domains exhibited positive moderate to strong correlations (r > 0.40) with measures that address constructs similar to those addressed on the SS-QOL questionnaire. The items demonstrated adequate internal consistency and are capable of differentiating individuals with and without restriction to participation. The ceiling and floor effects were considered adequate for the total SS-QOL score, but beyond acceptable standards for some domains. The 26 items of the SS-QOL questionnaire measure a multidimensional construct and therefore do not only address participation. However, the items demonstrated adequate internal consistency and are capable of differentiating individuals with and without restriction to participation. Implications for rehabilitation The 26 items of the SS

A Philosophical Perspective on Construct Validation: Application of Inductive Logic to the Analysis of Experimental Episode Construct Validity.

ERIC Educational Resources Information Center

Rossi, Robert Joseph

Methods drawn from four logical theories associated with studies of inductive processes are applied to the assessment and evaluation of experimental episode construct validity. It is shown that this application provides for estimates of episode informativeness with respect to the person examined in terms of the construct and to the construct…

Construct Validation of the Fairy Tale Test--Standardization Data.

ERIC Educational Resources Information Center

Coulacoglou, Carina

2002-01-01

Studied the construct validity of the Fairy Tale Test (C. Coulacoglu, 1993), a personality projective test for children, in a sample of 800 Greek children aged 8, 10, and 12. Factor analysis led to identification of eight primary factors, and correlations with other measures provide construct validity evidence. (SLD)

Development and Construct Validation of an Academic Emotions Scale

ERIC Educational Resources Information Center

Govaerts, Sophie; Gregoire, Jacques

2008-01-01

This article describes the development and two studies on the construct validity of the Academic Emotions Scale (AES). The AES is a French self-report questionnaire assessing six emotions in the context of school learning: enjoyment, hope, pride, anxiety, shame and frustration. Its construct validity was studied through exploratory and…

Utility of pedometers for assessing physical activity: construct validity.

PubMed

Tudor-Locke, Catrine; Williams, Joel E; Reis, Jared P; Pluto, Delores

2004-01-01

Valid assessment of physical activity is necessary to fully understand this important health-related behaviour for research, surveillance, intervention and evaluation purposes. This article is the second in a companion set exploring the validity of pedometer-assessed physical activity. The previous article published in Sports Medicine dealt with convergent validity (i.e. the extent to which an instrument's output is associated with that of other instruments intended to measure the same exposure of interest). The present focus is on construct validity. Construct validity is the extent to which the measurement corresponds with other measures of theoretically-related parameters. Construct validity is typically evaluated by correlational analysis, that is, the magnitude of concordance between two measures (e.g. pedometer-determined steps/day and a theoretically-related parameter such as age, anthropometric measures and fitness). A systematic literature review produced 29 articles published since > or =1980 directly relevant to construct validity of pedometers in relation to age, anthropometric measures and fitness. Reported correlations were combined and a median r-value was computed. Overall, there was a weak inverse relationship (median r = -0.21) between age and pedometer-determined physical activity. A weak inverse relationship was also apparent with both body mass index and percentage overweight (median r = -0.27 and r = -0.22, respectively). Positive relationships regarding indicators of fitness ranged from weak to moderate depending on the fitness measure utilised: 6-minute walk test (median r = 0.69), timed treadmill test (median r = 0.41) and estimated maximum oxygen uptake (median r = 0.22). Studies are warranted to assess the relationship of pedometer-determined physical activity with other important health-related outcomes including blood pressure and physiological parameters such as blood glucose and lipid profiles. The aggregated evidence of convergent

Measuring teacher self-report on classroom practices: Construct validity and reliability of the Classroom Strategies Scale-Teacher Form.

PubMed

Reddy, Linda A; Dudek, Christopher M; Fabiano, Gregory A; Peters, Stephanie

2015-12-01

This article presents information about the construct validity and reliability of a new teacher self-report measure of classroom instructional and behavioral practices (the Classroom Strategies Scales-Teacher Form; CSS-T). The theoretical underpinnings and empirical basis for the instructional and behavioral management scales are presented. Information is provided about the construct validity, internal consistency, test-retest reliability, and freedom from item-bias of the scales. Given previous investigations with the CSS Observer Form, it was hypothesized that internal consistency would be adequate and that confirmatory factor analyses (CFA) of CSS-T data from 293 classrooms would offer empirical support for the CSS-T's Total, Composite and subscales, and yield a similar factor structure to that of the CSS Observer Form. Goodness-of-fit indices of χ2/df, Root Mean Square Error of Approximation, Goodness of Fit Index, and Adjusted Goodness of Fit Index suggested satisfactory fit of proposed CFA models whereas the Comparative Fit Index did not. Internal consistency estimates of .93 and .94 were obtained for the Instructional Strategies and Behavioral Strategies Total scales respectively. Adequate test-retest reliability was found for instructional and behavioral total scales (r = .79, r = .84, percent agreement 93% and 93%). The CSS-T evidences freedom from item bias on important teacher demographics (age, educational degree, and years of teaching experience). Implications of results are discussed. (c) 2015 APA, all rights reserved).

Engagement DEOCS 4.1 Construct Validity Summary

DTIC Science & Technology

2017-08-01

Engagement DEOCS 4.1 Construct Validity Summary DEFENSE EQUAL OPPORTUNITY MANAGEMENT INSTITUTE DIRECTORATE OF...increasingly popular construct in industry and research. Indeed, management literature suggests employee engagement is the key to an organization’s...definition was drawn upon to inform the creation of a definition and measure of engagement that was then adapted using subject matter expert (SME)1

Face validity, construct validity and training benefits of a virtual reality TURP simulator.

PubMed

Bright, Elizabeth; Vine, Samuel; Wilson, Mark R; Masters, Rich S W; McGrath, John S

2012-01-01

To assess face validity, construct validity and the training benefits of a virtual reality TURP simulator. 11 novices (no TURP experience) and 7 experts (>200 TURP's) completed a virtual reality median lobe prostate resection task on the TURPsim™ (Simbionix USA Corp., Cleveland, OH). Performance indicators (percentage of prostate resected (PR), percentage of capsular resection (CR) and time diathermy loop active without tissue contact (TAWC) were recorded via the TURPsim™ and compared between novices and experts to assess construct validity. Verbal comments provided by experts following task completion were used to assess face validity. Repeated attempts of the task by the novices were analysed to assess the training benefits of the TURPsim™. Experts resected a significantly greater percentage of prostate per minute (p < 0.01) and had significantly less active diathermy time without tissue contact (p < 0.01) than novices. After practice, novices were able to perform the simulation more effectively, with significant improvement in all measured parameters. Improvement in performance was noted in novices following repetitive training, as evidenced by improved TAWC scores that were not significantly different from the expert group (p = 0.18). This study has established face and construct validity for the TURPsim™. The potential benefit in using this tool to train novices has also been demonstrated. Copyright © 2012 Surgical Associates Ltd. Published by Elsevier Ltd. All rights reserved.

Validation of Spanish Language Evaluation Instruments for Body Dysmorphic Disorder and the Dysmorphic Concern Construct

PubMed Central

Senín-Calderón, Cristina; Valdés-Díaz, María; Benítez-Hernández, Ma M.; Núñez-Gaitán, Ma C.; Perona-Garcelán, Salvador; Martínez-Cervantes, Rafael; Rodríguez-Testal, Juan F.

2017-01-01

Dysmorphic concern (DC) refers to excessive preoccupation with a slight or imagined defect in physical appearance with social avoidance and behavior directed at controlling the defect in appearance. This study attempted to adapt the factor structure of two instruments that cover the DC construct, the Dysmorphic Concern Questionnaire (DCQ) and the Body Dysmorphic Disorder Examination Self-Report (BDDE-SR), to Spanish and establish their psychometric properties. A total of 920 subjects (62.7% women, Mage = 32.44 years) participated. Exploratory and Confirmatory Factor Analysis of both scales found adequate goodness of fit indices. A one-dimensional structure was found for the DCQ and two first-order factors (dissatisfaction/preoccupation with body image (BI) and BI avoidance behavior) were identified for the BDDE-SR. The psychometric test–retest reliability and validity properties (content, convergent, and discriminant) were satisfactory. It is suggested that the DC construct includes both cognitive and behavioral aspects and may represent a continuum of severity with Body Dysmorphic Disorder at the end. PMID:28713311

Validation of Spanish Language Evaluation Instruments for Body Dysmorphic Disorder and the Dysmorphic Concern Construct.

PubMed

Senín-Calderón, Cristina; Valdés-Díaz, María; Benítez-Hernández, Ma M; Núñez-Gaitán, Ma C; Perona-Garcelán, Salvador; Martínez-Cervantes, Rafael; Rodríguez-Testal, Juan F

2017-01-01

Dysmorphic concern (DC) refers to excessive preoccupation with a slight or imagined defect in physical appearance with social avoidance and behavior directed at controlling the defect in appearance. This study attempted to adapt the factor structure of two instruments that cover the DC construct, the Dysmorphic Concern Questionnaire (DCQ) and the Body Dysmorphic Disorder Examination Self-Report (BDDE-SR), to Spanish and establish their psychometric properties. A total of 920 subjects (62.7% women, M age = 32.44 years) participated. Exploratory and Confirmatory Factor Analysis of both scales found adequate goodness of fit indices. A one-dimensional structure was found for the DCQ and two first-order factors (dissatisfaction/preoccupation with body image (BI) and BI avoidance behavior) were identified for the BDDE-SR. The psychometric test-retest reliability and validity properties (content, convergent, and discriminant) were satisfactory. It is suggested that the DC construct includes both cognitive and behavioral aspects and may represent a continuum of severity with Body Dysmorphic Disorder at the end.

Hazing DEOCS 4.1 Construct Validity Summary

DTIC Science & Technology

2017-08-01

Hazing DEOCS 4.1 Construct Validity Summary DEFENSE EQUAL OPPORTUNITY MANAGEMENT INSTITUTE DIRECTORATE OF...the analysis. Tables 4 – 6 provide additional information regarding the descriptive statistics and reliability of the Hazing items. Table 7 provides

Face, Content, and Construct Validations of Endoscopic Needle Injection Simulator for Transurethral Bulking Agent in Treatment of Stress Urinary Incontinence.

PubMed

Farhan, Bilal; Soltani, Tandis; Do, Rebecca; Perez, Claudia; Choi, Hanul; Ghoniem, Gamal

2018-05-02

Endoscopic injection of urethral bulking agents is an office procedure that is used to treat stress urinary incontinence secondary to internal sphincteric deficiency. Validation studies important part of simulator evaluation and is considered important step to establish the effectiveness of simulation-based training. The endoscopic needle injection (ENI) simulator has not been formally validated, although it has been used widely at University of California, Irvine. We aimed to assess the face, content, and construct validity of the UC, Irvine ENI simulator. Dissected female porcine bladders were mounted in a modified Hysteroscopy Diagnostic Trainer. Using routine endoscopic equipment for this procedure with video monitoring, 6 urologists (experts group) and 6 urology trainee (novice group) completed urethral bulking agents injections on a total of 12 bladders using ENI simulator. Face and content validities were assessed by using structured quantitative survey which rating the realism. Construct validity was assessed by comparing the performance, time of the procedure, and the occlusive (anatomical and functional) evaluations between the experts and novices. Trainees also completed a postprocedure feedback survey. Effective injections were evaluated by measuring the retrograde urethral opening pressure, visual cystoscopic coaptation, and postprocedure gross anatomic examination. All 12 participants felt the simulator was a good training tool and should be used as essential part of urology training (face validity). ENI simulator showed good face and content validity with average score varies between the experts and the novices was 3.9/5 and 3.8/5, respectively. Content validity evaluation showed that most aspects of the simulator were adequately realistic (mean Likert scores 3.9-3.8/5). However, the bladder does not bleed, and sometimes thin. Experts significantly outperformed novices (p < 001) across all measure of performance therefore establishing construct

Teacher Efficacy and Preservice Teachers: A Construct Validation.

ERIC Educational Resources Information Center

Kushner, Susan N.

A construct validation of a modified version of a teacher efficiency scale was conducted to establish its use with preservice teachers. The scale adapted by A. E. Woolfolk and W. K. Hoy from one constructed by S. Gibson and M. H. Dembo, which contained 12 personal efficacy (PE) and 6 general teaching efficacy (TE) items, was further modified for…

Bullying DEOCS 4.1 Construct Validity Summary

DTIC Science & Technology

2017-08-01

Bullying DEOCS 4.1 Construct Validity Summary DEFENSE EQUAL OPPORTUNITY MANAGEMENT INSTITUTE DIRECTORATE OF...excessive or abusive use of water; the forced consumption of food , alcohol, drugs, or any other substance; and degrading or damaging the person or his

The validity of the 4-Skills Scan: A double validation study.

PubMed

van Kernebeek, W G; de Kroon, M L A; Savelsbergh, G J P; Toussaint, H M

2018-06-01

Adequate gross motor skills are an essential aspect of a child's healthy development. Where physical education (PE) is part of the primary school curriculum, a strong curriculum-based emphasis on evaluation and support of motor skill development in PE is apparent. Monitoring motor development is then a task for the PE teacher. In order to fulfil this task, teachers need adequate tools. The 4-Skills Scan is a quick and easily manageable gross motor skill instrument; however, its validity has never been assessed. Therefore, the purpose of this study is to assess the construct and concurrent validity of both 4-Skills Scans (version 2007 and version 2015). A total of 212 primary school children (6 - 12 years old), was requested to participate in both versions of the 4-Skills Scan. For assessing construct validity, children covered an obstacle course with video recordings for observation by an expert panel. For concurrent validity, a comparison was made with the MABC-2, by calculating Pearson correlations. Multivariable linear regression analyses were performed to determine the contribution of each subscale to the construct of gross motor skills, according to the MABC-2 and the expert panel. Correlations between the 4-Skills Scans and expert valuations were moderate, with coefficients of .47 (version 2007) and .46 (version 2015). Correlations between the 4-Skills Scans and the MABC-2 (gross) were moderate (.56) for version 2007 and high (.64) for version 2015. It is concluded that both versions of the 4-Skills Scans are satisfactory valid instruments for assessing gross motor skills during PE lessons. This article is protected by copyright. All rights reserved. This article is protected by copyright. All rights reserved.

Determining the Scoring Validity of a Co-Constructed CEFR-Based Rating Scale

ERIC Educational Resources Information Center

Deygers, Bart; Van Gorp, Koen

2015-01-01

Considering scoring validity as encompassing both reliable rating scale use and valid descriptor interpretation, this study reports on the validation of a CEFR-based scale that was co-constructed and used by novice raters. The research questions this paper wishes to answer are (a) whether it is possible to construct a CEFR-based rating scale with…

Construct validity, test-retest reliability and internal consistency of the Thai version of the disabilities of the arm, shoulder and hand questionnaire (DASH-TH) in patients with carpal tunnel syndrome.

PubMed

Buntragulpoontawee, Montana; Phutrit, Suphatha; Tongprasert, Siam; Wongpakaran, Tinakon; Khunachiva, Jeeranan

2018-03-27

This study evaluated additional psychometric properties of the Thai version of the disabilities of the arm, shoulder and hand questionnaire (DASH-TH) which included, test-retest reliability, construct validity, internal consistency of in patients with carpal tunnel syndrome. As for determining construct validity, the Thai EuroQOL questionnaire (EQ-5D-5L) was also administered in order to examine convergent and divergent validity. Fifty patients completed both questionnaires. The DASH-TH showed excellent test-retest reliability (intraclass correlation coefficient = 0.811) and internal consistency (Cronbach's alpha = 0.911). The exploratory factor analysis yielded a six-factor solution while the confirmatory factor analysis denoted that the hypothesized model adequately fit the data with a comparative fit index of 0.967 and a Tucker-Lewis index of 0.964. The related subscales between the DASH-TH and the Thai EQ-5D-5L were significantly correlated, indicating the DASH-TH's convergent and discriminant validity. The DASH-TH demonstrated good reliability, internal consistency construct validity, and multidimensionality, in assessing the upper extremity function in carpal tunnel syndrome patients.

Factors affecting unsafe behavior in construction projects: development and validation of a new questionnaire.

PubMed

Asilian-Mahabadi, Hassan; Khosravi, Yahya; Hassanzadeh-Rangi, Narmin; Hajizadeh, Ebrahim; Behzadan, Amir H

2018-02-05

Occupational safety in general, and construction safety in particular, is a complex phenomenon. This study was designed to develop a new valid measure to evaluate factors affecting unsafe behavior in the construction industry. A new questionnaire was generated from qualitative research according to the principles of grounded theory. Key measurement properties (face validity, content validity, construct validity, reliability and discriminative validity) were examined using qualitative and quantitative approaches. The receiver operating characteristic curve was used to estimate the discriminating power and the optimal cutoff score. Construct validity revealed an interpretable 12-factor structure which explained 61.87% of variance. Good internal consistency (Cronbach's α = 0.94) and stability (intra-class correlation coefficient = 0.93) were found for the new instrument. The area under the curve, sensitivity and specificity were 0.80, 0.80 and 0.75, respectively. The new instrument also discriminated safety performance among the construction sites with different workers' accident histories (F = 6.40, p < 0.05). The new instrument appears to be a valid, reliable and sensitive instrument that will contribute to investigating the root causes of workers' unsafe behaviors, thus promoting safety performance in the construction industry.

The multidimensional nature of ageism: construct validity and group differences.

PubMed

Rupp, Deborah E; Vodanovich, Stephen J; Credé, Marcus

2005-06-01

The authors investigated the factor structure and construct validity of the Fraboni Scale of Ageism and the age and gender differences in ageism scores. Confirmatory factor analyses supported the multidimensional nature of FSA scores and generally corroborated the initial factor structure reported by M. Fraboni, with some notable exceptions. Essentially, the present findings were aligned with theoretical models of ageism that emphasize both cognitive facets and affective facets. That is, on the basis of their factor analytic findings, the authors redefined Fraboni's original factors of Antilocution, Avoidance, and Discrimination as Stereotypes, Separation, and Affective Attitudes, respectively, because of the clustering of items within factors. The revised 3-factor structure accounted for 36.4% of the variance in FSA scores. FSA factor scores significantly related to other scores from other measures of age-related attitudes, with higher correlations among factors that were similar in terms of their cognitive nature versus their affective nature. Finally, younger individuals and men had significantly higher ageism scores on the FSA than older individuals and women. The authors discussed the importance of adequately assessing ageism, with particular emphasis devoted to the understanding of age bias.

Construct Validation--Community College Instructional Development Inventory

ERIC Educational Resources Information Center

Xiong, Soua; Delgado, Nexi; Wood, J. Luke; Harris, Frank, III

2017-01-01

This white paper describes the construct validation of the Community College Instructional Development Inventory (CC-IDI). The CC-IDI is an institutional assessment tool designed to inform professional development programming for instructional faculty. The instrument was developed to serve as a standardized assessment tool to determine the…

Construct Validity of Three Clerkship Performance Assessments

ERIC Educational Resources Information Center

Lee, Ming; Wimmers, Paul F.

2010-01-01

This study examined construct validity of three commonly used clerkship performance assessments: preceptors' evaluations, OSCE-type clinical performance measures, and the NBME [National Board of Medical Examiners] medicine subject examination. Six hundred and eighty-six students taking the inpatient medicine clerkship from 2003 to 2007…

Development and Construct Validation of the Mentor Behavior Scale

ERIC Educational Resources Information Center

Brodeur, Pascale; Larose, Simon; Tarabulsy, George; Feng, Bei; Forget-Dubois, Nadine

2015-01-01

Researchers suggest that certain supportive behaviors of mentors could increase the benefits of school-based mentoring for youth. However, the literature contains few validated instruments to measure these behaviors. In our present study, we aimed to construct and validate a tool to measure the supportive behaviors of mentors participating in…

Construct Validation of the Behavior and Instructional Management Scale

ERIC Educational Resources Information Center

Martin, Nancy K.; Sass, Daniel A.

2010-01-01

Beliefs related to classroom management vary among teachers and play an important role in classrooms. Despite the importance of this construct, valid measures have proven difficult to develop. This study evaluated the psychometric properties of the Behavior and Instructional Management Scale (BIMS), a short but valid measure of teachers'…

On the Value of Homogeneous Constructs for Construct Validation, Theory Testing, and the Description of Psychopathology

PubMed Central

Smith, Gregory T.; McCarthy, Denis M.; Zapolski, Tamika C. B.

2010-01-01

The authors argue for a significant shift in how clinical psychology researchers conduct construct validation and theory validation tests. They argue that sound theory and validation tests can best be conducted on measures of unidimensional or homogeneous constructs. Hierarchical organizations of such constructs are useful descriptively and theoretically, but higher order composites do not refer to definable psychological processes. Application of this perspective to the approach of the Diagnostic and Statistical Manual of Mental Disorders to describing psychopathology calls into doubt the traditional use of the syndromal approach, in which single scores reflect the presence of multidimensional disorders. For many forms of psychological dysfunction, this approach does not appear optimal and may need to be discarded. The authors note that their perspective represents a straightforward application of existing psychometric theory, they demonstrate the practical value of adopting this perspective, and they provide evidence that this shift is already under way among clinical researchers. Description in terms of homogeneous dimensions provides improved validity, utility, and parsimony. In contrast, the use of composite diagnoses can retard scientific progress and hamper clinicians' efforts to understand and treat dysfunction. PMID:19719340

Construct validation of a novel hybrid surgical simulator.

PubMed

Broe, D; Ridgway, P F; Johnson, S; Tierney, S; Conlon, K C

2006-06-01

Simulated minimal access surgery has improved recently as both a learning and assessment tool. The construct validation of a novel simulator, ProMis, is described for use by residents in training. ProMis is a surgical simulator that can design tasks in both virtual and actual reality. A pilot group of surgical residents ranging from novice to expert completed three standardized tasks: orientation, dissection, and basic suturing. The tasks were tested for construct validity. Two experienced surgeons examined the recorded tasks in a blinded fashion using an objective structured assessment of technical skills format (OSATS: task-specific checklist and global rating score) as well as metrics delivered by the simulator. The findings showed excellent interrater reliability (Cronbach's alpha of 0.88 for the checklist and 0.93 for the global rating). The median scores in the experience groups were statistically different in both the global rating and the task-specific checklists (p < 0.05). The scores for the orientation task alone did not reach significance (p = 0.1), suggesting that modification is required before ProMis could be used in isolation as an assessment tool. The three simulated tasks in combination are construct valid for differentiating experience levels among surgeons in training. This hybrid simulator has potential added benefits of marrying the virtual with actual, and of combining simple box traits and advanced virtual reality simulation.

Behavioural Regulation in Exercise Questionnaire in people with schizophrenia: construct validity of the Portuguese versions.

PubMed

Costa, Raquel; Probst, Michel; Bastos, Tânia; Vilhena, Estela; Seabra, André; Corredeira, Rui

2017-06-22

People with schizophrenia have low physical activity levels that can be explained by the restriction in motivation. The Behavioural Regulation in Exercise Questionnaire-2 is a 19-item scale commonly used to assess five different motivational subtypes for physical activity. However, there are limited psychometric analyses of this version in the schizophrenia context. Moreover, there is a lack of information related to the psychometric properties of version 3 of this questionnaire, with 24 items and six different motivational subtypes. The aim of this study was to examine the construct validity of both Portuguese versions in people with schizophrenia. A total of 118 persons with schizophrenia were included (30 women). Cronbach's alpha was used for internal consistency, Pearson's correlation for the retained motivation-types, confirmatory factor analysis for the structural validity of version 2 and exploratory factor analysis for the factor structure of version 3. Analyses of version 2 provided an adequate fit index for the structure of the five factors. Exploratory analyses suggested retaining 2 factors of version 3. The results of this study suggest that version 3 was an appropriate measure to assess controlled and autonomous motivation for physical activity in people with schizophrenia and support its use in clinical practice and research. Implications for Rehabilitation This study supports the need to identify the reasons why people with schizophrenia practice physical activity. For that purpose, it is important to use valid and cost-effective instruments. The Portuguese version of BREQ-2 confirmed a 5-factor model and showed adequate fit for the application in people with schizophrenia. However, the incremental indices values were lower than expected. The Portuguese version of BREQ-3 showed acceptable psychometric properties to assess controlled and autonomous motivation for physical activity in people with schizophrenia.

Measuring positive mental health in Canada: construct validation of the Mental Health Continuum-Short Form.

PubMed

Orpana, Heather; Vachon, Julie; Dykxhoorn, Jennifer; Jayaraman, Gayatri

2017-04-01

Positive mental health is increasingly recognized as an important focus for public health policies and programs. In Canada, the Mental Health Continuum-Short Form (MHC-SF) was identified as a promising measure to include on population surveys to measure positive mental health. It proposes to measure a three-factor model of positive mental health including emotional, social and psychological well-being. The purpose of this study was to examine whether the MHC-SF is an adequate measure of positive mental health for Canadian adults. We conducted confirmatory factor analysis (CFA) using data from the 2012 Canadian Community Health Survey (CCHS)-Mental Health Component (CCHS-MH), and cross-validated the model using data from the CCHS 2011-2012 annual cycle. We examined criterion-related validity through correlations of MHC-SF subscale scores with positively and negatively associated concepts (e.g. life satisfaction and psychological distress, respectively). We confirmed the validity of the three-factor model of emotional, social and psychological well-being through CFA on two independent samples, once four correlated errors between items on the social well-being scale were added. We observed significant correlations in the anticipated direction between emotional, psychological and social well-being scores and related concepts. Cronbach's alpha for both emotional and psychological well-being subscales was 0.82; for social well-being it was 0.77. Our study suggests that the MHC-SF measures a three-factor model of positive mental health in the Canadian population. However, caution is warranted when using the social well-being scale, which did not function as well as the other factors, as evidenced by the need to add several correlated error terms to obtain adequate model fit, a higher level of missing data on these questions and weaker correlations with related constructs. Social well-being is important in a comprehensive measure of positive mental health, and further

Construction and Validation of a Professional Suitability Scale for Social Work Practice

ERIC Educational Resources Information Center

Tam, Dora M. Y.; Coleman, Heather

2009-01-01

This article reports on the construction and validation of a professional suitability scale, designed for assessing students' suitability for social work practice. Data were collected from 188 field supervisors who provided usable questionnaires, representing a response rate of 74%. Construct validation by exploratory factor analysis identified a…

The Construct Validity of Language Aptitude: A Meta-Analysis

ERIC Educational Resources Information Center

Li, Shaofeng

2016-01-01

A meta-analysis was conducted to examine the construct validity of language aptitude by synthesizing the existing research that has been accumulated over the past five decades. The study aimed to provide a thorough understanding of the construct by aggregating the data reported in the primary research on its correlations with other individual…

The Physician Values in Practice Scale: Construction and Initial Validation

ERIC Educational Resources Information Center

Hartung, Paul J.; Taber, Brian J.; Richard, George V.

2005-01-01

Measures of values typically appraise the construct globally, across life domains or relative to a broad life domain such as work. We conducted two studies to construct and initially validate an occupation- and context-specific values measure. Study 1, based on a sample of 192 medical students, describes the initial construction and item analysis…

Construct validity of the Moral Development Scale for Professionals (MDSP)

PubMed Central

Söderhamn, Olle; Bjørnestad, John Olav; Skisland, Anne; Cliffordson, Christina

2011-01-01

The aim of this study was to investigate the construct validity of the Moral Development Scale for Professionals (MDSP) using structural equation modeling. The instrument is a 12-item self-report instrument, developed in the Scandinavian cultural context and based on Kohlberg’s theory. A hypothesized simplex structure model underlying the MDSP was tested through structural equation modeling. Validity was also tested as the proportion of respondents older than 20 years that reached the highest moral level, which according to the theory should be small. A convenience sample of 339 nursing students with a mean age of 25.3 years participated. Results confirmed the simplex model structure, indicating that MDSP reflects a moral construct empirically organized from low to high. A minority of respondents >20 years of age (13.5%) scored more than 80% on the highest moral level. The findings support the construct validity of the MDSP and the stages and levels in Kohlberg’s theory. PMID:21655343

Construct validity of the Moral Development Scale for Professionals (MDSP).

PubMed

Söderhamn, Olle; Bjørnestad, John Olav; Skisland, Anne; Cliffordson, Christina

2011-01-01

The aim of this study was to investigate the construct validity of the Moral Development Scale for Professionals (MDSP) using structural equation modeling. The instrument is a 12-item self-report instrument, developed in the Scandinavian cultural context and based on Kohlberg's theory. A hypothesized simplex structure model underlying the MDSP was tested through structural equation modeling. Validity was also tested as the proportion of respondents older than 20 years that reached the highest moral level, which according to the theory should be small. A convenience sample of 339 nursing students with a mean age of 25.3 years participated. Results confirmed the simplex model structure, indicating that MDSP reflects a moral construct empirically organized from low to high. A minority of respondents >20 years of age (13.5%) scored more than 80% on the highest moral level. The findings support the construct validity of the MDSP and the stages and levels in Kohlberg's theory.

Developing a validation for environmental sustainability

NASA Astrophysics Data System (ADS)

Adewale, Bamgbade Jibril; Mohammed, Kamaruddeen Ahmed; Nawi, Mohd Nasrun Mohd; Aziz, Zulkifli

2016-08-01

One of the agendas for addressing environmental protection in construction is to reduce impacts and make the construction activities more sustainable. This important consideration has generated several research interests within the construction industry, especially considering the construction damaging effects on the ecosystem, such as various forms of environmental pollution, resource depletion and biodiversity loss on a global scale. Using Partial Least Squares-Structural Equation Modeling technique, this study validates environmental sustainability (ES) construct in the context of large construction firms in Malaysia. A cross-sectional survey was carried out where data was collected from Malaysian large construction firms using a structured questionnaire. Results of this study revealed that business innovativeness and new technology are important in determining environmental sustainability (ES) of the Malaysian construction firms. It also established an adequate level of internal consistency reliability, convergent validity and discriminant validity for each of this study's constructs. And based on this result, it could be suggested that the indicators for organisational innovativeness dimensions (business innovativeness and new technology) are useful to measure these constructs in order to study construction firms' tendency to adopt environmental sustainability (ES) in their project execution.

Construct Validation of Content Standards for Teaching

ERIC Educational Resources Information Center

van der Schaaf, Marieke F.; Stokking, Karel M.

2011-01-01

Current international demands to strengthen the teaching profession have led to an increased development and use of professional content standards. The study aims to provide insight in the construct validity of content standards by researching experts' underlying assumptions and preferences when participating in a delphi method. In three rounds 21…

Construction and initial validation of the self-worth protection scale.

PubMed

Thompson, Ted; Dinnel, Dale L

2003-03-01

The self-worth theory of achievement motivation holds that in certain circumstances students stand to gain by deliberately withdrawing effort. When failure occurs despite effort, students are likely to conclude that failure resulted from lack of ability. Thus, withdrawing effort offers a defence against conclusions of low ability, thereby protecting self-worth. We undertook to assess the psychometric properties of the Self-Worth Protection Scale (SWPS). Data were obtained from 243 participants (Study 1) and 411 participants (Study 2) enrolled in undergraduate psychology courses at a university in the United States. We administered a number of scales, including the SWPS and scales assessing a fear of negative evaluation, academic self-esteem, uncertain global self-evaluations, self-handicapping, and causal uncertainty. Exploratory factor analysis indicated a three-factor solution (ability doubts, the importance of ability as a criterion of self-worth, and an avoidance orientation) utilising 33 of the original 44 items. A confirmatory factor analysis indicated that this three-factor solution was a poor fit of the data. After modifying the model, a confirmatory factor analysis indicated that a three-factor solution with 26 of the original items and a higher order factor of self-worth protection was an adequate fit of the data. Reliability measures were acceptable for the three subscales and total score. The total score of the SWPS was positively correlated with theoretically related constructs, demonstrating construct validity. The SWPS appears to be a psychometrically sound scale to assist in identifying individuals who manifest self-worth protection in achievement situations.

Quantification of construction waste prevented by BIM-based design validation: Case studies in South Korea.

PubMed

Won, Jongsung; Cheng, Jack C P; Lee, Ghang

2016-03-01

Waste generated in construction and demolition processes comprised around 50% of the solid waste in South Korea in 2013. Many cases show that design validation based on building information modeling (BIM) is an effective means to reduce the amount of construction waste since construction waste is mainly generated due to improper design and unexpected changes in the design and construction phases. However, the amount of construction waste that could be avoided by adopting BIM-based design validation has been unknown. This paper aims to estimate the amount of construction waste prevented by a BIM-based design validation process based on the amount of construction waste that might be generated due to design errors. Two project cases in South Korea were studied in this paper, with 381 and 136 design errors detected, respectively during the BIM-based design validation. Each design error was categorized according to its cause and the likelihood of detection before construction. The case studies show that BIM-based design validation could prevent 4.3-15.2% of construction waste that might have been generated without using BIM. Copyright © 2015 Elsevier Ltd. All rights reserved.

Assessing the reliability, predictive and construct validity of historical, clinical and risk management-20 (HCR-20) in Mexican psychiatric inpatients.

PubMed

Sada, Andrea; Robles-García, Rebeca; Martínez-López, Nicolás; Hernández-Ramírez, Rafael; Tovilla-Zarate, Carlos-Alfonso; López-Munguía, Fernando; Suárez-Alvarez, Enrique; Ayala, Xochitl; Fresán, Ana

2016-08-01

Assessing dangerousness to gauge the likelihood of future violent behaviour has become an integral part of clinical mental health practice in forensic and non-forensic psychiatric settings, one of the most effective instruments for this being the Historical, Clinical and Risk Management-20 (HCR-20). To examine the HCR-20 factor structure in Mexican psychiatric inpatients and to obtain its predictive validity and reliability for use in this population. In total, 225 patients diagnosed with psychotic, affective or personality disorders were included. The HCR-20 was applied at hospital admission and violent behaviours were assessed during psychiatric hospitalization using the Overt Aggression Scale (OAS). Construct validity, predictive validity and internal consistency were determined. Violent behaviour remains more severe in patients classified in the high-risk group during hospitalization. Fifteen items displayed adequate communalities in the original designated domains of the HCR-20 and internal consistency of the instruments was high. The HCR-20 is a suitable instrument for predicting violence risk in Mexican psychiatric inpatients.

Connectedness DEOCS 4.1 Construct Validity Summary

DTIC Science & Technology

2017-08-01

Connectedness DEOCS 4.1 Construct Validity Summary DEFENSE EQUAL OPPORTUNITY MANAGEMENT INSTITUTE DIRECTORATE OF...appropriate statistical method to analyze these data. This EFA yielded a single factor solution. Refer to Table 6 for more information . Table 6...top management team perceptions of CEO charisma. Academy of Management Journal, 49(1), 161-174. Assessment to Solutions. (2016). Retrieved from https

The Modified Cognitive Constructions Coding System: Reliability and Validity Assessments

ERIC Educational Resources Information Center

Moran, Galia S.; Diamond, Gary M.

2006-01-01

The cognitive constructions coding system (CCCS) was designed for coding client's expressed problem constructions on four dimensions: intrapersonal-interpersonal, internal-external, responsible-not responsible, and linear-circular. This study introduces, and examines the reliability and validity of, a modified version of the CCCS--a version that…

Construct Validity of Adolescent Antisocial Personality Disorder

ERIC Educational Resources Information Center

Taylor, Jeanette; Elkins, Irene J.; Legrand, Lisa; Peuschold, Dawn; Iacono, William G.

2007-01-01

This study examined the construct validity of antisocial personality disorder (ASPD) diagnosed in adolescence. Boys and girls were grouped by history of DSM-III-R conduct disorder (CD) and ASPD: Controls (n = 340) had neither diagnosis; CD Only (n = 77) had CD by age 17 but no ASPD through age 20; Adolescent ASPD (n = 64) had ASPD by age 17. The…

The Construct of the Learning Organization: Dimensions, Measurement, and Validation

ERIC Educational Resources Information Center

Yang, Baiyin; Watkins, Karen E.; Marsick, Victoria J.

2004-01-01

This research describes efforts to develop and validate a multidimensional measure of the learning organization. An instrument was developed based on a critical review of both the conceptualization and practice of this construct. Supporting validity evidence for the instrument was obtained from several sources, including best model-data fit among…

Construct Validity of Symptom Checklist-90-Revised (SCL-90-R) and General Health Questionnaire-28 (GHQ-28) in Patients with Drug Addiction and Diabetes, and Normal Population

PubMed Central

ARDAKANI, Abolfazl; SEGHATOLESLAM, Tahereh; HABIL, Hussain; JAMEEI, Fahimeh; RASHID, Rusdi; ZAHIRODIN, Alireza; MOTLAQ, Farid; MASJIDI ARANI, Abbas

2016-01-01

Background: Given that validity is the baseline of psychological assessments, there is a need to provide evidence-based data for construct validity of such scales to advance the clinicians for evaluating psychiatric morbidity in psychiatric and psychosomatic setting. Methods: This comparative cross-sectional study aimed to investigate the construct validity of the Malaysian version of the GHQ-28 and the SCL-90-R. The sample comprised 660 individuals including diabetics, drug dependents, and normal population. The research scales were administered to the participants. Convergent and discriminant validity of both scales were investigated by Confirmatory Factor Analysis (CFA) using AMOS. The Pearson correlation coefficient was utilized to obtain the relationship between the two scales. Results: The internal consistency of the GHQ-28 and SCL-90-R were highly acceptable, and confirmatory factor analysis confirmed the convergent validity of both scales. The results of this study revealed that the construct validity of GHQ-28 was acceptable, whereas discriminant validity of SCL-90-R was not adequate. According to Pearson correlation coefficient the relationships between three common subscales of the GHQ-28 and SCL-90-R were significantly positive; somatization (r=0.671, P<0.01), Anxiety (r=0.728, P<0.01), and Depression (r=0.660, P <0.01). Conclusions: This study replicated the construct of the Malaysian version of GHQ-28, yet failed to support the nine-factor structure of the SCL-90-R. Therefore, multidimensionality of the SCL-90-R as clinical purposes is questionable, and it may be a better unitary measure for assessing and screening mental disorders. Further research need to be carried out to prove this finding. PMID:27252914

Identifying correlates of self-stigma in adults who stutter: Further establishing the construct validity of the Self-Stigma of Stuttering Scale (4S).

PubMed

Boyle, Michael P

2015-03-01

This study was set up to further establish the construct validity of the Self-Stigma of Stuttering Scale (4S) by demonstrating its associations with other established scales and replicating its original factor structure and reliability estimates. Web surveys were completed by 354 adults who stutter recruited from Board Certified Specialists in Fluency Disorders, and adult chapters of the National Stuttering Association. Participants completed a series of psychometrically validated scales measuring self-stigma, hope, empowerment, quality of life, social support, anxiety, depression, and self-rated speech disruption. Higher subscale and total stigma scores on the 4S were associated with significantly lower levels of hope, empowerment, quality of life, and social support, and significantly higher levels of anxiety, depression, and self-rated speech disruption. The original factor structure of the 4S was replicated, and reliability estimates of the subscales ranged from adequate to excellent. The findings of this study support the construct validity of the 4S and its use by clinicians and researchers intending to measure the construct of self-stigma in adults who stutter. Readers should be able to: (a) distinguish between the various components of self-stigma; (b) describe how the various components of the self-stigma model relate to hope, empowerment, quality of life, and social support, self-rated speech disruption, anxiety, and depression; (c) summarize the psychometric properties of the Self-Stigma of Stuttering Scale (4S) in terms of reliability, factor structure, and construct validity; (d) discuss how the 4S could be used in research and clinical practice. Copyright © 2015 Elsevier Inc. All rights reserved.

Validation of the Mayo Hip Score: construct validity, reliability and responsiveness to change.

PubMed

Singh, Jasvinder A; Schleck, Cathy; Harmsen, W Scott; Lewallen, David G

2016-01-19

Previous studies have provided the initial evidence for construct validity and test-retest reliability of the Mayo Hip Score. Instruments used for Total Hip Arthroplasty (THA) outcomes assessment should be valid, reliable and responsive to change. Our main objective was to examine the responsiveness to change, association with subsequent revision and the construct validity of the Mayo hip score. Discriminant ability was assessed by calculating effect size (ES), standardized response mean (SRM) and Guyatt's responsiveness index (GRI). Minimal clinically important difference (MCII) and moderate improvement thresholds were calculated. We assessed construct validity by examining association of scores with preoperative patient characteristics and correlation with Harris hip score, and assessed association of scores with the risk of subsequent revision. Five thousand three hundred seven provided baseline data; of those with baseline data, 2,278 and 2,089 (39%) provided 2- and 5-year data, respectively. Large ES, SRM and GRI ranging 2.66-2.78, 2.42-2.61 and 1.67-1.88 were noted for Mayo hip scores with THA, respectively. The MCII and moderate improvement thresholds were 22.4-22.7 and 39.4-40.5 respectively. Hazard ratios of revision surgery were higher with lower final score or less improvement in Mayo hip score at 2-years and borderline significant/non-significant at 5-years, respectively: (1) score ≤55 with hazard ratios of 2.24 (95% CI, 1.45, 3.46; p = 0.0003) and 1.70 (95% CI, 1.00, 2.92; p = 0.05) of implant revision subsequently, compared to 72-80 points; (2) no improvement or worsening score with hazard ratios 3.94 (95% CI, 1.50, 10.30; p = 0.005) and 2.72 (95% CI, 0.85,8.70; p = 0.09), compared to improvement >50-points. Mayo hip score had significant positive correlation with younger age, male gender, lower BMI, lower ASA class and lower Deyo-Charlson index (p ≤ 0.003 for each) and with Harris hip scores (p < 0.001). Mayo Hip Score is

Construct Validity of the Societal Outreach Scale (SOS).

PubMed

Fike, David S; Denton, Jason; Walk, Matt; Kish, Jennifer; Gorman, Ira

2018-04-01

The American Physical Therapy Association (APTA) has been working toward a vision of increasing professional focus on societal-level health. However, performance of social responsibility and related behaviors by physical therapists remain relatively poorly integrated into practice. Promoting a focus on societal outreach is necessary for all health care professionals to impact the health of their communities. The objective was to document the validity of the 14-item Societal Outreach Scale (SOS) for use with practicing physical therapists. This study used a cross-sectional survey. The SOS was transmitted via email to all therapists who were licensed and practicing in 10 states in the United States that were purposefully selected to assure a broad representation. A sample of 2612 usable responses was received. Factor analysis was applied to assess construct validity of the instrument. Of alternate models, a 3-factor model best demonstrated goodness of fit with the sample data according to conventional indices (standardized root mean squared residual = .03, comparative fit index .96, root mean square error of approximation = .06). The 3 factors measured by the SOS were labeled Societal-Level Health Advocacy, Community Engagement/Social Integration, and Political Engagement. Internal consistency reliability was 0.7 for all factors. The 3-factor SOS demonstrated acceptable validity and reliability. Though the sample included a broad representation of physical therapists, this was a single cross-sectional study. Additional confirmatory factor analysis, reliability testing, and word refinement of the tool are warranted. Given the construct validity and reliability of the 3-factor SOS, it is recommended for use as a validated instrument to measure physical therapists' performance of social responsibility and related behaviors.

An exploratory study into the effect of time-restricted internet access on face-validity, construct validity and reliability of postgraduate knowledge progress testing

PubMed Central

2013-01-01

Background Yearly formative knowledge testing (also known as progress testing) was shown to have a limited construct-validity and reliability in postgraduate medical education. One way to improve construct-validity and reliability is to improve the authenticity of a test. As easily accessible internet has become inseparably linked to daily clinical practice, we hypothesized that allowing internet access for a limited amount of time during the progress test would improve the perception of authenticity (face-validity) of the test, which would in turn improve the construct-validity and reliability of postgraduate progress testing. Methods Postgraduate trainees taking the yearly knowledge progress test were asked to participate in a study where they could access the internet for 30 minutes at the end of a traditional pen and paper test. Before and after the test they were asked to complete a short questionnaire regarding the face-validity of the test. Results Mean test scores increased significantly for all training years. Trainees indicated that the face-validity of the test improved with internet access and that they would like to continue to have internet access during future testing. Internet access did not improve the construct-validity or reliability of the test. Conclusion Improving the face-validity of postgraduate progress testing, by adding the possibility to search the internet for a limited amount of time, positively influences test performance and face-validity. However, it did not change the reliability or the construct-validity of the test. PMID:24195696

Note on the Construct Validity of the ITPA

ERIC Educational Resources Information Center

Silverstein, A. B.

1978-01-01

Correlations with Binet IQ in the ITPA normative sample were corrected for restricted intelligence range. The corrected correlation for the Psycholinguistic Quotient is as high as that between the WISC and the Binet, a finding that raises a serious question about the construct validity of the ITPA. (Author)

Measuring positive mental health in Canada: construct validation of the Mental Health Continuum—Short Form

PubMed Central

Heather, Orpana; Julie, Vachon; Jennifer, Dykxhoorn; Gayatri, Jayaraman

2017-01-01

Abstract Introduction: Positive mental health is increasingly recognized as an important focus for public health policies and programs. In Canada, the Mental Health Continuum— Short Form (MHC-SF) was identified as a promising measure to include on population surveys to measure positive mental health. It proposes to measure a three-factor model of positive mental health including emotional, social and psychological well-being. The purpose of this study was to examine whether the MHC-SF is an adequate measure of positive mental health for Canadian adults. Methods: We conducted confirmatory factor analysis (CFA) using data from the 2012 Canadian Community Health Survey (CCHS)—Mental Health Component (CCHS-MH), and cross-validated the model using data from the CCHS 2011–2012 annual cycle. We examined criterion-related validity through correlations of MHC-SF subscale scores with positively and negatively associated concepts (e.g. life satisfaction and psychological distress, respectively). Results: We confirmed the validity of the three-factor model of emotional, social and psychological well-being through CFA on two independent samples, once four correlated errors between items on the social well-being scale were added. We observed significant correlations in the anticipated direction between emotional, psychological and social well-being scores and related concepts. Cronbach’s alpha for both emotional and psychological well-being subscales was 0.82; for social well-being it was 0.77. Conclusion: Our study suggests that the MHC-SF measures a three-factor model of positive mental health in the Canadian population. However, caution is warranted when using the social well-being scale, which did not function as well as the other factors, as evidenced by the need to add several correlated error terms to obtain adequate model fit, a higher level of missing data on these questions and weaker correlations with related constructs. Social well-being is important in a

Construct Validation Theory Applied to the Study of Personality Dysfunction

PubMed Central

Zapolski, Tamika C. B.; Guller, Leila; Smith, Gregory T.

2013-01-01

The authors review theory validation and construct validation principles as related to the study of personality dysfunction. Historically, personality disorders have been understood to be syndromes of heterogeneous symptoms. The authors argue that the syndrome approach to description results in diagnoses of unclear meaning and constrained validity. The alternative approach of describing personality dysfunction in terms of homogeneous dimensions of functioning avoids the problems of the syndromal approach and has been shown to provide more valid description and diagnosis. The authors further argue that description based on homogeneous dimensions of personality function/dysfunction is more useful, because it provides direct connections to validated treatments. PMID:22321263

Construction of Valid and Reliable Test for Assessment of Students

ERIC Educational Resources Information Center

Osadebe, P. U.

2015-01-01

The study was carried out to construct a valid and reliable test in Economics for secondary school students. Two research questions were drawn to guide the establishment of validity and reliability for the Economics Achievement Test (EAT). It is a multiple choice objective test of five options with 100 items. A sample of 1000 students was randomly…

Rater reliability and construct validity of a mobile application for posture analysis

PubMed Central

Szucs, Kimberly A.; Brown, Elena V. Donoso

2018-01-01

[Purpose] Measurement of posture is important for those with a clinical diagnosis as well as researchers aiming to understand the impact of faulty postures on the development of musculoskeletal disorders. A reliable, cost-effective and low tech posture measure may be beneficial for research and clinical applications. The purpose of this study was to determine rater reliability and construct validity of a posture screening mobile application in healthy young adults. [Subjects and Methods] Pictures of subjects were taken in three standing positions. Two raters independently digitized the static standing posture image twice. The app calculated posture variables, including sagittal and coronal plane translations and angulations. Intra- and inter-rater reliability were calculated using the appropriate ICC models for complete agreement. Construct validity was determined through comparison of known groups using repeated measures ANOVA. [Results] Intra-rater reliability ranged from 0.71 to 0.99. Inter-rater reliability was good to excellent for all translations. ICCs were stronger for translations versus angulations. The construct validity analysis found that the app was able to detect the change in the four variables selected. [Conclusion] The posture mobile application has demonstrated strong rater reliability and preliminary evidence of construct validity. This application may have utility in clinical and research settings. PMID:29410561

Rater reliability and construct validity of a mobile application for posture analysis.

PubMed

Szucs, Kimberly A; Brown, Elena V Donoso

2018-01-01

[Purpose] Measurement of posture is important for those with a clinical diagnosis as well as researchers aiming to understand the impact of faulty postures on the development of musculoskeletal disorders. A reliable, cost-effective and low tech posture measure may be beneficial for research and clinical applications. The purpose of this study was to determine rater reliability and construct validity of a posture screening mobile application in healthy young adults. [Subjects and Methods] Pictures of subjects were taken in three standing positions. Two raters independently digitized the static standing posture image twice. The app calculated posture variables, including sagittal and coronal plane translations and angulations. Intra- and inter-rater reliability were calculated using the appropriate ICC models for complete agreement. Construct validity was determined through comparison of known groups using repeated measures ANOVA. [Results] Intra-rater reliability ranged from 0.71 to 0.99. Inter-rater reliability was good to excellent for all translations. ICCs were stronger for translations versus angulations. The construct validity analysis found that the app was able to detect the change in the four variables selected. [Conclusion] The posture mobile application has demonstrated strong rater reliability and preliminary evidence of construct validity. This application may have utility in clinical and research settings.

The Specific Level of Functioning Scale: construct validity, internal consistency and factor structure in a large Italian sample of people with schizophrenia living in the community.

PubMed

Mucci, Armida; Rucci, Paola; Rocca, Paola; Bucci, Paola; Gibertoni, Dino; Merlotti, Eleonora; Galderisi, Silvana; Maj, Mario

2014-10-01

The study aimed to assess the construct validity, internal consistency and factor structure of the Specific Levels of Functioning Scale (SLOF), a multidimensional instrument assessing real life functioning. The study was carried out in 895 Italian people with schizophrenia, all living in the community and attending the outpatient units of 26 university psychiatric clinics and/or community mental health departments. The construct validity of the SLOF was analyzed by means of the multitrait-multimethod approach, using the Personal and Social Performance (PSP) Scale as the gold standard. The factor structure of the SLOF was examined using both an exploratory principal component analysis and a confirmatory factor analysis. The six factors identified using exploratory principal component analysis explained 57.1% of the item variance. The examination of the multitrait-multimethod matrix revealed that the SLOF factors had high correlations with PSP factors measuring the same constructs and low correlations with PSP factors measuring different constructs. The confirmatory factor analysis (CFA) corroborated the 6-factor structure reported in the original validation study. Loadings were all significant and ranged from a minimum of 0.299 to a maximum of 0.803. The CFA model was adequately powered and had satisfactory goodness of fit indices (comparative fit index=0.927, Tucker-Lewis index=0.920 and root mean square error of approximation=0.047, 95% CI 0.045-0.049). The present study confirms, in a large sample of Italian people with schizophrenia living in the community, that the SLOF is a reliable and valid instrument for the assessment of social functioning. It has good construct validity and internal consistency, and a well-defined factor structure. Copyright © 2014 Elsevier B.V. All rights reserved.

The Riso-Hudson Enneagram Type Indicator: Estimates of Reliability and Validity

ERIC Educational Resources Information Center

Newgent, Rebecca A.; Parr, Patricia E.; Newman, Isadore; Higgins, Kristin K.

2004-01-01

This investigation was conducted to estimate the reliability and validity of scores on the Riso-Hudson Enneagram Type Indicator (D. R. Riso & R. Hudson, 1999a). Results of 287 participants were analyzed. Alpha suggests an adequate degree of internal consistency. Evidence provides mixed support for construct validity using correlational and…

Construct Validity of the Spanish Versions of the Memorial Symptom Assessment Scale Short Form and Condensed Form: Rasch Analysis of Responses in Oncology Outpatients.

PubMed

Llamas-Ramos, Inés; Llamas-Ramos, Rocío; Buz, José; Cortés-Rodríguez, María; Martín-Nogueras, Ana María

2018-06-01

The Memorial Symptom Assessment Scale (MSAS) is a self-rating instrument for the assessment of symptom distress in cancer patients. The Spanish version of the MSAS has recently been validated. However, we lack evidence of the internal construct validity of the shorter versions (short form [MSAS-SF] and condensed form [CMSAS]). In addition, rigorous testing of these scales with modern psychometric methods is needed. The aim of this study was to evaluate the internal construct validity and reliability of the Spanish versions of the MSAS-SF and CMSAS in oncology outpatients using Rasch analysis. Data from a convenience sample of oncology outpatients receiving chemotherapy (n = 306; mean age 60 years; 63% women) at a university hospital were analyzed. The Rasch unidimensional measurement model was used to examine response category functioning, item hierarchy, targeting, unidimensionality, reliability, and differential item functioning by age, gender, and marital status. The response category structure of the symptom distress items was improved by collapsing two categories. The scales were adequately targeted to the study patients, showed overall Rasch model fit (mean Infit MnSq ranged from 0.98 to 1.05), met criteria for unidimensionality, and the reliability of scores was good (person reliability > 0.80), except for the CMSAS prevalence scale. Only four items showed differential item functioning. The present study demonstrated that the Spanish versions of the MSAS-SF and CMSAS have adequate psychometric properties to evaluate symptom distress in oncology outpatients. Additional studies of the CMSAS are recommended. Copyright © 2018 American Academy of Hospice and Palliative Medicine. Published by Elsevier Inc. All rights reserved.

[Diagnostics of work motivation (DIAMO): optimization and construct validity].

PubMed

Ranft, Andreas; Fiedler, Rolf; Greitemann, Bernhard; Heuft, Gereon

2009-01-01

Faced with increasing cost pressure of the social insurance system the carriers of rehabilitation programs focus on the efficacy of their measures. The diagnostic instrument for work motivation (DIAMO) has been developed to assess the influence of job-related motivation on the rehabilitation outcome. The inner structure of the instrument was validated and optimized in a cohort of medical rehabilitation patients (n = 422). Construct validity was further tested by using established instruments. Ten scales related to self-image, intention of action and goodness of fit show good psychometric qualities (Cronbachs alpha: 0.72 - 0.86). The constructs correlate moderately-to-strongly with personality-oriented scales while correlation with disease-related contents is low. The DIAMO is a generic and not disease oriented instrument. It would be expected to facilitate the development of vocational interventions to increase the rehabilitation outcome.

Construct validity of the ovine model in endoscopic sinus surgery training.

PubMed

Awad, Zaid; Taghi, Ali; Sethukumar, Priya; Tolley, Neil S

2015-03-01

To demonstrate construct validity of the ovine model as a tool for training in endoscopic sinus surgery (ESS). Prospective, cross-sectional evaluation study. Over 18 consecutive months, trainees and experts were evaluated in their ability to perform a range of tasks (based on previous face validation and descriptive studies conducted by the same group) relating to ESS on the sheep-head model. Anonymized randomized video recordings of the above were assessed by two independent and blinded assessors. A validated assessment tool utilizing a five-point Likert scale was employed. Construct validity was calculated by comparing scores across training levels and experts using mean and interquartile range of global and task-specific scores. Subgroup analysis of the intermediate group ascertained previous experience. Nonparametric descriptive statistics were used, and analysis was carried out using SPSS version 21 (IBM, Armonk, NY). Reliability of the assessment tool was confirmed. The model discriminated well between different levels of expertise in global and task-specific scores. A positive correlation was noted between year in training and both global and task-specific scores (P < .001). Experience of the intermediate group was variable, and the number of ESS procedures performed under supervision had the highest impact on performance. This study describes an alternative model for ESS training and assessment. It is also the first to demonstrate construct validity of the sheep-head model for ESS training. © 2014 The American Laryngological, Rhinological and Otological Society, Inc.

Group Cohesion DEOCS 4.1 Construct Validity Summary

DTIC Science & Technology

2017-08-01

Group Cohesion DEOCS 4.1 Construct Validity Summary DEFENSE EQUAL OPPORTUNITY MANAGEMENT INSTITUTE DIRECTORATE...See Table 4 for more information regarding item reliabilities. The relationship between the original four-point scale (Organizational Cohesion) and...future analyses, including those using the seven-point scale. Tables 4 and 5 provide additional information regarding the reliability and descriptive

Testing the Predictive Validity and Construct of Pathological Video Game Use

PubMed Central

Groves, Christopher L.; Gentile, Douglas; Tapscott, Ryan L.; Lynch, Paul J.

2015-01-01

Three studies assessed the construct of pathological video game use and tested its predictive validity. Replicating previous research, Study 1 produced evidence of convergent validity in 8th and 9th graders (N = 607) classified as pathological gamers. Study 2 replicated and extended the findings of Study 1 with college undergraduates (N = 504). Predictive validity was established in Study 3 by measuring cue reactivity to video games in college undergraduates (N = 254), such that pathological gamers were more emotionally reactive to and provided higher subjective appraisals of video games than non-pathological gamers and non-gamers. The three studies converged to show that pathological video game use seems similar to other addictions in its patterns of correlations with other constructs. Conceptual and definitional aspects of Internet Gaming Disorder are discussed. PMID:26694472

Construct Validation of the Piers-Harris Children's Self Concept Scale.

ERIC Educational Resources Information Center

Franklin, Melvin R., Jr.; And Others

1981-01-01

Results indicated that the Piers-Harris Children's Self Concept Scale demonstrates both convergent and discriminant validity in an assessment of a relatively stable and internally consistent construct. (Author/BW)

Construct Validity of the Anxiety Sensitivity Index-3 in Clinical Samples

ERIC Educational Resources Information Center

Kemper, Christoph J.; Lutz, Johannes; Bahr, Tobias; Ruddel, Heinz; Hock, Michael

2012-01-01

Using two clinical samples of patients, the presented studies examined the construct validity of the recently revised Anxiety Sensitivity Index-3 (ASI-3). Confirmatory factor analyses established a clear three-factor structure that corresponds to the postulated subdivision of the construct into correlated somatic, social, and cognitive components.…

Construct Validity of Fresh Frozen Human Cadaver as a Training Model in Minimal Access Surgery

PubMed Central

Macafee, David; Pranesh, Nagarajan; Horgan, Alan F.

2012-01-01

Background: The construct validity of fresh human cadaver as a training tool has not been established previously. The aims of this study were to investigate the construct validity of fresh frozen human cadaver as a method of training in minimal access surgery and determine if novices can be rapidly trained using this model to a safe level of performance. Methods: Junior surgical trainees, novices (<3 laparoscopic procedure performed) in laparoscopic surgery, performed 10 repetitions of a set of structured laparoscopic tasks on fresh frozen cadavers. Expert laparoscopists (>100 laparoscopic procedures) performed 3 repetitions of identical tasks. Performances were scored using a validated, objective Global Operative Assessment of Laparoscopic Skills scale. Scores for 3 consecutive repetitions were compared between experts and novices to determine construct validity. Furthermore, to determine if the novices reached a safe level, a trimmed mean of the experts score was used to define a benchmark. Mann-Whitney U test was used for construct validity analysis and 1-sample t test to compare performances of the novice group with the benchmark safe score. Results: Ten novices and 2 experts were recruited. Four out of 5 tasks (nondominant to dominant hand transfer; simulated appendicectomy; intracorporeal and extracorporeal knot tying) showed construct validity. Novices’ scores became comparable to benchmark scores between the eighth and tenth repetition. Conclusion: Minimal access surgical training using fresh frozen human cadavers appears to have construct validity. The laparoscopic skills of novices can be accelerated through to a safe level within 8 to 10 repetitions. PMID:23318058

The Social Physique Anxiety Scale: construct validity in adolescent females.

PubMed

McAuley, E; Burman, G

1993-09-01

Hart, Leary, and Rejeski have developed the Social Physique Anxiety Scale (SPA), a measure of the anxiety experienced in response to having one's physique evaluated by other people. The present study cross-validated the psychometric properties of this measure in a sample (N = 236) of adolescent competitive female gymnasts. Employing structural equation modeling, the proposed unidimensional factor structure of the SPA was supported, although some questions regarding the robustness of the fit are raised. Construct validity was demonstrated by significant inverse relationships between aspects of physical efficacy (perceived physical ability and physical self-presentation confidence) and degree of social physique anxiety. These findings are discussed in terms of possible alternative factor structures and integration of social anxiety and other psychosocial constructs to better understand physical activity behavior.

Development and validation of a fatigue assessment scale for U.S. construction workers.

PubMed

Zhang, Mingzong; Sparer, Emily H; Murphy, Lauren A; Dennerlein, Jack T; Fang, Dongping; Katz, Jeffrey N; Caban-Martinez, Alberto J

2015-02-01

To develop a fatigue assessment scale and test its reliability and validity for commercial construction workers. Using a two-phased approach, we first identified items (first phase) for the development of a Fatigue Assessment Scale for Construction Workers (FASCW) through review of existing scales in the scientific literature, key informant interviews (n = 11) and focus groups (three groups with six workers each) with construction workers. The second phase included assessment for the reliability, validity, and sensitivity of the new scale using a repeated-measures study design with a convenience sample of construction workers (n = 144). Phase one resulted in a 16-item preliminary scale that after factor analysis yielded a final 10-item scale with two sub-scales ("Lethargy" and "Bodily Ailment"). During phase two, the FASCW and its subscales demonstrated satisfactory internal consistency (alpha coefficients were FASCW [0.91], Lethargy [0.86] and Bodily Ailment [0.84]) and acceptable test-retest reliability (Pearson Correlations Coefficients: 0.59-0.68; Intraclass Correlation Coefficients: 0.74-0.80). Correlation analysis substantiated concurrent and convergent validity. A discriminant analysis demonstrated that the FASCW differentiated between groups with arthritis status and different work hours. The 10-item FASCW with good reliability and validity is an effective tool for assessing the severity of fatigue among construction workers. © 2015 Wiley Periodicals, Inc.

Development and Validation of a Fatigue Assessment Scale for U.S. Construction Workers

PubMed Central

Zhang, Mingzong; Sparer, Emily H.; Murphy, Lauren A.; Dennerlein, Jack T.; Fang, Dongping; Katz, Jeffrey N.; Caban-Martinez, Alberto J.

2015-01-01

Objective To develop a fatigue assessment scale and test its reliability and validity for commercial construction workers. Methods Using a two-phased approach, we first identified items for the development of a Fatigue Assessment Scale for Construction Workers (FASCW) through review of existing scales in the scientific literature, key informant interviews (n=11) and focus groups (3 groups with 6 workers each) with construction workers. The second phase included assessment for the reliability, validity and sensitivity of the new scale using a repeated-measures study design with a convenience sample of construction workers (n=144). Results Phase one resulted in a 16-item preliminary scale that after factor analysis yielded a final 10-item scale with two sub-scales (“Lethargy” and “Bodily Ailment”).. During phase two, the FASCW and its subscales demonstrated satisfactory internal consistency (alpha coefficients were FASCW (0.91), Lethargy (0.86) and Bodily Ailment (0.84)) and acceptable test-retest reliability (Pearson Correlations Coefficients: 0.59–0.68; Intraclass Correlation Coefficients: 0.74–0.80). Correlation analysis substantiated concurrent and convergent validity. A discriminant analysis demonstrated that the FASCW differentiated between groups with arthritis status and different work hours. Conclusions The 10-item FASCW with good reliability and validity is an effective tool for assessing the severity of fatigue among construction workers. PMID:25603944

Investigation of Item-Pair Presentation and Construct Validity of the Navy Computer Adaptive Personality Scales (NCAPS)

DTIC Science & Technology

2006-10-01

Investigation of Item-Pair Presentation and Construct Validity of the Navy Computer Adaptive Personality Scales ( NCAPS ) Christina M. Underhill, Ph.D...Construct Validity of the Navy Computer Adaptive Personality Scales ( NCAPS ) Christina M. Underhill, Ph.D. Reviewed and Approved by Jacqueline A. Mottern...and Construct Validity of the Navy Computer Adaptive Personality Scales ( NCAPS ) 5b. GRANT NUMBER 5c. PROGRAM ELEMENT NUMBER 0602236N and 0603236N 6

Cross-cultural construct validity study of professionalism of Vietnamese medical students.

PubMed

Nhan, Vo Thanh; Violato, Claudio; Le An, Pham; Beran, Tanya N

2014-01-01

Although many studies have made efforts to define and assess medical professionalism, few have addressed issues of construct validity. The purpose of this article is to explore further construct validity of medical professionalism employing exploratory and confirmatory factor analysis. The 32-item instrument by the American Board of Internal Medicine (ABIM) was adapted to assess the perceptions on medical professionalism of Vietnamese medical students. A sample of 1,196 (487 first-year, 341 third-year, 368 sixth-year) medical students participated voluntarily in the completion of the instrument. The data were randomly divided into three samples to assess the construct validity of medical professionalism by empirically deriving and confirming a model of professionalism. Exploratory and confirmatory factor analytic techniques resulted in a six-factor well-fitting model with a comparative fit index of .963 and root mean square error approximation of .029, 90% confidence interval [016, .039]: integrity, social responsibility, professional practice habits, ensuring quality care, altruism, and self-awareness. Social responsibility was perceived least important, and self-awareness was perceived most important by Vietnamese medical students. These constructs of medical professionalism were relatively similar with those found in Taiwanese medical students and the ABIM definitions but with some Vietnamese cultural differences. Although the results confirm that medical professionalism is a somewhat culturally sensitive construct, it nonetheless has many elements of medical professionalism that are universal. Future research should be conducted to test the generalizability of our six-factor model of professionalism with various samples (e.g., residents, physicians), cultures, and language groups.

Construction and validation of a Tamil logMAR chart.

PubMed

Varadharajan, Srinivasa; Srinivasan, Krithica; Kumaresan, Brindha

2009-09-01

To design, construct and validate a new Tamil logMAR visual acuity chart based on current recommendations. Ten Tamil letters of equal legibility were identified experimentally and were used in the chart. Two charts, one internally illuminated and one externally illuminated, were constructed for testing at 4 m distance. The repeatability of the two charts was tested. For validation, the two charts were compared with a standard English logMAR chart (ETDRS). When compared to the ETDRS chart, a difference of 0.06 +/- 0.07 and 0.07 +/- 0.07 logMAR was found for the internally and externally illuminated charts respectively. Limits of agreement between the internally illuminated Tamil logMAR chart and ETDRS chart were found to be (-0.08, 0.19), and (-0.07, 0.20) for the externally illuminated chart. The test - retest results showed a difference of 0.02 +/- 0.04 and 0.02 +/- 0.06 logMAR for the internally and externally illuminated charts respectively. Limits of agreement for repeated measurements for the internally illuminated Tamil logMAR chart were found to be (-0.06, 0.10), and (-0.10, 0.14) for the externally illuminated chart. The newly constructed Tamil logMAR charts have good repeatability. The difference in visual acuity scores between the newly constructed Tamil logMAR chart and the standard English logMAR chart was within acceptable limits. This new chart can be used for measuring visual acuity in the literate Tamil population.

Construction and Evaluation of Reliability and Validity of Reasoning Ability Test

ERIC Educational Resources Information Center

Bhat, Mehraj A.

2014-01-01

This paper is based on the construction and evaluation of reliability and validity of reasoning ability test at secondary school students. In this paper an attempt was made to evaluate validity, reliability and to determine the appropriate standards to interpret the results of reasoning ability test. The test includes 45 items to measure six types…

Predictive value and construct validity of the work functioning screener-healthcare (WFS-H).

PubMed

Boezeman, Edwin J; Nieuwenhuijsen, Karen; Sluiter, Judith K

2016-05-25

To test the predictive value and convergent construct validity of a 6-item work functioning screener (WFS-H). Healthcare workers (249 nurses) completed a questionnaire containing the work functioning screener (WFS-H) and a work functioning instrument (NWFQ) measuring the following: cognitive aspects of task execution and general incidents, avoidance behavior, conflicts and irritation with colleagues, impaired contact with patients and their family, and level of energy and motivation. Productivity and mental health were also measured. Negative and positive predictive values, AUC values, and sensitivity and specificity were calculated to examine the predictive value of the screener. Correlation analysis was used to examine the construct validity. The screener had good predictive value, since the results showed that a negative screener score is a strong indicator of work functioning not hindered by mental health problems (negative predictive values: 94%-98%; positive predictive values: 21%-36%; AUC:.64-.82; sensitivity: 42%-76%; and specificity 85%-87%). The screener has good construct validity due to moderate, but significant (p<.001), associations with productivity (r=.51), mental health (r=.48), and distress (r=.47). The screener (WFS-H) had good predictive value and good construct validity. Its score offers occupational health professionals a helpful preliminary insight into the work functioning of healthcare workers.

Reliability and concurrent and construct validity of the Strategies for Weight Management measure for adults.

PubMed

Kolodziejczyk, Julia K; Norman, Gregory J; Rock, Cheryl L; Arredondo, Elva M; Roesch, Scott C; Madanat, Hala; Patrick, Kevin

2016-01-01

This study evaluates the reliability and validity of the strategies for weight management (SWM) measure, a questionnaire that assesses weight management strategies for adults. The SWM includes 20 items that are categorized within the following subscales: (1) energy intake, (2) energy expenditure, (3) self-monitoring, and (4) self-regulation. Baseline and 6-month data were collected from 404 overweight/obese adults (mean age=22±3.8 years, 68% ethnic minority) enrolled in a randomized controlled trial aiming to reduce weight by improving diet and physical activity behaviours. Reliability and validity were assessed for each subscale separately. Cronbach alpha was conducted to assess reliability. Concurrent, construct I (sensitivity to the study treatment condition), and construct II (relationship to the outcomes) validity were assessed using linear regressions with the following outcome measures: weight, self-reported diet, and weekly energy expenditure. All subscales showed strong internal consistency. The strength of the validity evidence depended on subscale and validity type. The strongest validity evidence was concurrent validity of the energy intake and energy expenditure subscales; construct I validity of the energy intake and self-monitoring subscales; and construct II validity of the energy intake, energy expenditure, and self-regulation subscales. Results indicate that the SWM can be used to assess weight management strategies among an ethnically diverse sample of adults as each subscale showed evidence of reliability and select types of validity. As validity is an accumulation of evidence over multiple studies, this study provides initial reliability and validity evidence in one population segment. Copyright © 2015 Asia Oceania Association for the Study of Obesity. Published by Elsevier Ltd. All rights reserved.

Construct validity of the Health Science Reasoning Test.

PubMed

Huhn, Karen; Black, Lisa; Jensen, Gail M; Deutsch, Judith E

2011-01-01

The aim of this study was to evaluate the construct validity of the Health Science Reasoning Test (HSRT) by determining if the test could discriminate between expert and novice physical therapists' critical-thinking skills. Experts identified from a random list of certified clinical specialists and students in the first year of their physical therapy education from two physical therapy programs completed the HSRT. Experts (n = 73) had a higher total HSRT score (mean 24.06, SD 3.92) than the novices (n = 79) (mean 22.49, SD 3.2), with the difference being statistically significant t (148) = 2.67, p = 0.008. The HSRT total score discriminated between expert and novice critical-thinking skills, therefore establishing construct validity. To our knowledge, this is the first study to compare expert and novice performance on a standardized test. The opportunity to have a tool that provides evidence of students' critical thinking skills could be helpful for educators and students. The test results could aid in identifying areas of students' strengths and weaknesses, thereby enabling targeted remediation to improve critical thinking skills, which are key factors in clinical reasoning, a necessary skill for effective physical therapy practice.

Virtual reality simulator training for laparoscopic colectomy: what metrics have construct validity?

PubMed

Shanmugan, Skandan; Leblanc, Fabien; Senagore, Anthony J; Ellis, C Neal; Stein, Sharon L; Khan, Sadaf; Delaney, Conor P; Champagne, Bradley J

2014-02-01

Virtual reality simulation for laparoscopic colectomy has been used for training of surgical residents and has been considered as a model for technical skills assessment of board-eligible colorectal surgeons. However, construct validity (the ability to distinguish between skill levels) must be confirmed before widespread implementation. This study was designed to specifically determine which metrics for laparoscopic sigmoid colectomy have evidence of construct validity. General surgeons that had performed fewer than 30 laparoscopic colon resections and laparoscopic colorectal experts (>200 laparoscopic colon resections) performed laparoscopic sigmoid colectomy on the LAP Mentor model. All participants received a 15-minute instructional warm-up and had never used the simulator before the study. Performance was then compared between each group for 21 metrics (procedural, 14; intraoperative errors, 7) to determine specifically which measurements demonstrate construct validity. Performance was compared with the Mann-Whitney U-test (p < 0.05 was significant). Fifty-three surgeons; 29 general surgeons, and 24 colorectal surgeons enrolled in the study. The virtual reality simulators for laparoscopic sigmoid colectomy demonstrated construct validity for 8 of 14 procedural metrics by distinguishing levels of surgical experience (p < 0.05). The most discriminatory procedural metrics (p < 0.01) favoring experts were reduced instrument path length, accuracy of the peritoneal/medial mobilization, and dissection of the inferior mesenteric artery. Intraoperative errors were not discriminatory for most metrics and favored general surgeons for colonic wall injury (general surgeons, 0.7; colorectal surgeons, 3.5; p = 0.045). Individual variability within the general surgeon and colorectal surgeon groups was not accounted for. The virtual reality simulators for laparoscopic sigmoid colectomy demonstrated construct validity for 8 procedure-specific metrics. However, using virtual

Construct Validity of the Autism Impact Measure (AIM).

PubMed

Mazurek, Micah O; Carlson, Coleen; Baker-Ericzén, Mary; Butter, Eric; Norris, Megan; Kanne, Stephen

2018-01-17

The Autism Impact Measure (AIM) was designed to track incremental change in frequency and impact of core ASD symptoms. The current study examined the structural and convergent validity of the AIM in a large sample of children with ASD. The results of a series of exploratory and confirmatory factor analyses yielded a final model with five theoretically and empirically meaningful subdomains: Repetitive Behavior, Atypical Behavior, Communication, Social Reciprocity, and Peer Interaction. The final model showed very good fit both overall and for each of the five factors, indicating excellent structural validity. AIM subdomain scores were significantly correlated with measures of similar constructs across all five domains. The results provide further support for the psychometric properties of the AIM.

The convergent and discriminant validity of burnout measures in sport: a multi-trait/multi-method analysis.

PubMed

Cresswell, Scott L; Eklund, Robert C

2006-02-01

Athlete burnout research has been hampered by the lack of an adequate measurement tool. The Athlete Burnout Questionnaire (ABQ) and the Maslach Burnout Inventory General Survey (MBI-GS) are two recently developed self-report instruments designed to assess burnout. The convergent and discriminant validity of the ABQ and MBI-GS were assessed through multi-trait/multi-method analysis with a sporting population. Overall, the ABQ and the MBI-GS displayed acceptable convergent validity with matching subscales highly correlated, and satisfactory internal discriminant validity with lower correlations between non-matching subscales. Both scales also indicated an adequate discrimination between the concepts of burnout and depression. These findings add support to previous findings in non-sporting populations that depression and burnout are separate constructs. Based on the psychometric results, construct validity analysis and practical considerations, the results support the use of the ABQ to assess athlete burnout.

Intratester Reliability and Construct Validity of a Hip Abductor Eccentric Strength Test.

PubMed

Brindle, Richard A; Ebaugh, David; Milner, Clare E

2018-06-06

Side-lying hip abductor strength tests are commonly used to evaluate muscle strength. In a "break" test, the tester applies sufficient force to lower the limb to the table while the patient resists. The peak force is postulated to occur while the leg is lowering, thus representing the participant's eccentric muscle strength. However, it is unclear whether peak force occurs before or after the leg begins to lower. To determine intrarater reliability and construct validity of a hip abductor eccentric strength test. Intrarater reliability and construct validity study. Twenty healthy adults (26 [6] y; 1.66 [0.06] m; 62.2 [8.0] kg) made 2 visits to the laboratory at least 1 week apart. During the hip abductor eccentric strength test, a handheld dynamometer recorded peak force and time to peak force, and limb position was recorded via a motion capture system. Intrarater reliability was determined using intraclass correlation, SEM, and minimal detectable difference. Construct validity was assessed by determining if peak force occurred after the start of the lowering phase using a 1-sample t test. The hip abductor eccentric strength test had substantial intrarater reliability (intraclass correlation (3,3)  = .88; 95% confidence interval, .65-.95), SEM of 0.9 %BWh, and a minimal detectable difference of 2.5 %BWh. Construct validity was established as peak force occurred 2.1 (0.6) seconds (range: 0.7-3.7 s) after the start of the lowering phase of the test (P ≤ .001). The hip abductor eccentric strength test is a valid and reliable measure of eccentric muscle strength. This test may be used clinically to assess changes in eccentric muscle strength over time.

Construct Validation of a Multidimensional Computerized Adaptive Test for Fatigue in Rheumatoid Arthritis

PubMed Central

Nikolaus, Stephanie; Bode, Christina; Taal, Erik; Vonkeman, Harald E.; Glas, Cees A. W.; van de Laar, Mart A. F. J.

2015-01-01

Objective Multidimensional computerized adaptive testing enables precise measurements of patient-reported outcomes at an individual level across different dimensions. This study examined the construct validity of a multidimensional computerized adaptive test (CAT) for fatigue in rheumatoid arthritis (RA). Methods The ‘CAT Fatigue RA’ was constructed based on a previously calibrated item bank. It contains 196 items and three dimensions: ‘severity’, ‘impact’ and ‘variability’ of fatigue. The CAT was administered to 166 patients with RA. They also completed a traditional, multidimensional fatigue questionnaire (BRAF-MDQ) and the SF-36 in order to examine the CAT’s construct validity. A priori criterion for construct validity was that 75% of the correlations between the CAT dimensions and the subscales of the other questionnaires were as expected. Furthermore, comprehensive use of the item bank, measurement precision and score distribution were investigated. Results The a priori criterion for construct validity was supported for two of the three CAT dimensions (severity and impact but not for variability). For severity and impact, 87% of the correlations with the subscales of the well-established questionnaires were as expected but for variability, 53% of the hypothesised relations were found. Eighty-nine percent of the items were selected between one and 137 times for CAT administrations. Measurement precision was excellent for the severity and impact dimensions, with more than 90% of the CAT administrations reaching a standard error below 0.32. The variability dimension showed good measurement precision with 90% of the CAT administrations reaching a standard error below 0.44. No floor- or ceiling-effects were found for the three dimensions. Conclusion The CAT Fatigue RA showed good construct validity and excellent measurement precision on the dimensions severity and impact. The dimension variability had less ideal measurement characteristics

Examining the Construct Validity of the Elemental Psychopathy Assessment

ERIC Educational Resources Information Center

Miller, Joshua D.; Gaughan, Eric T.; Maples, Jessica; Gentile, Brittany; Lynam, Donald R.; Widiger, Thomas A.

2011-01-01

Lynam and colleagues recently developed a new self-report inventory for the assessment of psychopathy, the Elemental Psychopathy Assessment (EPA). Using a sample of undergraduates (N = 227), the authors examined the construct validity of the EPA by examining its correlations with self and stranger ratings on the Five-Factor Model, as well as…

Beliefs about language development: construct validity evidence.

PubMed

Donahue, Mavis L; Fu, Qiong; Smith, Everett V

2012-01-01

Understanding language development is incomplete without recognizing children's sociocultural environments, including adult beliefs about language development. Yet there is a need for data supporting valid inferences to assess these beliefs. The current study investigated the psychometric properties of data from a survey (MODeL) designed to explore beliefs in the popular culture, and their alignment with more formal theories. Support for the content, substantive, structural, generalizability, and external aspects of construct validity of the data were investigated. Subscales representing Behaviorist, Cognitive, Nativist, and Sociolinguistic models were identified as dimensions of beliefs. More than half of the items showed a high degree of consensus, suggesting culturally-transmitted beliefs. Behaviorist ideas were most popular. Bilingualism and ethnicity were related to Cognitive and Sociolinguistic beliefs. Identifying these beliefs may clarify the nature of child-directed speech, and enable the design of language intervention programs that are congruent with family and cultural expectations.

Preliminary Face and Construct Validation Study of a Virtual Basic Laparoscopic Skill Trainer

PubMed Central

Sankaranarayanan, Ganesh; Lin, Henry; Arikatla, Venkata S.; Mulcare, Maureen; Zhang, Likun; Derevianko, Alexandre; Lim, Robert; Fobert, David; Cao, Caroline; Schwaitzberg, Steven D.; Jones, Daniel B.

2010-01-01

Abstract Background The Virtual Basic Laparoscopic Skill Trainer (VBLaST™) is a developing virtual-reality–based surgical skill training system that incorporates several of the tasks of the Fundamentals of Laparoscopic Surgery (FLS) training system. This study aimed to evaluate the face and construct validity of the VBLaST™ system. Materials and Methods Thirty-nine subjects were voluntarily recruited at the Beth Israel Deaconess Medical Center (Boston, MA) and classified into two groups: experts (PGY 5, fellow and practicing surgeons) and novice (PGY 1–4). They were then asked to perform three FLS tasks, consisting of peg transfer, pattern cutting, and endoloop, on both the VBLaST and FLS systems. The VBLaST performance scores were automatically computed, while the FLS scores were rated by a trained evaluator. Face validity was assessed using a 5-point Likert scale, varying from not realistic/useful (1) to very realistic/useful (5). Results Face-validity scores showed that the VBLaST system was significantly realistic in portraying the three FLS tasks (3.95 ± 0.909), as well as the reality in trocar placement and tool movements (3.67 ± 0.874). Construct-validity results show that VBLaST was able to differentiate between the expert and novice group (P = 0.015). However, of the two tasks used for evaluating VBLaST, only the peg-transfer task showed a significant difference between the expert and novice groups (P = 0.003). Spearman correlation coefficient analysis between the two scores showed significant correlation for the peg-transfer task (Spearman coefficient 0.364; P = 0.023). Conclusions VBLaST demonstrated significant face and construct validity. A further set of studies, involving improvement to the current VBLaST system, is needed to thoroughly demonstrate face and construct validity for all the tasks. PMID:20201683

The Cerebral Palsy Quality of Life for Children (CP QOL-Child): Evidence of Construct Validity

ERIC Educational Resources Information Center

Chen, Kuan-Lin; Wang, Hui-Yi; Tseng, Mei-Hui; Shieh, Jeng-Yi; Lu, Lu; Yao, Kai-Ping Grace; Huang, Chien-Yu

2013-01-01

The Cerebral Palsy Quality of Life for Children (CP QOL-Child) is the first health condition-specific questionnaire designed for measuring QOL in children with cerebral palsy (CP). However, its construct validity has not yet been confirmed by confirmatory factor analysis (CFA). Hence, this study assessed the construct validity of the caregiver…

Visual reproduction subtest of the Wechsler Memory Scale-Revised: analysis of construct validity.

PubMed

Williams, M A; Rich, M A; Reed, L K; Jackson, W T; LaMarche, J A; Boll, T J

1998-11-01

This study assessed the construct validity of Visual Reproduction (VR) Cards A (Flags) and B (Boxes) from the original Wechsler Memory Scale (WMS) compared to Flags and Boxes from the revised edition of the WMS (WMS-R). Independent raters scored Flags and Boxes using both the original and revised scoring criteria and correlations were obtained with age, education, IQ, and four separate criterion memory measures. Results show that for Flags, there is a tendency for the revised scoring criteria to produce improved construct validity. For Boxes, however, there was a trend in the opposite direction, with the revised scoring criteria demonstrating worse construct validity. Factor analysis suggests that Flags are a more distinct measure of visual memory, whereas Boxes are more complex and significantly associated with conceptual reasoning abilities. Using the revised scoring criteria, Boxes were found to be more strongly related to IQ than Flags. This difference was not found using the original scoring criteria.

Health Sciences-Evidence Based Practice questionnaire (HS-EBP) for measuring transprofessional evidence-based practice: Creation, development and psychometric validation.

PubMed

Fernández-Domínguez, Juan Carlos; de Pedro-Gómez, Joan Ernest; Morales-Asencio, José Miguel; Bennasar-Veny, Miquel; Sastre-Fullana, Pedro; Sesé-Abad, Albert

2017-01-01

Most of the EBP measuring instruments available to date present limitations both in the operationalisation of the construct and also in the rigour of their psychometric development, as revealed in the literature review performed. The aim of this paper is to provide rigorous and adequate reliability and validity evidence of the scores of a new transdisciplinary psychometric tool, the Health Sciences Evidence-Based Practice (HS-EBP), for measuring the construct EBP in Health Sciences professionals. A pilot study and a subsequent two-stage validation test sample were conducted to progressively refine the instrument until a reduced 60-item version with a five-factor latent structure. Reliability was analysed through both Cronbach's alpha coefficient and intraclass correlations (ICC). Latent structure was contrasted using confirmatory factor analysis (CFA) following a model comparison aproach. Evidence of criterion validity of the scores obtained was achieved by considering attitudinal resistance to change, burnout, and quality of professional life as criterion variables; while convergent validity was assessed using the Spanish version of the Evidence-Based Practice Questionnaire (EBPQ-19). Adequate evidence of both reliability and ICC was obtained for the five dimensions of the questionnaire. According to the CFA model comparison, the best fit corresponded to the five-factor model (RMSEA = 0.049; CI 90% RMSEA = [0.047; 0.050]; CFI = 0.99). Adequate criterion and convergent validity evidence was also provided. Finally, the HS-EBP showed the capability to find differences between EBP training levels as an important evidence of decision validity. Reliability and validity evidence obtained regarding the HS-EBP confirm the adequate operationalisation of the EBP construct as a process put into practice to respond to every clinical situation arising in the daily practice of professionals in health sciences (transprofessional). The tool could be useful for EBP individual

[Comparison of the Wechsler Memory Scale-III and the Spain-Complutense Verbal Learning Test in acquired brain injury: construct validity and ecological validity].

PubMed

Luna-Lario, P; Pena, J; Ojeda, N

2017-04-16

To perform an in-depth examination of the construct validity and the ecological validity of the Wechsler Memory Scale-III (WMS-III) and the Spain-Complutense Verbal Learning Test (TAVEC). The sample consists of 106 adults with acquired brain injury who were treated in the Area of Neuropsychology and Neuropsychiatry of the Complejo Hospitalario de Navarra and displayed memory deficit as the main sequela, measured by means of specific memory tests. The construct validity is determined by examining the tasks required in each test over the basic theoretical models, comparing the performance according to the parameters offered by the tests, contrasting the severity indices of each test and analysing their convergence. The external validity is explored through the correlation between the tests and by using regression models. According to the results obtained, both the WMS-III and the TAVEC have construct validity. The TAVEC is more sensitive and captures not only the deficits in mnemonic consolidation, but also in the executive functions involved in memory. The working memory index of the WMS-III is useful for predicting the return to work at two years after the acquired brain injury, but none of the instruments anticipates the disability and dependence at least six months after the injury. We reflect upon the construct validity of the tests and their insufficient capacity to predict functionality when the sequelae become chronic.

The ad-libitum alcohol 'taste test': secondary analyses of potential confounds and construct validity.

PubMed

Jones, Andrew; Button, Emily; Rose, Abigail K; Robinson, Eric; Christiansen, Paul; Di Lemma, Lisa; Field, Matt

2016-03-01

Motivation to drink alcohol can be measured in the laboratory using an ad-libitum 'taste test', in which participants rate the taste of alcoholic drinks whilst their intake is covertly monitored. Little is known about the construct validity of this paradigm. The objective of this study was to investigate variables that may compromise the validity of this paradigm and its construct validity. We re-analysed data from 12 studies from our laboratory that incorporated an ad-libitum taste test. We considered time of day and participants' awareness of the purpose of the taste test as potential confounding variables. We examined whether gender, typical alcohol consumption, subjective craving, scores on the Alcohol Use Disorders Identification Test and perceived pleasantness of the drinks predicted ad-libitum consumption (construct validity). We included 762 participants (462 female). Participant awareness and time of day were not related to ad-libitum alcohol consumption. Males drank significantly more alcohol than females (p < 0.001), and individual differences in typical alcohol consumption (p = 0.04), craving (p < 0.001) and perceived pleasantness of the drinks (p = 0.04) were all significant predictors of ad-libitum consumption. We found little evidence that time of day or participant awareness influenced alcohol consumption. The construct validity of the taste test was supported by relationships between ad-libitum consumption and typical alcohol consumption, craving and pleasantness ratings of the drinks. The ad-libitum taste test is a valid method for the assessment of alcohol intake in the laboratory.

Construct Validity of the Emotional Eating Scale Adapted for Children and Adolescents

PubMed Central

Vannucci, Anna; Tanofsky-Kraff, Marian; Shomaker, Lauren B.; Ranzenhofer, Lisa M.; Matheson, Brittany E.; Cassidy, Omni L.; Zocca, Jaclyn M.; Kozlosky, Merel; Yanovski, Susan Z.; Yanovski, Jack A.

2012-01-01

Background Emotional eating, defined as eating in response to a range of negative emotions, is common in youth. Yet, there are few easily administered and well-validated methods to assess emotional eating in pediatric populations. Objective The current study tested the construct validity of the Emotional Eating Scale Adapted for Children and Adolescents (EES-C) by examining its relationship to observed emotional eating at laboratory test meals. Method One hundred fifty-one youth (8-18 years) participated in two multi-item lunch buffet meals on separate days. They ate ad libitum after being instructed to “eat as much as you would at a normal meal” or to “let yourself go and eat as much as you want.” State negative affect was assessed immediately prior to each meal. The EES-C was completed three months, on average, prior to the first test meal. Results Among youth with high EES-C total scores, but not low EES-C scores, higher pre-meal state negative affect was related to greater total energy intake at both meals, with and without the inclusion of age, race, sex, and BMI-z as covariates (ps < 0.03). Discussion The EES-C demonstrates good construct validity for children and adolescents’ observed energy intake across laboratory test meals designed to capture both normal and disinhibited eating. Future research is required to evaluate the construct validity of the EES-C in the natural environment and the predictive validity of the EES-C longitudinally. PMID:22124451

Inclusion at Work DEOCS 4.1 Construct Validity Summary

DTIC Science & Technology

2017-08-01

Inclusion at Work DEOCS 4.1 Construct Validity Summary DEFENSE EQUAL OPPORTUNITY MANAGEMENT INSTITUTE DIRECTORATE...2014, Defense Equal Opportunity Management Institute (DEOMI) released DEOCS 4.0 for Department of Defense military and civilian members. DEOMI...review of the research, see Ferdman & Deane, 2014). This highlights the need for leaders to manage their workforce in ways that will elicit positive

A Framework for Conducting ESL/EFL Construct Validation Studies.

ERIC Educational Resources Information Center

Mouw, John T.; Perkins, Kyle

The purpose for which a test is used and the examinees' stage of learning are two anchor points that are incorporated into a suggested framework for conducting construct validation studies for tests of students with English as a second language (ESL) or English as a foreign language (EFL). The framework includes the use of generalizability theory,…

Validation of the updated ArthroS simulator: face and construct validity of a passive haptic virtual reality simulator with novel performance metrics.

PubMed

Garfjeld Roberts, Patrick; Guyver, Paul; Baldwin, Mathew; Akhtar, Kash; Alvand, Abtin; Price, Andrew J; Rees, Jonathan L

2017-02-01

To assess the construct and face validity of ArthroS, a passive haptic VR simulator. A secondary aim was to evaluate the novel performance metrics produced by this simulator. Two groups of 30 participants, each divided into novice, intermediate or expert based on arthroscopic experience, completed three separate tasks on either the knee or shoulder module of the simulator. Performance was recorded using 12 automatically generated performance metrics and video footage of the arthroscopic procedures. The videos were blindly assessed using a validated global rating scale (GRS). Participants completed a survey about the simulator's realism and training utility. This new simulator demonstrated construct validity of its tasks when evaluated against a GRS (p ≤ 0.003 in all cases). Regarding it's automatically generated performance metrics, established outputs such as time taken (p ≤ 0.001) and instrument path length (p ≤ 0.007) also demonstrated good construct validity. However, two-thirds of the proposed 'novel metrics' the simulator reports could not distinguish participants based on arthroscopic experience. Face validity assessment rated the simulator as a realistic and useful tool for trainees, but the passive haptic feedback (a key feature of this simulator) is rated as less realistic. The ArthroS simulator has good task construct validity based on established objective outputs, but some of the novel performance metrics could not distinguish between surgical experience. The passive haptic feedback of the simulator also needs improvement. If simulators could offer automated and validated performance feedback, this would facilitate improvements in the delivery of training by allowing trainees to practise and self-assess.

Construct validity of the Iowa Gambling Task.

PubMed

Buelow, Melissa T; Suhr, Julie A

2009-03-01

The Iowa Gambling Task (IGT) was created to assess real-world decision making in a laboratory setting and has been applied to various clinical populations (i.e., substance abuse, schizophrenia, pathological gamblers) outside those with orbitofrontal cortex damage, for whom it was originally developed. The current review provides a critical examination of lesion, functional neuroimaging, developmental, and clinical studies in order to examine the construct validity of the IGT. The preponderance of evidence provides support for the use of the IGT to detect decision making deficits in clinical populations, in the context of a more comprehensive evaluation. The review includes a discussion of three critical issues affecting the validity of the IGT, as it has recently become available as a clinical instrument: the lack of a concise definition as to what aspect of decision making the IGT measures, the lack of data regarding reliability of the IGT, and the influence of personality and state mood on IGT performance.

[Validity and reliability of a scale to assess self-efficacy for physical activity in elderly].

PubMed

Borges, Rossana Arruda; Rech, Cassiano Ricardo; Meurer, Simone Teresinha; Benedetti, Tânia Rosane Bertoldo

2015-04-01

This study aimed to analyze the confirmatory factor validity and reliability of a self-efficacy scale for physical activity in a sample of 118 elderly (78% women) from 60 to 90 years of age. Mplus 6.1 was used to evaluate the confirmatory factor analysis. Reliability was tested by internal consistency and temporal stability. The original scale consisted of five items with dichotomous answers (yes/no), independently for walking and moderate and vigorous physical activity. The analysis excluded the item related to confidence in performing physical activities when on vacation. Two constructs were identified, called "self-efficacy for walking" and "self-efficacy for moderate and vigorous physical activity", with a factor load ≥ 0.50. Internal consistency was adequate both for walking (> 0.70) and moderate and vigorous physical activity (> 0.80), and temporal stability was adequate for all the items. In conclusion, the self-efficacy scale for physical activity showed adequate validity, reliability, and internal consistency for evaluating this construct in elderly Brazilians.

Measuring Social Relationships in Different Social Systems: The Construction and Validation of the Evaluation of Social Systems (EVOS) Scale

PubMed Central

Aguilar-Raab, Corina; Grevenstein, Dennis; Schweitzer, Jochen

2015-01-01

Social interactions have gained increasing importance, both as an outcome and as a possible mediator in psychotherapy research. Still, there is a lack of adequate measures capturing relational aspects in multi-person settings. We present a new measure to assess relevant dimensions of quality of relationships and collective efficacy regarding interpersonal interactions in diverse personal and professional social systems including couple partnerships, families, and working teams: the EVOS. Theoretical dimensions were derived from theories of systemic family therapy and organizational psychology. The study was divided in three parts: In Study 1 (N = 537), a short 9-item scale with two interrelated factors was constructed on the basis of exploratory factor analysis. Quality of relationship and collective efficacy emerged as the most relevant dimensions for the quality of social systems. Study 2 (N = 558) confirmed the measurement model using confirmatory factor analysis and established validity with measures of family functioning, life satisfaction, and working team efficacy. Measurement invariance was assessed to ensure that EVOS captures the same latent construct in all social contexts. In Study 3 (N = 317), an English language adaptation was developed, which again confirmed the original measurement model. The EVOS is a theory-based, economic, reliable, and valid measure that covers important aspects of social relationships, applicable for different social systems. It is the first instrument of its kind and an important addition to existing measures of social relationships and related outcome measures in therapeutic and other counseling settings involving multiple persons. PMID:26200357

Testing for Factorial Invariance in the Context of Construct Validation

ERIC Educational Resources Information Center

Dimitrov, Dimiter M.

2010-01-01

This article describes the logic and procedures behind testing for factorial invariance across groups in the context of construct validation. The procedures include testing for configural, measurement, and structural invariance in the framework of multiple-group confirmatory factor analysis (CFA). The "forward" (sequential constraint imposition)…

Career Adapt-Abilities Scale--China Form: Construction and Initial Validation

ERIC Educational Resources Information Center

Hou, Zhi-Jin; Leung, S. Alvin; Li, Xixi; Li, Xu; Xu, Hui

2012-01-01

The Career Adapt-Abilities Scale (CAAS)--China Form consists of four subscales, with six items each to measure Concern, Control, Curiosity, and Confidence as psychosocial resources for managing occupational transitions, developmental tasks, and work traumas. This study investigated the construction and validation of its Chinese Form. Results…

Elucidating the Construct Validity of the Psychopathic Personality Inventory Triarchic Scales.

PubMed

Sellbom, Martin; Wygant, Dustin B; Drislane, Laura E

2015-01-01

This study sought to replicate and extend Hall and colleagues' (2014) work on developing and validating scales from the Psychopathic Personality Inventory (PPI) to index the triarchic psychopathy constructs of boldness, meanness, and disinhibition. This study also extended Hall et al.'s initial findings by including the PPI Revised (PPI-R). A community sample (n = 240) weighted toward subclinical psychopathy traits and a male prison sample (n = 160) were used for this study. Results indicated that PPI-Boldness, PPI-Meanness, and PPI-Disinhibition converged with other psychopathy, personality, and behavioral criteria in ways conceptually expected from the perspective of the triarchic psychopathy model, including showing very strong convergent and discriminant validity with their Triarchic Psychopathy Measure counterparts. These findings further enhance the utility of the PPI and PPI-R in measuring these constructs.

Validation of the MISSCARE-BRASIL survey - A tool to assess missed nursing care.

PubMed

Siqueira, Lillian Dias Castilho; Caliri, Maria Helena Larcher; Haas, Vanderlei José; Kalisch, Beatrice; Dantas, Rosana Aparecida Spadoti

2017-12-21

to analyze the metric validity and reliability properties of the MISSCARE-BRASIL survey. methodological research conducted by assessing construct validity and reliability via confirmatory factor analysis, known-groups validation, convergent construct validation, analysis of internal consistency and test-retest reliability. The sample consisted of 330 nursing professionals, of whom 86 participated in the retest phase. of the 330 participants, 39.7% were aides, 33% technicians, 20.9% nurses, and 6.4% nurses with administrative roles. Confirmatory factorial analysis demonstrated that the Brazilian Portuguese version of the instrument is adequately adjusted to the dimensional structure the scale authors originally proposed. The correlation between "satisfaction with position/role" and "satisfaction with teamwork" and the survey's missed care variables was moderate (Spearman's coefficient =0.35; p<0.001). The results of the Student's t-test indicated known-group validity. Professionals from closed units reported lower levels of missed care in comparison with the other units. The reliability showed a strong correlation, with the exception of "institutional management/leadership style" (intraclass correlation coefficient (ICC)=0.15; p=0.04). The internal consistency was adequate (Cronbach's alpha was greater than 0.70). the MISSCARE-BRASIL was valid and reliable in the group studied. The application of the MISSCARE-BRASIL can contribute to identifying solutions for missed nursing care.

Dynamic testing in schizophrenia: does training change the construct validity of a test?

PubMed

Wiedl, Karl H; Schöttke, Henning; Green, Michael F; Nuechterlein, Keith H

2004-01-01

Dynamic testing typically involves specific interventions for a test to assess the extent to which test performance can be modified, beyond level of baseline (static) performance. This study used a dynamic version of the Wisconsin Card Sorting Test (WCST) that is based on cognitive remediation techniques within a test-training-test procedure. From results of previous studies with schizophrenia patients, we concluded that the dynamic and static versions of the WCST should have different construct validity. This hypothesis was tested by examining the patterns of correlations with measures of executive functioning, secondary verbal memory, and verbal intelligence. Results demonstrated a specific construct validity of WCST dynamic (i.e., posttest) scores as an index of problem solving (Tower of Hanoi) and secondary verbal memory and learning (Auditory Verbal Learning Test), whereas the impact of general verbal capacity and selective attention (Verbal IQ, Stroop Test) was reduced. It is concluded that the construct validity of the test changes with dynamic administration and that this difference helps to explain why the dynamic version of the WCST predicts functional outcome better than the static version.

Construction and validation of attitudes toward plagiarism questionnaire.

PubMed

Mavrinac, Martina; Brumini, Gordana; Bilić-Zulle, Lidija; Petrovecki, Mladen

2010-06-01

To develop and test the psychometric characteristics of a questionnaire measuring attitudes toward plagiarism. Participants were 227 undergraduates and graduate students (128 women and 99 men) from three Croatian universities, with a median age of 21 years (range 18 to 48). Research was conducted from March to June 2009. For the purpose of construction of the first version of the questionnaire, 67 statements (items) were developed. The statements were based on the relevant literature and were developed following rules and recommendations for questionnaire writing, and 36 items were chosen for final validation. Factor analysis was used to find out the factor structure of the questionnaire and to measure construct validity. The final version of the questionnaire consisted of 29 items divided into a three-factor structure: factor I - positive attitude toward plagiarism (12 items); factor II - negative attitude toward plagiarism (7 items); and factor III - subjective norms toward plagiarism (10 items). Cronbach alpha was calculated to confirm the reliability of the scale: factor I - alpha=0.83; factor II - alpha=0.79; and factor III - alpha=0.85. Correlations between factors were: -0.37 between I and II, -0.41 between I and III, and +0.31 between II and III. Attitudes Toward Plagiarism questionnaire was developed, with good psychometric characteristics. It will be used in future research as a standardized tool for measuring attitudes toward plagiarism.

Construct validity test of evaluation tool for professional behaviors of entry-level occupational therapy students in the United States.

PubMed

Yuen, Hon K; Azuero, Andres; Lackey, Kaitlin W; Brown, Nicole S; Shrestha, Sangita

2016-01-01

This study aimed to test the construct validity of an instrument to measure student professional behaviors in entry-level occupational therapy (OT) students in the academic setting. A total of 718 students from 37 OT programs across the United States answered a self-assessment survey of professional behavior that we developed. The survey consisted of ranking 28 attributes, each on a 5-point Likert scale. A split-sample approach was used for exploratory and then confirmatory factor analysis. A three-factor solution with nine items was extracted using exploratory factor analysis [EFA] (n=430, 60%). The factors were 'Commitment to Learning' (2 items), 'Skills for Learning' (4 items), and 'Cultural Competence' (3 items). Confirmatory factor analysis (CFA) on the validation split (n=288, 40%) indicated fair fit for this three-factor model (fit indices: CFI=0.96, RMSEA=0.06, and SRMR=0.05). Internal consistency reliability estimates of each factor and the instrument ranged from 0.63 to 0.79. Results of the CFA in a separate validation dataset provided robust measures of goodness-of-fit for the three-factor solution developed in the EFA, and indicated that the three-factor model fitted the data well enough. Therefore, we can conclude that this student professional behavior evaluation instrument is a structurally validated tool to measure professional behaviors reported by entry-level OT students. The internal consistency reliability of each individual factor and the whole instrument was considered to be adequate to good.

Construct Validity of the MMPI-2 College Maladjustment (Mt) Scale

ERIC Educational Resources Information Center

Barthlow, Deanna L.; Graham, John R.; Ben-Porath, Yossef S.; McNulty, John L

2004-01-01

The construct validity of the MMPI-2 (Minnesota Multiphasic Personality Inventory-2) College Maladjustment (Mt) Scale was examined using 376 student clients at a university psychological clinic. A principal components analysis and correlations of Mt scale scores with clients' and therapists' ratings of symptoms and functioning showed that the Mt…

Development and empirical validation of symmetric component measures of multidimensional constructs: customer and competitor orientation.

PubMed

Sørensen, Hans Eibe; Slater, Stanley F

2008-08-01

Atheoretical measure purification may lead to construct deficient measures. The purpose of this paper is to provide a theoretically driven procedure for the development and empirical validation of symmetric component measures of multidimensional constructs. Particular emphasis is placed on establishing a formalized three-step procedure for achieving a posteriori content validity. Then the procedure is applied to development and empirical validation of two symmetrical component measures of market orientation, customer orientation and competitor orientation. Analysis suggests that average variance extracted is particularly critical to reliability in the respecification of multi-indicator measures. In relation to this, the results also identify possible deficiencies in using Cronbach alpha for establishing reliable and valid measures.

Shame, trauma, temperament and psychopathology: Construct validity of the Experience of Shame Scale.

PubMed

Vizin, Gabriella; Urbán, Róbert; Unoka, Zsolt

2016-12-30

Although Experience of Shame Scale (ESS) is used in clinical research and it covers psychiatrically relevant dimensions of chronic shame, characterological (CS), behavioral (BS) and bodily (BoS) respectively, its factor structures were not confirmed on clinical sample. The goals of our research were to examine the factor structure of the Hungarian version of ESS, in addition, to analyze the associations between factors of ESS and different types of predictors, such as clinical status, gender, age, school years, early abuse history, general psychopathology (GSI), and temperament dimensions by using a series of confirmatory factor analyses (CFA) with covariates in a large clinical and matched healthy sample. Psychiatric inpatients (N=148) and healthy control subjects (N=148) participated in this cross-sectional questionnaire study. In both samples, the degree of fit was adequate. The final CFA with covariates model showed significant and positive associations between CS and clinical status and education respectively, between CS, BS, BoS and frequency of verbal abuse, between CS and BoS and GSI and between CS and BS and harm avoidance and in addition we found negative associations between each of the shame factors and age. Our results support the psychiatric validity of the ESS construct. Copyright © 2016 Elsevier Ireland Ltd. All rights reserved.

Reliability and criterion-related validity testing (construct) of the Endotracheal Suction Assessment Tool (ESAT©).

PubMed

Davies, Kylie; Bulsara, Max K; Ramelet, Anne-Sylvie; Monterosso, Leanne

2018-05-01

To establish criterion-related construct validity and test-retest reliability for the Endotracheal Suction Assessment Tool© (ESAT©). Endotracheal tube suction performed in children can significantly affect clinical stability. Previously identified clinical indicators for endotracheal tube suction were used as criteria when designing the ESAT©. Content validity was reported previously. The final stages of psychometric testing are presented. Observational testing was used to measure construct validity and determine whether the ESAT© could guide "inexperienced" paediatric intensive care nurses' decision-making regarding endotracheal tube suction. Test-retest reliability of the ESAT© was performed at two time points. The researchers and paediatric intensive care nurse "experts" developed 10 hypothetical clinical scenarios with predetermined endotracheal tube suction outcomes. "Experienced" (n = 12) and "inexperienced" (n = 14) paediatric intensive care nurses were presented with the scenarios and the ESAT© guiding decision-making about whether to perform endotracheal tube suction for each scenario. Outcomes were compared with those predetermined by the "experts" (n = 9). Test-retest reliability of the ESAT© was measured at two consecutive time points (4 weeks apart) with "experienced" and "inexperienced" paediatric intensive care nurses using the same scenarios and tool to guide decision-making. No differences were observed between endotracheal tube suction decisions made by "experts" (n = 9), "inexperienced" (n = 14) and "experienced" (n = 12) nurses confirming the tool's construct validity. No differences were observed between groups for endotracheal tube suction decisions at T1 and T2. Criterion-related construct validity and test-retest reliability of the ESAT© were demonstrated. Further testing is recommended to confirm reliability in the clinical setting with the "inexperienced" nurse to guide decision-making related to endotracheal tube

Testing the Construct Validity of a Virtual Reality Hip Arthroscopy Simulator.

PubMed

Khanduja, Vikas; Lawrence, John E; Audenaert, Emmanuel

2017-03-01

To test the construct validity of the hip diagnostics module of a virtual reality hip arthroscopy simulator. Nineteen orthopaedic surgeons performed a simulated arthroscopic examination of a healthy hip joint using a 70° arthroscope in the supine position. Surgeons were categorized as either expert (those who had performed 250 hip arthroscopies or more) or novice (those who had performed fewer than this). Twenty-one specific targets were visualized within the central and peripheral compartments; 9 via the anterior portal, 9 via the anterolateral portal, and 3 via the posterolateral portal. This was immediately followed by a task testing basic probe examination of the joint in which a series of 8 targets were probed via the anterolateral portal. During the tasks, the surgeon's performance was evaluated by the simulator using a set of predefined metrics including task duration, number of soft tissue and bone collisions, and distance travelled by instruments. No repeat attempts at the tasks were permitted. Construct validity was then evaluated by comparing novice and expert group performance metrics over the 2 tasks using the Mann-Whitney test, with a P value of less than .05 considered significant. On the visualization task, the expert group outperformed the novice group on time taken (P = .0003), number of collisions with soft tissue (P = .001), number of collisions with bone (P = .002), and distance travelled by the arthroscope (P = .02). On the probe examination, the 2 groups differed only in the time taken to complete the task (P = .025) with no significant difference in other metrics. Increased experience in hip arthroscopy was reflected by significantly better performance on the virtual reality simulator across 2 tasks, supporting its construct validity. This study validates a virtual reality hip arthroscopy simulator and supports its potential for developing basic arthroscopic skills. Level III. Copyright © 2016 Arthroscopy Association of North America

THE CONSTRUCTION AND VALIDATION OF A MEASURE OF VOCATIONAL MATURITY.

ERIC Educational Resources Information Center

CLARY, JOE R.; WESTBROOK, BERT W.

THIS REPORT DEALS WITH THE ORGANIZATION, RATIONALE, METHODS AND EXPECTED END-PRODUCTS OF A RESEARCH PROJECT (SCHEDULED FOR COMPLETION ON JUNE 23, 1970) FOR THE CONSTRUCTION AND VALIDATION OF A RELIABLE VOCATIONAL MATURITY MEASURE (VMM). THE PROJECT'S EIGHT PHASES AND ACTIVITIES ARE EXPLAINED. THE PROJECT ASSUMES--(1) THE INDIVIDUAL AND SOCIETY AS…

Illustrating a Mixed-Method Approach for Validating Culturally Specific Constructs

ERIC Educational Resources Information Center

Hitchcock, J.H.; Nastasi, B.K.; Dai, D.Y.; Newman, J.; Jayasena, A.; Bernstein-Moore, R.; Sarkar, S.; Varjas, K.

2005-01-01

The purpose of this article is to illustrate a mixed-method approach (i.e., combining qualitative and quantitative methods) for advancing the study of construct validation in cross-cultural research. The article offers a detailed illustration of the approach using the responses 612 Sri Lankan adolescents provided to an ethnographic survey. Such…

Construct Validation of the Physics Metacognition Inventory

NASA Astrophysics Data System (ADS)

Taasoobshirazi, Gita; Farley, John

2013-02-01

The 24-item Physics Metacognition Inventory was developed to measure physics students' metacognition for problem solving. Items were classified into eight subcomponents subsumed under two broader components: knowledge of cognition and regulation of cognition. The students' scores on the inventory were found to be reliable and related to students' physics motivation and physics grade. An exploratory factor analysis provided evidence of construct validity, revealing six components of students' metacognition when solving physics problems including: knowledge of cognition, planning, monitoring, evaluation, debugging, and information management. Although women and men differed on the components, they had equivalent overall metacognition for problem solving. The implications of these findings for future research are discussed.

Construction and Validation of the Perceived Opportunity to Craft Scale.

PubMed

van Wingerden, Jessica; Niks, Irene M W

2017-01-01

We developed and validated a scale to measure employees' perceived opportunity to craft (POC) in two separate studies conducted in the Netherlands (total N = 2329). POC is defined as employees' perception of their opportunity to craft their job. In Study 1, the perceived opportunity to craft scale (POCS) was developed and tested for its factor structure and reliability in an explorative way. Study 2 consisted of confirmatory analyses of the factor structure and reliability of the scale as well as examination of the discriminant and criterion-related validity of the POCS. The results indicated that the scale consists of one dimension and could be reliably measured with five items. Evidence was found for the discriminant validity of the POCS. The scale also showed criterion-related validity when correlated with job crafting (+), job resources (autonomy +; opportunities for professional development +), work engagement (+), and the inactive construct cynicism (-). We discuss the implications of these findings for theory and practice.

The Construction of Mathematical Literacy Problems for Geometry

NASA Astrophysics Data System (ADS)

Malasari, P. N.; Herman, T.; Jupri, A.

2017-09-01

The students of junior high school should have mathematical literacy ability to formulate, apply, and interpret mathematics in problem solving of daily life. Teaching these students are not enough by giving them ordinary mathematics problems. Teaching activities for these students brings consequence for teacher to construct mathematical literacy problems. Therefore, the aim of this study is to construct mathematical literacy problems to assess mathematical literacy ability. The steps of this study that consists of analysing, designing, theoretical validation, revising, limited testing to students, and evaluating. The data was collected with written test to 38 students of grade IX at one of state junior high school. Mathematical literacy problems consist of three essays with three indicators and three levels at polyhedron subject. The Indicators are formulating and employing mathematics. The results show that: (1) mathematical literacy problems which are constructed have been valid and practical, (2) mathematical literacy problems have good distinguishing characteristics and adequate distinguishing characteristics, (3) difficulty levels of problems are easy and moderate. The final conclusion is mathematical literacy problems which are constructed can be used to assess mathematical literacy ability.

Construction and Validation of Attitudes Toward Plagiarism Questionnaire

PubMed Central

Mavrinac, Martina; Brumini, Gordana; Bilić-Zulle, Lidija; Petrovečki, Mladen

2010-01-01

Aim To develop and test the psychometric characteristics of a questionnaire measuring attitudes toward plagiarism. Methods Participants were 227 undergraduates and graduate students from three Croatian universities, with a median age of 21 years (range 18 to 48). Research was conducted from March to June 2009. For the purpose of construction of the first version of the questionnaire, 67 statements (items) were developed. The statements were based on the relevant literature and were developed following rules and recommendations for questionnaire writing, and 36 items were chosen for final validation. Factor analysis was used to find out the factor structure of the questionnaire and to measure construct validity. Results The final version of the questionnaire consisted of 29 items divided into a three-factor structure: factor I – positive attitude toward plagiarism (12 items); factor II – negative attitude toward plagiarism (7 items); and factor III – subjective norms toward plagiarism (10 items). Cronbach α was calculated to confirm the reliability of the scale: factor I – α = 0.83; factor II – α = 0.79; and factor III – α = 0.85. Correlations between factors were: -0.37 between I and II, -0.41 between I and III, and +0.31 between II and III. Conclusion Attitudes Toward Plagiarism questionnaire was developed, with good psychometric characteristics. It will be used in future research as a standardized tool for measuring attitudes toward plagiarism. PMID:20564761

Experimentally Manipulating Items Informs on the (Limited) Construct and Criterion Validity of the Humor Styles Questionnaire

PubMed Central

Ruch, Willibald; Heintz, Sonja

2017-01-01

How strongly does humor (i.e., the construct-relevant content) in the Humor Styles Questionnaire (HSQ; Martin et al., 2003) determine the responses to this measure (i.e., construct validity)? Also, how much does humor influence the relationships of the four HSQ scales, namely affiliative, self-enhancing, aggressive, and self-defeating, with personality traits and subjective well-being (i.e., criterion validity)? The present paper answers these two questions by experimentally manipulating the 32 items of the HSQ to only (or mostly) contain humor (i.e., construct-relevant content) or to substitute the humor content with non-humorous alternatives (i.e., only assessing construct-irrelevant context). Study 1 (N = 187) showed that the HSQ affiliative scale was mainly determined by humor, self-enhancing and aggressive were determined by both humor and non-humorous context, and self-defeating was primarily determined by the context. This suggests that humor is not the primary source of the variance in three of the HQS scales, thereby limiting their construct validity. Study 2 (N = 261) showed that the relationships of the HSQ scales to the Big Five personality traits and subjective well-being (positive affect, negative affect, and life satisfaction) were consistently reduced (personality) or vanished (subjective well-being) when the non-humorous contexts in the HSQ items were controlled for. For the HSQ self-defeating scale, the pattern of relationships to personality was also altered, supporting an positive rather than a negative view of the humor in this humor style. The present findings thus call for a reevaluation of the role that humor plays in the HSQ (construct validity) and in the relationships to personality and well-being (criterion validity). PMID:28473794

Health Sciences-Evidence Based Practice questionnaire (HS-EBP) for measuring transprofessional evidence-based practice: Creation, development and psychometric validation

PubMed Central

Fernández-Domínguez, Juan Carlos; de Pedro-Gómez, Joan Ernest; Morales-Asencio, José Miguel; Sastre-Fullana, Pedro; Sesé-Abad, Albert

2017-01-01

Introduction Most of the EBP measuring instruments available to date present limitations both in the operationalisation of the construct and also in the rigour of their psychometric development, as revealed in the literature review performed. The aim of this paper is to provide rigorous and adequate reliability and validity evidence of the scores of a new transdisciplinary psychometric tool, the Health Sciences Evidence-Based Practice (HS-EBP), for measuring the construct EBP in Health Sciences professionals. Methods A pilot study and a subsequent two-stage validation test sample were conducted to progressively refine the instrument until a reduced 60-item version with a five-factor latent structure. Reliability was analysed through both Cronbach’s alpha coefficient and intraclass correlations (ICC). Latent structure was contrasted using confirmatory factor analysis (CFA) following a model comparison aproach. Evidence of criterion validity of the scores obtained was achieved by considering attitudinal resistance to change, burnout, and quality of professional life as criterion variables; while convergent validity was assessed using the Spanish version of the Evidence-Based Practice Questionnaire (EBPQ-19). Results Adequate evidence of both reliability and ICC was obtained for the five dimensions of the questionnaire. According to the CFA model comparison, the best fit corresponded to the five-factor model (RMSEA = 0.049; CI 90% RMSEA = [0.047; 0.050]; CFI = 0.99). Adequate criterion and convergent validity evidence was also provided. Finally, the HS-EBP showed the capability to find differences between EBP training levels as an important evidence of decision validity. Conclusions Reliability and validity evidence obtained regarding the HS-EBP confirm the adequate operationalisation of the EBP construct as a process put into practice to respond to every clinical situation arising in the daily practice of professionals in health sciences (transprofessional). The

Comparability and Reliability Considerations of Adequate Yearly Progress

ERIC Educational Resources Information Center

Maier, Kimberly S.; Maiti, Tapabrata; Dass, Sarat C.; Lim, Chae Young

2012-01-01

The purpose of this study is to develop an estimate of Adequate Yearly Progress (AYP) that will allow for reliable and valid comparisons among student subgroups, schools, and districts. A shrinkage-type estimator of AYP using the Bayesian framework is described. Using simulated data, the performance of the Bayes estimator will be compared to…

Parent- and Self-Reported Dimensions of Oppositionality in Youth: Construct Validity, Concurrent Validity, and the Prediction of Criminal Outcomes in Adulthood

ERIC Educational Resources Information Center

Aebi, Marcel; Plattner, Belinda; Metzke, Christa Winkler; Bessler, Cornelia; Steinhausen, Hans-Christoph

2013-01-01

Background: Different dimensions of oppositional defiant disorder (ODD) have been found as valid predictors of further mental health problems and antisocial behaviors in youth. The present study aimed at testing the construct, concurrent, and predictive validity of ODD dimensions derived from parent- and self-report measures. Method: Confirmatory…

Are we really measuring what we say we're measuring? Using video techniques to supplement traditional construct validation procedures.

PubMed

Podsakoff, Nathan P; Podsakoff, Philip M; Mackenzie, Scott B; Klinger, Ryan L

2013-01-01

Several researchers have persuasively argued that the most important evidence to consider when assessing construct validity is whether variations in the construct of interest cause corresponding variations in the measures of the focal construct. Unfortunately, the literature provides little practical guidance on how researchers can go about testing this. Therefore, the purpose of this article is to describe how researchers can use video techniques to test whether their scales measure what they purport to measure. First, we discuss how researchers can develop valid manipulations of the focal construct that they hope to measure. Next, we explain how to design a study to use this manipulation to test the validity of the scale. Finally, comparing and contrasting traditional and contemporary perspectives on validation, we discuss the advantages and limitations of video-based validation procedures. PsycINFO Database Record (c) 2013 APA, all rights reserved.

The Resilience Scale for Adults: Construct Validity and Measurement in a Belgian Sample

ERIC Educational Resources Information Center

Hjemdal, Odin; Friborg, Oddgeir; Braun, Stephanie; Kempenaers, Chantal; Linkowski, Paul; Fossion, Pierre

2011-01-01

The Resilience Scale for Adults (RSA) was developed and has been extensively validated in Norwegian samples. The purpose of this study was to explore the construct validity of the Resilience Scale for Adults in a French-speaking Belgian sample and test measurement invariance between the Belgian and a Norwegian sample. A Belgian student sample (N =…

Development and construct validation of the Client-Centredness of Goal Setting (C-COGS) scale.

PubMed

Doig, Emmah; Prescott, Sarah; Fleming, Jennifer; Cornwell, Petrea; Kuipers, Pim

2015-07-01

Client-centred philosophy is integral to occupational therapy practice and client-centred goal planning is considered fundamental to rehabilitation. Evaluation of whether goal-planning practices are client-centred requires an understanding of the client's perspective about goal-planning processes and practices. The Client-Centredness of Goal Setting (C-COGS) was developed for use by practitioners who seek to be more client-centred and who require a scale to guide and evaluate individually orientated practice, especially with adults with cognitive impairment related to acquired brain injury. To describe development of the C-COGS scale and examine its construct validity. The C-COGS was administered to 42 participants with acquired brain injury after multidisciplinary goal planning. C-COGS scores were correlated with the Canadian Occupational Performance Measure (COPM) importance scores, and measures of therapeutic alliance, motivation, and global functioning to establish construct validity. The C-COGS scale has three subscales evaluating goal alignment, goal planning participation, and client-centredness of goals. The C-COGS subscale items demonstrated moderately significant correlations with scales measuring similar constructs. Findings provide preliminary evidence to support the construct validity of the C-COGS scale, which is intended to be used to evaluate and reflect on client-centred goal planning in clinical practice, and to highlight factors contributing to best practice rehabilitation.

Validity test and its consistency in the construction of patient loyalty model

NASA Astrophysics Data System (ADS)

Yanuar, Ferra

2016-04-01

The main objective of this present study is to demonstrate the estimation of validity values and its consistency based on structural equation model. The method of estimation was then implemented to an empirical data in case of the construction the patient loyalty model. In the hypothesis model, service quality, patient satisfaction and patient loyalty were determined simultaneously, each factor were measured by any indicator variables. The respondents involved in this study were the patients who ever got healthcare at Puskesmas in Padang, West Sumatera. All 394 respondents who had complete information were included in the analysis. This study found that each construct; service quality, patient satisfaction and patient loyalty were valid. It means that all hypothesized indicator variables were significant to measure their corresponding latent variable. Service quality is the most measured by tangible, patient satisfaction is the most mesured by satisfied on service and patient loyalty is the most measured by good service quality. Meanwhile in structural equation, this study found that patient loyalty was affected by patient satisfaction positively and directly. Service quality affected patient loyalty indirectly with patient satisfaction as mediator variable between both latent variables. Both structural equations were also valid. This study also proved that validity values which obtained here were also consistence based on simulation study using bootstrap approach.

Longitudinal construct validity of the minimum data set health status index.

PubMed

Jones, Aaron; Feeny, David; Costa, Andrew P

2018-05-24

The Minimum Data Set Health Status Index (MDS-HSI) is a generic, preference-based health-related quality of life (HRQOL) measure derived by mapping items from the Resident Assessment Instrument - Minimum Data Set (RAI-MDS) assessment onto the Health Utilities Index Mark 2 classification system. While the validity of the MDS-HSI has been examined in cross-sectional settings, the longitudinal validity has not been explored. The objective of this study was to investigate the longitudinal construct validity of the MDS-HSI in a home care population. This study utilized a retrospective cohort of home care patients in the Hamilton-Niagara-Haldimand-Brant health region of Ontario, Canada with at least two RAI-MDS Home Care assessments between January 2010 and December 2014. Convergent validity was assessed by calculating Spearman rank correlations between the change in MDS-HSI and changes in six validated indices of health domains that can be calculated from the RAI-MDS assessment. Known-groups validity was investigated by fitting multivariable linear regression models to estimate the mean change in MDS-HSI associated with clinically important changes in the six health domain indices and 15 disease symptoms from the RAI-MDS Home Care assessment, controlling for age and sex. The cohort contained 25,182 patients with two RAI-MDS Home Care assessments. Spearman correlations between the MDS-HSI change and changes in the health domain indices were all statistically significant and in the hypothesized small to moderate range [0.1 < ρ < 0.5]. Clinically important changes in all of the health domain indices and 13 of the 15 disease symptoms were significantly associated with clinically important changes in the MDS-HSI. The findings of this study support the longitudinal construct validity of the MDS-HSI in home care populations. In addition to evaluating changes in HRQOL among home care patients in clinical research, economic evaluation, and health technology assessment

Transplantation of Tissue-Engineered Cartilage in an Animal Model (Xenograft and Autograft): Construct Validation.

PubMed

Nemoto, Hitoshi; Watson, Deborah; Masuda, Koichi

2015-01-01

Tissue engineering holds great promise for cartilage repair with minimal donor-site morbidity. The in vivo maturation of a tissue-engineered construct can be tested in the subcutaneous tissues of the same species for autografts or of immunocompromised animals for allografts or xenografts. This section describes detailed protocols for the surgical transplantation of a tissue-engineered construct into an animal model to assess construct validity.

Applying the Mixed Methods Instrument Development and Construct Validation Process: the Transformative Experience Questionnaire

ERIC Educational Resources Information Center

Koskey, Kristin L. K.; Sondergeld, Toni A.; Stewart, Victoria C.; Pugh, Kevin J.

2018-01-01

Onwuegbuzie and colleagues proposed the Instrument Development and Construct Validation (IDCV) process as a mixed methods framework for creating and validating measures. Examples applying IDCV are lacking. We provide an illustrative case integrating the Rasch model and cognitive interviews applied to the development of the Transformative…

Construct validation of an interactive digital algorithm for ostomy care.

PubMed

Beitz, Janice M; Gerlach, Mary A; Schafer, Vickie

2014-01-01

The purpose of this study was to evaluate construct validity for a previously face and content validated Ostomy Algorithm using digital real-life clinical scenarios. A cross-sectional, mixed-methods Web-based survey design study was conducted. Two hundred ninety-seven English-speaking RNs completed the study; participants practiced in both acute care and postacute settings, with 1 expert ostomy nurse (WOC nurse) and 2 nonexpert nurses. Following written consent, respondents answered demographic questions and completed a brief algorithm tutorial. Participants were then presented with 7 ostomy-related digital scenarios consisting of real-life photos and pertinent clinical information. Respondents used the 11 assessment components of the digital algorithm to choose management options. Participant written comments about the scenarios and the research process were collected. The mean overall percentage of correct responses was 84.23%. Mean percentage of correct responses for respondents with a self-reported basic ostomy knowledge was 87.7%; for those with a self-reported intermediate ostomy knowledge was 85.88% and those who were self-reported experts in ostomy care achieved 82.77% correct response rate. Five respondents reported having no prior ostomy care knowledge at screening and achieved an overall 45.71% correct response rate. No negative comments regarding the algorithm were recorded by participants. The new standardized Ostomy Algorithm remains the only face, content, and construct validated digital clinical decision instrument currently available. Further research on application at the bedside while tracking patient outcomes is warranted.

Dimensionality and construct validity of the Perceptions of Organizational Politics Scale (POPS).

DOT National Transportation Integrated Search

1992-02-01

This study examined the dimensionality and construct validity of Kacmar and Ferris (1991) Perceptions of Organizational Politics Scale (POPS), which is comprised of 3 subscales: "General Political Behavior," "Going Along to Get Ahead," and "Pay and P...

Construct and Concurrent Validity of a Prototype Questionnaire to Survey Public Attitudes toward Stuttering

ERIC Educational Resources Information Center

St. Louis, Kenneth O.; Reichel, Isabella K.; Yaruss, J. Scott; Lubker, Bobbie Boyd

2009-01-01

Purpose: Construct validity and concurrent validity were investigated in a prototype survey instrument, the "Public Opinion Survey of Human Attributes-Experimental Edition" (POSHA-E). The POSHA-E was designed to measure public attitudes toward stuttering within the context of eight other attributes, or "anchors," assumed to range from negative…

Construct validity of the modified numeric rating scale of patient global assessment in psoriatic arthritis.

PubMed

Leung, Ying-Ying; Ho, Kwok-Wah; Zhu, Tracy-Yanner; Tam, Lai-Shan; Kun, Emily Wailin; Li, Edmund Kwok-Ming

2012-04-01

The construct validity of the patient global health assessment (PGA) in psoriatic arthritis (PsA) has not been analyzed, despite its common use. We evaluated the construct validity of a numeric rating scale (NRS) of the PGA in PsA. Patients with PsA who fulfilled the ClASsification for Psoriatic ARthritis (CASPAR) criteria were recruited at a tertiary referral center. Demographic data were collected and PGA data were determined from administration of an 11-point NRS (0 to 10 points representing best to worst status). Convergent and discriminant validity were evaluated by correlation between PGA and clinical variables. Patients were grouped as having severe disease based on Disease Activity Score 28-joint count (DAS28) > 5.1, Health Assessment Questionnaire (HAQ) > 1.0, walking with aids, and social welfare-dependent. Patients were grouped as being in remission by DAS28 < 2.6 and the Minimal Disease Activity Criteria. Known-group validity of PGA was evaluated. A total of 125 patients (52% men) were studied. Convergent validity revealed strong correlations of PGA with pain score, HAQ, and DAS28; and weak correlations with skin severity score, physician's global assessment and morning stiffness. In multivariate analysis, PGA was associated with pain, physical function, mental function, and skin severity score. PGA distinguished different levels of severity well, as determined by comparison with different known groups with large effect sizes. Judged on an NRS, the PGA had good construct validity and satisfactorily distinguished all levels of severity in PsA.

Construction and Validation of a Holistic Education School Evaluation Tool Using Montessori Erdkinder Principles

ERIC Educational Resources Information Center

Setari, Anthony Philip

2016-01-01

The purpose of this study was to construct a holistic education school evaluation tool using Montessori Erdkinder principles, and begin the validation process of examining the proposed tool. This study addresses a vital need in the holistic education community for a school evaluation tool. The tool construction process included using Erdkinder…

Development, Construction, and Content Validation of a Questionnaire to Test Mobile Shower Commode Usability

PubMed Central

Theodoros, Deborah G.; Russell, Trevor G.

2015-01-01

Background: Usability is an emerging domain of outcomes measurement in assistive technology provision. Currently, no questionnaires exist to test the usability of mobile shower commodes (MSCs) used by adults with spinal cord injury (SCI). Objective: To describe the development, construction, and initial content validation of an electronic questionnaire to test mobile shower commode usability for this population. Methods: The questionnaire was constructed using a mixed-methods approach in 5 phases: determining user preferences for the questionnaire’s format, developing an item bank of usability indicators from the literature and judgement of experts, constructing a preliminary questionnaire, assessing content validity with a panel of experts, and constructing the final questionnaire. Results: The electronic Mobile Shower Commode Assessment Tool Version 1.0 (eMAST 1.0) questionnaire tests MSC features and performance during activities identified using a mixed-methods approach and in consultation with users. It confirms that usability is complex and multidimensional. The final questionnaire contains 25 questions in 3 sections. The eMAST 1.0 demonstrates excellent content validity as determined by a small sample of expert clinicians. Conclusion: The eMAST 1.0 tests usability of MSCs from the perspective of adults with SCI and may be used to solicit feedback during MSC design, assessment, prescription, and ongoing use. Further studies assessing the eMAST’s psychometric properties, including studies with users of MSCs, are needed. PMID:25762862

Constructing, Quantifying, and Validating an Adverse Outcome Pathway for Vascular Developmental Toxicity

EPA Science Inventory

Constructing, Quantifying, and Validating an Adverse Outcome Pathway for Vascular Developmental Toxicity The adverse outcome pathway (AOP) for embryonic vascular disruption1 leading to a range of adverse prenatal outcomes was recently entered into the AOP wiki and accepted as par...

Development and Construct Validation of a Situational Judgment Test of Strategic Knowledge of Classroom Management in Elementary Schools

ERIC Educational Resources Information Center

Gold, Bernadette; Holodynski, Manfred

2015-01-01

The current study describes the development and construct validation of a situational judgment test for assessing the strategic knowledge of classroom management in elementary schools. Classroom scenarios and accompanying courses of action were constructed, of which 17 experts confirmed the content validity. A pilot study and a cross-validation…

A Multilevel Bifactor Approach to Construct Validation of Mixed-Format Scales

ERIC Educational Resources Information Center

Wang, Yan; Kim, Eun Sook; Dedrick, Robert F.; Ferron, John M.; Tan, Tony

2018-01-01

Wording effects associated with positively and negatively worded items have been found in many scales. Such effects may threaten construct validity and introduce systematic bias in the interpretation of results. A variety of models have been applied to address wording effects, such as the correlated uniqueness model and the correlated traits and…

Construct validity of the helplessness/hopelessness/haplessness scale: correlations with perfectionism and depression.

PubMed

Leenaars, Lindsey; Lester, David

2007-02-01

In a sample of 117 undergraduates, helplessness scores and the discrepancy scores on a measure of perfectionism predicted depression scores, providing evidence for construct validity for the hopelessness, helplessness, and haplessness scales.

The Construct Validation of a Questionnaire of Social and Cultural Capital

ERIC Educational Resources Information Center

Pishghadam, Reza; Noghani, Mohsen; Zabihi, Reza

2011-01-01

The present study was conducted to construct and validate a questionnaire of social and cultural capital in the foreign language context of Iran. To this end, a questionnaire was designed by picking up the most frequently-used indicators of social and cultural capital. The Factorability of the intercorrelation matrix was measured by two tests:…

Constructing and Validating the Foreign Language Attitudes and Goals Survey (FLAGS)

ERIC Educational Resources Information Center

Cid, Eva; Granena, Gisela; Tragant, Elsa

2009-01-01

The present study describes the process that was followed in the construction and validation of the foreign language attitudes and goals survey (FLAGS), a new questionnaire based on qualitative data from Tragant and Munoz [Tragant, Munoz, C., 2000. "La motivacion y su relacion con la edad en un contexto escolar de aprendizaje de una lengua…

Validation of the Dyadic Coping Inventory with Chinese couples: Factorial structure, measurement invariance, and construct validity.

PubMed

Xu, Feng; Hilpert, Peter; Randall, Ashley K; Li, Qiuping; Bodenmann, Guy

2016-08-01

The Dyadic Coping Inventory (DCI, Bodenmann, 2008) assesses how couples support each other when facing individual (e.g., workload) and common (e.g., parenting) stressors. Specifically, the DCI measures partners' perceptions of their own (Self) and their partners' behaviors (Partner) when facing individual stressors, and partners' common coping behaviors when facing common stressors (Common). To date, the DCI has been validated in 6 different languages from individualistic Western cultures; however, because culture can affect interpersonal interactions, it is unknown whether the DCI is a reliable measure of coping behaviors for couples living in collectivistic Eastern cultures. Based on data from 474 Chinese couples (N = 948 individuals), the current study examined the Chinese version of the DCI's factorial structure, measurement invariance (MI), and construct validity of test scores. Using 3 cultural groups (China, Switzerland, and the United States [U.S.]), confirmatory factor analysis revealed a 5-factor structure regarding Self and Partner and a 2-factor structure regarding Common dyadic coping (DC). Results from analyses of MI indicated that the DCI subscales met the criteria for configural, metric, and full/partial scalar invariance across cultures (Chinese-Swiss and Chinese-U.S.) and genders (Chinese men and women). Results further revealed good construct validity of the DCI test scores. In all, the Chinese version of the DCI can be used for measuring Chinese couples' coping behaviors, and is available for cross-cultural studies examining DC behaviors between Western and Eastern cultures. (PsycINFO Database Record (c) 2016 APA, all rights reserved).

Testing the construct validity of willingness to pay valuations using objective information about risk and health benefit.

PubMed

Philips, Zoë; Whynes, David K; Avis, Mark

2006-02-01

This paper describes an experiment to test the construct validity of contingent valuation, by eliciting women's valuations for the NHS cervical cancer screening programme. It is known that, owing to low levels of knowledge of cancer and screening in the general population, women both over-estimate the risk of disease and the efficacy of screening. The study is constructed as a randomised experiment, in which one group is provided with accurate information about cervical cancer screening, whilst the other is not. The first hypothesis supporting construct validity, that controls who perceive greater benefits from screening will offer higher valuations, is substantiated. Both groups are then provided with objective information on an improvement to the screening programme, and are asked to value the improvement as an increment to their original valuations. The second hypothesis supporting construct validity, that controls who perceive the benefits of the programme to be high already will offer lower incremental valuations, is also substantiated. Copyright 2005 John Wiley & Sons, Ltd.

Reliability and Construct Validity of the Portuguese Version of the Psychological Capital Questionnaire.

PubMed

Antunes, Ana Cristina; Caetano, António; Pina E Cunha, Miguel

2017-06-01

The Psychological Capital Questionnaire (PCQ) is the most commonly used measure for assessing psychological capital in work settings. Although several studies confirmed its factorial validity, most validation studies only examined the four-factor structure preconized by Luthans, Youssef, and Avolio, not attending to empirical evidence on alternative factorial structures. The present study aimed to test the psychometric properties of the Portuguese version of the PCQ, by using two independent samples (NS1 = 542; NS2 = 115) of Portuguese employees. We conducted a series of confirmatory factor analyses and found that, unlike previous findings, a five-factor solution of the PCQ best fitted the data. The evidence obtained also supported the existence of a second-order factor, psychological capital. The coefficients of internal consistency, as measured by Cronbach's alpha, were adequate and test-retest reliability suggested that the PCQ presented a lower stability than personality factors. Convergent validity, assessed with average variance extracted, revealed problems in the optimism subscale. The discriminant validity of the PCQ was confirmed by its correlations with Positive and Negative Affect and Big Five personality factors. Hierarchical regression analyses showed that this measure has incremental validity over personality and affect when predicting job performance.

Computer Literacy and the Construct Validity of a High-Stakes Computer-Based Writing Assessment

ERIC Educational Resources Information Center

Jin, Yan; Yan, Ming

2017-01-01

One major threat to validity in high-stakes testing is construct-irrelevant variance. In this study we explored whether the transition from a paper-and-pencil to a computer-based test mode in a high-stakes test in China, the College English Test, has brought about variance irrelevant to the construct being assessed in this test. Analyses of the…

Construct Validity and Scoring Methods of the World Health Organization: Health and Work Performance Questionnaire Among Workers With Arthritis and Rheumatological Conditions.

PubMed

AlHeresh, Rawan; LaValley, Michael P; Coster, Wendy; Keysor, Julie J

2017-06-01

To evaluate construct validity and scoring methods of the world health organization-health and work performance questionnaire (HPQ) for people with arthritis. Construct validity was examined through hypothesis testing using the recommended guidelines of the consensus-based standards for the selection of health measurement instruments (COSMIN). The HPQ using the absolute scoring method showed moderate construct validity as four of the seven hypotheses were met. The HPQ using the relative scoring method had weak construct validity as only one of the seven hypotheses were met. The absolute scoring method for the HPQ is superior in construct validity to the relative scoring method in assessing work performance among people with arthritis and related rheumatic conditions; however, more research is needed to further explore other psychometric properties of the HPQ.

Development and validation of a multi-dimensional measure of intellectual humility

PubMed Central

Alfano, Mark; Iurino, Kathryn; Stey, Paul; Robinson, Brian; Christen, Markus; Yu, Feng; Lapsley, Daniel

2017-01-01

This paper presents five studies on the development and validation of a scale of intellectual humility. This scale captures cognitive, affective, behavioral, and motivational components of the construct that have been identified by various philosophers in their conceptual analyses of intellectual humility. We find that intellectual humility has four core dimensions: Open-mindedness (versus Arrogance), Intellectual Modesty (versus Vanity), Corrigibility (versus Fragility), and Engagement (versus Boredom). These dimensions display adequate self-informant agreement, and adequate convergent, divergent, and discriminant validity. In particular, Open-mindedness adds predictive power beyond the Big Six for an objective behavioral measure of intellectual humility, and Intellectual Modesty is uniquely related to Narcissism. We find that a similar factor structure emerges in Germanophone participants, giving initial evidence for the model’s cross-cultural generalizability. PMID:28813478

Construction concepts and validation of the 3D printed UST_2 modular stellarator

NASA Astrophysics Data System (ADS)

Queral, V.

2015-03-01

High accuracy, geometric complexity and thus high cost of stellarators tend to hinder the advance of stellarator research. Nowadays, new manufacturing methods might be developed for the production of small and middle-size stellarators. The methods should demonstrate advantages with respect common fabrication methods, like casting, cutting, forging and welding, for the construction of advanced highly convoluted modular stellarators. UST2 is a small modular three period quasi-isodynamic stellarator of major radius 0.26 m and plasma volume 10 litres being currently built to validate additive manufacturing (3D printing) for stellarator construction. The modular coils are wound in grooves defined on six 3D printed half period frames designed as light truss structures filled by a strong filler. A geometrically simple assembling configuration has been concocted for UST2 so as to try to lower the cost of the device while keeping the positioning accuracy of the different elements. The paper summarizes the construction and assembling concepts developed, the devised positioning methodology, the design of the coil frames and positioning elements and, an initial validation of the assembling of the components.

Validation of a Survey Questionnaire on Organ Donation: An Arabic World Scenario

PubMed Central

Agarwal, Tulika Mehta; Al-Thani, Hassan; Al Maslamani, Yousuf

2018-01-01

Objective To validate a questionnaire for measuring factors influencing organ donation and transplant. Methods The constructed questionnaire was based on the theory of planned behavior by Ajzen Icek and had 45 questions including general inquiry and demographic information. Four experts on the topic, Arabic culture, and the Arabic and English languages established content validity through review. It was quantified by content validity index (CVI). Construct validity was established by principal component analysis (PCA), whereas internal consistency was checked by Cronbach's Alpha and intraclass correlation coefficient (ICC). Statistical analysis was performed by SPSS 22.0 statistical package. Results Content validity in the form of S-CVI/Average and S-CVI/UA was 0.95 and 0.82, respectively, suggesting adequate relevance content of the questionnaire. Factor analysis indicated that the construct validity for each domain (knowledge, attitudes, beliefs, and intention) was 65%, 71%, 77%, and 70%, respectively. Cronbach's Alpha and ICC coefficients were 0.90, 0.67, 0.75, and 0.74 and 0.82, 0.58, 0.61, and 0.74, respectively, for the domains. Conclusion The questionnaire consists of 39 items on knowledge, attitudes, beliefs, and intention domains which is valid and reliable tool to use for organ donation and transplant survey. PMID:29593894

Low back related leg pain: an investigation of construct validity of a new classification system.

PubMed

Schäfer, Axel G M; Hall, Toby M; Rolke, Roman; Treede, Rolf-Detlef; Lüdtke, Kerstin; Mallwitz, Joachim; Briffa, Kathryn N

2014-01-01

Leg pain is associated with back pain in 25-65% of all cases and classified as somatic referred pain or radicular pain. However, distinction between the two may be difficult as different pathomechanisms may cause similar patterns of pain. Therefore a pathomechanism based classification system was proposed, with four distinct hierarchical and mutually exclusive categories: Neuropathic Sensitization (NS) comprising major features of neuropathic pain with sensory sensitization; Denervation (D) arising from significant axonal compromise; Peripheral Nerve Sensitization (PNS) with marked nerve trunk mechanosensitivity; and Musculoskeletal (M) with pain referred from musculoskeletal structures. To investigate construct validity of the classification system. Construct validity was investigated by determining the relationship of nerve functioning with subgroups of patients and asymptomatic controls. Thus somatosensory profiles of subgroups of patients with low back related leg pain (LBRLP) and healthy controls were determined by a comprehensive quantitative sensory test (QST) protocol. It was hypothesized that subgroups of patients and healthy controls would show differences in QST profiles relating to underlying pathomechanisms. 77 subjects with LBRLP were recruited and classified in one of the four groups. Additionally, 18 age and gender matched asymptomatic controls were measured. QST revealed signs of pain hypersensitivity in group NS and sensory deficits in group D whereas Groups PNS and M showed no significant differences when compared to the asymptomatic group. These findings support construct validity for two of the categories of the new classification system, however further research is warranted to achieve construct validation of the classification system as a whole.

Development and validation of a nutrition knowledge questionnaire for a Canadian population.

PubMed

Bradette-Laplante, Maude; Carbonneau, Élise; Provencher, Véronique; Bégin, Catherine; Robitaille, Julie; Desroches, Sophie; Vohl, Marie-Claude; Corneau, Louise; Lemieux, Simone

2017-05-01

The present study aimed to develop and validate a nutrition knowledge questionnaire in a sample of French Canadians from the province of Quebec, taking into account dietary guidelines. A thirty-eight-item questionnaire was developed by the research team and evaluated for content validity by an expert panel, and then administered to respondents. Face validity and construct validity were measured in a pre-test. Exploratory factor analysis and covariance structure analysis were performed to verify the structure of the questionnaire and identify problematic items. Internal consistency and test-retest reliability were evaluated through a validation study. Online survey. Six nutrition and psychology experts, fifteen registered dietitians (RD) and 180 lay people participated. Content validity evaluation resulted in the removal of two items and reformulation of one item. Following face validity, one item was reformulated. Construct validity was found to be adequate, with higher scores for RD v. non-RD (21·5 (sd 2·1) v. 15·7 (sd 3·0) out of 24, P<0·001). Exploratory factor analysis revealed that the questionnaire contained only one factor. Covariance structure analysis led to removal of sixteen items. Internal consistency for the overall questionnaire was adequate (Cronbach's α=0·73). Assessment of test-retest reliability resulted in significant associations for the total knowledge score (r=0·59, P<0·001). This nutrition knowledge questionnaire was found to be a suitable instrument which can be used to measure levels of nutrition knowledge in a Canadian population. It could also serve as a model for the development of similar instruments in other populations.

Prevalence and construct validity of compulsive buying disorder in shopping mall visitors.

PubMed

Maraz, Aniko; van den Brink, Wim; Demetrovics, Zsolt

2015-08-30

Compulsive buying is a relatively new psychopathological concept and very few data are currently available regarding the prevalence and validity of compulsive buying disorder. In this cross-sectional study, we establish the prevalence of compulsive buying disorder in shopping mall visitors and explore the construct validity of the concept using the revised version of the Edwards Compulsive Buying Scale in 1441 shopping mall visitors looking at shopping habits, current substance use (smoking, alcohol and illicit drug) and various psychological characteristics. Overall, 8.7% (95% CI: 7.3-10.3) of our sample was classified as having a compulsive buying disorder. Compulsive buyers were younger, less educated and more likely to be female than non-compulsive buyers. They were also more likely to have used licit and illicit substances. Compulsive buyers also reported higher levels of impulsivity and obsessive-compulsive symptoms, lower levels of well-being and self-esteem and more psychological distress. Finally, compulsive buyers were five times more likely to meet criteria for borderline personality disorder than non-compulsive buyers. Compulsive buying is a frequent disorder in shopping mall visitors and is associated with important and robust indicators of psychopathology thus supporting the validity of the construct. Copyright © 2015 Elsevier Ireland Ltd. All rights reserved.

Assessment of construct validity of a virtual reality laparoscopy simulator.

PubMed

Rosenthal, Rachel; Gantert, Walter A; Hamel, Christian; Hahnloser, Dieter; Metzger, Juerg; Kocher, Thomas; Vogelbach, Peter; Scheidegger, Daniel; Oertli, Daniel; Clavien, Pierre-Alain

2007-08-01

The aim of this study was to assess whether virtual reality (VR) can discriminate between the skills of novices and intermediate-level laparoscopic surgical trainees (construct validity), and whether the simulator assessment correlates with an expert's evaluation of performance. Three hundred and seven (307) participants of the 19th-22nd Davos International Gastrointestinal Surgery Workshops performed the clip-and-cut task on the Xitact LS 500 VR simulator (Xitact S.A., Morges, Switzerland). According to their previous experience in laparoscopic surgery, participants were assigned to the basic course (BC) or the intermediate course (IC). Objective performance parameters recorded by the simulator were compared to the standardized assessment by the course instructors during laparoscopic pelvitrainer and conventional surgery exercises. IC participants performed significantly better on the VR simulator than BC participants for the task completion time as well as the economy of movement of the right instrument, not the left instrument. Participants with maximum scores in the pelvitrainer cholecystectomy task performed the VR trial significantly faster, compared to those who scored less. In the conventional surgery task, a significant difference between those who scored the maximum and those who scored less was found not only for task completion time, but also for economy of movement of the right instrument. VR simulation provides a valid assessment of psychomotor skills and some basic aspects of spatial skills in laparoscopic surgery. Furthermore, VR allows discrimination between trainees with different levels of experience in laparoscopic surgery establishing construct validity for the Xitact LS 500 clip-and-cut task. Virtual reality may become the gold standard to assess and monitor surgical skills in laparoscopic surgery.

A Construct Validity Study of Clinical Competence: A Multitrait Multimethod Matrix Approach

ERIC Educational Resources Information Center

Baig, Lubna; Violato, Claudio; Crutcher, Rodney

2010-01-01

Introduction: The purpose of the study was to adduce evidence for estimating the construct validity of clinical competence measured through assessment instruments used for high-stakes examinations. Methods: Thirty-nine international physicians (mean age = 41 + 6.5 y) participated in high-stakes examination and 3-month supervised clinical practice…

Role of learning potential in cognitive remediation: Construct and predictive validity.

PubMed

Davidson, Charlie A; Johannesen, Jason K; Fiszdon, Joanna M

2016-03-01

The construct, convergent, discriminant, and predictive validity of Learning Potential (LP) was evaluated in a trial of cognitive remediation for adults with schizophrenia-spectrum disorders. LP utilizes a dynamic assessment approach to prospectively estimate an individual's learning capacity if provided the opportunity for specific related learning. LP was assessed in 75 participants at study entry, of whom 41 completed an eight-week cognitive remediation (CR) intervention, and 22 received treatment-as-usual (TAU). LP was assessed in a "test-train-test" verbal learning paradigm. Incremental predictive validity was assessed as the degree to which LP predicted memory skill acquisition above and beyond prediction by static verbal learning ability. Examination of construct validity confirmed that LP scores reflected use of trained semantic clustering strategy. LP scores correlated with executive functioning and education history, but not other demographics or symptom severity. Following the eight-week active phase, TAU evidenced little substantial change in skill acquisition outcomes, which related to static baseline verbal learning ability but not LP. For the CR group, LP significantly predicted skill acquisition in domains of verbal and visuospatial memory, but not auditory working memory. Furthermore, LP predicted skill acquisition incrementally beyond relevant background characteristics, symptoms, and neurocognitive abilities. Results suggest that LP assessment can significantly improve prediction of specific skill acquisition with cognitive training, particularly for the domain assessed, and thereby may prove useful in individualization of treatment. Published by Elsevier B.V.

Evidence of Construct Validity in the Assessment of Hebephilia.

PubMed

Stephens, Skye; Seto, Michael C; Goodwill, Alasdair M; Cantor, James M

2017-01-01

Hebephilia refers to a persistent intense sexual interest in pubescent children. Although not as widely studied as pedophilia, studies of hebephilia have indicated convergence in self-report and sexual arousal. The present study expanded on previous work by examining convergent and divergent validity across indicators of hebephilia that included self-report, sexual behavior, and sexual arousal in a sample of 2238 men who had sexually offended. We included men who denied such interest and specifically examined the overlap between hebephilia and pedophilia and examined pedohebephilia (i.e., sexual interests in both prepubescent and pubescent children). Results indicated that there was considerable convergence across indicators of hebephilia. The results suggested poor divergent validity between hebephilia and pedophilia, as there was substantial overlap between the two constructs across analyses. Finally, a distinct pattern of sexual arousal was found in offenders with pedohebephilia. The results of the present study were discussed with a focus on implications for the assessment of sexual interest in children and the conceptualization of pedohebephilia.

Deconstructing, reconstructing, preserving Paul E. Meehl's legacy of construct validity.

PubMed

Maher, Brendan A; Gottesman, Irving I

2005-12-01

The question of the status of cause-and-effect explanations of human behavior that posit physically existing causative factors and those that, on the other hand, posit hypothetical entities in the form of "useful fictions" has a long history. The influence of the works of Jeremy Bentham and Hans Vaihinger, as well as the later influence of Francis Galton, is described. Issues of the validity of hypothetical constructs and related problems of measurement and definition as found in psychoanalytic theory construction and in trait theory are examined. The significant and continuing interest generated by the landmark studies of K. MacCorquodale and P. E. Meehl (1948) and L. J. Cronbach and P. E. Meehl (1955) as well as the central importance of P. E. Meehl's thinking are described.

Measurement of alienation among adolescents: construct validity of three scales on powerlessness, meaninglessness and social isolation.

PubMed

Rayce, Signe Boe; Kreiner, Svend; Damsgaard, Mogens Trab; Nielsen, Tine; Holstein, Bjørn Evald

2017-01-01

Psychological alienation is an important concept in the study of adolescents' health and behavior but no gold standard for measuring alienation among adolescents exists. There is a need for new scales with high validity for use in adolescent health and social research. The purpose of the present study was to develop and validate alienation scales in accordance with Seeman's conceptualization of alienation focusing on three independent variants specifically relevant in adolescent health research: powerlessness, meaninglessness and social isolation. Cross-sectional data from 3083 adolescents aged 13 to 15 years from the Danish contribution to the cross-national study Health Behaviour in School-aged Children (HBSC) were used. We identified and developed items, addressed content and face validity through interviews, and examined the criterion-related construct validity of the scales using graphical loglinear Rasch models (GLLRM). The three scales each comprised three to five face valid items. The powerlessness scale reflected the adolescent's expectancy as to whether his/her behavior can determine the outcome or reinforcement he/she seeks. The meaninglessness scale reflected the expectancy as to whether satisfactory predictions regarding the effects of one's behavior are possible. Finally, the social isolation scale reflected whether the adolescent had a low expectancy for inclusion and social acceptance. All scales contained some uniform local dependency and differential item functioning. However, only to a limited degree, which could be accounted for using GLLRM. Thus the scales fitted GLLRMs and can therefore be considered to be essentially construct valid and essentially objective. The three alienation scales appear to be content and face valid and fulfill the psychometric properties of a good construct valid reflective scale. This suggests that the scales may be appropriate in future large-scale surveys to examine the relation between alienation and a range of

A Comparison of the Construct Validity of Three Measures of Negative Affectivity

ERIC Educational Resources Information Center

Fortunato, Vincent F.

2004-01-01

This study assessed the construct validity of three measures of negative affectivity (NA) by examining their relationships with measures of job stressors, strains, and attitudes. The authors also examined the extent to which controlling for scores on NA attenuated relationships between job stressors and strains differently depending on the NA and…

Constructing a Validity Argument for the Objective Structured Assessment of Technical Skills (OSATS): A Systematic Review of Validity Evidence

ERIC Educational Resources Information Center

Hatala, Rose; Cook, David A.; Brydges, Ryan; Hawkins, Richard

2015-01-01

In order to construct and evaluate the validity argument for the Objective Structured Assessment of Technical Skills (OSATS), based on Kane's framework, we conducted a systematic review. We searched MEDLINE, EMBASE, CINAHL, PsycINFO, ERIC, Web of Science, Scopus, and selected reference lists through February 2013. Working in duplicate, we selected…

Preliminary validation of the Yale Food Addiction Scale.

PubMed

Gearhardt, Ashley N; Corbin, William R; Brownell, Kelly D

2009-04-01

Previous research has found similarities between addiction to psychoactive substances and excessive food consumption. Further exploration is needed to evaluate the concept of "food addiction," as there is currently a lack of psychometrically validated measurement tools in this area. The current study represents a preliminary exploration of the Yale Food Addiction Scale (YFAS), designed to identify those exhibiting signs of addiction towards certain types of foods (e.g., high fat and high sugar). Survey data were collected from 353 respondents from a stratified random sample of young adults. In addition to the YFAS, the survey assessed eating pathology, alcohol consumption and other health behaviors. The YFAS exhibited adequate internal reliability, and showed good convergent validity with measures of similar constructs and good discriminant validity relative to related but dissimilar constructs. Additionally, the YFAS predicted binge-eating behavior above and beyond existing measures of eating pathology, demonstrating incremental validity. The YFAS is a sound tool for identifying eating patterns that are similar to behaviors seen in classic areas of addiction. Further evaluation of the scale is needed, especially due to a low response rate of 24.5% and a non-clinical sample, but confirmation of the reliability and validity of the scale has the potential to facilitate empirical research on the concept of "food addiction".

Development and validation of Triarchic construct scales from the psychopathic personality inventory.

PubMed

Hall, Jason R; Drislane, Laura E; Patrick, Christopher J; Morano, Mario; Lilienfeld, Scott O; Poythress, Norman G

2014-06-01

The Triarchic model of psychopathy describes this complex condition in terms of distinct phenotypic components of boldness, meanness, and disinhibition. Brief self-report scales designed specifically to index these psychopathy facets have thus far demonstrated promising construct validity. The present study sought to develop and validate scales for assessing facets of the Triarchic model using items from a well-validated existing measure of psychopathy-the Psychopathic Personality Inventory (PPI). A consensus-rating approach was used to identify PPI items relevant to each Triarchic facet, and the convergent and discriminant validity of the resulting PPI-based Triarchic scales were evaluated in relation to multiple criterion variables (i.e., other psychopathy inventories, antisocial personality disorder features, personality traits, psychosocial functioning) in offender and nonoffender samples. The PPI-based Triarchic scales showed good internal consistency and related to criterion variables in ways consistent with predictions based on the Triarchic model. Findings are discussed in terms of implications for conceptualization and assessment of psychopathy.

Development and Validation of Triarchic Construct Scales from the Psychopathic Personality Inventory

PubMed Central

Hall, Jason R.; Drislane, Laura E.; Patrick, Christopher J.; Morano, Mario; Lilienfeld, Scott O.; Poythress, Norman G.

2014-01-01

The Triarchic model of psychopathy describes this complex condition in terms of distinct phenotypic components of boldness, meanness, and disinhibition. Brief self-report scales designed specifically to index these psychopathy facets have thus far demonstrated promising construct validity. The present study sought to develop and validate scales for assessing facets of the Triarchic model using items from a well-validated existing measure of psychopathy—the Psychopathic Personality Inventory (PPI). A consensus rating approach was used to identify PPI items relevant to each Triarchic facet, and the convergent and discriminant validity of the resulting PPI-based Triarchic scales were evaluated in relation to multiple criterion variables (i.e., other psychopathy inventories, antisocial personality disorder features, personality traits, psychosocial functioning) in offender and non-offender samples. The PPI-based Triarchic scales showed good internal consistency and related to criterion variables in ways consistent with predictions based on the Triarchic model. Findings are discussed in terms of implications for conceptualization and assessment of psychopathy. PMID:24447280

Degree and Direction of Multiple Career Factors: Sex Differences and Construct Validity.

ERIC Educational Resources Information Center

Shaffer, Michal; And Others

Personality, environment, and the interaction between them have been suggested as the major factors accounting for career development. Students (N=283) were asked to respond to 28 items on a recently revised self-report instrument, the Career Factor Checklist (CFC), in order to establish the construct validity of the revised CFC and to investigate…

Development, test-retest reliability, and construct validity of the resistance training skills battery.

PubMed

Lubans, David R; Smith, Jordan J; Harries, Simon K; Barnett, Lisa M; Faigenbaum, Avery D

2014-05-01

The aim of this study was to describe the development and assess test-retest reliability and construct validity of the Resistance Training Skills Battery (RTSB) for adolescents. The RTSB provides an assessment of resistance training skill competency and includes 6 exercises (i.e., body weight squat, push-up, lunge, suspended row, standing overhead press, and front support with chest touches). Scoring for each skill is based on the number of performance criteria successfully demonstrated. An overall resistance training skill quotient (RTSQ) is created by adding participants' scores for the 6 skills. Participants (44 boys and 19 girls, mean age = 14.5 ± 1.2 years) completed the RTSB on 2 occasions separated by 7 days. Participants also completed the following fitness tests, which were used to create a muscular fitness score (MFS): handgrip strength, timed push-up, and standing long jump tests. Intraclass correlation (ICC), paired samples t-tests, and typical error were used to assess test-retest reliability. To assess construct validity, gender and RTSQ were entered into a regression model predicting MFS. The rank order repeatability of the RTSQ was high (ICC = 0.88). The model explained 39% of the variance in MFS (p ≤ 0.001) and RTSQ (r = 0.40, p ≤ 0.001) was a significant predictor. This study has demonstrated the construct validity and test-retest reliability of the RTSB in a sample of adolescents. The RTSB can reliably rank participants in regards to their resistance training competency and has the necessary sensitivity to detect small changes in resistance training skill proficiency.

Development and Validation of a Daily Pain Catastrophizing Scale.

PubMed

Darnall, Beth D; Sturgeon, John A; Cook, Karon F; Taub, Chloe J; Roy, Anuradha; Burns, John W; Sullivan, Michael; Mackey, Sean C

2017-09-01

To date, there is no validated measure for pain catastrophizing at the daily level. The Pain Catastrophizing Scale (PCS) is widely used to measure trait pain catastrophizing. We sought to develop and validate a brief, daily version of the PCS for use in daily diary studies to facilitate research on mechanisms of catastrophizing treatment, individual differences in self-regulation, and to reveal the nuanced relationships between catastrophizing, correlates, and pain outcomes. After adapting the PCS for daily use, we evaluated the resulting 14 items using 3 rounds of cognitive interviews with 30 adults with chronic pain. We refined and tested the final daily PCS in 3 independent, prospective, cross-sectional, observational validation studies conducted in a combined total of 519 adults with chronic pain who completed online measures daily for 14 consecutive days. For study 1 (N = 131), exploratory factor analysis revealed adequate fit and-unexpectedly-unidimensionality for item responses to the daily PCS. Study 2 (N = 177) correlations indicated adequate association with related constructs (anger, anxiety, pain intensity, depression). Similarly, results for study 3 (N = 211) revealed expected correlations for daily PCS and measures of daily constructs including physical activity, sleep, energy level, and positive affect. Results from complex/multilevel confirmatory factor analysis confirmed good fit to a unidimensional model. Scores on the daily PCS were statistically comparable with and more parsimonious than the full 14-item version. Next steps include evaluation of score validity in populations with medical diagnoses, greater demographic diversity, and in patients with acute pain. This article describes the development and validation of a daily PCS. This daily measure may facilitate research that aims to characterize pain mechanisms, individual differences in self-regulation, adaptation, and nuanced relationships between catastrophizing, correlates, and pain

Development and Construct Validation of the Interprofessional Attitudes Scale

PubMed Central

Norris, Jeffrey; Carpenter, Joan G.; Eaton, Jacqueline; Guo, Jia-Wen; Lassche, Madeline; Pett, Marjorie A.; Blumenthal, Donald K.

2015-01-01

Purpose Training of health professionals requires development of interprofessional competencies and assessment of these competencies. No validated tools exist to assess all four competency domains described in the 2011 Core Competencies for Interprofessional Collaborative Practice (the IPEC Report). The purpose of this study was to develop and validate a scale based on the IPEC competency domains that assesses interprofessional attitudes of students in the health professions. Method In 2012, a survey tool was developed and administered to 1,549 students from the University of Utah Health Science Center, an academic health center composed of four schools and colleges (Health, Medicine, Nursing, and Pharmacy). Exploratory and confirmatory factor analyses (EFA and CFA) were performed to validate the assessment tool, eliminate redundant questions, and to identify subscales. Results The EFA and CFA focused on aligning subscales with IPEC core competencies, and demonstrating good construct validity and internal consistency reliability. A response rate of 45% (n = 701) was obtained. Responses with complete data (n=678) were randomly split into two datasets which were independently analyzed using EFA and CFA. The EFA produced a 27-item scale, with five subscales (Cronbach’s alpha coefficients: 0.62 to 0.92). CFA indicated the content of the five subscales was consistent with the EFA model. Conclusions The Interprofessional Attitudes Scale (IPAS) is a novel tool that, compared to previous tools, better reflects current trends in interprofessional competencies. The IPAS should be useful to health sciences educational institutions and others training people to work collaboratively in interprofessional teams. PMID:25993280

Sexual behavioral abstine HIV/AIDS questionnaire: Validation study of an Iranian questionnaire.

PubMed

Najarkolaei, Fatemeh Rahmati; Niknami, Shamsaddin; Shokravi, Farkhondeh Amin; Tavafian, Sedigheh Sadat; Fesharaki, Mohammad Gholami; Jafari, Mohammad Reza

2014-01-01

This study was designed to assess the validity and reliability of the designed sexual, behavioral abstinence, and avoidance of high-risk situation questionnaire (SBAHAQ), with an aim to construct an appropriate development tool in the Iranian population. A descriptive-analytic study was conducted among female undergraduate students of Tehran University, who were selected through cluster random sampling. After reviewing the questionnaires and investigating face and content validity, internal consistency of the questionnaire was assessed by Cronbach's alpha. Explanatory and confirmatory factor analysis was conducted using SPSS and AMOS 16 Software, respectively. The sample consisted of 348 female university students with a mean age of 20.69 ± 1.63 years. The content validity ratio (CVR) coefficient was 0.85 and the reliability of each section of the questionnaire was as follows: Perceived benefit (PB; 0.87), behavioral intention (BI; 0.77), and self-efficacy (SE; 0.85) (Cronbach's alpha totally was 0.83). Explanatory factor analysis showed three factors, including SE, PB, and BI, with the total variance of 61% and Kaiser-Meyer-Olkin (KMO) index of 88%. These factors were also confirmed by confirmatory factor analysis [adjusted goodness of fitness index (AGFI) = 0.939, root mean square error of approximation (RMSEA) = 0.039]. This study showed the designed questionnaire provided adequate construct validity and reliability, and could be adequately used to measure sexual abstinence and avoidance of high-risk situations among female students.

Sexual behavioral abstine HIV/AIDS questionnaire: Validation study of an Iranian questionnaire

PubMed Central

Najarkolaei, Fatemeh Rahmati; Niknami, Shamsaddin; Shokravi, Farkhondeh Amin; Tavafian, Sedigheh Sadat; Fesharaki, Mohammad Gholami; Jafari, Mohammad Reza

2014-01-01

Background: This study was designed to assess the validity and reliability of the designed sexual, behavioral abstinence, and avoidance of high-risk situation questionnaire (SBAHAQ), with an aim to construct an appropriate development tool in the Iranian population. Materials and Methods: A descriptive–analytic study was conducted among female undergraduate students of Tehran University, who were selected through cluster random sampling. After reviewing the questionnaires and investigating face and content validity, internal consistency of the questionnaire was assessed by Cronbach's alpha. Explanatory and confirmatory factor analysis was conducted using SPSS and AMOS 16 Software, respectively. Results: The sample consisted of 348 female university students with a mean age of 20.69 ± 1.63 years. The content validity ratio (CVR) coefficient was 0.85 and the reliability of each section of the questionnaire was as follows: Perceived benefit (PB; 0.87), behavioral intention (BI; 0.77), and self-efficacy (SE; 0.85) (Cronbach's alpha totally was 0.83). Explanatory factor analysis showed three factors, including SE, PB, and BI, with the total variance of 61% and Kaiser–Meyer–Olkin (KMO) index of 88%. These factors were also confirmed by confirmatory factor analysis [adjusted goodness of fitness index (AGFI) = 0.939, root mean square error of approximation (RMSEA) = 0.039]. Conclusion: This study showed the designed questionnaire provided adequate construct validity and reliability, and could be adequately used to measure sexual abstinence and avoidance of high-risk situations among female students. PMID:24741650

The Motivation of Stereotypic and Repetitive Behavior: Examination of Construct Validity of the Motivation Assessment Scale

ERIC Educational Resources Information Center

Joosten, Annette V.; Bundy, Anita C.

2008-01-01

Construct validity of the Motivation Assessment Scale (MAS) (Durand, Crimmins, The Motivation Assessment Scale 1988) was studied using Rasch analysis data from 67 children (246 MASs), with dual diagnosis of autism and intellectual disability or with intellectual disability only. Results failed to support the proposed unidimensional construct or…

Construct Validity and Reliability of the Questionnaire on the Quality of Physician-Patient Interaction in Adults With Hypertension.

PubMed

Hickman, Ronald L; Clochesy, John M; Hetland, Breanna; Alaamri, Marym

2017-04-01

There are limited reliable and valid measures of the patient- provider interaction among adults with hypertension. Therefore, the purpose of this report is to describe the construct validity and reliability of the Questionnaire on the Quality of Physician-Patient Interaction (QQPPI), in community-dwelling adults with hypertension. A convenience sample of 109 participants with hypertension was recruited and administered the QQPPI at baseline and 8 weeks later. The exploratory factor analysis established a 12-item, 2-factor structure for the QQPPI was valid in this sample. The modified QQPPI proved to have sufficient internal consistency and test- retest reliability. The modified QQPPI is a valid and reliable measure of the provider-patient interaction, a construct posited to impact self-management, in adults with hypertension.

Construct Validation of a Measure to Assess Sustainability of School-Wide Behavior Interventions

ERIC Educational Resources Information Center

Hume, Amanda; McIntosh, Kent

2013-01-01

This study assessed aspects of construct validity of the School-wide Universal Behavior Sustainability Index-School Teams (SUBSIST), a measure evaluating critical features of the school context related to sustainability of school-wide interventions. Participants at 217 schools implementing School-wide Positive Behavior Support (SWPBS) were…

Gene-environment interactions and construct validity in preclinical models of psychiatric disorders.

PubMed

Burrows, Emma L; McOmish, Caitlin E; Hannan, Anthony J

2011-08-01

The contributions of genetic risk factors to susceptibility for brain disorders are often so closely intertwined with environmental factors that studying genes in isolation cannot provide the full picture of pathogenesis. With recent advances in our understanding of psychiatric genetics and environmental modifiers we are now in a position to develop more accurate animal models of psychiatric disorders which exemplify the complex interaction of genes and environment. Here, we consider some of the insights that have emerged from studying the relationship between defined genetic alterations and environmental factors in rodent models. A key issue in such animal models is the optimization of construct validity, at both genetic and environmental levels. Standard housing of laboratory mice and rats generally includes ad libitum food access and limited opportunity for physical exercise, leading to metabolic dysfunction under control conditions, and thus reducing validity of animal models with respect to clinical populations. A related issue, of specific relevance to neuroscientists, is that most standard-housed rodents have limited opportunity for sensory and cognitive stimulation, which in turn provides reduced incentive for complex motor activity. Decades of research using environmental enrichment has demonstrated beneficial effects on brain and behavior in both wild-type and genetically modified rodent models, relative to standard-housed littermate controls. One interpretation of such studies is that environmentally enriched animals more closely approximate average human levels of cognitive and sensorimotor stimulation, whereas the standard housing currently used in most laboratories models a more sedentary state of reduced mental and physical activity and abnormal stress levels. The use of such standard housing as a single environmental variable may limit the capacity for preclinical models to translate into successful clinical trials. Therefore, there is a need to

Test of Achievement in Quantitative Economics for Secondary Schools: Construction and Validation Using Item Response Theory

ERIC Educational Resources Information Center

Eleje, Lydia I.; Esomonu, Nkechi P. M.

2018-01-01

A Test to measure achievement in quantitative economics among secondary school students was developed and validated in this study. The test is made up 20 multiple choice test items constructed based on quantitative economics sub-skills. Six research questions guided the study. Preliminary validation was done by two experienced teachers in…

A Chimpanzee (Pan troglodytes) Model of Triarchic Psychopathy Constructs: Development and Initial Validation

PubMed Central

Latzman, Robert D.; Drislane, Laura E.; Hecht, Lisa K.; Brislin, Sarah J.; Patrick, Christopher J.; Lilienfeld, Scott O.; Freeman, Hani J.; Schapiro, Steven J.; Hopkins, William D.

2015-01-01

The current work sought to operationalize constructs of the triarchic model of psychopathy in chimpanzees (Pan troglodytes), a species well-suited for investigations of basic biobehavioral dispositions relevant to psychopathology. Across three studies, we generated validity evidence for scale measures of the triarchic model constructs in a large sample (N=238) of socially-housed chimpanzees. Using a consensus-based rating approach, we first identified candidate items for the chimpanzee triarchic (CHMP-Tri) scales from an existing primate personality instrument and refined these into scales. In Study 2, we collected data for these scales from human informants (N=301), and examined their convergent and divergent relations with scales from another triarchic inventory developed for human use. In Study 3, we undertook validation work examining associations between CHMP-Tri scales and task measures of approach-avoidance behavior (N=73) and ability to delay gratification (N=55). Current findings provide support for a chimpanzee model of core dispositions relevant to psychopathy and other forms of psychopathology. PMID:26779396

Examining construct and predictive validity of the Health-IT Usability Evaluation Scale: confirmatory factor analysis and structural equation modeling results

PubMed Central

Yen, Po-Yin; Sousa, Karen H; Bakken, Suzanne

2014-01-01

Background In a previous study, we developed the Health Information Technology Usability Evaluation Scale (Health-ITUES), which is designed to support customization at the item level. Such customization matches the specific tasks/expectations of a health IT system while retaining comparability at the construct level, and provides evidence of its factorial validity and internal consistency reliability through exploratory factor analysis. Objective In this study, we advanced the development of Health-ITUES to examine its construct validity and predictive validity. Methods The health IT system studied was a web-based communication system that supported nurse staffing and scheduling. Using Health-ITUES, we conducted a cross-sectional study to evaluate users’ perception toward the web-based communication system after system implementation. We examined Health-ITUES's construct validity through first and second order confirmatory factor analysis (CFA), and its predictive validity via structural equation modeling (SEM). Results The sample comprised 541 staff nurses in two healthcare organizations. The CFA (n=165) showed that a general usability factor accounted for 78.1%, 93.4%, 51.0%, and 39.9% of the explained variance in ‘Quality of Work Life’, ‘Perceived Usefulness’, ‘Perceived Ease of Use’, and ‘User Control’, respectively. The SEM (n=541) supported the predictive validity of Health-ITUES, explaining 64% of the variance in intention for system use. Conclusions The results of CFA and SEM provide additional evidence for the construct and predictive validity of Health-ITUES. The customizability of Health-ITUES has the potential to support comparisons at the construct level, while allowing variation at the item level. We also illustrate application of Health-ITUES across stages of system development. PMID:24567081

Construct Validation of the Dietary Inflammatory Index among Postmenopausal Women

PubMed Central

Tabung, Fred K.; Steck, Susan E.; Zhang, Jiajia; Ma, Yunsheng; Liese, Angela D.; Agalliu, Ilir; Hingle, Melanie; Hou, Lifang; Hurley, Thomas G.; Jiao, Li; Martin, Lisa W.; Millen, Amy E.; Park, Hannah L.; Rosal, Milagros C.; Shikany, James M.; Shivappa, Nitin; Ockene, Judith K.; Hebert, James R.

2015-01-01

Purpose Many dietary factors have either pro- or anti-inflammatory properties. We previously developed a dietary inflammatory index (DII) to assess the inflammatory potential of diet. In this study we conducted a construct validation of the DII based on data from a food frequency questionnaire and three inflammatory biomarkers in a subsample of 2,567 postmenopausal women in the Women’s Health Initiative Observational Study. Methods We used multiple linear and logistic regression models, controlling for potential confounders, to test whether baseline DII predicted concentrations of interleukin-6 (IL-6), high-sensitivity C-reactive protein (hs-CRP), tumor necrosis factor alpha receptor 2 (TNFα-R2), or an overall biomarker score combining all three inflammatory biomarkers. Results The DII was associated with the four biomarkers with beta estimates (95%CI) comparing the highest with lowest DII quintiles as follows: IL-6: 1.26 (1.15, 1.38), Ptrend<0.0001; TNFα-R2: 81.43 (19.15, 143.71), Ptrend=0.004; dichotomized hs-CRP (odds ratio for higher versus lower hs-CRP): 1.30 (0.97, 1.67), Ptrend=0.34); and the combined inflammatory biomarker score: 0.26 (0.12, 0.40), Ptrend=0.0001. Conclusion The DII was significantly associated with inflammatory biomarkers. Construct validity of the DII indicates its utility for assessing the inflammatory potential of diet and for expanding its use to include associations with common chronic diseases in future studies. PMID:25900255

Brazilian Portuguese version of the Revised Fibromyalgia Impact Questionnaire (FIQR-Br): cross-cultural validation, reliability, and construct and structural validation.

PubMed

Lupi, Jaqueline Basilio; Carvalho de Abreu, Daniela Cristina; Ferreira, Mariana Candido; Oliveira, Renê Donizeti Ribeiro de; Chaves, Thais Cristina

2017-08-01

This study aimed to culturally adapt and validate the Revised Fibromyalgia Impact Questionnaire (FIQR) to Brazilian Portuguese, by the use of analysis of internal consistency, reliability, and construct and structural validity. A total of 100 female patients with fibromyalgia participated in the validation process of the Brazilian Portuguese version of the FIQR (FIQR-Br).The intraclass correlation coefficient (ICC) was used for statistical analysis of reliability (test-retest), Cronbach's alpha for internal consistency, Pearson's rank correlation for construct validity, and confirmatory factor analysis (CFA) for structural validity. It was verified excellent levels of reliability, with ICC greater than 0.75 for all questions and domains of the FIQR-Br. For internal consistency, alpha values greater than 0.70 for the items and domains of the questionnaire were observed. Moderate (0.40 < r < 0.70) and strong (r > 0.70) correlations were observed for the scores of domains and total score between the FIQR-Br and FIQ-Br. The structure of the three domains of the FIQR-Br was confirmed by CFA. The results of this study suggest that that the FIQR-Br is a reliable and valid instrument for assessing fibromyalgia-related impact, and supports its use in clinical settings and research. The structure of the three domains of the FIQR-Br was also confirmed. Implications for Rehabilitation Fibromyalgia is a chronic musculoskeletal disorder characterized by widespread and diffuse pain, fatigue, sleep disturbances, and depression. The disease significantly impairs patients' quality of life and can be highly disabling. To be used in multicenter research efforts, the Revised Fibromyalgia Impact Questionnaire (FIQR) must be cross-culturally validated and psychometrically tested. This paper will make available a new version of the FIQR-Br since another version already exists, but there are concerns about its measurement properties. The availability of an instrument adapted to

Construct and concurrent validity of a Nintendo Wii video game made for training basic laparoscopic skills.

PubMed

Jalink, M B; Goris, J; Heineman, E; Pierie, J P E N; ten Cate Hoedemaker, H O

2014-02-01

Virtual reality (VR) laparoscopic simulators have been around for more than 10 years and have proven to be cost- and time-effective in laparoscopic skills training. However, most simulators are, in our experience, considered less interesting by residents and are often poorly accessible. Consequently, these devices are rarely used in actual training. In an effort to make a low-cost and more attractive simulator, a custom-made Nintendo Wii game was developed. This game could ultimately be used to train the same basic skills as VR laparoscopic simulators ought to. Before such a video game can be implemented into a surgical training program, it has to be validated according to international standards. The main goal of this study was to test construct and concurrent validity of the controls of a prototype of the game. In this study, the basic laparoscopic skills of experts (surgeons, urologists, and gynecologists, n = 15) were compared to those of complete novices (internists, n = 15) using the Wii Laparoscopy (construct validity). Scores were also compared to the Fundamentals of Laparoscopy (FLS) Peg Transfer test, an already established assessment method for measuring basic laparoscopic skills (concurrent validity). Results showed that experts were 111 % faster (P = 0.001) on the Wii Laparoscopy task than novices. Also, scores of the FLS Peg Transfer test and the Wii Laparoscopy showed a significant, high correlation (r = 0.812, P < 0.001). The prototype setup of the Wii Laparoscopy possesses solid construct and concurrent validity.

An Examination of the Construct Validity of the Inventory of Classroom Management Style.

ERIC Educational Resources Information Center

Martin, Nancy K.; Baldwin, Beatrice

Confirmatory factor analysis was used to examine the construct validity of a new instrument measuring perceptions toward classroom management: the Inventory of Classroom Management Style (ICMS). Classroom management was defined as a multifaceted process that includes three broad dimensions: (1) what teachers believe about students as persons; (2)…

Validating the Type D personality construct in Chinese patients with coronary heart disease.

PubMed

Yu, Doris S F; Thompson, David R; Yu, Cheuk Man; Pedersen, Susanne S; Denollet, Johan

2010-08-01

Type D personality predicts poor prognosis in coronary heart disease (CHD) but little is known about Type D in non-Western cultures. We examined the (a) validity of the Type D construct and its assessment with the DS14 scale in the Chinese culture, (b) prevalence of Type D, and (c) gender vs. Type D discrepancies in depression/anxiety, among Chinese patients with CHD. Patients with CHD (N=326) completed the Chinese version of the DS14. The NEO Five Factor Inventory (NEO-FFI), Hospital Anxiety and Depression Scale (HADS), and Stress Symptom Checklist (SSC) were administered to subsamples to establish construct and discriminant validity. Administration of the DS14, HADS, and SSC was repeated at 1 month after hospital discharge in 66 patients, and stability of the DS14 was examined in another subsample of 100 patients. The theoretical structure of the Type D construct in the Chinese culture was supported (chi(2)/df=2.89, root mean square error of approximation=0.08, normal fit index=0.91, non-normal fit index=0.91, comparative fit index=0.93). The Negative Affectivity (NA) and Social Inhibition (SI) subscales of the DS14 in the entire sample were internally consistent (Cronbach's alpha=0.89/0.81), measured stable traits (3-month test-retest ICC=0.76/0.74), and correlated significantly with the neuroticism (NA/neuroticism, r=0.78, P<.001) and extraversion subscales (SI/extraversion, r=-0.64, P<.001) of the NEO-FFI, respectively. The prevalence of Type D personality was 31%. Type D was not related to transient emotional states. However, Chinese patients with a Type D personality were at increased concurrent risk of anxiety (P=.002) and depression (P=.016). Type D personality is a cross-culturally valid construct, is associated with an increased risk of anxiety and depression, and deserves prompt attention in estimating the prognostic risk of Chinese CHD patients. Copyright 2010 Elsevier Inc. All rights reserved.

Reliability and construct validity of the College Student Stress Scale.

PubMed

Feldt, Ronald C; Koch, Chris

2011-04-01

Reliability and construct validity of the 11-item College Student Stress Scale were investigated with exploratory (N = 273) and confirmatory factor analyses (N = 185) in undergraduate college students. Two factors were observed; however, reliability of the 3-item factor was too low and one item failed to load on either factor. A 7-item measure (Factor 1) had acceptable reliability (.81) and good convergence with the Perceived Stress Scale. This measure was significantly correlated with Neuroticism, Test Anxiety, and Self-efficacy for Learning, but not Social Desirability or age.

Validation of a novel basic virtual reality simulator, the LAP-X, for training basic laparoscopic skills.

PubMed

Kawaguchi, Koji; Egi, Hiroyuki; Hattori, Minoru; Sawada, Hiroyuki; Suzuki, Takahisa; Ohdan, Hideki

2014-10-01

Virtual reality surgical simulators are becoming popular as a means of providing trainees with an opportunity to practice laparoscopic skills. The Lap-X (Epona Medical, Rotterdam, the Netherlands) is a novel VR simulator for training basic skills in laparoscopic surgery. The objective of this study was to validate the LAP-X laparoscopic virtual reality simulator by assessing the face and construct validity in order to determine whether the simulator is adequate for basic skills training. The face and content validity were evaluated using a structured questionnaire. To assess the construct validity, the participants, nine expert surgeons (median age: 40 (32-45)) (>100 laparoscopic procedures) and 11 novices performed three basic laparoscopic tasks using the Lap-X. The participants reported a high level of content validity. No significant differences were found between the expert surgeons and the novices (Ps > 0.246). The performance of the expert surgeons on the three tasks was significantly better than that of the novices in all parameters (Ps < 0.05). This study demonstrated the face, content and construct validity of the Lap-X. The Lap-X holds real potential as a home and hospital training device.

Construct Validity of the Relationship Profile Test: Links with measures of psychopathology and adult attachment

PubMed Central

Haggerty, Greg; Bornstein, Robert F.; Khalid, Mohammad; Sharma, Vishal; Riaz, Usman; Blanchard, Mark; Siefert, Caleb J; Sinclair, Samuel J.

2015-01-01

This study assessed the construct validity of the Relationship Profile Test (RPT; Bornstein & Languirand, 2003) with a substance abuse sample. One hundred-eight substance abuse patients completed the RPT, Experiences in Close Relationships Scale (ECR-SF; Wei, Russell, Mallinckrodt, & Vogel, 2007), Personality Assessment Inventory (PAI; Morey, 1991), and Symptom Checklist-90-Revised (SCL-90-R: Derogatis 1983). Results suggest that the RPT has good construct validity when compared against theoretically related broadband measures of personality, psychopathology and adult attachment. Overall, health hependency was negatively related to measures of psychopathology and insecure attachment, and overdependence was positively related to measures of psychopathology and attachment anxiety. Many of the predictions regarding RPT detachment and the criterion measures were not supported. Implications of these findings are discussed. PMID:26620463

Diagnostic Construct Validity of MMPI-2 Restructured Form (MMPI-2-RF) Scale Scores

ERIC Educational Resources Information Center

Sellbom, Martin; Bagby, R. Michael; Kushner, Shauna; Quilty, Lena C.; Ayearst, Lindsay E.

2012-01-01

In the current investigation, the authors examined the diagnostic construct validity of the "Minnesota Multiphasic Personality Inventory-2-Restructured Form" (MMPI-2-RF) in a patient sample. All participants were diagnosed via the "Structured Clinical Interview" for DSM-IV Axis I Disorders (SCID-I/P). The data set used in this…

On Conducting Construct Validity Meta-Analyses for the Rorschach: A Reply to Tibon Czopp and Zeligman (2016).

PubMed

Mihura, Joni L; Meyer, Gregory J; Dumitrascu, Nicolae; Bombel, George

2016-01-01

We respond to Tibon Czopp and Zeligman's (2016) critique of our systematic reviews and meta-analyses of 65 Rorschach Comprehensive System (CS) variables published in Psychological Bulletin (2013). The authors endorsed our supportive findings but critiqued the same methodology when used for the 13 unsupported variables. Unfortunately, their commentary was based on significant misunderstandings of our meta-analytic method and results, such as thinking we used introspectively assessed criteria in classifying levels of support and reporting only a subset of our externally assessed criteria. We systematically address their arguments that our construct label and criterion variable choices were inaccurate and, therefore, meta-analytic validity for these 13 CS variables was artificially low. For example, the authors created new construct labels for these variables that they called "the customary CS interpretation," but did not describe their methodology nor provide evidence that their labels would result in better validity than ours. They cite studies they believe we should have included; we explain how these studies did not fit our inclusion criteria and that including them would have actually reduced the relevant CS variables' meta-analytic validity. Ultimately, criticisms alone cannot change meta-analytic support from negative to positive; Tibon Czopp and Zeligman would need to conduct their own construct validity meta-analyses.

Construct Validity and Reliability of the Beliefs Toward Mental Illness Scale for American, Japanese, and Korean Women.

PubMed

Saint Arnault, Denise M; Gang, Moonhee; Woo, Seoyoon

2017-11-01

The aim of this study was to evaluate the psychometric properties of the Beliefs Toward Mental Illness Scale (BMI) across women from the United States, Japan, and South Korea. A cross-sectional study design was employed. The sample was 564 women aged 21-64 years old who were recruited in the United States and Korea (American = 127, Japanese immigrants in the United States = 204, and Korean = 233). We carried out item analysis, construct validity by confirmatory factor analysis (CFA), and internal consistency using SPSS Version 22 and AMOS Version 22. An acceptable model fit for a 20-item BMI (Beliefs Toward Mental Illness Scale-Revised [BMI-R]) with 3 factors was confirmed using CFA. Construct validity of the BMI-R showed to be all acceptable; convergent validity (average variance extracted [AVE] ≥0.5, construct reliability [CR] ≥0.7) and discriminant validity (r = .65-.89, AVE >.79). The Cronbach's alpha of the BMI-R was .92. These results showed that the BMI was a reliable tool to study beliefs about mental illness across cultures. Our findings also suggested that continued efforts to reduce stigma in culturally specific contexts within and between countries are necessary to promote help-seeking for those suffering from psychological distress.

Bimanual Fine Motor Function (BFMF) Classification in Children with Cerebral Palsy: Aspects of Construct and Content Validity.

PubMed

Elvrum, Ann-Kristin G; Andersen, Guro L; Himmelmann, Kate; Beckung, Eva; Öhrvall, Ann-Marie; Lydersen, Stian; Vik, Torstein

2016-01-01

The Bimanual Fine Motor Function (BFMF) is currently the principal classification of hand function recorded by the Surveillance of Cerebral Palsy in Europe (SCPE) register. The BFMF is used in a number of epidemiological studies, but has not yet been validated. To examine aspects of construct and content validity of the BFMF. Construct validity of the BFMF was assessed by comparison with the Manual Ability Classification System (MACS) using register-based data from 539 children born 1999-2003 (304 boys; 4-12 years). The high correlation with the MACS (Spearman's rho = 0.89, CI: 0.86-0.91, p<.001) supports construct validity of the BFMF. The content of the BFMF was appraised through literature review, and by using the ICF-CY as a framework to compare the BFMF and MACS. The items hold, grasp and manipulate were found to be relevant to describe increasingly advanced fine motor abilities in children with CP, but the description of the BFMF does not state whether it is a classification of fine motor capacity or performance. Our results suggest that the BFMF may provide complementary information to the MACS regarding fine motor function and actual use of the hands, particularly if used as a classification of fine motor capacity.

POLYGON - A New Fundamental Movement Skills Test for 8 Year Old Children: Construction and Validation

PubMed Central

Zuvela, Frane; Bozanic, Ana; Miletic, Durdica

2011-01-01

Inadequately adopted fundamental movement skills (FMS) in early childhood may have a negative impact on the motor performance in later life (Gallahue and Ozmun, 2005). The need for an efficient FMS testing in Physical Education was recognized. The aim of this paper was to construct and validate a new FMS test for 8 year old children. Ninety-five 8 year old children were used for the testing. A total of 24 new FMS tasks were constructed and only the best representatives of movement areas entered into the final test product - FMS-POLYGON. The ICC showed high values for all 24 tasks (0.83-0.97) and the factorial analysis revealed the best representatives of each movement area that entered the FMS-POLYGON: tossing and catching the volleyball against a wall, running across obstacles, carrying the medicine balls, and straight running. The ICC for the FMS-POLYGON showed a very high result (0.98) and, therefore, confirmed the test’s intra-rater reliability. Concurrent validity was tested with the use of the “Test of Gross Motor Development” (TGMD-2). Correlation analysis between the newly constructed FMS-POLYGON and the TGMD-2 revealed the coefficient of -0.82 which indicates a high correlation. In conclusion, the new test for FMS assessment proved to be a reliable and valid instrument for 8 year old children. Application of this test in schools is justified and could play an important factor in physical education and sport practice. Key points All 21 newly constructed tasks demonstrated high intra-rater reliability (0.83-0.97) in FMS assessment. High reliability was also noted in the FMS-POLYGON test (0.98). A high correlation was found between the FMS-POLYGON and TGMD-2 which is a confirmation of the new test’s concurrent validity. The research resolved the problem of long and detailed FMS assessment by adding a new dimension using quick and effective norm-referenced approach but also covering all the most important movement areas. New and validated test can be

POLYGON - A New Fundamental Movement Skills Test for 8 Year Old Children: Construction and Validation.

PubMed

Zuvela, Frane; Bozanic, Ana; Miletic, Durdica

2011-01-01

Inadequately adopted fundamental movement skills (FMS) in early childhood may have a negative impact on the motor performance in later life (Gallahue and Ozmun, 2005). The need for an efficient FMS testing in Physical Education was recognized. The aim of this paper was to construct and validate a new FMS test for 8 year old children. Ninety-five 8 year old children were used for the testing. A total of 24 new FMS tasks were constructed and only the best representatives of movement areas entered into the final test product - FMS-POLYGON. The ICC showed high values for all 24 tasks (0.83-0.97) and the factorial analysis revealed the best representatives of each movement area that entered the FMS-POLYGON: tossing and catching the volleyball against a wall, running across obstacles, carrying the medicine balls, and straight running. The ICC for the FMS-POLYGON showed a very high result (0.98) and, therefore, confirmed the test's intra-rater reliability. Concurrent validity was tested with the use of the "Test of Gross Motor Development" (TGMD-2). Correlation analysis between the newly constructed FMS-POLYGON and the TGMD-2 revealed the coefficient of -0.82 which indicates a high correlation. In conclusion, the new test for FMS assessment proved to be a reliable and valid instrument for 8 year old children. Application of this test in schools is justified and could play an important factor in physical education and sport practice. Key pointsAll 21 newly constructed tasks demonstrated high intra-rater reliability (0.83-0.97) in FMS assessment. High reliability was also noted in the FMS-POLYGON test (0.98).A high correlation was found between the FMS-POLYGON and TGMD-2 which is a confirmation of the new test's concurrent validity.The research resolved the problem of long and detailed FMS assessment by adding a new dimension using quick and effective norm-referenced approach but also covering all the most important movement areas.New and validated test can be of great use

Validation of new psychosocial factors questionnaires: a Colombian national study.

PubMed

Villalobos, Gloria H; Vargas, Angélica M; Rondón, Martin A; Felknor, Sarah A

2013-01-01

The study of workers' health problems possibly associated with stressful conditions requires valid and reliable tools for monitoring risk factors. The present study validates two questionnaires to assess psychosocial risk factors for stress-related illnesses within a sample of Colombian workers. The validation process was based on a representative sample survey of 2,360 Colombian employees, aged 18-70 years. Worker response rate was 90%; 46% of the responders were women. Internal consistency was calculated, construct validity was tested with factor analysis and concurrent validity was tested with Spearman correlations. The questionnaires demonstrated adequate reliability (0.88-0.95). Factor analysis confirmed the dimensions proposed in the measurement model. Concurrent validity resulted in significant correlations with stress and health symptoms. "Work and Non-work Psychosocial Factors Questionnaires" were found to be valid and reliable for the assessment of workers' psychosocial factors, and they provide information for research and intervention. Copyright © 2012 Wiley Periodicals, Inc.

Examining construct and predictive validity of the Health-IT Usability Evaluation Scale: confirmatory factor analysis and structural equation modeling results.

PubMed

Yen, Po-Yin; Sousa, Karen H; Bakken, Suzanne

2014-10-01

In a previous study, we developed the Health Information Technology Usability Evaluation Scale (Health-ITUES), which is designed to support customization at the item level. Such customization matches the specific tasks/expectations of a health IT system while retaining comparability at the construct level, and provides evidence of its factorial validity and internal consistency reliability through exploratory factor analysis. In this study, we advanced the development of Health-ITUES to examine its construct validity and predictive validity. The health IT system studied was a web-based communication system that supported nurse staffing and scheduling. Using Health-ITUES, we conducted a cross-sectional study to evaluate users' perception toward the web-based communication system after system implementation. We examined Health-ITUES's construct validity through first and second order confirmatory factor analysis (CFA), and its predictive validity via structural equation modeling (SEM). The sample comprised 541 staff nurses in two healthcare organizations. The CFA (n=165) showed that a general usability factor accounted for 78.1%, 93.4%, 51.0%, and 39.9% of the explained variance in 'Quality of Work Life', 'Perceived Usefulness', 'Perceived Ease of Use', and 'User Control', respectively. The SEM (n=541) supported the predictive validity of Health-ITUES, explaining 64% of the variance in intention for system use. The results of CFA and SEM provide additional evidence for the construct and predictive validity of Health-ITUES. The customizability of Health-ITUES has the potential to support comparisons at the construct level, while allowing variation at the item level. We also illustrate application of Health-ITUES across stages of system development. Published by the BMJ Publishing Group Limited. For permission to use (where not already granted under a licence) please go to http://group.bmj.com/group/rights-licensing/permissions.

The Investigation of Construct Validity of Diagnostic and Statistical Manual of Mental Disorder-5 Personality Traits on Iranian sample with Antisocial and Borderline Personality Disorders.

PubMed

Amini, Mehdi; Pourshahbaz, Abbas; Mohammadkhani, Parvaneh; Ardakani, Mohammad-Reza Khodaie; Lotfi, Mozhgan

2014-12-01

The goal of this study was to examine the construct validity of the diagnostic and statistical manual of mental disorder-5 (DSM-5) conceptual model of antisocial and borderline personality disorders (PDs). More specifically, the aim was to determine whether the DSM-5 five-factor structure of pathological personality trait domains replicated in an independently collected sample that differs culturally from the derivation sample. This study was on a sample of 346 individuals with antisocial (n = 122) and borderline PD (n = 130), and nonclinical subjects (n = 94). Participants randomly selected from prisoners, out-patient, and in-patient clients. Participants were recruited from Tehran prisoners, and clinical psychology and psychiatry clinics of Razi and Taleghani Hospital, Tehran, Iran. The SCID-II-PQ, SCID-II, DSM-5 Personality Trait Rating Form (Clinician's PTRF) were used to diagnosis of PD and to assessment of pathological traits. The data were analyzed by exploratory factor analysis. Factor analysis revealed a 5-factor solution for DSM-5 personality traits. Results showed that DSM-5 has adequate construct validity in Iranian sample with antisocial and borderline PDs. Factors similar in number with the other studies, but different in the content. Exploratory factor analysis revealed five homogeneous components of antisocial and borderline PDs. That may represent personality, behavioral, and affective features central to the disorder. Furthermore, the present study helps understand the adequacy of DSM-5 dimensional approach to evaluation of personality pathology, specifically on Iranian sample.

Construction and preliminary validation of the Barcelona Immigration Stress Scale.

PubMed

Tomás-Sábado, Joaquín; Qureshi, Adil; Antonin, Montserrat; Collazos, Francisco

2007-06-01

In the study of mental health and migration, an increasing number of researchers have shifted the focus away from the concept of acculturation towards the stress present in the migratory experience. The bulk of research on acculturative stress has been carried out in the United States, and thus the definition and measurement of the construct has been predicated on that cultural and demographic context, which is of dubious applicability in Europe in general, and Spain in particular. Further, some scales have focused on international students, which down-played the importance of the migratory process, because it deals with a special subset of people who are not formally immigrating. The Barcelona Immigration Stress Scale was developed to measure acculturative stress appropriate to immigrants in Spain, using expert and focus group review and has 42 items. The scale shows acceptable internal validity, and, consistent with other scales, suggests that immigration stress is a complex construct.

Construct Validity Evidence for Single-Response Items to Estimate Physical Activity Levels in Large Sample Studies

ERIC Educational Resources Information Center

Jackson, Allen W.; Morrow, James R., Jr.; Bowles, Heather R.; FitzGerald, Shannon J.; Blair, Steven N.

2007-01-01

Valid measurement of physical activity is important for studying the risks for morbidity and mortality. The purpose of this study was to examine evidence of construct validity of two similar single-response items assessing physical activity via self-report. Both items are based on the stages of change model. The sample was 687 participants (men =…

Construct Validity in TOEFL iBT Speaking Tasks: Insights from Natural Language Processing

ERIC Educational Resources Information Center

Kyle, Kristopher; Crossley, Scott A.; McNamara, Danielle S.

2016-01-01

This study explores the construct validity of speaking tasks included in the TOEFL iBT (e.g., integrated and independent speaking tasks). Specifically, advanced natural language processing (NLP) tools, MANOVA difference statistics, and discriminant function analyses (DFA) are used to assess the degree to which and in what ways responses to these…

Construct Validity of the Neighborhood Environment Walkability Scale for Africa.

PubMed

Oyeyemi, Adewale L; Conway, Terry L; Adedoyin, Rufus A; Akinroye, Kingsley K; Aryeetey, Richmond; Assah, Felix; Cain, Kelli L; Gavand, Kavita A; Kasoma, Sandra S; Kolbe-Alexander, Tracy L; Lambert, Estelle V; Larouche, Richard; Moss, Sarah J; Ocansey, Reginald; Onywera, Vincent O; Prista, Antonio; Tremblay, Mark S; Sallis, James F

2017-03-01

The development of valid measures of built environments relevant for physical activity is an important step toward controlling the global epidemic of physical inactivity-related noncommunicable diseases and deaths. This study assessed the construct validity of a self-report neighborhood environment walkability scale adapted for Africa (NEWS-Africa), by examining relationships with self-reported walking for transportation and recreation using pooled data from six sub-Saharan African countries. NEWS was systematically adapted to assess urban, periurban, and rural environments in sub-Saharan Africa. Adults (n = 469, 18-85 yr, 49.7% women) from Cameroon, Ghana, Mozambique, Nigeria, South Africa, and Uganda were purposively recruited from neighborhoods varying in walkability and socioeconomic status, with some from villages. Participants completed the 76-item (13 subscales) NEWS-Africa by structured interview and reported weekly minutes of walking for transport and recreation using items from the International Physical Activity Questionnaire. The overall "walkability" index had a positive relationship with both walking for transportation (η = 0.020, P = 0.005) and recreation (η = 0.013, P = 0.028) in the pooled analyses. The mixed-use access and stranger danger scales were positively related with transport walking (η = 0.020, P = 0.006 and η = 0.021, P = 0.040, respectively). Proximity of recreational facilities (η = 0.016, P = 0.015), road/path connectivity (η = 0.025, P = 0.002), path infrastructure (η = 0.021, P = 0.005), and overall places for walking and cycling (η = 0.012, P = 0.029) scales were positively related to recreational walking. Country-specific results were mostly nonsignificant except for South Africa and Uganda. Of 14 NEWS-Africa scales, 7 were significantly related to walking behavior in pooled analyses, providing partial support for the construct validity of NEWS-Africa. However, effect sizes appeared to be lower than those from other

Construct Validity of the Neighborhood Environment Walkability Scale for Africa

PubMed Central

Oyeyemi, Adewale L.; Conway, Terry L.; Adedoyin, Rufus A.; Akinroye, Kingsley K.; Aryeetey, Richmond; Assah, Felix; Cain, Kelli L.; Gavand, Kavita A.; Kasoma, Sandra S.; Kolbe-Alexander, Tracy L.; Lambert, Estelle V.; Larouche, Richard; Mos, Sarah J.; Ocansey, Reginald; Onywera, Vincent O.; Prista, Antonio; Tremblay, Mark S.; Sallis, James F.

2016-01-01

Purpose Development of valid measures of built environments relevant for physical activity is an important step toward controlling the global epidemic of physical inactivity-related noncommunicable diseases and deaths. This study assessed the construct validity of a self-report neighborhood environment walkability scale adapted for Africa (NEWS-Africa), by examining relationships with self-reported walking for transportation and recreation using pooled data from six sub-Saharan African countries. Methods NEWS was systematically adapted to assess urban, peri-urban and rural environments in sub-Saharan Africa. Adults (n=469, 18-85 years, 49.7% women) from Cameroon, Ghana, Mozambique, Nigeria, South Africa and Uganda were purposively recruited from neighborhoods varying in walkability and socioeconomic status, with some from villages. Participants completed the 76-item (13 subscales) NEWS-Africa by structured interview and reported weekly minutes of walking for transport and recreation using items from the International Physical Activity Questionnaire. Results The overall ‘walkability’ index had a positive relationship with both walking for transportation (eta2=0.020, p=0.005) and recreation (eta2=0.013, p=0.028) in the pooled analyses. The mixed-use access and stranger-danger scales were positively related with transport walking (eta2=0.020, p=0.006 and eta2=0.021, p=0.040, respectively). Proximity of recreational facilities (eta2=0.016, p=0.015), road/path connectivity (eta2=0.025, p=0.002), path infrastructure (eta2=0.021, p=0.005), and overall places for walking and cycling (eta2=0.012, p=0.029) scales were positively related to recreational walking. Country-specific results were mostly non-significant except for South Africa and Uganda. Conclusions Seven of 14 NEWS-Africa scales were significantly related to walking behavior in pooled analyses, providing partial support for the construct validity of NEWS-Africa. However, effect sizes appeared to be lower than

Construction and Validation of a Women's Autonomy Measurement Scale with Reference to Utilization of Maternal Health Care Services in Nepal.

PubMed

Bhandari, T R; Dangal, G; Sarma, P S; Kutty, V R

2014-01-01

Women's autonomy is one of the predictors of maternal health care service utilization. This study aimed to construct and validate a scale for measuring women's autonomy with relevance to developing countries. We conducted a study for construction and validation of a scale in Rupandehi and further validated in Kapilvastu districts of Nepal. Initially, we administered a 24-item preliminary scale and finalized a 23-item scale using psychometric tests. After defining the construct of women's autonomy, we pooled 194 items and selected 24 items to develop a preliminary scale. The scale development process followed different steps i.e. definition of construct, generation of items pool, pretesting, analysis of psychometric test and further validation. The new scale was strongly supported by Cronbach's Alpha value (0.84), test-retest Pearson correlation (0.87), average content validity ratio (0.8) and overall agreement- Kappa value of the items (0.83) whereas all values were found satisfactory. From factor analysis, we selected 23 items for the final scale which show good convergent and discriminant validity. From preliminary draft, we removed one item; the remaining 23 items were loaded in five factors. All five factors had single loading items by suppressing absolute coefficient value less than 0.45 and average coefficient was more than 0.60 of each factor. Similarly, the factors and loaded items had good convergent and discriminant validity which further showed strong measurement capacity of the scale. The new scale is a reliable tool for assessing women's autonomy in developing countries. We recommend for further use and validation of the scale for ensuring the measurement capacity.

Measuring production loss due to health and work environment problems: construct validity and implications.

PubMed

Karlsson, Malin Lohela; Bergström, Gunnar; Björklund, Christina; Hagberg, Jan; Jensen, Irene

2013-12-01

The aim was to validate two measures of production loss, health-related and work environment-related production loss, concerning their associations with health status and work environment factors. Validity was assessed by evaluating the construct validity. Health problems related and work environment-related problems (or factors) were included in separate analyses and evaluated regarding the significant difference in proportion of explained variation (R) of production loss. health problems production loss was not found to fulfill the criteria for convergent validity in this study; however, the measure of work environment-related production loss did fulfill the criteria that were set up. The measure of work environment-related production loss can be used to screen for production loss due to work environment problems as well as an outcome measure when evaluating the effect of organizational interventions.

Reliability, validity, sensitivity and specificity of Guajarati version of the Roland-Morris Disability Questionnaire.

PubMed

Nambi, S Gopal

2013-01-01

The most common instruments developed to assess the functional status of patients with Non specific low back pain is the Roland-Morris Disability Questionnaire (RMDQ). Clinical and epidemiological research related to low back pain in the Gujarati population would be facilitated by the availability of well-established outcome measures. To find the reliability, validity, sensitivity and specificity of the Gujarati version of the RMDQ for use in Non Specific Chronic low back pain. A reliability, validity, sensitivity and specificity study of Gujarati version of the Roland-Morris Disability Questionnaire (RMDQ). Thirty out patients with Non Specific Chronic low back pain were assessed by the RMDQ. Reliability is assessed by using internal consistency and the intra-class correlation coefficient (ICC). Internal construct validity is assessed by RASCH Analysis and external construct validity is assessed by association with pain and spinal movement. Clinical calculator was used to determine the sensitivity and specificity. Internal consistency of the RMDQ is found to be adequate (> 0.65) at both times, with high ICC's also at both time points. Internal construct validity of the scale is good, indicating a single underlying construct. Expected associations with pain and spinal movement confirm external construct validity. The Sensitivity and Specificity at cut off point of 0.5 was 80% and 84% with respectively positive predictive value (PPV) of 83.33% and negative predictive value (NPV) of 80.76%. The Questionnaire is at the ordinal level. The RMDQ is a one-dimensional, ordinal measure, which works well in the Gujarati population.

Validity and reliability testing of the Prenatal Psychosocial Profile.

PubMed

Curry, M A; Campbell, R A; Christian, M

1994-04-01

Two studies of low-income pregnant women (N = 179) were done to examine the validity and reliability of the Prenatal Psychosocial Profile (PPP). The PPP, a composite of the Rosenberg Self-Esteem Scale, the Support Behaviors Inventory, and a newly developed measure of stress, is a brief, comprehensive clinical assessment of psychosocial risk during pregnancy. Construct validity of the stress scale was supported by theoretically predicted negative correlations with self-esteem, partner support, and support from others (N = 91). Convergent validity of the stress scale was demonstrated by a correlation of .71 with the Difficult Life Circumstances Scale. Adequate levels of internal consistency were found. Interrelationships between the four subscales were consistent with the underlying conceptualization, and there was beginning evidence of the factorial independence of the subscales.

Comparing the Construct and Criterion-Related Validity of Ability-Based and Mixed-Model Measures of Emotional Intelligence

ERIC Educational Resources Information Center

Livingstone, Holly A.; Day, Arla L.

2005-01-01

Despite the popularity of the concept of emotional intelligence(EI), there is much controversy around its definition, measurement, and validity. Therefore, the authors examined the construct and criterion-related validity of an ability-based EI measure (Mayer Salovey Caruso Emotional Intelligence Test [MSCEIT]) and a mixed-model EI measure…

Construction and validation of forms: systematization of the care of people under hemodialysis.

PubMed

Arreguy-Sena, Cristina; Marques, Tais de Oliveira; Souza, Luciene Carnevale de; Alvarenga-Martins, Nathália; Krempser, Paula; Braga, Luciene Muniz; Parreira, Pedro Miguel Dos Santos Dinis

2018-01-01

create and validate forms to subsidize the systematization of nursing care with people on hemodialysis. institutional case study to support the systematization of assistance from the construction of forms for data collection, diagnoses, interventions and nursing results, using cross-mapping, Risner's reasoning, Neuman's theory, taxonomies of diagnoses, interventions and nursing results with application in clinical practice and validation by focal group with specialist nurses. 18 people on hemodialysis and 7 nurses participated. Consensus content of form matter with specialist nurses in the area (Crombach 0.86). The papers captured 43 diagnoses, 26 interventions and 78 nursing results depicting human responses in their singularities. the validated forms fill a gap by enabling the capture of human responses from people on hemodialysis and by subsidizing the planning of nursing care on a scientific basis.

Validation and Diagnostic Efficiency of the Mini-SPIN in Spanish-Speaking Adolescents.

PubMed

Garcia-Lopez, LuisJoaquín; Moore, Harry T A

2015-01-01

Social Anxiety Disorder (SAD) is one of the most common mental disorders in adolescence. Many validated psychometric tools are available to diagnose individuals with SAD efficaciously. However, there is a demand for shortened self-report instruments that identify adolescents at risk of developing SAD. We validate the Mini-SPIN and its diagnostic efficiency in overcoming this problem in Spanish-speaking adolescents in Spain. The psychometric properties of the 3-item Mini-SPIN scale for adolescents were assessed in a community (study 1) and clinical sample (study 2). Study 1 consisted of 573 adolescents, and found the Mini-SPIN to have appropriate internal consistency and high construct validity. Study 2 consisted of 354 adolescents (147 participants diagnosed with SAD and 207 healthy controls). Data revealed that the Mini-SPIN has good internal consistency, high construct validity and adequate diagnostic efficiency. Our findings suggest that the Mini-SPIN has good psychometric properties on clinical and healthy control adolescents and general population, which indicates that it can be used as a screening tool in Spanish-speaking adolescents. Cut-off scores are provided.

Construct validity of self-reported historical physical activity.

PubMed

Bowles, Heather R; FitzGerald, Shannon J; Morrow, James R; Jackson, Allen W; Blair, Steven N

2004-08-01

The purpose of this study was to determine the construct-related validity of self-reported historical walking, running, and jogging (WRJ) activity on the basis of data from the Aerobics Center Longitudinal Study (Dallas, Texas). A total of 4,100 men and 963 women underwent at least one medical examination between 1976 and 1985 and completed a follow-up questionnaire in 1986. Levels of glucose, cholesterol, and triglycerides, resting systolic blood pressure, body mass index (weight (kg)/height (m)(2)), and cardiorespiratory fitness were measured at the time of the medical examination. The follow-up questionnaire assessed WRJ and other strenuous activities for each year from 1976 through 1985. Data analysis included Spearman and partial correlations, analysis of variance, analysis of covariance, and t tests. Results indicated significant correlations between recalled WRJ and treadmill times for each year throughout the 10-year period (r = 0.40-0.61). Participants were classified as historically either sufficiently physically active to receive a health benefit or insufficiently active for a health benefit. Engaging in sufficient levels of historical WRJ was associated with higher treadmill times and lower body mass indices for men and women and lower triglyceride levels for men. Self-reported historical WRJ can be assessed with reasonable validity in comparison with measured treadmill performance, with no decay in accuracy of reporting for up to 10 years in the past.

An empirical look at the Defense Mechanism Test (DMT): reliability and construct validity.

PubMed

Ekehammar, Bo; Zuber, Irena; Konstenius, Marja-Liisa

2005-07-01

Although the Defense Mechanism Test (DMT) has been in use for almost half a century, there are still quite contradictory views about whether it is a reliable instrument, and if so, what it really measures. Thus, based on data from 39 female students, we first examined DMT inter-coder reliability by analyzing the agreement among trained judges in their coding of the same DMT protocols. Second, we constructed a "parallel" photographic picture that retained all structural characteristic of the original and analyzed DMT parallel-test reliability. Third, we examined the construct validity of the DMT by (a) employing three self-report defense-mechanism inventories and analyzing the intercorrelations between DMT defense scores and corresponding defenses in these instruments, (b) studying the relationships between DMT responses and scores on trait and state anxiety, and (c) relating DMT-defense scores to measures of self-esteem. The main results showed that the DMT can be coded with high reliability by trained coders, that the parallel-test reliability is unsatisfactory compared to traditional psychometric standards, that there is a certain generalizability in the number of perceptual distortions that people display from one picture to another, and that the construct validation provided meager empirical evidence for the conclusion that the DMT measures what it purports to measure, that is, psychological defense mechanisms.

Validation of a French-Canadian adaptation of the Intuitive Eating Scale-2 for the adult population.

PubMed

Carbonneau, Elise; Carbonneau, Noémie; Lamarche, Benoît; Provencher, Véronique; Bégin, Catherine; Bradette-Laplante, Maude; Laramée, Catherine; Lemieux, Simone

2016-10-01

Intuitive eating is an adaptive eating style based on the reliance on physiological cues to determine when, what, and how much to eat. The Intuitive Eating Scale-2 (IES-2) is a validated four-subscale tool measuring the degree of adherence to intuitive eating principles. The present series of studies aimed at evaluating the psychometric properties of a French-Canadian adaptation of the IES-2 for the adult population. The factor structure, the reliability (internal consistency and test-retest), the construct validity, and the discriminant validity were evaluated in 334 women and 75 men from the Province of Québec, Canada, across two studies. A confirmatory factor analysis upheld that the four-factor structure of the original IES-2 was adequate for the present sample of French-Canadians. The scale demonstrated adequate internal consistency and test-retest reliability. Construct validity evidence was obtained with the significant associations between intuitive eating and psychological and eating-related variables. Intuitive eating was negatively associated with eating disorder symptomatology and with food- and weight-preoccupation, and positively associated with body-esteem and well-being. The French-Canadian IES-2 was also able to discriminate between genders and body mass index categories. The properties of this new version of the IES-2 are demonstrative of a reliable and valid tool to assess intuitive eating in the French-Canadian adult population of the Province of Québec. Copyright © 2016 Elsevier Ltd. All rights reserved.

The Construct Validity of Attitudes toward Career Counseling Scale for Korean College Students

ERIC Educational Resources Information Center

Nam, Suk Kyung; In Park, Hyung

2015-01-01

This study aimed to examine the construct validity of the Attitudes Toward Career Counseling Scale (ATCCS) in Korea. In Study 1, confirmatory factor analysis (CFA) was used for testing the factor structure of the scale. The results supported a two-factor (value and stigma) model, which was theoretically driven from the original study. Results of…

Testing the Construct Validity of Proposed Criteria for "DSM-5" Autism Spectrum Disorder

ERIC Educational Resources Information Center

Mandy, William P. L.; Charman, Tony; Skuse, David H.

2012-01-01

Objective: To use confirmatory factor analysis to test the construct validity of the proposed "DSM-5" symptom model of autism spectrum disorder (ASD), in comparison to alternative models, including that described in "DSM-IV-TR." Method: Participants were 708 verbal children and young persons (mean age, 9.5 years) with mild to severe autistic…

Validity threats: overcoming interference with proposed interpretations of assessment data.

PubMed

Downing, Steven M; Haladyna, Thomas M

2004-03-01

Factors that interfere with the ability to interpret assessment scores or ratings in the proposed manner threaten validity. To be interpreted in a meaningful manner, all assessments in medical education require sound, scientific evidence of validity. The purpose of this essay is to discuss 2 major threats to validity: construct under-representation (CU) and construct-irrelevant variance (CIV). Examples of each type of threat for written, performance and clinical performance examinations are provided. The CU threat to validity refers to undersampling the content domain. Using too few items, cases or clinical performance observations to adequately generalise to the domain represents CU. Variables that systematically (rather than randomly) interfere with the ability to meaningfully interpret scores or ratings represent CIV. Issues such as flawed test items written at inappropriate reading levels or statistically biased questions represent CIV in written tests. For performance examinations, such as standardised patient examinations, flawed cases or cases that are too difficult for student ability contribute CIV to the assessment. For clinical performance data, systematic rater error, such as halo or central tendency error, represents CIV. The term face validity is rejected as representative of any type of legitimate validity evidence, although the fact that the appearance of the assessment may be an important characteristic other than validity is acknowledged. There are multiple threats to validity in all types of assessment in medical education. Methods to eliminate or control validity threats are suggested.

The Psychometric Properties of the Center for Epidemiologic Studies Depression Scale in Chinese Primary Care Patients: Factor Structure, Construct Validity, Reliability, Sensitivity and Responsiveness

PubMed Central

2015-01-01

Background The Center for Epidemiologic Studies Depression Scale (CES-D) is a commonly used instrument to measure depressive symptomatology. Despite this, the evidence for its psychometric properties remains poorly established in Chinese populations. The aim of this study was to validate the use of the CES-D in Chinese primary care patients by examining factor structure, construct validity, reliability, sensitivity and responsiveness. Methods and Results The psychometric properties were assessed amongst a sample of 3686 Chinese adult primary care patients in Hong Kong. Three competing factor structure models were examined using confirmatory factor analysis. The original CES-D four-structure model had adequate fit, however the data was better fit into a bi-factor model. For the internal construct validity, corrected item-total correlations were 0.4 for most items. The convergent validity was assessed by examining the correlations between the CES-D, the Patient Health Questionnaire 9 (PHQ-9) and the Short Form-12 Health Survey (version 2) Mental Component Summary (SF-12 v2 MCS). The CES-D had a strong correlation with the PHQ-9 (coefficient: 0.78) and SF-12 v2 MCS (coefficient: -0.75). Internal consistency was assessed by McDonald’s omega hierarchical (ωH). The ωH value for the general depression factor was 0.855. The ωH values for “somatic”, “depressed affect”, “positive affect” and “interpersonal problems” were 0.434, 0.038, 0.738 and 0.730, respectively. For the two-week test-retest reliability, the intraclass correlation coefficient was 0.91. The CES-D was sensitive in detecting differences between known groups, with the AUC >0.7. Internal responsiveness of the CES-D to detect positive and negative changes was satisfactory (with p value <0.01 and all effect size statistics >0.2). The CES-D was externally responsive, with the AUC>0.7. Conclusions The CES-D appears to be a valid, reliable, sensitive and responsive instrument for screening and

The Psychometric Properties of the Center for Epidemiologic Studies Depression Scale in Chinese Primary Care Patients: Factor Structure, Construct Validity, Reliability, Sensitivity and Responsiveness.

PubMed

Chin, Weng Yee; Choi, Edmond P H; Chan, Kit T Y; Wong, Carlos K H

2015-01-01

The Center for Epidemiologic Studies Depression Scale (CES-D) is a commonly used instrument to measure depressive symptomatology. Despite this, the evidence for its psychometric properties remains poorly established in Chinese populations. The aim of this study was to validate the use of the CES-D in Chinese primary care patients by examining factor structure, construct validity, reliability, sensitivity and responsiveness. The psychometric properties were assessed amongst a sample of 3686 Chinese adult primary care patients in Hong Kong. Three competing factor structure models were examined using confirmatory factor analysis. The original CES-D four-structure model had adequate fit, however the data was better fit into a bi-factor model. For the internal construct validity, corrected item-total correlations were 0.4 for most items. The convergent validity was assessed by examining the correlations between the CES-D, the Patient Health Questionnaire 9 (PHQ-9) and the Short Form-12 Health Survey (version 2) Mental Component Summary (SF-12 v2 MCS). The CES-D had a strong correlation with the PHQ-9 (coefficient: 0.78) and SF-12 v2 MCS (coefficient: -0.75). Internal consistency was assessed by McDonald's omega hierarchical (ωH). The ωH value for the general depression factor was 0.855. The ωH values for "somatic", "depressed affect", "positive affect" and "interpersonal problems" were 0.434, 0.038, 0.738 and 0.730, respectively. For the two-week test-retest reliability, the intraclass correlation coefficient was 0.91. The CES-D was sensitive in detecting differences between known groups, with the AUC >0.7. Internal responsiveness of the CES-D to detect positive and negative changes was satisfactory (with p value <0.01 and all effect size statistics >0.2). The CES-D was externally responsive, with the AUC>0.7. The CES-D appears to be a valid, reliable, sensitive and responsive instrument for screening and monitoring depressive symptoms in adult Chinese primary care

Construct Validity Examination of Critical Thinking Dispositions for Undergraduate Students in University Putra Malaysia

ERIC Educational Resources Information Center

Ghadi, Ibrahim; Alwi, Nor Hayati; Bakar, Kamariah Abu; Talib, Othman

2012-01-01

This research aims to evaluate the psychology properties of the construct validity for the Critical Thinking Disposition (CTD) instrument. The CTD instrument consists of 39 Likert-type items measuring seven dispositions, namely analyticity, open-mind, truth-seeking, systematicity, self-confidence inquisitiveness and maturity. The study involves…

OA Go Away: Development and Preliminary Validation of a Self-Management Tool to Promote Adherence to Exercise and Physical Activity for People with Osteoarthritis of the Hip or Knee

PubMed Central

Toupin April, Karine; Backman, Catherine; Tugwell, Peter

2016-01-01

Purpose: To determine the face and content validity, construct validity, and test–retest reliability of the OA Go Away (OGA), a personalized self-management tool to promote adherence to exercise and physical activity for people with osteoarthritis (OA) of the hip or knee. Methods: The face and content validity of OGA version 1.0 were determined via interviews with 10 people with OA of the hip or knee and 10 clinicians. A revised OGA version 2.0 was then tested for construct validity and test–retest reliability with a new sample of 50 people with OA of the hip or knee by comparing key items in the OGA journal with validated outcome measures assessing similar health outcomes and comparing scores on key items of the journal 4–7 days apart. Face and content validity were then confirmed with a new sample of 5 people with OA of the hip or knee and 5 clinicians. Results: Eighteen of 30 items from the OGA version 1.0 and 41 of 43 items from the OGA version 2.0 journal, goals and action plan, and exercise log had adequate content validity. Construct validity and test–retest reliability were acceptable for the main items of the OGA version 2.0 journal. The OGA underwent modifications based on results and participant feedback. Conclusion: The OGA is a novel self-management intervention and assessment tool for people with OA of the hip or knee that shows adequate preliminary measurement properties. PMID:27909359

Validation of the PASSPORT V2 training environment for arthroscopic skills.

PubMed

Stunt, J J; Kerkhoffs, G M M J; Horeman, T; van Dijk, C N; Tuijthof, G J M

2016-06-01

Virtual reality simulators used in the education of orthopaedic residents often lack realistic haptic feedback. To solve this, the (Practice Arthroscopic Surgical Skills for Perfect Operative Real-life Treatment) PASSPORT simulator was developed, which was subjected to fundamental changes: improved realism and user interface. The purpose was to demonstrate its face and construct validity. Thirty-one participants were divided into three groups having different levels of arthroscopic experience. Participants answered questions regarding general information and the outer appearance of the simulator for face validity. Construct validity was assessed with one standardized navigation task, which was timed. Face validity, educational value and user-friendliness were determined with two representative exercises and by asking participants to fill out the questionnaire. A value of 7 or greater was considered sufficient. Construct validity was demonstrated between experts and novices. Median task time for the fifth trial was 55 s (range 17-139 s) for the novices, 33 s (range 17-59 s) for the intermediates, and 26 s (range 14-52 s) for the experts. Median task times of three trials were not significantly different between the novices and intermediates, and none of the trials between intermediates and experts. Face validity, educational value and user-friendliness were perceived as sufficient (median >7). The presence of realistic tactile feedback was considered the biggest asset of the simulator. Proper preparation for arthroscopic operations will increase the quality of real-life surgery and patients' safety. The PASSPORT simulator can assist in achieving this, as it showed construct and face validity, and its physical nature offered adequate haptic feedback during training. This indicates that PASSPORT has potential to evolve as a valuable training modality.

[Reliability and construct validity of an instrument to asses the Self-perception of Family Health Status].

PubMed

Lima Rodríguez, Joaquín Salvador; Lima Serrano, Marta; Jiménez Picón, Nerea; Domínguez Sánchez, Isabel

2012-10-01

Family health determines and it is determined by family´s capacity to function effectively as a biosocial unit in a given culture and society. The main of study has been to test reliability and construct validity of an instrument to asses the Self-perception of Family Health Status. We validated its content by an on-line Dephi panel with experts. We surveyed 258 families in them homes or in primary health centres from Seville, Spain. We administered the instrument that has five Likert scales: Family climate, Family integrity, Family functioning, and Family resistance. We tested reliability by Cronbach Alpha and construct validity by exploratory factor analysis. The five scales obtained values α between 0.73 for the Family Climate and 0.89 for Family Integrity. They showed evidence of one-dimensional interpretation after factor analysis, a) all items got weights r>0.30 in first factor before rotations, b) the first factor explained a significant proportion of variance before rotations, and c) the total variance explained by the main factors extracted was greater than 50%. The scales showed their reliability and validity. They could be employed to assess the self-perception of family health status.

Poor Validity of the DSM-IV Schizoid Personality Disorder Construct as a Diagnostic Category.

PubMed

Hummelen, Benjamin; Pedersen, Geir; Wilberg, Theresa; Karterud, Sigmund

2015-06-01

This study sought to evaluate the construct validity of schizoid personality disorder (SZPD) by investigating a sample of 2,619 patients from the Norwegian Network of Personality-Focused Treatment Programs by a variety of statistical techniques. Nineteen patients (0.7%) reached the diagnostic threshold of SZPD. Results from the factor analyses indicated that SZPD consists of three factors: social detachment, withdrawal, and restricted affectivity/ anhedonia. Overall, internal consistency and diagnostic efficiency were poor and best for the criteria that belong to the social detachment factor. These findings pose serious questions about the clinical utility of SZPD as a diagnostic category. On the other hand, the three factors were in concordance with findings from previous studies and with the trait model for personality disorders in DSM-5, supporting the validity of SZPD as a dimensional construct. The authors recommend that SZPD should be deleted as a diagnostic category in future editions of DSM-5.

Construct Validation of Analytic Rating Scales in a Speaking Assessment: Reporting a Score Profile and a Composite

ERIC Educational Resources Information Center

Sawaki, Yasuyo

2007-01-01

This is a construct validation study of a second language speaking assessment that reported a language profile based on analytic rating scales and a composite score. The study addressed three key issues: score dependability, convergent/discriminant validity of analytic rating scales and the weighting of analytic ratings in the composite score.…

The construct validity and reliability of the Turkish version of Spreitzer's psychological empowerment scale

PubMed Central

2010-01-01

Background Today, many organizations have adopted some kind of empowerment initiative for at least part of their workforce. Over the last two decades, two complementary perspectives on empowerment at work have emerged: structural and psychological empowerment. Psychological empowerment is a motivational construct manifested in four cognitions: meaning, competence, self-determination and impact. The aim of this article is to examine the construct validity and reliability of the Turkish translation of Spreitzer's psychological empowerment scale in a culturally diverse environment. Methods The scale contains four dimensions over 12 statements. Data were gathered from 260 nurses and 161 physicians. The dimensionality of the scale was evaluated by exploratory factor analyses. To investigate the multidimensional nature of the empowerment construct and the validity of the scale, first- and second-order confirmatory factor analysis was conducted. Furthermore, Cronbach alpha coefficients were assessed to investigate reliability. Results Exploratory factor analyses revealed that four factors in both solutions. The first- and second-order factor analysis indicated an acceptable fit between the data and the theoretical model for nurses and physicians. Cronbach alpha coefficients varied between 0.81-0.94 for both groups, which may be considered satisfactory. Conclusions The analyses indicated that the psychometric properties of the Turkish version of the scale can be considered satisfactory. PMID:20214770

Construct Validity and Reliability of College Students' Responses to the Reasons for Smoking Scale

ERIC Educational Resources Information Center

Fiala, Kelly Ann; D'Abundo, Michelle Lee; Marinaro, Laura Marie

2010-01-01

When utilizing self-assessments to determine motives for health behaviors, it is essential that the resulting data demonstrate sound psychometric properties. The purpose of this research was to assess the reliability and construct validity of college students' responses to the Reasons for Smoking Scale (RFS). Confirmatory factor analyses and…

Construction and Validation of a Questionnaire to Study Future Teachers' Beliefs about Cultural Diversity

ERIC Educational Resources Information Center

López López, M. Carmen; Hinojosa Pareja, Eva F.

2016-01-01

The article presents the construction and validation process of a questionnaire designed to study student teachers' beliefs about cultural diversity. The study, beyond highlighting the complexity involved in the study of beliefs, emphasises their relevance in implementing inclusive educational processes that guarantee the right to a good education…

Cataract surgeons outperform medical students in Eyesi virtual reality cataract surgery: evidence for construct validity.

PubMed

Selvander, Madeleine; Asman, Peter

2013-08-01

To investigate construct validity for modules hydromaneuvers and phaco on the Eyesi surgical simulator. Seven cataract surgeons and 17 medical students performed capsulorhexis, hydromaneuvers, phaco, navigation, forceps, cracking and chopping modules in a standardized manner. Three trials were performed on each module (two on phaco) in the above order. Performance parameters as calculated by the simulator for each trial were saved. Video recordings of the second trial of the modules capsulorhexis, hydromaneuvers and phaco were evaluated with the modified Objective Structured Assessment of Surgical Skill (OSATS) and Objective Structured Assessment of Cataract Surgical Skill (OSACSS) tools. Cataract surgeons outperformed medical students with regard to overall score on capsulorhexis (p < 0.001, p = 0.035, p = 0.010 for the tree iterations, respectively), navigation (p = 0.024, p = 0.307, p = 0.007), forceps (p = 0.017, p = 0.03, p = 0.028). Less obvious differences in overall score were found for modules cracking and chopping (p = 0.266, p = 0.022, p = 0.324) and phaco (p = 0.011, p = 0.081 for the two iterations, respectively). No differences in overall score were found on hydromaneuvers (p = 0.588, p = 0.503, p = 0.773), but surgeons received better scores from the evaluations of the modified OSATS (p = 0.001) and OSACSS (capsulorhexis, p = 0.003; hydromaneuvers, p = 0.017; phaco, p = 0.001). Construct validity was found on several modules previously not investigated (phaco, hydromaneuvers, cracking and chopping, navigation), and our results confirm previously demonstrated construct validity for capsulorhexis and forceps modules. Interestingly, validation of the hydromaneuvers module required OSACSS video evaluation tool. A further development of the scoring system in the simulator for the hydromaneuvers module would be advantageous and make training and evaluation of progress more accessible and immediate. © 2012 The Authors. Acta Ophthalmologica © 2012 Acta

Test-retest reliability and construct validity of the ENERGY-child questionnaire on energy balance-related behaviours and their potential determinants: the ENERGY-project.

PubMed

Singh, Amika S; Vik, Froydis N; Chinapaw, Mai J M; Uijtdewilligen, Léonie; Verloigne, Maïté; Fernández-Alvira, Juan M; Stomfai, Sarolta; Manios, Yannis; Martens, Marloes; Brug, Johannes

2011-12-09

Insight in children's energy balance-related behaviours (EBRBs) and their determinants is important to inform obesity prevention research. Therefore, reliable and valid tools to measure these variables in large-scale population research are needed. To examine the test-retest reliability and construct validity of the child questionnaire used in the ENERGY-project, measuring EBRBs and their potential determinants among 10-12 year old children. We collected data among 10-12 year old children (n = 730 in the test-retest reliability study; n = 96 in the construct validity study) in six European countries, i.e. Belgium, Greece, Hungary, the Netherlands, Norway, and Spain. Test-retest reliability was assessed using the intra-class correlation coefficient (ICC) and percentage agreement comparing scores from two measurements, administered one week apart. To assess construct validity, the agreement between questionnaire responses and a subsequent face-to-face interview was assessed using ICC and percentage agreement. Of the 150 questionnaire items, 115 (77%) showed good to excellent test-retest reliability as indicated by ICCs > .60 or percentage agreement ≥ 75%. Test-retest reliability was moderate for 34 items (23%) and poor for one item. Construct validity appeared to be good to excellent for 70 (47%) of the 150 items, as indicated by ICCs > .60 or percentage agreement ≥ 75%. From the other 80 items, construct validity was moderate for 39 (26%) and poor for 41 items (27%). Our results demonstrate that the ENERGY-child questionnaire, assessing EBRBs of the child as well as personal, family, and school-environmental determinants related to these EBRBs, has good test-retest reliability and moderate to good construct validity for the large majority of items.

The consumer quality index anthroposophic healthcare: a construction and validation study.

PubMed

Koster, Evi B; Ong, Rob R S; Heybroek, Rachel; Delnoij, Diana M J; Baars, Erik W

2014-04-02

Accounting for the patients' perspective on quality of care has become increasingly important in the development of Evidence Based Medicine as well as in governmental policies. In the Netherlands the Consumer Quality (CQ) Index has been developed to measure the quality of care from the patients' perspective in different healthcare sectors in a standardized manner. Although the scientific accountability of anthroposophic healthcare as a form of integrative medicine is growing, patient experiences with anthroposophic healthcare have not been measured systematically. In addition, the specific anthroposophic aspects are not measured by means of existing CQ Indexes. To enable accountability of quality of the anthroposophic healthcare from the patients' perspective the aim of this study is the construction and validation of a CQ Index for anthroposophic healthcare. Construction in three phases: Phase 1. Determining anthroposophic quality aspects: literature study and focus groups. Phase 2. Adding new questions and validating the new questionnaire. Research population: random sample from 7910 patients of 22 anthroposophic GPs. survey, mixed mode by means of the Dillman method. Measuring instrument: experience questionnaire: CQ Index General Practice (56 items), added with 27 new anthroposophic items added and an item-importance questionnaire (anthroposophic items only). Factor analysis, scale construction, internal consistency (Chronbach's Alpha), inter-item-correlation, discriminative ability (Intra Class Correlation) and inter-factor-correlations. Phase 3. Modulation and selection of new questions based on results. Criteria of retaining items: general: a limited amount of items, statistical: part of a reliable scale and inter-item-correlation <0,7, and theoretical. Phase 1. 27 anthroposophic items. Phase 2. Two new anthroposophic scales: Scale AntroposophicTreatmentGP: seven items, Alpha=0,832, ICC=4,2 Inter-factor-correlation with existing GP-scales range from r=0

Examining construct validity of a new naturalistic observational assessment of hand skills for preschool- and school-age children.

PubMed

Chien, Chi-Wen; Brown, Ted; McDonald, Rachael

2012-04-01

The Assessment of Children's Hand Skills is a new assessment that utilises a naturalistic observational method to capture children's real-life hand skill performance when engaged at various types of daily activities in everyday living contexts. The Assessment of Children's Hand Skills is designed for use with 2- to 12-year-old children with a range of disabilities or health conditions. The study aimed to investigate construct validity of the Assessment of Children's Hand Skills in Australian children. Rasch analysis was used to examine internal construct validity of the Assessment of Children's Hand Skills in a mixed sample of 53 children with disabilities (including autism spectrum disorder, developmental/genetic disorders and physical disabilities) and 85 typically developing children. External construct validity was examined by correlating with three questionnaires evaluating daily living skills and hand skills. Rasch goodness-of-fit analysis suggested that all 22 activity items and 19 of 20 hand skill items in the Assessment of Children's Hand Skills measured a single construct. The Assessment of Children's Hand Skills items were placed in a clinically meaningful hierarchy from easy to hard, and the difficulty range of the items also matched the majority of children with disabilities and typically developing preschool-aged children. Moderate to high correlations (0.59 ≤ Spearman's ρ coefficients ≤ 0.89, P < 0.01) were found with the assessments of daily living and fine motor skills. This study provided preliminary evidence supporting the construct validity of the Assessment of Children's Hand Skills for its clinical application in assessing children's real-life hand skill performance in Australian contexts. © 2012 The Authors Australian Occupational Therapy Journal © 2012 Occupational Therapy Australia.

Face and construct validity of a computer-based virtual reality simulator for ERCP.

PubMed

Bittner, James G; Mellinger, John D; Imam, Toufic; Schade, Robert R; Macfadyen, Bruce V

2010-02-01

Currently, little evidence supports computer-based simulation for ERCP training. To determine face and construct validity of a computer-based simulator for ERCP and assess its perceived utility as a training tool. Novice and expert endoscopists completed 2 simulated ERCP cases by using the GI Mentor II. Virtual Education and Surgical Simulation Laboratory, Medical College of Georgia. Outcomes included times to complete the procedure, reach the papilla, and use fluoroscopy; attempts to cannulate the papilla, pancreatic duct, and common bile duct; and number of contrast injections and complications. Subjects assessed simulator graphics, procedural accuracy, difficulty, haptics, overall realism, and training potential. Only when performance data from cases A and B were combined did the GI Mentor II differentiate novices and experts based on times to complete the procedure, reach the papilla, and use fluoroscopy. Across skill levels, overall opinions were similar regarding graphics (moderately realistic), accuracy (similar to clinical ERCP), difficulty (similar to clinical ERCP), overall realism (moderately realistic), and haptics. Most participants (92%) claimed that the simulator has definite training potential or should be required for training. Small sample size, single institution. The GI Mentor II demonstrated construct validity for ERCP based on select metrics. Most subjects thought that the simulated graphics, procedural accuracy, and overall realism exhibit face validity. Subjects deemed it a useful training tool. Study repetition involving more participants and cases may help confirm results and establish the simulator's ability to differentiate skill levels based on ERCP-specific metrics.

The construct and criterion validity of the multi-source feedback process to assess physician performance: a meta-analysis

PubMed Central

Al Ansari, Ahmed; Donnon, Tyrone; Al Khalifa, Khalid; Darwish, Abdulla; Violato, Claudio

2014-01-01

Background The purpose of this study was to conduct a meta-analysis on the construct and criterion validity of multi-source feedback (MSF) to assess physicians and surgeons in practice. Methods In this study, we followed the guidelines for the reporting of observational studies included in a meta-analysis. In addition to PubMed and MEDLINE databases, the CINAHL, EMBASE, and PsycINFO databases were searched from January 1975 to November 2012. All articles listed in the references of the MSF studies were reviewed to ensure that all relevant publications were identified. All 35 articles were independently coded by two authors (AA, TD), and any discrepancies (eg, effect size calculations) were reviewed by the other authors (KA, AD, CV). Results Physician/surgeon performance measures from 35 studies were identified. A random-effects model of weighted mean effect size differences (d) resulted in: construct validity coefficients for the MSF system on physician/surgeon performance across different levels in practice ranged from d=0.14 (95% confidence interval [CI] 0.40–0.69) to d=1.78 (95% CI 1.20–2.30); construct validity coefficients for the MSF on physician/surgeon performance on two different occasions ranged from d=0.23 (95% CI 0.13–0.33) to d=0.90 (95% CI 0.74–1.10); concurrent validity coefficients for the MSF based on differences in assessor group ratings ranged from d=0.50 (95% CI 0.47–0.52) to d=0.57 (95% CI 0.55–0.60); and predictive validity coefficients for the MSF on physician/surgeon performance across different standardized measures ranged from d=1.28 (95% CI 1.16–1.41) to d=1.43 (95% CI 0.87–2.00). Conclusion The construct and criterion validity of the MSF system is supported by small to large effect size differences based on the MSF process and physician/surgeon performance across different clinical and nonclinical domain measures. PMID:24600300

Evidence for the construct validity of self-motivation as a correlate of exercise adherence in French older adults.

PubMed

André, Nathalie; Dishman, Rod K

2012-04-01

Exercise adherence involves a number of sociocognitive factors that influence the adoption and maintenance of regular physical activity. Among trait-like factors, self-motivation is believed to be a unique predictor of persistence during behavior change. The aim of this study was to validate the factor structure of a French version of the Self-Motivation Inventory (SMI) and to provide initial convergent and discriminant evidence for its construct validity as a correlate of exercise adherence. Four hundred seventy-one elderly were recruited and administered the SMI-10. Structural equation modeling tested the relation of SMI-10 scores with exercise adherence in a correlated network that included decisional balance and perceived quality of life. Acceptable evidence was found to support the factor validity and measurement equivalence of the French version of the SMI-10. Moreover, self-motivation was related to exercise adherence independently of decisional balance and perceived quality of life, providing initial evidence for construct validity.

Is Going Beyond Rasch Analysis Necessary to Assess the Construct Validity of a Motor Function Scale?

PubMed

Guillot, Tiffanie; Roche, Sylvain; Rippert, Pascal; Hamroun, Dalil; Iwaz, Jean; Ecochard, René; Vuillerot, Carole

2018-04-03

To examine whether a Rasch analysis is sufficient to establish the construct validity of the Motor Function Measure (MFM) and discuss whether weighting the MFM item scores would improve the MFM construct validity. Observational cross-sectional multicenter study. Twenty-three physical medicine departments, neurology departments, or reference centers for neuromuscular diseases. Patients (N=911) aged 6 to 60 years with Charcot-Marie-Tooth disease (CMT), facioscapulohumeral dystrophy (FSHD), or myotonic dystrophy type 1 (DM1). None. Comparison of the goodness-of-fit of the confirmatory factor analysis (CFA) model vs that of a modified multidimensional Rasch model on MFM item scores in each considered disease. The CFA model showed good fit to the data and significantly better goodness of fit than the modified multidimensional Rasch model regardless of the disease (P<.001). Statistically significant differences in item standardized factor loadings were found between DM1, CMT, and FSHD in only 6 of 32 items (items 6, 27, 2, 7, 9 and 17). For multidimensional scales designed to measure patient abilities in various diseases, a Rasch analysis might not be the most convenient, whereas a CFA is able to establish the scale construct validity and provide weights to adapt the item scores to a specific disease. Copyright © 2018 American Congress of Rehabilitation Medicine. Published by Elsevier Inc. All rights reserved.

Construct Reliability and Validity of the Shortened Version of the Information-Seeking Behavior Scale

ERIC Educational Resources Information Center

Lerdpornkulrat, Thanita; Poondej, Chanut; Koul, Ravinder

2017-01-01

This study aimed to translate the information-seeking behavior scale from English to Thai, and to ascertain the construct reliability and validity of the scale. Data were collected from 664 undergraduate students in Thailand. The descriptive statistics were explored to see the extent to which various information sources are being used by…

Construction and validation of the national survey on recreation and the environment's lifestyles scale

Treesearch

Gary T. Green; H. Ken Cordell; Carter J. Betz; Christine DiStefano

2007-01-01

This study sought to construct and validate a lifestyle scale that would capture for leisure professionals a more holistic picture of people's interests. A broader profile of their customers would allow recreation professionals to tailor information of their services. Public sector recreation managers would provide better serviced by learning about how customers...

Measuring the construct of executive control in schizophrenia: defining and validating translational animal paradigms for discovery research.

PubMed

Gilmour, Gary; Arguello, Alexander; Bari, Andrea; Brown, Verity J; Carter, Cameron; Floresco, Stan B; Jentsch, David J; Tait, David S; Young, Jared W; Robbins, Trevor W

2013-11-01

Executive control is an aspect of cognitive function known to be impaired in schizophrenia. Previous meetings of the Cognitive Neuroscience Treatment Research to Improve Cognition in Schizophrenia (CNTRICS) group have more precisely defined executive control in terms of two constructs: "rule generation and selection", and "dynamic adjustments of control". Next, human cognitive tasks that may effectively measure performance with regard to these constructs were identified to be developed into practical and reliable measures for use in treatment development. The aim of this round of CNTRICS meetings was to define animal paradigms that have sufficient promise to warrant further investigation for their utility in measuring these constructs. Accordingly, "reversal learning" and the "attentional set-shifting task" were nominated to assess the construct of rule generation and selection, and the "stop signal task" for the construct of dynamic adjustments of control. These tasks are described in more detail here, with a particular focus on their utility for drug discovery efforts. Presently, each assay has strengths and weaknesses with regard to this point and increased emphasis on improving practical aspects of testing, understanding predictive validity, and defining biomarkers of performance represent important objectives in attaining confidence in translational validity here. Crown Copyright © 2012. Published by Elsevier Ltd. All rights reserved.

Test-retest reliability and construct validity of the ENERGY-child questionnaire on energy balance-related behaviours and their potential determinants: the ENERGY-project

PubMed Central

2011-01-01

Background Insight in children's energy balance-related behaviours (EBRBs) and their determinants is important to inform obesity prevention research. Therefore, reliable and valid tools to measure these variables in large-scale population research are needed. Objective To examine the test-retest reliability and construct validity of the child questionnaire used in the ENERGY-project, measuring EBRBs and their potential determinants among 10-12 year old children. Methods We collected data among 10-12 year old children (n = 730 in the test-retest reliability study; n = 96 in the construct validity study) in six European countries, i.e. Belgium, Greece, Hungary, the Netherlands, Norway, and Spain. Test-retest reliability was assessed using the intra-class correlation coefficient (ICC) and percentage agreement comparing scores from two measurements, administered one week apart. To assess construct validity, the agreement between questionnaire responses and a subsequent face-to-face interview was assessed using ICC and percentage agreement. Results Of the 150 questionnaire items, 115 (77%) showed good to excellent test-retest reliability as indicated by ICCs > .60 or percentage agreement ≥ 75%. Test-retest reliability was moderate for 34 items (23%) and poor for one item. Construct validity appeared to be good to excellent for 70 (47%) of the 150 items, as indicated by ICCs > .60 or percentage agreement ≥ 75%. From the other 80 items, construct validity was moderate for 39 (26%) and poor for 41 items (27%). Conclusions Our results demonstrate that the ENERGY-child questionnaire, assessing EBRBs of the child as well as personal, family, and school-environmental determinants related to these EBRBs, has good test-retest reliability and moderate to good construct validity for the large majority of items. PMID:22152048

Construct Validation of Three Nutrition Questions Using Health and Diet Ratings in Older Canadian Males Living in the Community.

PubMed

Akhtar, Usman; Keller, Heather H; Tate, Robert B; Lengyel, Christina O

2015-12-01

Brief nutrition screening tools are desired for research and practice. Seniors in the Community: Risk Evaluation for Eating and Nutrition (SCREEN-II, 14 items) and the abbreviated version SCREEN-II-AB (8 items) are valid and reliable nutrition screening tools for older adults. This exploratory study used a retrospective cross-sectional design to determine the construct validity of a subset of 3 items (weight loss, appetite, and swallowing difficulty) currently on the SCREEN-II and SCREEN-II-AB tools. Secondary data on community-dwelling senior males (n = 522, mean ± SD age = 86.7 ± 3.0 years) in the Manitoba Follow-up Study (MFUS) study were available for analysis. Participants completed the mailed MFUS Nutrition Survey that included SCREEN-II items and questions pertaining to self-rated health, diet healthiness, and rating of the importance of nutrition towards successful aging as the constructs for comparison. Self-perceived health status (F = 14.7, P < 0.001), diet healthiness (ρ = 0.17, P = 0.002) and the rating of nutrition's importance to aging (ρ = 0.10, P = 0.03) were correlated with the 3-item score. Inferences were consistent with associations between these construct variables and the full SCREEN-II. Three items from SCREEN-II and SCREEN-II-AB demonstrate initial construct validity with self-perceived health status and diet healthiness ratings by older males; further exploration for criterion and predictive validity in more diverse samples is needed.

Assessing the construct validity and reliability of the Parental Perception on Antibiotics (PAPA) scales.

PubMed

Alumran, Arwa; Hou, Xiang-Yu; Sun, Jiandong; Yousef, Abdullah A; Hurst, Cameron

2014-01-23

The overuse of antibiotics is becoming an increasing concern. Antibiotic resistance, which increases both the burden of disease, and the cost of health services, is perhaps the most profound impact of antibiotics overuse. Attempts have been made to develop instruments to measure the psychosocial constructs underlying antibiotics use, however, none of these instruments have undergone thorough psychometric validation. This study evaluates the psychometric properties of the Parental Perceptions on Antibiotics (PAPA) scales. The PAPA scales attempt to measure the factors influencing parental use of antibiotics in children. 1111 parents of children younger than 12 years old were recruited from primary schools' parental meetings in the Eastern Province of Saudi Arabia from September 2012 to January 2013. The structure of the PAPA instrument was validated using Confirmatory Factor Analysis (CFA) with measurement model fit evaluated using the raw and scaled χ2, Goodness of Fit Index, and Root Mean Square Error of Approximation. A five-factor model was confirmed with the model showing good fit. Constructs in the model include: Knowledge and Beliefs, Behaviors, Sources of information, Adherence, and Awareness about antibiotics resistance. The instrument was shown to have good internal consistency, and good discriminant and convergent validity. The availability of an instrument able to measure the psychosocial factors underlying antibiotics usage allows the risk factors underlying antibiotic use and overuse to now be investigated.

Evaluation of the internal construct validity of the Personal Care Participation Assessment and Resource Tool (PC-PART) using Rasch analysis.

PubMed

Darzins, Susan; Imms, Christine; Di Stefano, Marilyn; Taylor, Nicholas F; Pallant, Julie F

2014-11-05

The Personal Care Participation Assessment and Resource Tool (PC-PART) is a 43-item, clinician-administered assessment, designed to identify patients' unmet needs (participation restrictions) in activities of daily living (ADL) required for community life. This information is important for identifying problems that need addressing to enable, for example, discharge from inpatient settings to community living. The objective of this study was to evaluate internal construct validity of the PC-PART using Rasch methods. Fit to the Rasch model was evaluated for 41 PC-PART items, assessing threshold ordering, overall model fit, individual item fit, person fit, internal consistency, Differential Item Functioning (DIF), targeting of items and dimensionality. Data used in this research were taken from admission data from a randomised controlled trial conducted at two publically funded inpatient rehabilitation units in Melbourne, Australia, with 996 participants (63% women; mean age 74 years) and with various impairment types. PC-PART items assessed as one scale, and original PC-PART domains evaluated as separate scales, demonstrated poor fit to the Rasch model. Adequate fit to the Rasch model was achieved in two newly formed PC-PART scales: Self-Care (16 items) and Domestic Life (14 items). Both scales were unidimensional, had acceptable internal consistency (PSI =0.85, 0.76, respectively) and well-targeted items. Rasch analysis did not support conventional summation of all PC-PART item scores to create a total score. However, internal construct validity of the newly formed PC-PART scales, Self-Care and Domestic Life, was supported. Their Rasch-derived scores provided interval-level measurement enabling summation of scores to form a total score on each scale. These scales may assist clinicians, managers and researchers in rehabilitation settings to assess and measure changes in ADL participation restrictions relevant to community living. Data used in this research were

Construct validity and expert benchmarking of the haptic virtual reality dental simulator.

PubMed

Suebnukarn, Siriwan; Chaisombat, Monthalee; Kongpunwijit, Thanapohn; Rhienmora, Phattanapon

2014-10-01

The aim of this study was to demonstrate construct validation of the haptic virtual reality (VR) dental simulator and to define expert benchmarking criteria for skills assessment. Thirty-four self-selected participants (fourteen novices, fourteen intermediates, and six experts in endodontics) at one dental school performed ten repetitions of three mode tasks of endodontic cavity preparation: easy (mandibular premolar with one canal), medium (maxillary premolar with two canals), and hard (mandibular molar with three canals). The virtual instrument's path length was registered by the simulator. The outcomes were assessed by an expert. The error scores in easy and medium modes accurately distinguished the experts from novices and intermediates at the onset of training, when there was a significant difference between groups (ANOVA, p<0.05). The trend was consistent until trial 5. From trial 6 on, the three groups achieved similar scores. No significant difference was found between groups at the end of training. Error score analysis was not able to distinguish any group at the hard level of training. Instrument path length showed a difference in performance according to groups at the onset of training (ANOVA, p<0.05). This study established construct validity for the haptic VR dental simulator by demonstrating its discriminant capabilities between that of experts and non-experts. The experts' error scores and path length were used to define benchmarking criteria for optimal performance.

Construct validity of the LapVR virtual-reality surgical simulator.

PubMed

Iwata, Naoki; Fujiwara, Michitaka; Kodera, Yasuhiro; Tanaka, Chie; Ohashi, Norifumi; Nakayama, Goro; Koike, Masahiko; Nakao, Akimasa

2011-02-01

Laparoscopic surgery requires fundamental skills peculiar to endoscopic procedures such as eye-hand coordination. Acquisition of such skills prior to performing actual surgery is highly desirable for favorable outcome. Virtual-reality simulators have been developed for both surgical training and assessment of performance. The aim of the current study is to show construct validity of a novel simulator, LapVR (Immersion Medical, San Jose, CA, USA), for Japanese surgeons and surgical residents. Forty-four subjects were divided into the following three groups according to their experience in laparoscopic surgery: 14 residents (RE) with no experience in laparoscopic surgery, 14 junior surgeons (JR) with little experience, and 16 experienced surgeons (EX). All subjects executed "essential task 1" programmed in the LapVR, which consists of six tasks, resulting in automatic measurement of 100 parameters indicating various aspects of laparoscopic skills. Time required for each task tended to be inversely correlated with experience in laparoscopic surgery. For the peg transfer skill, statistically significant differences were observed between EX and RE in three parameters, including total time and average time taken to complete the procedure and path length for the nondominant hand. For the cutting skill, similar differences were observed between EX and RE in total time, number of unsuccessful cutting attempts, and path length for the nondominant hand. According to the programmed comprehensive evaluation, performance in terms of successful completion of the task and actual experience of the participants in laparoscopic surgery correlated significantly for the peg transfer (P=0.007) and cutting skills (P=0.026). The peg transfer and cutting skills could best distinguish between EX and RE. This study is the first to provide evidence that LapVR has construct validity to discriminate between novice and experienced laparoscopic surgeons.

Validation and Diagnostic Efficiency of the Mini-SPIN in Spanish-Speaking Adolescents

PubMed Central

Garcia-Lopez, LuisJoaquín; Moore, Harry T. A.

2015-01-01

Objectives Social Anxiety Disorder (SAD) is one of the most common mental disorders in adolescence. Many validated psychometric tools are available to diagnose individuals with SAD efficaciously. However, there is a demand for shortened self-report instruments that identify adolescents at risk of developing SAD. We validate the Mini-SPIN and its diagnostic efficiency in overcoming this problem in Spanish-speaking adolescents in Spain. Methods The psychometric properties of the 3-item Mini-SPIN scale for adolescents were assessed in a community (study 1) and clinical sample (study 2). Results Study 1 consisted of 573 adolescents, and found the Mini-SPIN to have appropriate internal consistency and high construct validity. Study 2 consisted of 354 adolescents (147 participants diagnosed with SAD and 207 healthy controls). Data revealed that the Mini-SPIN has good internal consistency, high construct validity and adequate diagnostic efficiency. Conclusions Our findings suggest that the Mini-SPIN has good psychometric properties on clinical and healthy control adolescents and general population, which indicates that it can be used as a screening tool in Spanish-speaking adolescents. Cut-off scores are provided. PMID:26317695

Cross-Cultural Adaptation and Validation of the Attitudes Toward Suicide Questionnaire Among Healthcare personnel in Malaysia.

PubMed

Siau, Ching Sin; Wee, Lei-Hum; Ibrahim, Norhayati; Visvalingam, Uma; Wahab, Suzaily

2017-01-01

Understanding attitudes toward suicide, especially among healthcare personnel, is an important step in both suicide prevention and treatment. We document the adaptation process and establish the validity and reliability of the Attitudes Toward Suicide (ATTS) questionnaire among 262 healthcare personnel in 2 major public hospitals in the Klang Valley, Malaysia. The findings indicate that healthcare personnel in Malaysia have unique constructs on suicide attitude, compared with the original study on a Western European sample. The adapted Malay ATTS questionnaire demonstrates adequate reliability and validity for use among healthcare personnel in Malaysia.

Cross-Cultural Adaptation and Validation of the Attitudes Toward Suicide Questionnaire Among Healthcare personnel in Malaysia

PubMed Central

Siau, Ching Sin; Wee, Lei-Hum; Ibrahim, Norhayati; Visvalingam, Uma; Wahab, Suzaily

2017-01-01

Understanding attitudes toward suicide, especially among healthcare personnel, is an important step in both suicide prevention and treatment. We document the adaptation process and establish the validity and reliability of the Attitudes Toward Suicide (ATTS) questionnaire among 262 healthcare personnel in 2 major public hospitals in the Klang Valley, Malaysia. The findings indicate that healthcare personnel in Malaysia have unique constructs on suicide attitude, compared with the original study on a Western European sample. The adapted Malay ATTS questionnaire demonstrates adequate reliability and validity for use among healthcare personnel in Malaysia. PMID:28486042

A pilot study to validate measures of the theory of reasoned action for organ donation behavior.

PubMed

Wong, Shui Hung; Chow, Amy Yin Man

2018-04-01

The present study aimed at taking the first attempt in validating the measures generated based on the theory of reasoned action (TRA). A total of 211 university students participated in the study, 95 were included in the exploratory factor analysis and 116 were included in the confirmatory factor analysis. The TRA measurements were established with adequate psychometric properties, internal consistency, and construct validity. Findings also suggested that attitude toward organ donation has both a cognitive and affective nature, while the subjective norm of the family seems to be important to students' views on organ donation.

Construction and validation of logMAR visual acuity charts in seven Indian languages.

PubMed

Negiloni, Kalpa; Mazumdar, Deepmala; Neog, Aditya; Das, Biman; Medhi, Jnanankar; Choudhury, Mitalee; George, Ronnie Jacob; Ramani, Krishna Kumar

2018-05-01

The evaluation of visual impairment requires the measurement of visual acuity with a validated and standard logMAR visual acuity chart. We aimed to construct and validate new logMAR visual acuity chart in Indian languages (Hindi, Bengali, Telugu, Urdu, Kannada, Malayalam, and Assamese). The commonly used font in each language was chosen as the reference and designed to fit the 5 × 5 grid (Adobe Photoshop). Ten letters (easiest to difficult) around median legibility score calculated for each language based on the results of legibility experiment and differing by 10% were selected. The chart was constructed based on the standard recommendations. The repeatability of charts was tested and also compared with a standard English Early Treatment Diabetic Retinopathy Study (ETDRS) logMAR chart for validation. A total of 14 rows (1.0 to -0.3 logMAR) with five letters in each line were designed with the range of row legibility between 4.7 and 5.3 for all the language charts. Each chart showed good repeatability, and a maximum difference of four letters was noted. The median difference in visual acuity was 0.16 logMAR for Urdu and Assamese chart compared to ETDRS English chart. Hindi and Malayalam chart had a median difference of 0.12 logMAR. When compared to the English chart a median difference of 0.14 logMAR was noted in Telugu, Kannada, and Bengali chart. The newly developed Indian language visual acuity charts are designed based on the standard recommendations and will help to assess visual impairment in people of these languages across the country.

The Construct Validity of the Category Test: Is It a Measure of Reasoning or Intelligence?

ERIC Educational Resources Information Center

Johnstone, Brick; And Others

1997-01-01

The construct validity of the Category Test (W. C. Halstead, 1947) was studied for 308 adults with heterogeneous cognitive dysfunction. Factor analysis indicated that Category subtests load on three factors distinct from intelligence: (1) symbol recognition/counting; (2) spatial position reasoning; (3) and proportional reasoning. Clinical…

The Alcohol Sensitivity Questionnaire: Evidence for Construct Validity

PubMed Central

Fleming, Kimberly A.; Bartholow, Bruce D.; Hilgard, Joseph B.; McCarthy, Denis M.; O’Neill, Susan E.; Steinley, Douglas; Sher, Kenneth J.

2016-01-01

Background Variability in sensitivity to the acute effects of alcohol is an important risk factor for the development of alcohol use disorder (AUD). The most commonly used retrospective self-report measure of sensitivity, the Self-Rating of the Effects of Alcohol form (SRE), queries a limited number of alcohol effects and relies on respondents’ ability to recall experiences that might have occurred in the distant past. Here, we investigated the construct validity of an alternative measure that queries a larger number of alcohol effects, the Alcohol Sensitivity Questionnaire (ASQ), and compared it to the SRE in predicting momentary subjective responses to an acute dose of alcohol. Method Healthy young adults (N = 423) completed the SRE and the ASQ and then were randomly assigned to consume either alcohol or a placebo beverage (between-subjects manipulation). Stimulation and sedation (Biphasic Alcohol Effects Scale) and subjective intoxication were measured multiple times after drinking. Results Hierarchical linear models showed that the ASQ reliably predicted each of these outcomes following alcohol but not placebo consumption, provided unique prediction beyond that associated with differences in recent alcohol involvement, and was preferred over the SRE (in terms of model fit) in direct model comparisons of stimulation and sedation. Conclusions The ASQ compared favorably with the better-known SRE in predicting increased stimulation and reduced sedation following an acute alcohol challenge. The ASQ appears to be a valid self-report measure of alcohol sensitivity and therefore holds promise for identifying individuals at-risk for AUD and related problems. PMID:27012527

Validation of psychosocial scales for physical activity in university students

PubMed Central

Tassitano, Rafael Miranda; de Farias, José Cazuza; Rech, Cassiano Ricardo; Tenório, Maria Cecília Marinho; Cabral, Poliana Coelho; da Silva, Giselia Alves Pontes

2015-01-01

OBJECTIVE Translate the Patient-centered Assessment and Counseling for Exercise questionnaire, adapt it cross-culturally and identify the psychometric properties of the psychosocial scales for physical activity in young university students. METHODS The Patient-centered Assessment and Counseling for Exercise questionnaire is made up of 39 items divided into constructs based on the social cognitive theory and the transtheoretical model. The analyzed constructs were, as follows: behavior change strategy (15 items), decision-making process (10), self-efficacy (6), support from family (4), and support from friends (4). The validation procedures were conceptual, semantic, operational, and functional equivalences, in addition to the equivalence of the items and of measurements. The conceptual, of items and semantic equivalences were performed by a specialized committee. During measurement equivalence, the instrument was applied to 717 university students. Exploratory factor analysis was used to verify the loading of each item, explained variance and internal consistency of the constructs. Reproducibility was measured by means of intraclass correlation coefficient. RESULTS The two translations were equivalent and back-translation was similar to the original version, with few adaptations. The layout, presentation order of the constructs and items from the original version were kept in the same form as the original instrument. The sample size was adequate and was evaluated by the Kaiser-Meyer-Olkin test, with values between 0.72 and 0.91. The correlation matrix of the items presented r < 0.8 (p < 0.05). The factor loadings of the items from all the constructs were satisfactory (> 0.40), varying between 0.43 and 0.80, which explained between 45.4% and 59.0% of the variance. Internal consistency was satisfactory (α ≥ 0.70), with support from friends being 0.70 and 0.92 for self-efficacy. Most items (74.3%) presented values above 0.70 for the reproducibility test

Validation of psychosocial scales for physical activity in university students.

PubMed

Tassitano, Rafael Miranda; de Farias Júnior, José Cazuza; Rech, Cassiano Ricardo; Tenório, Maria Cecília Marinho; Cabral, Poliana Coelho; da Silva, Giselia Alves Pontes

2015-01-01

OBJECTIVE Translate the Patient-centered Assessment and Counseling for Exercise questionnaire, adapt it cross-culturally and identify the psychometric properties of the psychosocial scales for physical activity in young university students. METHODS The Patient-centered Assessment and Counseling for Exercise questionnaire is made up of 39 items divided into constructs based on the social cognitive theory and the transtheoretical model. The analyzed constructs were, as follows: behavior change strategy (15 items), decision-making process (10), self-efficacy (6), support from family (4), and support from friends (4). The validation procedures were conceptual, semantic, operational, and functional equivalences, in addition to the equivalence of the items and of measurements. The conceptual, of items and semantic equivalences were performed by a specialized committee. During measurement equivalence, the instrument was applied to 717 university students. Exploratory factor analysis was used to verify the loading of each item, explained variance and internal consistency of the constructs. Reproducibility was measured by means of intraclass correlation coefficient. RESULTS The two translations were equivalent and back-translation was similar to the original version, with few adaptations. The layout, presentation order of the constructs and items from the original version were kept in the same form as the original instrument. The sample size was adequate and was evaluated by the Kaiser-Meyer-Olkin test, with values between 0.72 and 0.91. The correlation matrix of the items presented r < 0.8 (p < 0.05). The factor loadings of the items from all the constructs were satisfactory (> 0.40), varying between 0.43 and 0.80, which explained between 45.4% and 59.0% of the variance. Internal consistency was satisfactory (α ≥ 0.70), with support from friends being 0.70 and 0.92 for self-efficacy. Most items (74.3%) presented values above 0.70 for the reproducibility test

Assessment of Robotic Console Skills (ARCS): construct validity of a novel global rating scale for technical skills in robotically assisted surgery.

PubMed

Liu, May; Purohit, Shreya; Mazanetz, Joshua; Allen, Whitney; Kreaden, Usha S; Curet, Myriam

2018-01-01

Skill assessment during robotically assisted surgery remains challenging. While the popularity of the Global Evaluative Assessment of Robotics Skills (GEARS) has grown, its lack of discrimination between independent console skills limits its usefulness. The purpose of this study was to evaluate construct validity and interrater reliability of a novel assessment designed to overcome this limitation. We created the Assessment of Robotic Console Skills (ARCS), a global rating scale with six console skill domains. Fifteen volunteers who were console surgeons for 0 ("novice"), 1-100 ("intermediate"), or >100 ("experienced") robotically assisted procedures performed three standardized tasks. Three blinded raters scored the task videos using ARCS, with a 5-point Likert scale for each skill domain. Scores were analyzed for evidence of construct validity and interrater reliability. Group demographics were indistinguishable except for the number of robotically assisted procedures performed (p = 0.001). The mean scores of experienced subjects exceeded those of novices in dexterity (3.8 > 1.4, p < 0.001), field of view (4.1 > 1.8, p < 0.001), instrument visualization (3.9 > 2.2, p < 0.001), manipulator workspace (3.6 > 1.9, p = 0.001), and force sensitivity (4.3 > 2.6, p < 0.001). The mean scores of intermediate subjects exceeded those of novices in dexterity (2.8 > 1.4, p = 0.002), field of view (2.8 > 1.8, p = 0.021), instrument visualization (3.2 > 2.2, p = 0.045), manipulator workspace (3.1 > 1.9, p = 0.004), and force sensitivity (3.7 > 2.6, p = 0.033). The mean scores of experienced subjects exceeded those of intermediates in dexterity (3.8 > 2.8, p = 0.003), field of view (4.1 > 2.8, p < 0.001), and instrument visualization (3.9 > 3.2, p = 0.044). Rater agreement in each domain demonstrated statistically significant concordance (p < 0.05). We present strong evidence for construct validity and interrater reliability

A new method to model electroconvulsive therapy in rats with increased construct validity and enhanced translational value.

PubMed

Theilmann, Wiebke; Löscher, Wolfgang; Socala, Katarzyna; Frieling, Helge; Bleich, Stefan; Brandt, Claudia

2014-06-01

Electroconvulsive therapy is the most effective therapy for major depressive disorder (MDD). The remission rate is above 50% in previously pharmacoresistant patients but the mechanisms of action are not fully understood. Electroconvulsive stimulation (ECS) in rodents mimics antidepressant electroconvulsive therapy (ECT) in humans and is widely used to investigate the underlying mechanisms of ECT. For the translational value of findings in animal models it is essential to establish models with the highest construct, face and predictive validity possible. The commonly used model for ECT in rodents does not meet the demand for high construct validity. For ECT, cortical surface electrodes are used to induce therapeutic seizures whereas ECS in rodents is exclusively performed by auricular or corneal electrodes. However, the stimulation site has a major impact on the type and spread of the induced seizure activity and its antidepressant effect. We propose a method in which ECS is performed by screw electrodes placed above the motor cortex of rats to closely simulate the clinical situation and thereby increase the construct validity of the model. Cortical ECS in rats induced reliably seizures comparable to human ECT. Cortical ECS was more effective than auricular ECS to reduce immobility in the forced swim test. Importantly, auricular stimulation had a negative influence on the general health condition of the rats with signs of fear during the stimulation sessions. These results suggest that auricular ECS in rats is not a suitable ECT model. Cortical ECS in rats promises to be a valid method to mimic ECT. Copyright © 2014 Elsevier Ltd. All rights reserved.

Portuguese Version of the Pain Beliefs and Perceptions Inventory: A Multicenter Validation Study.

PubMed

Azevedo, Luís Filipe; Sampaio, Rute; Camila Dias, Cláudia; Romão, José; Lemos, Laurinda; Agualusa, Luís; Vaz-Serra, Sílvia; Patto, Teresa; Costa-Pereira, Altamiro; Castro-Lopes, José Manuel

2017-07-01

We aimed to perform the translation, cultural adaptation, and validation of the Pain Beliefs and Perceptions Inventory (PBPI) for the European Portuguese language and chronic pain population. This is a longitudinal multicenter validation study. A Portuguese version of the PBPI (PBPI-P) was created through a process of translation, back translation, and expert panel evaluation. The PBPI-P was administered to a total of 122 patients from 13 chronic pain clinics in Portugal, at baseline and after 7 days. Internal consistency and test-retest reliability were assessed by Cronbach's alpha (α) and intraclass correlation coefficient (ICC). Construct (convergent and discriminant) validity was assessed based on a set of previously developed theoretical hypotheses about interrelations between the PBPI-P and other measures. Exploratory and confirmatory factor analyses were performed to test the theoretical structure of the PBPI-P. The internal consistency and test-retest reliability coefficients for each respective subscale were α = 0.620 and ICC = 0.801 for mystery; α = 0.744 and ICC = 0.841 for permanence; α = 0.778 and ICC = 0.791 for constancy; and α = 0.764 and ICC = 0.881 for self-blame. Exploratory and confirmatory factor analysis revealed a four-factor structure (performance, constancy, self-blame, and mystery) that explained 63% of the variance. The construct validity of the PBPI-P was shown to be adequate, with more than 90% of the previously defined hypotheses regarding interrelations with other measures confirmed. The PBPI-P has been shown to be adequate and to have excellent reliability, internal consistency, and validity. It may contribute to a better pain assessment and is suitable for research and clinical use. © 2016 World Institute of Pain.

Validation of the Impulsive/Premeditated Aggression Scale in Mexican psychiatric patients.

PubMed

Romans, Laura; Fresán, Ana; Sentíes, Héctor; Sarmiento, Emmanuel; Berlanga, Carlos; Robles-García, Rebeca; Tovilla-Zarate, Carlos-Alfonso

2015-07-01

Aggression has been linked to several psychiatric disorders. None of the available instruments validated in Mexico is able to classify aggression as impulsive or premeditated. The Impulsive/Premeditated Aggression Scale (IPAS) is a self-report instrument designed to characterize aggressiveness as predominately impulsive or premeditated. The aim of the study was to determine the validity and reliability of the IPAS in a sample of Mexican psychiatric patients. A total of 163 patients diagnosed with affective, anxiety or psychotic disorder were included. A principal-component factor analysis was performed to obtain construct validity of the IPAS impulsive and premeditated aggression subscales; convergent validity as well as internal consistency of subscales were also determined. The rotated matrix accounted for 33.4% of the variance. Significant values were obtained for convergent validity and reliability of the IPAS subscales. The IPAS is an adequate instrument, which might be used to differentiate the type of aggressive behavior in Mexican psychiatric patients.

The factor structure and construct validity of the inventory of callous-unemotional traits in Chinese undergraduate students.

PubMed

Wang, Meng-Cheng; Gao, Yu; Deng, Jiaxin; Lai, Hongyu; Deng, Qiaowen; Armour, Cherie

2017-01-01

The current study assesses the factor structure and construct validity of the self-reported Inventory of Callous-Unemotional Traits (ICU) in 637 Chinese community adults (mean age = 25.98, SD = 5.79). A series of theoretical models proposed in previous studies were tested through confirmatory factor analyses. Results indicated that a shortened form that consists of 11 items (ICU-11) to assess callousness and uncaring factors has excellent overall fit. Additionally, correlations with a wide range of external variables demonstrated that this shortened form has similar construct validity compared to the original ICU. In conclusion, our findings suggest that the ICU-11 may be a promising self-report tool that could be a good substitute for the original form to assess callous-uncaring traits in adults.

Construct Validity of the MMPI-2-RF Triarchic Psychopathy Scales in Correctional and Collegiate Samples.

PubMed

Kutchen, Taylor J; Wygant, Dustin B; Tylicki, Jessica L; Dieter, Amy M; Veltri, Carlo O C; Sellbom, Martin

2017-01-01

This study examined the MMPI-2-RF (Ben-Porath & Tellegen, 2008/2011) Triarchic Psychopathy scales recently developed by Sellbom et al. ( 2016 ) in 3 separate groups of male correctional inmates and 2 college samples. Participants were administered a diverse battery of psychopathy specific measures (e.g., Psychopathy Checklist-Revised [Hare, 2003 ], Psychopathic Personality Inventory-Revised [Lilienfeld & Widows, 2005 ], Triarchic Psychopathy Measure [Patrick, 2010 ]), omnibus personality and psychopathology measures such as the Personality Assessment Inventory (Morey, 2007 ) and Personality Inventory for DSM-5 (Krueger, Derringer, Markon, Watson, & Skodol, 2012 ), and narrow-band measures that capture conceptually relevant constructs. Our results generally evidenced strong support for the convergent and discriminant validity for the MMPI-2-RF Triarchic scales. Boldness was largely associated with measures of fearless dominance, social potency, and stress immunity. Meanness showed strong relationships with measures of callousness, aggression, externalizing tendencies, and poor interpersonal functioning. Disinhibition exhibited strong associations with poor impulse control, stimulus seeking, and general externalizing proclivities. Our results provide additional construct validation to both the triarchic model and MMPI-2-RF Triarchic scales. Given the widespread use of the MMPI-2-RF in correctional and forensic settings, our results have important implications for clinical assessment in these 2 areas, where psychopathy is a highly relevant construct.

The PEDro scale had acceptably high convergent validity, construct validity, and interrater reliability in evaluating methodological quality of pharmaceutical trials.

PubMed

Yamato, Tie Parma; Maher, Chris; Koes, Bart; Moseley, Anne

2017-06-01

The Physiotherapy Evidence Database (PEDro) scale has been widely used to investigate methodological quality in physiotherapy randomized controlled trials; however, its validity has not been tested for pharmaceutical trials. The aim of this study was to investigate the validity and interrater reliability of the PEDro scale for pharmaceutical trials. The reliability was also examined for the Cochrane Back and Neck (CBN) Group risk of bias tool. This is a secondary analysis of data from a previous study. We considered randomized placebo controlled trials evaluating any pain medication for chronic spinal pain or osteoarthritis. Convergent validity was evaluated by correlating the PEDro score with the summary score of the CBN risk of bias tool. The construct validity was tested using a linear regression analysis to determine the degree to which the total PEDro score is associated with treatment effect sizes, journal impact factor, and the summary score for the CBN risk of bias tool. The interrater reliability was estimated using the Prevalence and Bias Adjusted Kappa coefficient and 95% confidence interval (CI) for the PEDro scale and CBN risk of bias tool. Fifty-three trials were included, with 91 treatment effect sizes included in the analyses. The correlation between PEDro scale and CBN risk of bias tool was 0.83 (95% CI 0.76-0.88) after adjusting for reliability, indicating strong convergence. The PEDro score was inversely associated with effect sizes, significantly associated with the summary score for the CBN risk of bias tool, and not associated with the journal impact factor. The interrater reliability for each item of the PEDro scale and CBN risk of bias tool was at least substantial for most items (>0.60). The intraclass correlation coefficient for the PEDro score was 0.80 (95% CI 0.68-0.88), and for the CBN, risk of bias tool was 0.81 (95% CI 0.69-0.88). There was evidence for the convergent and construct validity for the PEDro scale when used to evaluate

Hopes and Cautions for Instrument-Based Evaluation of Consent Capacity: Results of a Construct Validity Study of Three Instruments

PubMed Central

Moye, Jennifer; Azar, Annin R.; Karel, Michele J.; Gurrera, Ronald J.

2016-01-01

Does instrument based evaluation of consent capacity increase the precision and validity of competency assessment or does ostensible precision provide a false sense of confidence without in fact improving validity? In this paper we critically examine the evidence for construct validity of three instruments for measuring four functional abilities important in consent capacity: understanding, appreciation, reasoning, and expressing a choice. Instrument based assessment of these abilities is compared through investigation of a multi-trait multi-method matrix in 88 older adults with mild to moderate dementia. Results find variable support for validity. There appears to be strong evidence for good hetero-method validity for the measurement of understanding, mixed evidence for validity in the measurement of reasoning, and strong evidence for poor hetero-method validity for the concepts of appreciation and expressing a choice, although the latter is likely due to extreme range restrictions. The development of empirically based tools for use in capacity evaluation should ultimately enhance the reliability and validity of assessment, yet clearly more research is needed to define and measure the constructs of decisional capacity. We would also emphasize that instrument based assessment of capacity is only one part of a comprehensive evaluation of competency which includes consideration of diagnosis, psychiatric and/or cognitive symptomatology, risk involved in the situation, and individual and cultural differences. PMID:27330455

Construct validity of the Free and Cued Selective Reminding Test in older adults with memory complaints.

PubMed

Clerici, Francesca; Ghiretti, Roberta; Di Pucchio, Alessandra; Pomati, Simone; Cucumo, Valentina; Marcone, Alessandra; Vanacore, Nicola; Mariani, Claudio; Cappa, Stefano Francesco

2017-06-01

The Free and Cued Selective Reminding Test (FCSRT) is the memory test recommended by the International Working Group on Alzheimer's disease (AD) for the detection of amnestic syndrome of the medial temporal type in prodromal AD. Assessing the construct validity and internal consistency of the Italian version of the FCSRT is thus crucial. The FCSRT was administered to 338 community-dwelling participants with memory complaints (57% females, age 74.5 ± 7.7 years), including 34 with AD, 203 with Mild Cognitive Impairment, and 101 with Subjective Memory Impairment. Internal Consistency was estimated using Cronbach's alpha coefficient. To assess convergent validity, five FCSRT scores (Immediate Free Recall, Immediate Total Recall, Delayed Free Recall, Delayed Total Recall, and Index of Sensitivity of Cueing) were correlated with three well-validated memory tests: Story Recall, Rey Auditory Verbal Learning test, and Rey Complex Figure (RCF) recall (partial correlation analysis). To assess divergent validity, a principal component analysis (an exploratory factor analysis) was performed including, in addition to the above-mentioned memory tasks, the following tests: Word Fluencies, RCF copy, Clock Drawing Test, Trail Making Test, Frontal Assessment Battery, Raven Coloured Progressive Matrices, and Stroop Colour-Word Test. Cronbach's alpha coefficients for immediate recalls (IFR and ITR) and delayed recalls (DFR and DTR) were, respectively, .84 and .81. All FCSRT scores were highly correlated with those of the three well-validated memory tests. The factor analysis showed that the FCSRT does not load on the factors saturated by non-memory tests. These findings indicate that the FCSRT has a good internal consistency and has an excellent construct validity as an episodic memory measure. © 2015 The British Psychological Society.

The construct validity of the Bem Sex-Role Inventory for heterosexual and gay men.

PubMed

Chung, Y B

1995-01-01

This study examined the construct validity of the Bem Sex-Role Inventory (BSRI; Bem, 1978) for heterosexual and gay men. Sixty heterosexual and 63 gay male participants were recruited through networking and advertisements. These two groups were of equivalent age, socioeconomic background, race, student status, and educational level. They completed the Lifestyle Questionnaire assessing sexual orientation and the BSRI assessing sex-role orientation. The internal consistency and discriminant validity of the BSRI scales were examined by corrected item-total correlations, coefficient alphas, inter-scale correlations, and factor analysis. Results suggested that the BSRI was equally valid for heterosexual and gay men, and the psychometric data reported in the BSRI Manual (Bem, 1981) were essentially replicated. However, the short-form BSRI is recommended for use with male respondents because of the problematic non-short-form Femininity items.

Background, College Experiences, and the ACT-COMP Exam: Using Construct Validity to Evaluate Assessment Instruments.

ERIC Educational Resources Information Center

Pike, Gary R.

1989-01-01

A study investigated the appropriateness of the American College Testing Program's College Outcome Measures Program, conducted at the University of Tennessee, Knoxville, by applying the criterion of construct validity. Results indicated that while the test primarily measures individual differences, it is also sensitive to the effects of higher…

Bilingual Phonological Awareness: Multilevel Construct Validation among Spanish-Speaking Kindergarteners in Transitional Bilingual Education Classrooms

ERIC Educational Resources Information Center

Branum-Martin, Lee; Mehta, Paras D.; Fletcher, Jack M.; Carlson, Coleen D.; Ortiz, Alba; Carlo, Maria; Francis, David J.

2006-01-01

The construct validity of English and Spanish phonological awareness (PA) tasks was examined with a sample of 812 kindergarten children from 71 transitional bilingual education program classrooms located in 3 different types of geographic regions in California and Texas. Tasks of PA, including blending nonwords, segmenting words, and phoneme…

Male Body Satisfaction: Factorial and Construct Validity of the Body Parts Satisfaction Scale for Men

ERIC Educational Resources Information Center

McFarland, Michael B.; Petrie, Trent A.

2012-01-01

Given the centrality of body dissatisfaction in the manifestation of eating, exercise, and affective disturbances in men, measurement of this construct becomes essential. Across 2 studies with male undergraduates (Ns = 189 and 188), the psychometric properties, including incremental validity and factor structure, of the 25-item Body Parts…

Validation of the Spanish version of the Drive for Muscularity Scale (DMS) among males: Confirmatory factor analysis.

PubMed

Sepulveda, Ana R; Parks, Melissa; de Pellegrin, Yolanda; Anastasiadou, Dimitra; Blanco, Miriam

2016-04-01

Drive for Muscularity (DM) has been shown to be a relevant construct for measuring and understanding male body image. For this reason, it is important to have reliable and valid instruments with which to measure DM, and to date no such instruments exist in Spain. This study analyzes the psychometric and structural properties of the Drive for Muscularity Scale (DMS) in a sample of Spanish adolescent males (N=212), with the aim of studying the structural validity of the scale by using a confirmatory factor analysis (CFA), as well as analyzing the internal consistency and construct (convergent and discriminant) and concurrent validity of the instrument. After testing three models, results indicated that the best structure was a two-dimensional model, with the factors of muscularity-oriented body image (MBI) and muscularity behavior (MB). The scale showed good internal consistency (α=.90) and adequate construct validity. Furthermore, significant associations were found between DM and increased difficulties in emotional regulation (rho=.37) and low self-esteem (rho=-.19). Findings suggest that the two-factor structure may be used when assessing drive for muscularity among adolescent males in Spain. Copyright © 2016 Elsevier Ltd. All rights reserved.

Development and Validation of MMPI-2-RF Scales for Indexing Triarchic Psychopathy Constructs.

PubMed

Sellbom, Martin; Drislane, Laura E; Johnson, Alexandria K; Goodwin, Brandee E; Phillips, Tasha R; Patrick, Christopher J

2016-10-01

The triarchic model characterizes psychopathy in terms of three distinct dispositional constructs of boldness, meanness, and disinhibition. The model can be operationalized through scales designed specifically to index these domains or by using items from other inventories that provide coverage of related constructs. The present study sought to develop and validate scales for assessing the triarchic model domains using items from the Minnesota Multiphasic Personality Inventory-2-Restructured Form (MMPI-2-RF). A consensus rating approach was used to identify items relevant to each triarchic domain, and following psychometric refinement, the resulting MMPI-2-RF-based triarchic scales were evaluated for convergent and discriminant validity in relation to multiple psychopathy-relevant criterion variables in offender and nonoffender samples. Expected convergent and discriminant associations were evident very clearly for the Boldness and Disinhibition scales and somewhat less clearly for the Meanness scale. Moreover, hierarchical regression analyses indicated that all MMPI-2-RF triarchic scales incremented standard MMPI-2-RF scale scores in predicting extant triarchic model scale scores. The widespread use of MMPI-2-RF in clinical and forensic settings provides avenues for both clinical and research applications in contexts where traditional psychopathy measures are less likely to be administered. © The Author(s) 2015.

Dalhousie dyspnea scales: construct and content validity of pictorial scales for measuring dyspnea.

PubMed

McGrath, Patrick J; Pianosi, Paul T; Unruh, Anita M; Buckley, Chloe P

2005-08-30

Because there are no child-friendly, validated, self-report measures of dyspnea or breathlessness, we developed, and provided initial validation, of three, 7-item, pictorial scales depicting three sub-constructs of dyspnea: throat closing, chest tightness, and effort. We developed the three scales (Throat closing, Chest tightness, and Effort) using focus groups with 25 children. Subsequently, seventy-nine children (29 children with asthma, 30 children with cystic fibrosis. and 20 children who were healthy) aged 6 to 18 years rated each picture in each series, using a 0-10 scale. In addition, each child placed each picture in each series on a 100-cm long Visual Analogue Scale, with the anchors "not at all" and "a lot". Children aged eight years or older rated the scales in the correct order 75% to 98% correctly, but children less than 8 years of age performed unreliably. The mean distance between each consecutive item in each pictorial scale was equal. Preliminary results revealed that children aged 8 to 18 years understood and used these three scales measuring throat closing, chest tightness, and effort appropriately. The scales appear to accurately measure the construct of breathlessness, at least at an interval level. Additional research applying these scales to clinical situations is warranted.

Validation of a questionnaire on hand hygiene in the construction industry.

PubMed

Timmerman, Johan G; Zilaout, Hicham; Heederik, Dick; Spee, Ton; Smit, Lidwien A M

2014-10-01

Construction workers are at risk of developing occupational contact dermatitis. Gloves, when used properly, may protect against chemicals and coarse materials. We investigated the prevalence and determinants of contact dermatitis in a population of Dutch construction workers and aimed at validating questionnaire items on hand hygiene. A cross-sectional study was conducted at 13 construction sites, yielding data of 177 subjects (95% response rate). A questionnaire covering questions on hand hygiene and contact dermatitis symptoms was used. Agreement between workplace observations and a number of questionnaire items was assessed by calculating Cohen's kappa. Log-binomial regression analysis was used to assess the association between contact dermatitis and various hand hygiene-related determinants. The 1-year prevalence of self-reported contact dermatitis in our study sample was 46.9%. Multiple regression analysis showed a positive association with difficulties with hand cleaning (prevalence ratio [PR]: 1.26, 95% confidence interval [CI]: 1.05-1.52), hand contamination at the end of the working day (PR: 2.30, 95% CI: 1.14-4.65), and intensive hand cream use (PR: 2.07, 95% CI: 1.42-3.01). Observations of hand contamination, glove use, and glove types were found to agree well with the self-reported data from the questionnaire (Cohen's kappa's 0.75, 0.97, and 0.88). Self-reported contact dermatitis prevalence in construction workers was high and related to hand hygiene. A strong agreement was found between workplace observations and self-reported questionnaire data. © The Author 2014. Published by Oxford University Press on behalf of the British Occupational Hygiene Society.

Clinical Functional Capacity Testing in Patients With Facioscapulohumeral Muscular Dystrophy: Construct Validity and Interrater Reliability of Antigravity Tests.

PubMed

Rijken, Noortje H; van Engelen, Baziel G; Weerdesteyn, Vivian; Geurts, Alexander C

2015-12-01

To evaluate the construct validity and interrater reliability of 4 simple antigravity tests in a small group of patients with facioscapulohumeral muscular dystrophy (FSHD). Case-control study. University medical center. Patients with various severity levels of FSHD (n=9) and healthy control subjects (n=10) were included (N=19). Not applicable. A 4-point ordinal scale was designed to grade performance on the following 4 antigravity tests: sit to stance, stance to sit, step up, and step down. In addition, the 6-minute walk test, 10-m walking test, Berg Balance Scale, and timed Up and Go test were administered as conventional tests. Construct validity was determined by linear regression analysis using the Clinical Severity Score (CSS) as the dependent variable. Interrater agreement was tested using a κ analysis. Patients with FSHD performed worse on all 4 antigravity tests compared with the controls. Stronger correlations were found within than between test categories (antigravity vs conventional). The antigravity tests revealed the highest explained variance with regard to the CSS (R(2)=.86, P=.014). Interrater agreement was generally good. The results of this exploratory study support the construct validity and interrater reliability of the proposed antigravity tests for the assessment of functional capacity in patients with FSHD taking into account the use of compensatory strategies. Future research should further validate these results in a larger sample of patients with FSHD. Copyright © 2015 American Congress of Rehabilitation Medicine. Published by Elsevier Inc. All rights reserved.

Construct and face validity of a virtual reality-based camera navigation curriculum.

PubMed

Shetty, Shohan; Panait, Lucian; Baranoski, Jacob; Dudrick, Stanley J; Bell, Robert L; Roberts, Kurt E; Duffy, Andrew J

2012-10-01

Camera handling and navigation are essential skills in laparoscopic surgery. Surgeons rely on camera operators, usually the least experienced members of the team, for visualization of the operative field. Essential skills for camera operators include maintaining orientation, an effective horizon, appropriate zoom control, and a clean lens. Virtual reality (VR) simulation may be a useful adjunct to developing camera skills in a novice population. No standardized VR-based camera navigation curriculum is currently available. We developed and implemented a novel curriculum on the LapSim VR simulator platform for our residents and students. We hypothesize that our curriculum will demonstrate construct and face validity in our trainee population, distinguishing levels of laparoscopic experience as part of a realistic training curriculum. Overall, 41 participants with various levels of laparoscopic training completed the curriculum. Participants included medical students, surgical residents (Postgraduate Years 1-5), fellows, and attendings. We stratified subjects into three groups (novice, intermediate, and advanced) based on previous laparoscopic experience. We assessed face validity with a questionnaire. The proficiency-based curriculum consists of three modules: camera navigation, coordination, and target visualization using 0° and 30° laparoscopes. Metrics include time, target misses, drift, path length, and tissue contact. We analyzed data using analysis of variance and Student's t-test. We noted significant differences in repetitions required to complete the curriculum: 41.8 for novices, 21.2 for intermediates, and 11.7 for the advanced group (P < 0.05). In the individual modules, coordination required 13.3 attempts for novices, 4.2 for intermediates, and 1.7 for the advanced group (P < 0.05). Target visualization required 19.3 attempts for novices, 13.2 for intermediates, and 8.2 for the advanced group (P < 0.05). Participants believe that training improves

Construct Validity of the WISC-IV with a Referred Sample: Direct versus Indirect Hierarchical Structures

ERIC Educational Resources Information Center

Canivez, Gary L.

2014-01-01

The Wechsler Intelligence Scale for Children--Fourth Edition (WISC-IV) is one of the most frequently used intelligence tests in clinical assessments of children with learning difficulties. Construct validity studies of the WISC-IV have generally supported the higher order structure with four correlated first-order factors and one higher-order…

Thwarted Belongingness and Perceived Burdensomeness: Construct Validity and Psychometric Properties of the Interpersonal Needs Questionnaire

ERIC Educational Resources Information Center

Van Orden, Kimberly A.; Cukrowicz, Kelly C.; Witte, Tracy K.; Joiner, Thomas E., Jr.

2012-01-01

The present study examined the psychometric properties and construct validity of scores derived from the Interpersonal Needs Questionnaire (INQ) using latent variable modeling with 5 independent samples varying in age and level of psychopathology. The INQ was derived from the interpersonal theory of suicide and was developed to measure thwarted…

Reliability and Validity of the Musculoskeletal Tumor Society Scoring System for the Upper Extremity in Japanese Patients.

PubMed

Uehara, Kosuke; Ogura, Koichi; Akiyama, Toru; Shinoda, Yusuke; Iwata, Shintaro; Kobayashi, Eisuke; Tanzawa, Yoshikazu; Yonemoto, Tsukasa; Kawano, Hirotaka; Kawai, Akira

2017-09-01

The Musculoskeletal Tumor Society (MSTS) scoring system developed in 1993 is a widely used disease-specific evaluation tool for assessment of physical function in patients with musculoskeletal tumors; however, only a few studies have confirmed its reliability and validity. The aim of this study was to validate the MSTS scoring system for the upper extremity (MSTS-UE) in Japanese patients with musculoskeletal tumors for use by others in research. Does the MSTS-UE have: (1) sufficient reliability and internal consistency; (2) adequate construct validity; and (3) reasonable criterion validity in comparison to the Toronto Extremity Salvage Score (TESS) or SF-36? Reliability was performed using test-retest analysis, and internal consistency was evaluated with Cronbach's alpha coefficient. Construct validity was evaluated using a scree plot to confirm the construct number and the Akaike information criterion network. Criterion validity was evaluated by comparing the MSTS-UE with the TESS and SF-36. The test-retest reliability with intraclass correlation coefficient (0.95; 95% CI, 0.91-0.97) was excellent, and internal consistency with Cronbach's α (0.7; 95% CI, 0.53-0.81) was acceptable. There were no ceiling and floor effects. The Akaike Information Criterion network showed that lifting ability, pain, and dexterity played central roles among the components. The MSTS-UE showed substantial correlation with the TESS scoring scale (r = 0.75; p < 0.001) and fair correlation with the SF-36 physical component summary (r = 0.37; p = 0.007). Although the MSTS-UE showed slight correlation with the SF-36 mental component summary, the emotional acceptance component of the MSTS-UE showed fair correlation (r = 0.29; p = 0.039). We can conclude that the MSTS is not an adequate measure of general health-related quality of life; however, this system was designed mainly to be a simple measure of function in a single extremity. To evaluate the mental state of patients with

Factor structure and construct validity of the psychopathic personality inventory in a forensic sample.

PubMed

Gonsalves, Valerie M; McLawsen, Julia E; Huss, Matthew T; Scalora, Mario J

2013-01-01

A wealth of research has underscored the strong relationship between PCL-R scores and recidivism. However, mounting criticism cites the PCL-R's cumbersome administration procedures and failure to adequately measure core features associated with the construct of psychopathy (Skeem, Polaschek, Patrick, & Lilienfeld, 2011). In light of these concerns, this study examined the PPI and the PPI-R, which were designed to measure core personality features associated with psychopathy (Lilienfeld & Andrews, 1996; Lilienfeld & Widows, 2005). Study one examined the PPI relative to the PCL-R and examined its factor structure. The instruments shared few significant correlations and neither the PCL-R nor the PPI significantly predicted recidivism. Study two examined the PPI-R relative to the PCL-R, the PPI, both history of violence and future criminal activity and measure of related constructs. The PPI-R was significantly correlated with measures of empathy and criminal thinking and the factors were related to a history of violence and predicted future violent criminal behavior. Copyright © 2013 Elsevier Ltd. All rights reserved.

Construct validity of individual and summary performance metrics associated with a computer-based laparoscopic simulator.

PubMed

Rivard, Justin D; Vergis, Ashley S; Unger, Bertram J; Hardy, Krista M; Andrew, Chris G; Gillman, Lawrence M; Park, Jason

2014-06-01

Computer-based surgical simulators capture a multitude of metrics based on different aspects of performance, such as speed, accuracy, and movement efficiency. However, without rigorous assessment, it may be unclear whether all, some, or none of these metrics actually reflect technical skill, which can compromise educational efforts on these simulators. We assessed the construct validity of individual performance metrics on the LapVR simulator (Immersion Medical, San Jose, CA, USA) and used these data to create task-specific summary metrics. Medical students with no prior laparoscopic experience (novices, N = 12), junior surgical residents with some laparoscopic experience (intermediates, N = 12), and experienced surgeons (experts, N = 11) all completed three repetitions of four LapVR simulator tasks. The tasks included three basic skills (peg transfer, cutting, clipping) and one procedural skill (adhesiolysis). We selected 36 individual metrics on the four tasks that assessed six different aspects of performance, including speed, motion path length, respect for tissue, accuracy, task-specific errors, and successful task completion. Four of seven individual metrics assessed for peg transfer, six of ten metrics for cutting, four of nine metrics for clipping, and three of ten metrics for adhesiolysis discriminated between experience levels. Time and motion path length were significant on all four tasks. We used the validated individual metrics to create summary equations for each task, which successfully distinguished between the different experience levels. Educators should maintain some skepticism when reviewing the plethora of metrics captured by computer-based simulators, as some but not all are valid. We showed the construct validity of a limited number of individual metrics and developed summary metrics for the LapVR. The summary metrics provide a succinct way of assessing skill with a single metric for each task, but require further validation.

Automated Metrics in a Virtual-Reality Myringotomy Simulator: Development and Construct Validity.

PubMed

Huang, Caiwen; Cheng, Horace; Bureau, Yves; Ladak, Hanif M; Agrawal, Sumit K

2018-06-15

The objectives of this study were: 1) to develop and implement a set of automated performance metrics into the Western myringotomy simulator, and 2) to establish construct validity. Prospective simulator-based assessment study. The Auditory Biophysics Laboratory at Western University, London, Ontario, Canada. Eleven participants were recruited from the Department of Otolaryngology-Head & Neck Surgery at Western University: four senior otolaryngology consultants and seven junior otolaryngology residents. Educational simulation. Discrimination between expert and novice participants on five primary automated performance metrics: 1) time to completion, 2) surgical errors, 3) incision angle, 4) incision length, and 5) the magnification of the microscope. Automated performance metrics were developed, programmed, and implemented into the simulator. Participants were given a standardized simulator orientation and instructions on myringotomy and tube placement. Each participant then performed 10 procedures and automated metrics were collected. The metrics were analyzed using the Mann-Whitney U test with Bonferroni correction. All metrics discriminated senior otolaryngologists from junior residents with a significance of p < 0.002. Junior residents had 2.8 times more errors compared with the senior otolaryngologists. Senior otolaryngologists took significantly less time to completion compared with junior residents. The senior group also had significantly longer incision lengths, more accurate incision angles, and lower magnification keeping both the umbo and annulus in view. Automated quantitative performance metrics were successfully developed and implemented, and construct validity was established by discriminating between expert and novice participants.

Validity aspects of the patient feedback questionnaire on consultation skills (PFC), a promising learning instrument in medical education.

PubMed

Reinders, Marcel E; Blankenstein, Annette H; Knol, Dirk L; de Vet, Henrica C W; van Marwijk, Harm W J

2009-08-01

A focus on the communicator competency is considered to be an important requirement to help physicians to acquire consultation skills. A feedback questionnaire, in which patients assess consultation skills might be a useful learning tool. An existing questionnaire on patient perception of patient-centeredness (PPPC) was adapted to cover the 'communicator' items in the competency profile. We assessed the face and content validity, the construct validity and the internal consistency of this new patient feedback on consultation skills (PFC) questionnaire. We assessed the face validity of the PFC by interviewing patients and general practice trainees (GPTs) during the developmental process. The content validity was determined by experts (n=10). First-year GPTs (23) collected 222 PFCs, from which the data were used to assess the construct validity (factor analysis), internal consistency, response rates and ceiling effects. The PFC adequately covers the corresponding 'communicator' competency (face and content validity). Factor analysis showed a one-dimensional construct. The internal consistency was high (Cronbach's alpha 0.89). For the single items, the response rate varied from 89.2% to 100%; the maximum score (ceiling effect) varied from 45.5% to 89.2%. The PFC appears to be a valid, internally consistent instrument. The PFC may be a valuable learning tool with which GPTs, other physicians and medical students can acquire feedback from patients regarding their consultation skills.

The Construction and Validation of the Heat Vulnerability Index, a Review

PubMed Central

Bao, Junzhe; Li, Xudong; Yu, Chuanhua

2015-01-01

The occurrence of extreme heat and its adverse effects will be exacerbated with the trend of global warming. An increasing number of researchers have been working on aggregating multiple heat-related indicators to create composite indices for heat vulnerability assessments and have visualized the vulnerability through geographic information systems to provide references for reducing the adverse effects of extreme heat more effectively. This review includes 15 studies concerning heat vulnerability assessment. We have studied the indicators utilized and the methods adopted in these studies for the construction of the heat vulnerability index (HVI) and then further reviewed some of the studies that validated the HVI. We concluded that the HVI is useful for targeting the intervention of heat risk, and that heat-related health outcomes could be used to validate and optimize the HVI. In the future, more studies should be conducted to provide references for the selection of heat-related indicators and the determination of weight values of these indicators in the development of the HVI. Studies concerning the application of the HVI are also needed. PMID:26132476

Construct Validity of Accelerometry-Derived Force to Quantify Basketball Movement Patterns.

PubMed

Staunton, Craig; Wundersitz, Daniel; Gordon, Brett; Kingsley, Michael

2017-12-01

This study assessed the construct validity of accelerometry-derived net force to quantify the external demands of basketball movements. Twenty-eight basketballers completed the Yo-Yo intermittent recovery test (Yo-Yo-IR1) and basketball exercise simulation test (BEST). Intensity was quantified using accelerometry-derived average net force (AvF Net ) and PlayerLoad TM per minute (PL/min). Within-player correlations were determined between intensity and running speed during Yo-Yo-IR1. Measured AvF Net was determined for movements during the BEST and predicted AvF Net was calculated using movement speed and correlations from Yo-Yo-IR1. Relationships between AvF Net and running speed during Yo-Yo-IR1 were nearly perfect (r 2 =0.95, 95% CI: 0.94-0.96; p<0.001) and stronger than correlations between running speed and PL/min (r 2 =0.80, 95% CI: 0.73-0.87; p<0.001). Differences between measured and predicted AvF Net were small during jogging and running (<1%), but large for basketball movements including jumping, change-of-direction and shuffling (15%-41%). As hypothesised, AvF Net differed by playing position (11%-16%; p <0.001) and reflected the additional demand upon players with larger body mass and lower movement efficiency. Both sprint speed and AvF Net reduced during the course of the BEST ( p ≤0.013). These findings confirm the construct validity of AvF Net to quantify the external demand of basketball movements. Accelerometry-derived net force has the potential to quantify the external demands of basketballers during training and competition. © Georg Thieme Verlag KG Stuttgart · New York.

The factor structure and construct validity of the inventory of callous-unemotional traits in Chinese undergraduate students

PubMed Central

Gao, Yu; Deng, Jiaxin; Lai, Hongyu; Deng, Qiaowen; Armour, Cherie

2017-01-01

The current study assesses the factor structure and construct validity of the self-reported Inventory of Callous–Unemotional Traits (ICU) in 637 Chinese community adults (mean age = 25.98, SD = 5.79). A series of theoretical models proposed in previous studies were tested through confirmatory factor analyses. Results indicated that a shortened form that consists of 11 items (ICU-11) to assess callousness and uncaring factors has excellent overall fit. Additionally, correlations with a wide range of external variables demonstrated that this shortened form has similar construct validity compared to the original ICU. In conclusion, our findings suggest that the ICU-11 may be a promising self-report tool that could be a good substitute for the original form to assess callous-uncaring traits in adults. PMID:29216240

Construct validity and reliability of a two-step tool for the identification of frail older people in primary care.

PubMed

van Kempen, Janneke A L; Schers, Henk J; Melis, René J F; Olde Rikkert, Marcel G M

2014-02-01

To study the reliability and construct validity of the EASY-Care Two-step Older persons Screening (EASY-Care TOS), a practice-based tool that helps family physicians (FPs) to identify their frail older patients. This validation study was conducted in six FP practices. We determined the construct validity by comparing the results of the EASY-Care TOS with other commonly used frailty constructs [Fried Frailty Criteria (FFC), Frailty Index (FI)] and with other related constructs (ie, multimorbidity, disability, cognition, mobility, mental well-being, and social context). To determine interrater reliability, an independent second EASY-Care TOS assessment was made for a subpopulation. We included 587 older patients (mean age 77 ± 5 years, 56% women). According to EASY-Care TOS, 39.4% of patients were frail. EASY-Care TOS frailty correlated better with FI frailty (0.63) than with FFC frailty (0.52). A high correlation was found with multimorbidity (0.50), disabilities (0.53), and mobility (0.55) and a moderate correlation with cognition (0.31) and mental well-being (0.38). Reliability testing showed 89% agreement (Cohen's κ 0.63) between EASY-Care TOS frailty judgment by two different assessments. EASY-Care TOS correlated well with relevant physical and psychosocial measures. Accordingly, these results show that the EASY-Care TOS identifies patients who have a wide spectrum of interacting problems. Copyright © 2014 Elsevier Inc. All rights reserved.

Development and Initial Validation of a Multidimensional Scale Assessing Subjective Well-Being: The Well-Being Scale (WeBS).

PubMed

Lui, P Priscilla; Fernando, Gaithri A

2018-02-01

Numerous scales currently exist that assess well-being, but research on measures of well-being is still advancing. Conceptualization and measurement of subjective well-being have emphasized intrapsychic over psychosocial domains of optimal functioning, and disparate research on hedonic, eudaimonic, and psychological well-being lacks a unifying theoretical model. Lack of systematic investigations on the impact of culture on subjective well-being has also limited advancement of this field. The goals of this investigation were to (1) develop and validate a self-report measure, the Well-Being Scale (WeBS), that simultaneously assesses overall well-being and physical, financial, social, hedonic, and eudaimonic domains of this construct; (2) evaluate factor structures that underlie subjective well-being; and (3) examine the measure's psychometric properties. Three empirical studies were conducted to develop and validate the 29-item scale. The WeBS demonstrated an adequate five-factor structure in an exploratory structural equation model in Study 1. Confirmatory factor analyses showed that a bifactor structure best fit the WeBS data in Study 2 and Study 3. Overall WeBS scores and five domain-specific subscale scores demonstrated adequate to excellent internal consistency reliability and construct validity. Mean differences in overall well-being and its five subdomains are presented for different ethnic groups. The WeBS is a reliable and valid measure of multiple aspects of well-being that are considered important to different ethnocultural groups.

Test-retest reliability and construct validity of the ENERGY-parent questionnaire on parenting practices, energy balance-related behaviours and their potential behavioural determinants: the ENERGY-project.

PubMed

Singh, Amika S; Chinapaw, Mai J M; Uijtdewilligen, Léonie; Vik, Froydis N; van Lippevelde, Wendy; Fernández-Alvira, Juan M; Stomfai, Sarolta; Manios, Yannis; van der Sluijs, Maria; Terwee, Caroline; Brug, Johannes

2012-08-13

Insight in parental energy balance-related behaviours, their determinants and parenting practices are important to inform childhood obesity prevention. Therefore, reliable and valid tools to measure these variables in large-scale population research are needed. The objective of the current study was to examine the test-retest reliability and construct validity of the parent questionnaire used in the ENERGY-project, assessing parental energy balance-related behaviours, their determinants, and parenting practices among parents of 10-12 year old children. We collected data among parents (n = 316 in the test-retest reliability study; n = 109 in the construct validity study) of 10-12 year-old children in six European countries, i.e. Belgium, Greece, Hungary, the Netherlands, Norway, and Spain. Test-retest reliability was assessed using the intra-class correlation coefficient (ICC) and percentage agreement comparing scores from two measurements, administered one week apart. To assess construct validity, the agreement between questionnaire responses and a subsequent interview was assessed using ICC and percentage agreement.All but one item showed good to excellent test-retest reliability as indicated by ICCs > .60 or percentage agreement ≥ 75%. Construct validity appeared to be good to excellent for 92 out of 121 items, as indicated by ICCs > .60 or percentage agreement ≥ 75%. From the other 29 items, construct validity was moderate for 24 and poor for 5 items. The reliability and construct validity of the items of the ENERGY-parent questionnaire on multiple energy balance-related behaviours, their potential determinants, and parenting practices appears to be good. Based on the results of the validity study, we strongly recommend adapting parts of the ENERGY-parent questionnaire if used in future research.

Individual safety performance in the construction industry: development and validation of two short scales.

PubMed

DeArmond, Sarah; Smith, April E; Wilson, Christina L; Chen, Peter Y; Cigularov, Konstantin P

2011-05-01

In the current research a short measure of safety performance is developed for use in the construction industry and the relationships between different components of safety performance and safety outcomes (e.g., occupational injuries and work-related pain) are explored within the construction context. This research consists of two field studies. In the first, comprehensive measures of safety compliance and safety participation were shortened and modified to be appropriate for use in construction. Evidence of reliability and validity is provided. Both safety compliance and safety participation were negatively related to occupational injuries, yet these two correlations were not statistically different. In the second study, we investigated the relationships between these two components of safety performance and work-related pain frequency, in addition to replicating Study 1. Safety compliance had a stronger negative relationship with pain than safety participation. Implications for research are discussed. Copyright © 2010 Elsevier Ltd. All rights reserved.

Construct Validity of the Nutrition and Activity Knowledge Scale in a French Sample of Adolescents with Mild to Moderate Intellectual Disability

ERIC Educational Resources Information Center

Maiano, Christophe; Begarie, Jerome; Morin, Alexandre J. S.; Garbarino, Jean-Marie; Ninot, Gregory

2010-01-01

The purpose of this study was to test the reliability (i.e. internal consistency and test-retest reliability) and construct validity (i.e. content validity, factor validity, measurement invariance, and latent mean invariance) of the Nutrition and Activity Knowledge Scale (NAKS) in a sample of French adolescents with mild to moderate Intellectual…

Analysis of Test-Retest Reliability, Construct Validity, and Internal Consistency of the Brazilian Version of the Pelvic Girdle Questionnaire.

PubMed

Simões, Luan; Teixeira-Salmela, Luci Fuscaldi; Magalhães, Lívia; Stuge, Britt; Laurentino, Glória; Wanderley, Elaine; Barros, Raphaela; Lemos, Andrea

2018-04-24

The purpose of this study was to evaluate test-retest reliability, construct validity, and internal consistency of the Brazilian version of the Pelvic Girdle Questionnaire (PGQ-Brazil). Analysis of the measurement properties was carried out in 4 steps. Step 1 was the pilot study, on which basis 4 hypotheses were formulated. These hypotheses were tested during the next step (construct validity, step 2) by completion of the questionnaire by the 2 groups (in pain [n = 105] and not in pain [n = 52]). For implementation of the PGQ-Brazil in the group with pain, we calculated the internal consistency (step 3) and, 7 days later, test-retest reliability (step 4) by re-application of the instrument in this group. First, the PGQ-Brazil was able to discriminate between these groups (construct validity). Second, test-retest reliability (intraclass correlation coefficients for Activities subscale [0.97 with 95% confidence interval of 0.95-0.98] and Symptoms subscale [0.98 with 95% confidence interval of 0.97-0.98] and κ coefficient between 0.50 and 0.89 for the items) was found to be good; the Bland-Altman test indicated satisfactory agreement. The Rasch analysis indicated good internal consistency, and the instrument's ability to divide the participants into at least 3 levels of skills was confirmed. In contrast, a ceiling effect was observed, as 24% of pregnant women exhibited skills superior to what the PGQ-Brazil could evaluate. The PGQ-Brazil had good internal consistency, test-retest reliability, and construct validity in assessment of limitations in activities and symptoms of pregnant women with pelvic girdle pain. Copyright © 2018. Published by Elsevier Inc.

Measuring Psychological Capital: Construction and Validation of the Compound PsyCap Scale (CPC-12)

PubMed Central

Lorenz, Timo; Beer, Clemens; Pütz, Jan; Heinitz, Kathrin

2016-01-01

With the Psychological Capital Questionnaire (PCQ) being the standard measure to assess psychological capital (PsyCap) in the context of organizations, this paper aims to broaden this domain-specific approach by introducing a measure with universal claim. Two studies were conducted to create and validate a German self-report scale (CPC-12) measuring PsyCap. We performed confirmatory factor analyses and correlations with other positive psychological constructs on the data of two German samples (N1 = 321; N2 = 202). The twelve-item CPC-12 exhibits the anticipated factorial structure with a very good model fit and associations to other constructs concur with previous findings with other measures of PsyCap. PMID:27035437

Reliability and construct validity of the Malay version of the Job Content Questionnaire (JCQ) among secondary school teachers in Kota Bharu, Kelantan, Malaysia.

PubMed

Hadi, Azlihanis Abdul; Naing, Nyi Nyi; Daud, Aziah; Nordin, Rusli

2006-11-01

This study was conducted to assess the reliability and construct validity of the Malay version of Job Content Questionnaire (JCQ) among secondary school teachers in Kota Bharu, Kelantan. A total of 68 teachers consented to participate in the study and were administered the Malay version of JCQ. Reliability was determined using Cronbach's alpha for internal consistency whilst construct validity was assessed using factor analysis. The results indicated that Cronbach's alpha coefficients revealed decision latitude (0.75), psychological job demand (0.50) and social support (0.84). Factor analysis showed three meaningful common factors that could explain the construct of Karasek's demand-control-social support model. The study suggests the JCQ scales are reliable and valid tools for assessing job stress in school teachers.

Construct Validation in Counseling Psychology Research

ERIC Educational Resources Information Center

Hoyt, William T.; Warbasse, Rosalia E.; Chu, Erica Y.

2006-01-01

Counseling psychology researchers devote little attention to theory-based measurement validation, as evidenced by cursory mention of validity issues in the method and discussion sections of published research reports. Especially, many researchers appear unaware of the limitations of correlations between pairs of self-report measures as evidence of…

Constructing Aligned Assessments Using Automated Test Construction

ERIC Educational Resources Information Center

Porter, Andrew; Polikoff, Morgan S.; Barghaus, Katherine M.; Yang, Rui

2013-01-01

We describe an innovative automated test construction algorithm for building aligned achievement tests. By incorporating the algorithm into the test construction process, along with other test construction procedures for building reliable and unbiased assessments, the result is much more valid tests than result from current test construction…

Construct Validation and Application of a Common Measure of Social Cohesion in 33 European Countries

ERIC Educational Resources Information Center

Dickes, Paul; Valentova, Marie; Borsenberger, Monique

2010-01-01

The aim of the paper is to assess the construct validation of a multidimensional measure of social cohesion which is well theoretically grounded and has an equivalent/comparable interpretation across all European countries. Up-to-now published research on social cohesion is deficient in either one or both of these important aspects. This paper…

Construct Validity of the Infant Motor Profile: Relation with Prenatal, Perinatal, and Neonatal Risk Factors

ERIC Educational Resources Information Center

Heineman, Kirsten R.; La Bastide-Van Gemert, Sacha; Fidler, Vaclav; Middelburg, Karin J.; Bos, Arend F.; Hadders-Algra, Mijna

2010-01-01

Aim: The Infant Motor Profile (IMP) is a qualitative assessment of motor behaviour of infants aged 3 to 18 months. The aim of this study was to investigate construct validity of the IMP through the relation of IMP scores with prenatal, perinatal, and neonatal variables, including the presence of brain pathology indicated by neonatal ultrasound…

Construct Validation of the Dietary Inflammatory Index among African Americans.

PubMed

Wirth, M D; Shivappa, N; Davis, L; Hurley, T G; Ortaglia, A; Drayton, R; Blair, S N; Hébert, J R

2017-01-01

Chronic inflammation is linked to many chronic conditions. One of the strongest modulators of chronic inflammation is diet. The Dietary Inflammatory Index (DII) measures dietary inflammatory potential and has been validated previously, but not among African Americans (AAs). Cross-sectional analysis using baseline data from the Healthy Eating and Active Living in the Spirit (HEALS) intervention study. Baseline data collection occurred between 2009 and 2012 in or near Columbia, SC. African-American churchgoers. Baseline data collection included c-reactive protein (CRP) and interleukin-6 from blood draws, anthropometric measures, and numerous questionnaires. The questionnaires included a food frequency questionnaire which was used for DII calculation. The main analyses were performed using quantile regression. Subjects in the highest DII quartile (i.e., more pro-inflammatory) were younger, more likely to be married, and had less education and greater BMI. Individuals in DII quartile 4 had statistically significantly greater CRP at the 75th and 90th percentiles of CRP versus those in quartile 1 (i.e., more anti-inflammatory). Construct validation provides support for using the DII in research among AA populations. Future research should explore avenues to promote more anti-inflammatory diets, with use of the DII, among AA populations to reduce risk of chronic disease.

Construct Validation of the Dietary Inflammatory Index among African Americans

PubMed Central

Wirth, Michael D; Shivappa, Nitin; Davis, Lisa; Hurley, Thomas G.; Ortaglia, Andrew; Drayton, Ruby; Blair, Steven N.; Hébert, James R.

2017-01-01

Objectives Chronic inflammation is linked to many chronic conditions. One of the strongest modulators of chronic inflammation is diet. The Dietary Inflammatory Index (DII) measures dietary inflammatory potential and has been validated previously, but not among African Americans (AAs). Design Cross-sectional analysis using baseline data from the Healthy Eating and Active Living in the Spirit (HEALS) intervention study. Setting Baseline data collection occurred between 2009 and 2012 in or near Columbia, SC. Participants African-American churchgoers Measurements Baseline data collection included c-reactive protein (CRP) and interleukin-6 from blood draws, anthropometric measures, and numerous questionnaires. The questionnaires included a food frequency questionnaire which was used for DII calculation. The main analyses were performed using quantile regression. Results Subjects in the highest DII quartile (i.e., more pro-inflammatory) were younger, more likely to be married, and had less education and greater BMI. Individuals in DII quartile 4 had statistically significantly greater CRP at the 75th and 90th percentiles of CRP versus those in quartile 1 (i.e., more anti-inflammatory). Conclusion Construct validation provides support for using the DII in research among AA populations. Future research should explore avenues to promote more anti-inflammatory diets, with use of the DII, among AA populations to reduce risk of chronic disease. PMID:28448077

Social Loafing Construct Validity in Higher Education: How Well Do Three Measures of Social Loafing Stand up to Scrutiny?

ERIC Educational Resources Information Center

de l'Eau, Jacquelyn

2017-01-01

The purpose of this study was to examine the construct validity of social loafing using convergent and discriminant validity principles. Three instruments that purport to measure social loafing were factor analyzed: A ten-item instrument by George (1992), a 13-item instrument by Mulvey and Klein (1998), and a 22-item instrument by Jassawalla,…

Construct, concurrent and discriminant validity of Type D personality in the general population: associations with anxiety, depression, stress and cardiac output.

PubMed

Howard, Siobhán; Hughes, Brian M

2012-01-01

The Type D personality, identified by high negative affectivity paired with high social inhibition, has been associated with a number of health-related outcomes in (mainly) cardiac populations. However, despite its prevalence in the health-related literature, how this personality construct fits within existing personality theory has not been directly tested. Using a sample of 134 healthy university students, this study examined the Type D personality in terms of two well-established personality traits; introversion and neuroticism. Construct, concurrent and discriminant validity of this personality type was established through examination of the associations between the Type D personality and psychometrically assessed anxiety, depression and stress, as well as measurement of resting cardiovascular function. Results showed that while the Type D personality was easily represented using alternative measures of both introversion and neuroticism, associations with anxiety, depression and stress were mainly accounted for by neuroticism. Conversely, however, associations with resting cardiac output were attributable to the negative affectivity-social inhibition synergy, explicit within the Type D construct. Consequently, both the construct and concurrent validity of this personality type were confirmed, with discriminant validity evident on examination of physiological indices of well-being.

Exploring the Predictive Validity of the Susceptibility to Smoking Construct for Tobacco Cigarettes, Alternative Tobacco Products, and E-Cigarettes.

PubMed

Cole, Adam G; Kennedy, Ryan David; Chaurasia, Ashok; Leatherdale, Scott T

2017-12-06

Within tobacco prevention programming, it is useful to identify youth that are at risk for experimenting with various tobacco products and e-cigarettes. The susceptibility to smoking construct is a simple method to identify never-smoking students that are less committed to remaining smoke-free. However, the predictive validity of this construct has not been tested within the Canadian context or for the use of other tobacco products and e-cigarettes. This study used a large, longitudinal sample of secondary school students that reported never using tobacco cigarettes and non-current use of alternative tobacco products or e-cigarettes at baseline in Ontario, Canada. The sensitivity, specificity, and positive and negative predictive values of the susceptibility construct for predicting tobacco cigarette, e-cigarette, cigarillo or little cigar, cigar, hookah, and smokeless tobacco use one and two years after baseline measurement were calculated. At baseline, 29.4% of the sample was susceptible to future tobacco product or e-cigarette use. The sensitivity of the construct ranged from 43.2% (smokeless tobacco) to 59.5% (tobacco cigarettes), the specificity ranged from 70.9% (smokeless tobacco) to 75.9% (tobacco cigarettes), and the positive predictive value ranged from 2.6% (smokeless tobacco) to 32.2% (tobacco cigarettes). Similar values were calculated for each measure of the susceptibility construct. A significant number of youth that did not currently use tobacco products or e-cigarettes at baseline reported using tobacco products and e-cigarettes over a two-year follow-up period. The predictive validity of the susceptibility construct was high and the construct can be used to predict other tobacco product and e-cigarette use among youth. This study presents the predictive validity of the susceptibility construct for the use of tobacco cigarettes among secondary school students in Ontario, Canada. It also presents a novel use of the susceptibility construct for

The hospital anxiety and depression scale--dimensionality, reliability and construct validity among cognitively intact nursing home patients.

PubMed

Haugan, Gørill; Drageset, Jorunn

2014-08-01

Depression and anxiety are particularly common among individuals living in long-term care facilities. Therefore, access to a valid and reliable measure of anxiety and depression among nursing home patients is highly warranted. To investigate the dimensionality, reliability and construct validity of the Hospital Anxiety and Depression scale (HADS) in a cognitively intact nursing home population. Cross-sectional data were collected from two samples; 429 cognitively intact nursing home patients participated, representing 74 different Norwegian nursing homes. Confirmative factor analyses and correlations with selected constructs were used. The two-factor model provided a good fit in Sample1, revealing a poorer fit in Sample2. Good-acceptable measurement reliability was demonstrated, and construct validity was supported. Using listwise deletion the sample sizes were 227 and 187, for Sample1 and Sample2, respectively. Greater sample sizes would have strengthen the statistical power in the tests. The researchers visited the participants to help fill in the questionnaires; this might have introduced some bias into the respondents׳ reporting. The 14 HADS items were part of greater questionnaires. Thus, frail, older NH patients might have tired during the interview causing a possible bias. Low reliability for depression was disclosed, mainly resulting from three items appearing to be inappropriate indicators for depression in this population. Further research is needed exploring which items might perform as more reliably indicators for depression among nursing home patients. Copyright © 2014 Elsevier B.V. All rights reserved.

INCLEN Diagnostic Tool for Autism Spectrum Disorder (INDT-ASD): development and validation.

PubMed

Juneja, Monica; Mishra, Devendra; Russell, Paul S S; Gulati, Sheffali; Deshmukh, Vaishali; Tudu, Poma; Sagar, Rajesh; Silberberg, Donald; Bhutani, Vinod K; Pinto, Jennifer M; Durkin, Maureen; Pandey, Ravindra M; Nair, M K C; Arora, Narendra K

2014-05-01

To develop and validate INCLEN Diagnostic Tool for Autism Spectrum Disorder (INDT-ASD). Diagnostic test evaluation by cross sectional design. Four tertiary pediatric neurology centers in Delhi and Thiruvanthapuram, India. Children aged 2-9 years were enrolled in the study. INDT-ASD and Childhood Autism Rating Scale (CARS) were administered in a randomly decided sequence by trained psychologist, followed by an expert evaluation by DSM-IV TR diagnostic criteria (gold standard). Psychometric parameters of diagnostic accuracy, validity (construct, criterion and convergent) and internal consistency. 154 children (110 boys, mean age 64.2 mo) were enrolled. The overall diagnostic accuracy (AUC=0.97, 95% CI 0.93, 0.99; P<0.001) and validity (sensitivity 98%, specificity 95%, positive predictive value 91%, negative predictive value 99%) of INDT-ASD for Autism spectrum disorder were high, taking expert diagnosis using DSM-IV-TR as gold standard. The concordance rate between the INDT-ASD and expert diagnosis for 'ASD group' was 82.52% [Cohen's k=0.89; 95% CI (0.82, 0.97); P=0.001]. The internal consistency of INDT-ASD was 0.96. The convergent validity with CARS (r = 0.73, P= 0.001) and divergent validity with Binet-Kamat Test of intelligence (r = -0.37; P=0.004) were significantly high. INDT-ASD has a 4-factor structure explaining 85.3% of the variance. INDT-ASD has high diagnostic accuracy, adequate content validity, good internal consistency high criterion validity and high to moderate convergent validity and 4-factor construct validity for diagnosis of Autistm spectrum disorder.

Validation of an ambulatory capacity measure in Parkinson disease: a construct derived from the Unified Parkinson's Disease Rating Scale.

PubMed

Parashos, Sotirios A; Elm, Jordan; Boyd, James T; Chou, Kelvin L; Dai, Lin; Mari, Zoltan; Morgan, John C; Sudarsky, Lewis; Wielinski, Catherine L

2015-01-01

A construct calculated as the sum of items 13-15, 29, 30 of the Unified Parkinson's Disease Rating Scale (UPDRS) has been used as an "Ambulatory Capacity Measure" (ACM) in Parkinson disease (PD). Its construct validity has never been examined. A similar construct, consisting of the mean value of the same UPDRS items has been used under the acronym PIGD as a measure of postural instability and gait disorder in PD. To examine the construct validity of the ACM and PIGD in PD. We analyzed data in an existing database of 340 PD patients, Hoehn and Yahr stages (HYS) 1-5 who participated in a study of falls. Number of falls (NOF) was recorded over 4 weeks, and UPDRS (mental, ADL, and motor subscales), HYS, Activities Based Confidence Scale (ABC), Freezing of Gait Questionnaire (FOG), Five Times Sit-to-Stand (FTSS), Timed Up-and Go (TUG), Gait Velocity (GV), and Berg Balance Scale (BBS) evaluations were performed. Internal consistency was assessed by Cronbach's alpha. Construct validity was assessed through correlations of the ACM and PIGD to these measures and to their summed-ranks. A coefficient of determination was calculated through linear regression. Mean age was 71.4, mean age at diagnosis 61.4 years; 46% were women; mean UPDRS subscale scores were: Mental 3.7; ADL 15.7; motor: 27.1; mean ACM was 6.51, and mean PIGD 1.30. Cronbach's alpha was 0.78 for both ACM and PIGD. Spearman correlation coefficients between the ACM/PIGD and ABC, FOG, TUG, GV and BBS were 0.69, 0.72, 0.67, 0.58, and 0.70 respectively. Correlation between the ACM/PIGD and summed-ranks of HYS, NOF, ABC, FOG, FTSS, TUG, GV and BBS was high (Spearman r = 0.823, p < 0.0001); 68% of the variability in the summed-ranks was explained by ACM/PIGD. The ACM and the PIGD are valid global measures and accurately reflect the combined effects of the various components of ambulatory capacity in PD patients with HY stages 1-4.

Validation of a global scale to assess the quality of interprofessional teamwork in mental health settings.

PubMed

Tomizawa, Ryoko; Yamano, Mayumi; Osako, Mitue; Hirabayashi, Naotugu; Oshima, Nobuo; Sigeta, Masahiro; Reeves, Scott

2017-12-01

Few scales currently exist to assess the quality of interprofessional teamwork through team members' perceptions of working together in mental health settings. The purpose of this study was to revise and validate an interprofessional scale to assess the quality of teamwork in inpatient psychiatric units and to use it multi-nationally. A literature review was undertaken to identify evaluative teamwork tools and develop an additional 12 items to ensure a broad global focus. Focus group discussions considered adaptation to different care systems using subjective judgements from 11 participants in a pre-test of items. Data quality, construct validity, reproducibility, and internal consistency were investigated in the survey using an international comparative design. Exploratory factor analysis yielded five factors with 21 items: 'patient/community centred care', 'collaborative communication', 'interprofessional conflict', 'role clarification', and 'environment'. High overall internal consistency, reproducibility, adequate face validity, and reasonable construct validity were shown in the USA and Japan. The revised Collaborative Practice Assessment Tool (CPAT) is a valid measure to assess the quality of interprofessional teamwork in psychiatry and identifies the best strategies to improve team performance. Furthermore, the revised scale will generate more rigorous evidence for collaborative practice in psychiatry internationally.

Test-retest reliability and construct validity of the Helplessness, Hopelessness, and Haplessness Scale in patients with anxiety disorders.

PubMed

Vatan, Sevginar; Ertaş, Sedar; Lester, David

2011-04-01

In a sample of 100 Turkish psychiatric patients with diagnoses of anxiety disorders, Lester's Helplessness, Hopelessness, and Haplessness inventory had moderate estimates of internal consistency, test-retest reliability, and construct validity.

Homework Stress: Construct Validation of a Measure

ERIC Educational Resources Information Center

Katz, Idit; Buzukashvili, Tamara; Feingold, Liat

2012-01-01

This article presents 2 studies aimed at validating a measure of stress experienced by children and parents around the issue of homework, applying Benson's program of validation (Benson, 1998). Study 1 provides external validity of the measure by supporting hypothesized relations between stress around homework and students' and parents' positive…

Measuring Constructs in Family Science: How Can Item Response Theory Improve Precision and Validity?

PubMed Central

Gordon, Rachel A.

2014-01-01

This article provides family scientists with an understanding of contemporary measurement perspectives and the ways in which item response theory (IRT) can be used to develop measures with desired evidence of precision and validity for research uses. The article offers a nontechnical introduction to some key features of IRT, including its orientation toward locating items along an underlying dimension and toward estimating precision of measurement for persons with different levels of that same construct. It also offers a didactic example of how the approach can be used to refine conceptualization and operationalization of constructs in the family sciences, using data from the National Longitudinal Survey of Youth 1979 (n = 2,732). Three basic models are considered: (a) the Rasch and (b) two-parameter logistic models for dichotomous items and (c) the Rating Scale Model for multicategory items. Throughout, the author highlights the potential for researchers to elevate measurement to a level on par with theorizing and testing about relationships among constructs. PMID:25663714

[Validation of the Schizophrenia Quality Of Life Scale (SQLS) to Measure Quality of Life in Patients Diagnosed With Schizophrenia in Colombia].

PubMed

Suárez, María Fernanda; Sánchez, Ricardo; Calvo, José Manuel

2013-09-01

To validate the SQLS scale in Colombian patients diagnosed with schizophrenia. The self-report scale was applied to 251 patients. Measures of test-retest reliability, internal consistency and correlation inter-scales with the SF-12 were made by applying the scale 2 days later in 28 patients, and 30 days later in 38; 50 patients filled-out the SF-12 scale to determine the concurrent validity. Three domains were found with all of them having Cronbach's alphas >0.7. The three factors model did not show adequate fit indexes. Test-retest evaluation showed satisfactory correlation values (>0.86). Sensitivity to change did not shown significant differences between the repeated measures. As regards concurrent validity, acceptable correlation values were found only in SF-12 domains related to mental health and functioning. The SQLS has a factorial structure consistent with previous reports, adequate internal consistency and temporal stability. However, a more detailed examination of some of these items is required, considering that the measurement of the construct does not appear to be adequate. Copyright © 2013 Asociación Colombiana de Psiquiatría. Publicado por Elsevier España. All rights reserved.

The Development and Validation of the Client Expectations of Massage Scale

PubMed Central

Boulanger, Karen T.; Campo, Shelly; Glanville, Jennifer L.; Lowe, John B; Yang, Jingzhen

2012-01-01

Background: Although there is evidence that client expectations influence client outcomes, a valid and reliable scale for measuring the range of client expectations for both massage therapy and the behaviors of their massage therapists does not exist. Understanding how client expectations influence client outcomes would provide insight into how massage achieves its reported effects. Purpose: To develop and validate the Client Expectations of Massage Scale (CEMS), a measure of clients’ clinical, educational, interpersonal, and outcome expectations. Setting: Offices of licensed massage therapists in Iowa. Research Design: A practice-based research methodology was used to collect data from two samples of massage therapy clients. For Sample 1, 21 volunteer massage therapists collected data from their clients before the massage. Factor analysis was conducted to test construct validity and coefficient alpha was used to assess reliability. Correlational analyses with the CEMS, previous measures of client expectations, and the Life Orientation Test–Revised were examined to test the convergent and discriminant validity of the CEMS. For Sample 2, 24 massage therapists distributed study materials for clients to complete before and after a massage therapy session. Structural equation modeling was used to assess the construct, discriminant, and predictive validity of the CEMS. Participants: Sample 1 involved 320 and Sample 2 involved 321 adult massage clients. Intervention: Standard care provided by licensed massage therapists. Main Outcomes: Numeric Rating Scale for pain and Positive and Negative Affect Schedule–Revised (including the Serenity subscale). Results: The CEMS demonstrated good construct, convergent, discriminant and predictive validity, and adequate reliability. Client expectations were generally positive toward massage and their massage therapists. Positive outcome expectations had a positive effect on clients’ changes in pain and serenity. High

The development and validation of the client expectations of massage scale.

PubMed

Boulanger, Karen T; Campo, Shelly; Glanville, Jennifer L; Lowe, John B; Yang, Jingzhen

2012-01-01

Although there is evidence that client expectations influence client outcomes, a valid and reliable scale for measuring the range of client expectations for both massage therapy and the behaviors of their massage therapists does not exist. Understanding how client expectations influence client outcomes would provide insight into how massage achieves its reported effects. To develop and validate the Client Expectations of Massage Scale (CEMS), a measure of clients' clinical, educational, interpersonal, and outcome expectations. Offices of licensed massage therapists in Iowa. A practice-based research methodology was used to collect data from two samples of massage therapy clients. For Sample 1, 21 volunteer massage therapists collected data from their clients before the massage. Factor analysis was conducted to test construct validity and coefficient alpha was used to assess reliability. Correlational analyses with the CEMS, previous measures of client expectations, and the Life Orientation Test-Revised were examined to test the convergent and discriminant validity of the CEMS. For Sample 2, 24 massage therapists distributed study materials for clients to complete before and after a massage therapy session. Structural equation modeling was used to assess the construct, discriminant, and predictive validity of the CEMS. Sample 1 involved 320 and Sample 2 involved 321 adult massage clients. Standard care provided by licensed massage therapists. Numeric Rating Scale for pain and Positive and Negative Affect Schedule-Revised (including the Serenity subscale). The CEMS demonstrated good construct, convergent, discriminant and predictive validity, and adequate reliability. Client expectations were generally positive toward massage and their massage therapists. Positive outcome expectations had a positive effect on clients' changes in pain and serenity. High interpersonal expectations had a negative effect on clients' changes in serenity. Client expectations contribute to

7 CFR 3017.900 - Adequate evidence.

Code of Federal Regulations, 2010 CFR

2010-01-01

... 7 Agriculture 15 2010-01-01 2010-01-01 false Adequate evidence. 3017.900 Section 3017.900 Agriculture Regulations of the Department of Agriculture (Continued) OFFICE OF THE CHIEF FINANCIAL OFFICER... Adequate evidence. Adequate evidence means information sufficient to support the reasonable belief that a...

Assessing working memory in children with ADHD: Minor administration and scoring changes may improve digit span backward's construct validity.

PubMed

Wells, Erica L; Kofler, Michael J; Soto, Elia F; Schaefer, Hillary S; Sarver, Dustin E

2018-01-01

Pediatric ADHD is associated with impairments in working memory, but these deficits often go undetected when using clinic-based tests such as digit span backward. The current study pilot-tested minor administration/scoring modifications to improve digit span backward's construct and predictive validities in a well-characterized sample of children with ADHD. WISC-IV digit span was modified to administer all trials (i.e., ignore discontinue rule) and count digits rather than trials correct. Traditional and modified scores were compared to a battery of criterion working memory (construct validity) and academic achievement tests (predictive validity) for 34 children with ADHD ages 8-13 (M=10.41; 11 girls). Traditional digit span backward scores failed to predict working memory or KTEA-2 achievement (allns). Alternate administration/scoring of digit span backward significantly improved its associations with working memory reordering (r=.58), working memory dual-processing (r=.53), working memory updating (r=.28), and KTEA-2 achievement (r=.49). Consistent with prior work, these findings urge caution when interpreting digit span performance. Minor test modifications may address test validity concerns, and should be considered in future test revisions. Digit span backward becomes a valid measure of working memory at exactly the point that testing is traditionally discontinued. Copyright © 2017 Elsevier Ltd. All rights reserved.

Construct validity of the PROMIS® sexual function and satisfaction measures in patients with cancer

PubMed Central

2013-01-01

Background With data from a diverse sample of patients either in treatment for cancer or post-treatment for cancer, we examine inter-domain and cross-domain correlations among the core domains of the Patient-Reported Outcomes Measurement Information System Sexual Function and Satisfaction measures (PROMIS® SexFS) and the corresponding domains from conceptually-similar measures of sexual function, the International Index of Erectile Function and the Female Sexual Function Index. Findings Men (N=389) and women (N=430) were recruited from a tumor registry, oncology clinics, and an internet panel. The PROMIS SexFS, International Index of Erectile Function, and Female Sexual Function Index were used to collect participants’ self-reported sexual function. The domains shared among the measures include desire/interest in sexual activity, lubrication and vaginal discomfort/pain (women), erectile function (men), orgasm, and satisfaction. We examined correlations among different domains within the same instrument (discriminant validity) and correlations among similar domains measured by different instruments (convergent validity). Correlations demonstrating discriminant validity ranged from 0.38 to 0.73 for men and 0.48 to 0.74 for women, while correlations demonstrating convergent validity ranged from 0.62 to 0.83 for men and 0.71 to 0.92 for women. As expected, correlations demonstrating convergent validity were higher than correlations demonstrating discriminant validity, with one exception (orgasm for men). Conclusions Construct validity was supported by convergent and discriminant validity in a diverse sample of patients with cancer. For patients with cancer who may or may not have sexual dysfunction, the PROMIS SexFS measures provide a comprehensive assessment of key domains of sexual function and satisfaction. PMID:23497200

A Critical Evaluation of the Validity and the Reliability of Global Competency Constructs for Supervisor Assessment of Junior Medical Trainees

ERIC Educational Resources Information Center

McGill, D. A.; van der Vleuten, C. P. M.; Clarke, M. J.

2013-01-01

Supervisor assessments are critical for both formative and summative assessment in the workplace. Supervisor ratings remain an important source of such assessment in many educational jurisdictions even though there is ambiguity about their validity and reliability. The aims of this evaluation is to explore the: (1) construct validity of ward-based…

Construct validity of functional capacity tests in healthy workers

PubMed Central

2013-01-01

Background Functional Capacity (FC) is a multidimensional construct within the activity domain of the International Classification of Functioning, Disability and Health framework (ICF). Functional capacity evaluations (FCEs) are assessments of work-related FC. The extent to which these work-related FC tests are associated to bio-, psycho-, or social factors is unknown. The aims of this study were to test relationships between FC tests and other ICF factors in a sample of healthy workers, and to determine the amount of statistical variance in FC tests that can be explained by these factors. Methods A cross sectional study. The sample was comprised of 403 healthy workers who completed material handling FC tests (lifting low, overhead lifting, and carrying) and static work FC tests (overhead working and standing forward bend). The explainable variables were; six muscle strength tests; aerobic capacity test; and questionnaires regarding personal factors (age, gender, body height, body weight, and education), psychological factors (mental health, vitality, and general health perceptions), and social factors (perception of work, physical workloads, sport-, leisure time-, and work-index). A priori construct validity hypotheses were formulated and analyzed by means of correlation coefficients and regression analyses. Results Moderate correlations were detected between material handling FC tests and muscle strength, gender, body weight, and body height. As for static work FC tests; overhead working correlated fair with aerobic capacity and handgrip strength, and low with the sport-index and perception of work. For standing forward bend FC test, all hypotheses were rejected. The regression model revealed that 61% to 62% of material handling FC tests were explained by physical factors. Five to 15% of static work FC tests were explained by physical and social factors. Conclusions The current study revealed that, in a sample of healthy workers, material handling FC tests were

29 CFR 98.900 - Adequate evidence.

Code of Federal Regulations, 2012 CFR

2012-07-01

... 29 Labor 1 2012-07-01 2012-07-01 false Adequate evidence. 98.900 Section 98.900 Labor Office of the Secretary of Labor GOVERNMENTWIDE DEBARMENT AND SUSPENSION (NONPROCUREMENT) Definitions § 98.900 Adequate evidence. Adequate evidence means information sufficient to support the reasonable belief that a...

29 CFR 98.900 - Adequate evidence.

Code of Federal Regulations, 2011 CFR

2011-07-01

... 29 Labor 1 2011-07-01 2011-07-01 false Adequate evidence. 98.900 Section 98.900 Labor Office of the Secretary of Labor GOVERNMENTWIDE DEBARMENT AND SUSPENSION (NONPROCUREMENT) Definitions § 98.900 Adequate evidence. Adequate evidence means information sufficient to support the reasonable belief that a...

29 CFR 98.900 - Adequate evidence.

Code of Federal Regulations, 2013 CFR

2013-07-01

... 29 Labor 1 2013-07-01 2013-07-01 false Adequate evidence. 98.900 Section 98.900 Labor Office of the Secretary of Labor GOVERNMENTWIDE DEBARMENT AND SUSPENSION (NONPROCUREMENT) Definitions § 98.900 Adequate evidence. Adequate evidence means information sufficient to support the reasonable belief that a...

The LEAP™ Gesture Interface Device and Take-Home Laparoscopic Simulators: A Study of Construct and Concurrent Validity.

PubMed

Partridge, Roland W; Brown, Fraser S; Brennan, Paul M; Hennessey, Iain A M; Hughes, Mark A

2016-02-01

To assess the potential of the LEAP™ infrared motion tracking device to map laparoscopic instrument movement in a simulated environment. Simulator training is optimized when augmented by objective performance feedback. We explore the potential LEAP has to provide this in a way compatible with affordable take-home simulators. LEAP and the previously validated InsTrac visual tracking tool mapped expert and novice performances of a standardized simulated laparoscopic task. Ability to distinguish between the 2 groups (construct validity) and correlation between techniques (concurrent validity) were the primary outcome measures. Forty-three expert and 38 novice performances demonstrated significant differences in LEAP-derived metrics for instrument path distance (P < .001), speed (P = .002), acceleration (P < .001), motion smoothness (P < .001), and distance between the instruments (P = .019). Only instrument path distance demonstrated a correlation between LEAP and InsTrac tracking methods (novices: r = .663, P < .001; experts: r = .536, P < .001). Consistency of LEAP tracking was poor (average % time hands not tracked: 31.9%). The LEAP motion device is able to track the movement of hands using instruments in a laparoscopic box simulator. Construct validity is demonstrated by its ability to distinguish novice from expert performances. Only time and instrument path distance demonstrated concurrent validity with an existing tracking method however. A number of limitations to the tracking method used by LEAP have been identified. These need to be addressed before it can be considered an alternative to visual tracking for the delivery of objective performance metrics in take-home laparoscopic simulators. © The Author(s) 2015.

The Use of Variants of the Trail Making Test in Serial Assessment: A Construct Validity Study

ERIC Educational Resources Information Center

Atkinson, Thomas M.; Ryan, Jeanne P.

2008-01-01

The construct validity of three variants of the Trail Making Test was investigated using 162 undergraduate psychology students. During a 3-week period, the Trail Making Test of the Delis-Kaplan Executive Function System, Comprehensive Trail Making Test, and Connections Task were administered in six possible orders. Using confirmatory factor…

Construction and Validation of an Instrument to Measure Taiwanese Elementary Students' Attitudes toward Their Science Class

ERIC Educational Resources Information Center

Wang, Tzu-Ling; Berlin, Donna

2010-01-01

The main purpose of this study is to develop a valid and reliable instrument for measuring the "attitudes toward science class" of fourth- and fifth-grade students in an Asian school culture. Specifically, the development focused on three science attitude constructs--science enjoyment, science confidence, and importance of science as…

Validity of a Competing Food Choice Construct regarding Fruit and Vegetable Consumption among Urban College Freshmen

ERIC Educational Resources Information Center

Yeh, Ming-Chin; Matsumori, Brandy; Obenchain, Janel; Viladrich, Anahi; Das, Dhiman; Navder, Khursheed

2010-01-01

Objective: This paper presents the reliability and validity of a "competing food choice" construct designed to assess whether factors related to consumption of less-healthful food were perceived to be barriers to fruit and vegetable consumption in college freshmen. Design: Cross-sectional, self-administered survey. Setting: An urban public college…

Evaluating construct validity of the second version of the Copenhagen Psychosocial Questionnaire through analysis of differential item functioning and differential item effect.

PubMed

Bjorner, Jakob Bue; Pejtersen, Jan Hyld

2010-02-01

To evaluate the construct validity of the Copenhagen Psychosocial Questionnaire II (COPSOQ II) by means of tests for differential item functioning (DIF) and differential item effect (DIE). We used a Danish general population postal survey (n = 4,732 with 3,517 wage earners) with a one-year register based follow up for long-term sickness absence. DIF was evaluated against age, gender, education, social class, public/private sector employment, and job type using ordinal logistic regression. DIE was evaluated against job satisfaction and self-rated health (using ordinal logistic regression), against depressive symptoms, burnout, and stress (using multiple linear regression), and against long-term sick leave (using a proportional hazards model). We used a cross-validation approach to counter the risk of significant results due to multiple testing. Out of 1,052 tests, we found 599 significant instances of DIF/DIE, 69 of which showed both practical and statistical significance across two independent samples. Most DIF occurred for job type (in 20 cases), while we found little DIF for age, gender, education, social class and sector. DIE seemed to pertain to particular items, which showed DIE in the same direction for several outcome variables. The results allowed a preliminary identification of items that have a positive impact on construct validity and items that have negative impact on construct validity. These results can be used to develop better shortform measures and to improve the conceptual framework, items and scales of the COPSOQ II. We conclude that tests of DIF and DIE are useful for evaluating construct validity.

2 CFR 180.900 - Adequate evidence.

Code of Federal Regulations, 2013 CFR

2013-01-01

... 2 Grants and Agreements 1 2013-01-01 2013-01-01 false Adequate evidence. 180.900 Section 180.900 Grants and Agreements Office of Management and Budget Guidance for Grants and Agreements OFFICE OF... Adequate evidence. Adequate evidence means information sufficient to support the reasonable belief that a...

2 CFR 180.900 - Adequate evidence.

Code of Federal Regulations, 2012 CFR

2012-01-01

... 2 Grants and Agreements 1 2012-01-01 2012-01-01 false Adequate evidence. 180.900 Section 180.900 Grants and Agreements Office of Management and Budget Guidance for Grants and Agreements OFFICE OF... Adequate evidence. Adequate evidence means information sufficient to support the reasonable belief that a...

Construction, internal validation and implementation in a mobile application of a scoring system to predict nonadherence to proton pump inhibitors.

PubMed

Mares-García, Emma; Palazón-Bru, Antonio; Folgado-de la Rosa, David Manuel; Pereira-Expósito, Avelino; Martínez-Martín, Álvaro; Cortés-Castell, Ernesto; Gil-Guillén, Vicente Francisco

2017-01-01

Other studies have assessed nonadherence to proton pump inhibitors (PPIs), but none has developed a screening test for its detection. To construct and internally validate a predictive model for nonadherence to PPIs. This prospective observational study with a one-month follow-up was carried out in 2013 in Spain, and included 302 patients with a prescription for PPIs. The primary variable was nonadherence to PPIs (pill count). Secondary variables were gender, age, antidepressants, type of PPI, non-guideline-recommended prescription (NGRP) of PPIs, and total number of drugs. With the secondary variables, a binary logistic regression model to predict nonadherence was constructed and adapted to a points system. The ROC curve, with its area (AUC), was calculated and the optimal cut-off point was established. The points system was internally validated through 1,000 bootstrap samples and implemented in a mobile application (Android). The points system had three prognostic variables: total number of drugs, NGRP of PPIs, and antidepressants. The AUC was 0.87 (95% CI [0.83-0.91], p  < 0.001). The test yielded a sensitivity of 0.80 (95% CI [0.70-0.87]) and a specificity of 0.82 (95% CI [0.76-0.87]). The three parameters were very similar in the bootstrap validation. A points system to predict nonadherence to PPIs has been constructed, internally validated and implemented in a mobile application. Provided similar results are obtained in external validation studies, we will have a screening tool to detect nonadherence to PPIs.

Psychometric Validation of the Academic Motivation Scale in a Dental Student Sample.

PubMed

Orsini, Cesar; Binnie, Vivian; Evans, Phillip; Ledezma, Priscilla; Fuentes, Fernando; Villegas, Maria J

2015-08-01

The Academic Motivation Scale is one of the most frequently used instruments to assess academic motivation. It relies on the self-determination theory of human motivation. However, motivation has been understudied in dental education. Therefore, to address the lack of valid instruments to assess academic motivation in dental education and contribute to future research in the field, the aim of this study was to analyze the psychometric properties of this instrument in a sample of dental students. Participants were 989 Chilean undergraduate dental students (86% response rate) who completed a survey containing a Chilean face-valid version of the Spanish Academic Motivation Scale and three other motivation-related instruments to assess the survey's construct and criterion validity. Later, 76 of the students (out of 100 invited) took the survey again to assess its test-retest stability. The instrument's construct validity was supported by the superior goodness of fit of the seven-subscale Academic Motivation Scale over competing models through confirmatory factor analysis and by the expected correlations among its subscales. The concurrent criterion validity was supported by the confirmation of correlations between its subscales and external criteria. Adequate internal consistency and test-retest correlations were also found. The evidence from this study suggests that the Academic Motivation Scale is a preliminarily valid and reliable instrument to assess motivation in the predoctoral dental context. Future research in this area is needed to confirm or refute these results.

Construct validity of the Chinese version of the Self-care of Heart Failure Index determined using structural equation modeling.

PubMed

Kang, Xiaofeng; Dennison Himmelfarb, Cheryl R; Li, Zheng; Zhang, Jian; Lv, Rong; Guo, Jinyu

2015-01-01

The Self-care of Heart Failure Index (SCHFI) is an empirically tested instrument for measuring the self-care of patients with heart failure. The aim of this study was to develop a simplified Chinese version of the SCHFI and provide evidence for its construct validity. A total of 182 Chinese with heart failure were surveyed. A 2-step structural equation modeling procedure was applied to test construct validity. Factor analysis showed 3 factors explaining 43% of the variance. Structural equation model confirmed that self-care maintenance, self-care management, and self-care confidence are indeed indicators of self-care, and self-care confidence was a positive and equally strong predictor of self-care maintenance and self-care management. Moreover, self-care scores were correlated with the Partners in Health Scale, indicating satisfactory concurrent validity. The Chinese version of the SCHFI is a theory-based instrument for assessing self-care of Chinese patients with heart failure.

Measuring health-promoting behaviors: cross-cultural validation of the Health-Promoting Lifestyle Profile-II.

PubMed

Sousa, Pedro; Gaspar, Pedro; Vaz, Daniela C; Gonzaga, Sílvia; Dixe, M Anjos

2015-04-01

Individual lifestyles have emerged as valuable health constructs. This study aims to psychometrically test the Portuguese (European) version of the Health-Promoting Lifestyle Profile-II. After an adequate linguistic and cultural adaptation of the Health-Promoting Lifestyle Profile-II scale, their psychometric properties were assessed (N = 889) by Cronbach's alpha and confirmatory factor analysis. Results showed an adequate fit to a 52-item, six-factor structure. A global alpha of .925 was obtained. The Portuguese version demonstrated good validity and reliability in a wide adult sample, and can thus be applied to the Portuguese population. This instrument is useful as an evaluation tool for health-promoting lifestyles and as an instrument for testing the effectiveness of health-promoting programs. © 2014 NANDA International, Inc.

Measurement of Spatial Ability: Construction and Validation of the Spatial Reasoning Instrument for Middle School Students

ERIC Educational Resources Information Center

Ramful, Ajay; Lowrie, Thomas; Logan, Tracy

2017-01-01

This article describes the development and validation of a newly designed instrument for measuring the spatial ability of middle school students (11-13 years old). The design of the Spatial Reasoning Instrument (SRI) is based on three constructs (mental rotation, spatial orientation, and spatial visualization) and is aligned to the type of spatial…

Construction and Validation of the Career and Educational Decision Self-Efficacy Inventory for Secondary Students (CEDSIS)

ERIC Educational Resources Information Center

Ho, Esther Sui Chu; Sum, Kwok Wing

2018-01-01

This study aims to construct and validate the Career and Educational Decision Self-Efficacy Inventory for Secondary Students (CEDSIS) by using a sample of 2,631 students in Hong Kong. Principal component analysis yielded a three-factor structure, which demonstrated good model fit in confirmatory factor analysis. High reliability was found for the…

Drive: Theory and Construct Validation

PubMed Central

Petrides, K. V.

2016-01-01

This article explicates the theory of drive and describes the development and validation of two measures. A representative set of drive facets was derived from an extensive corpus of human attributes (Study 1). Operationalised using an International Personality Item Pool version (the Drive:IPIP), a three-factor model was extracted from the facets in two samples and confirmed on a third sample (Study 2). The multi-item IPIP measure showed congruence with a short form, based on single-item ratings of the facets, and both demonstrated cross-informant reliability. Evidence also supported the measures’ convergent, discriminant, concurrent, and incremental validity (Study 3). Based on very promising findings, the authors hope to initiate a stream of research in what is argued to be a rather neglected niche of individual differences and non-cognitive assessment. PMID:27409773

[Criterion and Construct Validity in Nursing Diagnosis "Sedentary Lifestyle" in People over 50 Years Old].

PubMed

Guirao-Goris, Silamani J; Ferrer Ferrandis, Esperanza; Montejano Lozoya, Raimunda

2016-02-18

The aim of the study is to identify the construct and criterion validity of the nursing diagnosis label Sedentary Lifestyle. A cross-sectional study in a nursing consultation in primary health care was conducted. Participants were all people that was attended for one year over 50 who voluntarily wish to participate (n=85) in the study. Objective weekly physical activity was measured in METs with an Accelerometer, objective measure of performance was measured by gait speed EPESE Battery (both measures that were used as the gold standard), and physical activity questionnaires (RAPA), the COOP-WONCA physical fitness chart. Spearman correlation coefficients, mean comparison tests and analysis of sensitivity and specificity were used as statistical analysis. The diagnosis "Sedentary Lifestyle" showed a positive correlation between its manifestations and physical activity measured in METs (r=0.39) and EPESE gait speed (r=0.35). The diagnosis showed a sensitivity of 85.1% and a specificity of 65.2% and showed ability to discriminate active people from those that are not using METs as a measure of physical activity (t=-4.4). The diagnosis "Sedentary Lifestyle" shows criterion and construct validity.

Construct and Criterion Validity of the PedsQL™ 4.0 Instrument (Pediatric Quality of Life Inventory) in Colombia.

PubMed

Amaya-Arias, Ana Carolina; Alzate, Juan Pablo; Eslava-Schmalbach, Javier H

2017-01-01

This study aimed at determining the validity of the Pediatric Quality of Life Inventory 4.0 (PedsQL™ 4.0) for the measurement of health-related quality of life (HRQOL) in Colombian children. Validation study of measurement instruments. The PedsQL™ 4.0 was applied by convenience sampling to 375 pairs of children and adolescents between the ages of 5 and 17 and to their parents-caregivers, as well as to 125 parents-caregivers of children between the ages of 2 and 4 in five cities of Colombia (Bogota, Medellin, Cali, Barranquilla and Bucaramanga). Construct validity was assessed through the use of exploratory and confirmatory factor analysis, and criterion validity was assessed by correlations between the PedsQL™ 4.0 and the KIDSCREEN-27. The instrument was applied to 375 children (ages 5-18) and 125 parents of children between the ages of 2 and 4. Factor analysis revealed four factors considered suitable for the sample in both the child and parent reports, whereas Bartlett's test of sphericity showed inter-correlation between variables. Scale and subscales showed proper indicators of internal consistency. It is recommended not to include or review some of the items in the Colombian version of the scale. The Spanish version for Colombia of the PedsQL™ 4.0 displays suitable indicators of criterion and construct validity, therefore becoming a valuable tool for measuring HRQOL in children in our country. Some modifications are recommended for the Colombian version of the scale.

Content validity of the DSM-IV borderline and narcissistic personality disorder criteria sets.

PubMed

Blais, M A; Hilsenroth, M J; Castlebury, F D

1997-01-01

This study sought to empirically evaluate the content validity of the newly revised DSM-IV narcissistic personality disorder (NPD) and borderline personality disorder (BPD) criteria sets. Using the essential features of each disorder as construct definitions, factor analysis was used to determine how adequately the criteria sets covered the constructs. In addition, this empirical investigation sought to: 1) help define the dimensions underlying these polythetic disorders; 2) identify core features of each diagnosis; and 3) highlight the characteristics that may be most useful in diagnosing these two disorders. Ninety-one outpatients meeting DSM-IV criteria for a personality disorder (PD) were identified through a retrospective analysis of chart information. Records of these 91 patients were independently rated on all of the BPD and NPD symptom criteria for the DSM-IV. Acceptable interrater reliability (kappa estimates) was obtained for both presence or absence of a PD and symptom criteria for BPD and NPD. The factor analysis, performed separately for each disorder, identified a three-factor solution for both the DSM-IV BPD and NPD criteria sets. The results of this study provide strong support for the content validity of the NPD criteria set and moderate support for the content validly of the BPD criteria set. Three domains were found to comprise the BPD criteria set, with the essential features of interpersonal and identity instability forming one domain, and impulsivity and affective instability each identified as separate domains. Factor analysis of the NPD criteria set found three factors basically corresponding to the essential features of grandiosity, lack of empathy, and need for admiration. Therefore, the NPD criteria set adequately covers the essential or defining features of the disorder.

A Multitrait-Multimethod Analysis of the Construct Validity of Child Anxiety Disorders in a Clinical Sample

ERIC Educational Resources Information Center

Langer, David A.; Wood, Jeffrey J.; Bergman, R. Lindsey; Piacentini, John C.

2010-01-01

The present study examines the construct validity of separation anxiety disorder (SAD), social phobia (SoP), panic disorder (PD), and generalized anxiety disorder (GAD) in a clinical sample of children. Participants were 174 children, 6 to 17 years old (94 boys) who had undergone a diagnostic evaluation at a university hospital based clinic.…

Construct Validation of the Translated Version of the Work-Family Conflict Scale for Use in Korea

ERIC Educational Resources Information Center

Lim, Doo Hun; Morris, Michael Lane; McMillan, Heather S.

2011-01-01

Recently, the stress of work-family conflict has been a critical workplace issue for Asian countries, especially within those cultures experiencing rapid economic development. Our research purpose is to translate and establish construct validity of a Korean-language version of the Multi-Dimensional Work-Family Conflict (WFC) scale used in the U.S.…

Do Smokers Know What We're Talking about? The Construct Validity of Nicotine Dependence Questionnaire Measures

ERIC Educational Resources Information Center

Japuntich, Sandra J.; Piper, Megan E.; Schlam, Tanya R.; Bolt, Daniel M.; Baker, Timothy B.

2009-01-01

Few studies have examined whether nicotine dependence self-report questionnaires can predict specific behaviors and symptoms at specific points in time. The present study used data from a randomized clinical trial (N = 608; M. E. Piper et al., 2007) to assess the construct validity of scales and items from 3 nicotine dependence measures: the…

Exploring the construct validity of the social cognition and object relations scale in a clinical sample.

PubMed

Stein, Michelle B; Slavin-Mulford, Jenelle; Sinclair, S Justin; Siefert, Caleb J; Blais, Mark A

2012-01-01

The Social Cognition and Object Relations Scale-Global rating method (SCORS-G; Stein, Hilsenroth, Slavin-Mulford, & Pinsker, 2011; Westen, 1995) measures the quality of object relations in narrative material. This study employed a multimethod approach to explore the structure and construct validity of the SCORS-G. The Thematic Apperception Test (TAT; Murray, 1943) was administered to 59 patients referred for psychological assessment at a large Northeastern U.S. hospital. The resulting 301 TAT narratives were rated using the SCORS-G method. The 8 SCORS variables were found to have high interrater reliability and good internal consistency. Principal components analysis revealed a 3-component solution with components tapping emotions/affect regulation in relationships, self-image, and aspects of cognition. Next, the construct validity of the SCORS-G components was explored using measures of intellectual and executive functioning, psychopathology, and normal personality. The 3 SCORS-G components showed unique and theoretically meaningful relationships across these broad and diverse psychological measures. This study demonstrates the value of using a standardized scoring method, like the SCORS-G, to reveal the rich and complex nature of narrative material.

Motivation and Engagement across the Academic Life Span: A Developmental Construct Validity Study of Elementary School, High School, and University/College Students

ERIC Educational Resources Information Center

Martin, Andrew J.

2009-01-01

From a developmental construct validity perspective, this study examines motivation and engagement across elementary school, high school, and university/college, with particular focus on the Motivation and Engagement Scale (comprising adaptive, impeding/maladaptive, and maladaptive factors). Findings demonstrated developmental construct validity…

The Construction and Initial Validation of the "Student Teachers' Efficacy Scale for Teaching Students with Disabilities"

ERIC Educational Resources Information Center

Zhang, Dake; Wang, Qiu; Stegall, Joanna; Losinki, Mickey; Katsiyannis, Antonis

2018-01-01

Although there have been numerous instruments for assessing teacher efficacy in teaching general education students, there is a need to develop and validate an instrument that specifically assesses teachers' efficacy in teaching students with disabilities. This study constructed and evaluated the psychometric properties of the "Student…

A Meta-Analytic Examination of the Construct Validity of the Michigan Organizational Assessment Questionnaire Job Satisfaction Subscale

ERIC Educational Resources Information Center

Bowling, Nathan A.; Hammond, Gregory D.

2008-01-01

Although several different measures have been developed to assess job satisfaction, large-scale examinations of the psychometric properties of most satisfaction scales are generally lacking. In the current study we used meta-analysis to examine the construct validity of the Michigan Organizational Assessment Questionnaire Job Satisfaction Subscale…

An Integrative Analysis of the Narcissistic Personality Inventory and the Hypomanic Personality Scale: Implications for Construct Validity.

PubMed

Stanton, Kasey; Daly, Elizabeth; Stasik-O'Brien, Sara M; Ellickson-Larew, Stephanie; Clark, Lee Anna; Watson, David

2017-09-01

The primary goal of this study was to explicate the construct validity of the Narcissistic Personality Inventory (NPI) and the Hypomanic Personality Scale (HPS) by examining their relations both to each other and to measures of personality and psychopathology in a community sample ( N = 255). Structural evidence indicates that the NPI is defined by Leadership/Authority, Grandiose Exhibitionism, and Entitlement/Exploitativeness factors, whereas the HPS is characterized by specific dimensions reflecting Social Vitality, Mood Volatility, and Excitement. Our results establish that (a) factor-based subscales from these instruments display divergent patterns of relations that are obscured when relying exclusively on total scores and (b) some NPI and HPS subscales more clearly tap content specifically relevant to narcissism and mania, respectively, than others. In particular, our findings challenge the construct validity of the NPI Leadership/Authority and HPS Social Vitality subscales, which appear to assess overlapping assertiveness content that is largely adaptive in nature.

Development and validation of the Survey of Organizational Research Climate (SORC).

PubMed

Martinson, Brian C; Thrush, Carol R; Lauren Crain, A

2013-09-01

Development and targeting efforts by academic organizations to effectively promote research integrity can be enhanced if they are able to collect reliable data to benchmark baseline conditions, to assess areas needing improvement, and to subsequently assess the impact of specific initiatives. To date, no standardized and validated tool has existed to serve this need. A web- and mail-based survey was administered in the second half of 2009 to 2,837 randomly selected biomedical and social science faculty and postdoctoral fellows at 40 academic health centers in top-tier research universities in the United States. Measures included the Survey of Organizational Research Climate (SORC) as well as measures of perceptions of organizational justice. Exploratory and confirmatory factor analyses yielded seven subscales of organizational research climate, all of which demonstrated acceptable internal consistency (Cronbach's α ranging from 0.81 to 0.87) and adequate test-retest reliability (Pearson r ranging from 0.72 to 0.83). A broad range of correlations between the seven subscales and five measures of organizational justice (unadjusted regression coefficients ranging from 0.13 to 0.95) document both construct and discriminant validity of the instrument. The SORC demonstrates good internal (alpha) and external reliability (test-retest) as well as both construct and discriminant validity.

Development and Validation of the Survey of Organizational Research Climate (SORC)

PubMed Central

Martinson, Brian C.; Thrush, Carol R.; Crain, A. Lauren

2012-01-01

Background Development and targeting efforts by academic organizations to effectively promote research integrity can be enhanced if they are able to collect reliable data to benchmark baseline conditions, to assess areas needing improvement, and to subsequently assess the impact of specific initiatives. To date, no standardized and validated tool has existed to serve this need. Methods A web- and mail-based survey was administered in the second half of 2009 to 2,837 randomly selected biomedical and social science faculty and postdoctoral fellows at 40 academic health centers in top-tier research universities in the United States. Measures included the Survey of Organizational Research Climate (SORC) as well as measures of perceptions of organizational justice. Results Exploratory and confirmatory factor analyses yielded seven subscales of organizational research climate, all of which demonstrated acceptable internal consistency (Cronbach’s α ranging from 0.81 to 0.87) and adequate test-retest reliability (Pearson r ranging from 0.72 to 0.83). A broad range of correlations between the seven subscales and five measures of organizational justice (unadjusted regression coefficients ranging from .13 to .95) document both construct and discriminant validity of the instrument. Conclusions The SORC demonstrates good internal (alpha) and external reliability (test-retest) as well as both construct and discriminant validity. PMID:23096775

All Validity Is Construct Validity. Or Is It?

ERIC Educational Resources Information Center

Kane, Michael

2012-01-01

Paul E. Newton's article on the consensus definition of validity tackles a number of big issues and makes a number of strong claims. I agreed with much of what he said, and I disagreed with a number of his claims, but I found his article to be consistently interesting and thought provoking (whether I agreed or not). I will focus on three general…

Construct validity evidence for the Male Role Norms Inventory-Short Form: A structural equation modeling approach using the bifactor model.

PubMed

Levant, Ronald F; Hall, Rosalie J; Weigold, Ingrid K; McCurdy, Eric R

2016-10-01

The construct validity of the Male Role Norms Inventory-Short Form (MRNI-SF) was assessed using a latent variable approach implemented with structural equation modeling (SEM). The MRNI-SF was specified as having a bifactor structure, and validation scales were also specified as latent variables. The latent variable approach had the advantages of separating effects of general and specific factors and controlling for some sources of measurement error. Data (N = 484) were from a diverse sample (38.8% men of color, 22.3% men of diverse sexualities) of community-dwelling and college men who responded to an online survey. The construct validity of the MRNI-SF General Traditional Masculinity Ideology factor was supported for all 4 of the proposed latent correlations with: (a) Male Role Attitudes Scale; (b) general factor of Conformity to Masculine Norms Inventory-46; (c) higher-order factor of Gender Role Conflict Scale; and (d) Personal Attributes Questionnaire-Masculinity Scale. Significant correlations with relevant other latent factors provided concurrent validity evidence for the MRNI-SF specific factors of Negativity toward Sexual Minorities, Importance of Sex, Restrictive Emotionality, and Toughness, with all 8 of the hypothesized relationships supported. However, 3 relationships concerning Dominance were not supported. (The construct validity of the remaining 2 MRNI-SF specific factors-Avoidance of Femininity and Self-Reliance through Mechanical Skills was not assessed.) Comparisons were made, and meaningful differences noted, between the latent correlations emphasized in this study and their raw variable counterparts. Results are discussed in terms of the advantages of an SEM approach and the unique characteristics of the bifactor model. (PsycINFO Database Record (c) 2016 APA, all rights reserved).

Construct Validity of "e-rater"® in Scoring TOEFL® Essays. Research Report. ETS RR-07-21

ERIC Educational Resources Information Center

Attali, Yigal

2007-01-01

This study examined the construct validity of the "e-rater"® automated essay scoring engine as an alternative to human scoring in the context of TOEFL® essay writing. Analyses were based on a sample of students who repeated the TOEFL within a short time period. Two "e-rater" scores were investigated in this study, the first…

The Community College Survey of Men: An Initial Validation of the Instrument's Non-Cognitive Outcomes Construct

ERIC Educational Resources Information Center

Wood, J. \\Luke; Harris, Frank, III.

2013-01-01

The purpose of this manuscript is to discuss the utility of the Community College Survey of Men (CCSM[c]), an instrument designed to examine predictors of student success for men in community colleges. The authors highlight initial validation results from a recent pilot of the CCSM[c], with a focus on the non-cognitive outcomes construct employed…

The construction and validation of an instrument for the assessment of graduates of undergraduate nursing courses 1

PubMed Central

Vieira, Maria Aparecida; Ohara, Conceição Vieira da Silva; de Domenico, Edvane Birelo Lopes

2016-01-01

Abstract Objective: to construct an instrument for the assessment of graduates of undergraduate nursing courses and to validate this instrument through the consensus of specialists. Method: methodological study. In order to elaborate the instrument, documental analysis and a literature review were undertaken. Validation took place through use of the Delphi Conference, between September 2012 and September 2013, in which 36 specialists from Brazilian Nursing participated. In order to analyze reliability, the Cronbach alpha coefficient, the item/total correlation, and the Pearson correlation coefficient were calculated. Results: the instrument was constructed with the participation of specialist nurses representing all regions of Brazil, with experience in lecturing and research. The first Delphi round led to changes in the first instrument, which was restructured and submitted to another round, with a response rate of 94.44%. In the second round, the instrument was validated with a Cronbach alpha of 0.75. Conclusion: the final instrument possessed three dimensions related to the characterization of the graduate, insertion in the job market, and evaluation of the professional training process. This instrument may be used across the territory of Brazil as it is based on the curricular guidelines and contributes to the process of regulation of the quality of the undergraduate courses in Nursing. PMID:27305184

Construct validity and reliability of a real-time multidimensional smartphone app to assess pain in children and adolescents with cancer.

PubMed

Stinson, Jennifer N; Jibb, Lindsay A; Nguyen, Cynthia; Nathan, Paul C; Maloney, Anne Marie; Dupuis, L Lee; Gerstle, J Ted; Hopyan, Sevan; Alman, Benjamin A; Strahlendorf, Caron; Portwine, Carol; Johnston, Donna L

2015-12-01

We evaluated the construct validity (including responsiveness), reliability, and feasibility of the Pain Squad multidimensional smartphone-based pain assessment application (app) in children and adolescents with cancer, using 2 descriptive studies with repeated measures. Participants (8-18 years) undergoing cancer treatment were drawn from 4 pediatric cancer centers. In study 1, 92 participants self-reported their level of pain twice daily for 2 weeks using the Pain Squad app to assess app construct validity and reliability. In study 2, 14 participants recorded their level of pain twice a day for 1 week before and 2 weeks after cancer-related surgery to determine app responsiveness. Participants in both studies completed multiple measures to determine the construct validity and feasibility of the Pain Squad app. Correlations between average weekly pain ratings on the Pain Squad app and recalled least, average, and worst weekly pain were moderate to high (0.43-0.68). Correlations with health-related quality of life and pain coping (measured with PedsQL Inventory 4.0, PedsQL Cancer Module, and Pain Coping Questionnaire) were -0.46 to 0.29. The app showed excellent internal consistency (α = 0.96). Pain ratings changed because of surgery with large effect sizes between baseline and the first week postsurgery (>0.85) and small effect sizes between baseline and the second week postsurgery (0.13-0.32). These findings provide evidence of the construct validity, reliability, and feasibility of the Pain Squad app in children and adolescents with cancer. Use of real-time data capture approaches should be considered in future studies of childhood cancer pain. A video accompanying this abstract is available online as Supplemental Digital Content at http://links.lww.com/PAIN/A169.

Validation of the Japanese version of the job crafting scale.

PubMed

Eguchi, Hisashi; Shimazu, Akihito; Bakker, Arnold B; Tims, Maria; Kamiyama, Kimika; Hara, Yujiro; Namba, Katsuyuki; Inoue, Akiomi; Ono, Masakatsu; Kawakami, Norito

2016-06-16

The aim of this study was to validate the Japanese version of the job crafting scale (JCS-J). JCS measures four independent job crafting dimensions, namely increasing structural job resources, decreasing hindering job demands, increasing social job resources, and increasing challenging job demands. The translated and back-translated JCS-J questionnaires were administered online to 972 employees of a Japanese manufacturing company. The data were then divided into independent explorative and confirmative samples. Exploratory and confirmatory factor analyses were performed to evaluate the factorial validity of JCS-J. The relationship with potential consequences of job crafting (e.g., job demands, job resources, and psychological well-being) was investigated to evaluate construct validity. Internal consistency was examined to evaluate the reliability of the four JCSs. An exploratory factor analysis extracted a five-factor solution. Decreasing hindering job demands was further split into two separate dimensions supporting a five- rather than four-factor structure. A series of confirmatory factor analyses revealed that the modified five-factor model that allows covariance between items fits the data best. Construct validity was generally supported by the expected correlations of each job crafting dimension with each corresponding job resource (+), job demand (+), and psychological well-being (+). Cronbach's α coefficient was sufficient for each of the four dimensions of job crafting (α ranged between 0.76 and 0.90). This study confirmed that JCS-J is an adequate measure of job crafting that can be used in the Japanese context.

Cross-cultural validation of the Children's Assessment of Participation and Enjoyment (CAPE) in Spain.

PubMed

Longo, E; Badia, M; Orgaz, B; Verdugo, M A

2014-03-01

Despite growing interest in the topic of participation, the construct has not yet been assessed in children and adolescents with and without cerebral palsy (CP) in Spain. As there are no available instruments to measure participation in leisure activities which have been adapted in this country, the goal of this study was to validate a Spanish version of the Children's Assessment of Participation and Enjoyment (CAPE). The sample comprised 199 children and adolescents with CP and 199 without CP, between 8 and 18 years of age, from seven regions in Spain. The adaptation of the original version of CAPE was carried out through translation and backward translation, and the validity of the instrument was analysed. Construct validity was assessed through the correlation of the diverse CAPE domains and the quality of life domains (KIDSCREEN questionnaire). Discriminant validity was established by comparing children and adolescents with CP and typically developing children and adolescents. For test-retest reliability, the children and adolescents with and without CP completed the CAPE questionnaire twice within 4 weeks. The correlations found between the CAPE domains and the quality of life domains show that the CAPE presents construct validity. The CAPE discriminated children and adolescents with CP from those without any disability in the results of participation. According to most CAPE domains, typically developing children and adolescents engage in a greater number of activities than children and adolescents with CP. Test-retest reliability for the Spanish version of CAPE was adequate. The study provides a valid instrument to assess the participation of children and adolescents with and without CP who live in Spain. © 2012 John Wiley & Sons Ltd.

Construct, Concurrent and Predictive Validity of the URICA: Data from Two Multi-site Clinical Trials

PubMed Central

Field, Craig A.; Adinoff, Bryon; Harris, T. Robert; Ball, Samuel A.; Carroll, Kathleen M.

2011-01-01

Background A better understanding of how to measure motivation to change and how it relates to behavior change in patients with drug and alcohol dependence would broaden our understanding of the role of motivation in addiction treatment. Methods Two multi-site, randomized clinical trials comparing brief motivational interventions with standard care were conducted in the National Institute on Drug Abuse Clinical Trials Network. Patients with primary drug dependence and alcohol dependence entering outpatient treatment participated in a study of either Motivational Enhancement Therapy (n=431) or Motivational Interviewing (n=423). The construct, concurrent, and predictive validity of two composite measures of motivation to change derived from the University of Rhode Island Change Assessment (URICA): Readiness to Change (RTC) and Committed Action (CA) were evaluated. Results Confirmatory factor analysis confirmed the a priori factor structure of the URICA. RTC was significantly associated with measures of addiction severity at baseline (r=.12-.52, p<.05). Although statistically significant (p<.01), the correlations between treatment outcomes and RTC were low (r=-.15 and -18). Additional analyses did not support a moderating or mediating effect of motivation on treatment retention or substance use. Conclusions The construct validity of the URICA was confirmed separately in a large sample of drug- and alcohol-dependent patients. However, evidence for the predictive validity of composite scores was very limited and there were no moderating or mediating effects of either measure on treatment outcome. Thus, increased motivation to change, as measured by the composite scores of motivation derived from the URICA, does not appear to influence treatment outcome. PMID:19157723

Training safer orthopedic surgeons. Construct validation of a virtual-reality simulator for hip fracture surgery.

PubMed

Akhtar, Kashif; Sugand, Kapil; Sperrin, Matthew; Cobb, Justin; Standfield, Nigel; Gupte, Chinmay

2015-01-01

Virtual-reality (VR) simulation in orthopedic training is still in its infancy, and much of the work has been focused on arthroscopy. We evaluated the construct validity of a new VR trauma simulator for performing dynamic hip screw (DHS) fixation of a trochanteric femoral fracture. 30 volunteers were divided into 3 groups according to the number of postgraduate (PG) years and the amount of clinical experience: novice (1-4 PG years; less than 10 DHS procedures); intermediate (5-12 PG years; 10-100 procedures); expert (> 12 PG years; > 100 procedures). Each participant performed a DHS procedure and objective performance metrics were recorded. These data were analyzed with each performance metric taken as the dependent variable in 3 regression models. There were statistically significant differences in performance between groups for (1) number of attempts at guide-wire insertion, (2) total fluoroscopy time, (3) tip-apex distance, (4) probability of screw cutout, and (5) overall simulator score. The intermediate group performed the procedure most quickly, with the lowest fluoroscopy time, the lowest tip-apex distance, the lowest probability of cutout, and the highest simulator score, which correlated with their frequency of exposure to running the trauma lists for hip fracture surgery. This study demonstrates the construct validity of a haptic VR trauma simulator with surgeons undertaking the procedure most frequently performing best on the simulator. VR simulation may be a means of addressing restrictions on working hours and allows trainees to practice technical tasks without putting patients at risk. The VR DHS simulator evaluated in this study may provide valid assessment of technical skill.

The construct validity of session RPE during an intensive camp in young male Karate athletes.

PubMed

Padulo, Johnny; Chaabène, Helmi; Tabben, Montassar; Haddad, Monoem; Gevat, Cecilia; Vando, Stefano; Maurino, Lucio; Chaouachi, Anis; Chamari, Karim

2014-04-01

the aim of this study was to assess the validity of the session rating of perceived exertion (RPE) method and two objective HR-based methods for quantifying karate's training load (TL) in young Karatekas. eleven athletes (age 12.50±1.84 years) participated in this study. The training period/camp was performed on 5 consecutive days with two training session (s) per-day (d). Construct validity of RPE method in young Karate athletes, was studied by correlation analysis between RPE session's training load and both Edwards and Banister's training impulse score' method. significant relationship was found between inter-day (n-11 × d-5 × s-2 = 110) sessions RPE and Edwards (r values from 0.84 to 0.92 p < 0.001) and Banister's (r values from 0.84 to 0.97 p < 0.001), respectively. this study showed that session-RPE can be considered a valid method for quantifying karate's training load in young karate athletes.

Construct validity for eye-hand coordination skill on a virtual reality laparoscopic surgical simulator.

PubMed

Yamaguchi, Shohei; Konishi, Kozo; Yasunaga, Takefumi; Yoshida, Daisuke; Kinjo, Nao; Kobayashi, Kiichiro; Ieiri, Satoshi; Okazaki, Ken; Nakashima, Hideaki; Tanoue, Kazuo; Maehara, Yoshihiko; Hashizume, Makoto

2007-12-01

This study was carried out to investigate whether eye-hand coordination skill on a virtual reality laparoscopic surgical simulator (the LAP Mentor) was able to differentiate among subjects with different laparoscopic experience and thus confirm its construct validity. A total of 31 surgeons, who were all right-handed, were divided into the following two groups according to their experience as an operator in laparoscopic surgery: experienced surgeons (more than 50 laparoscopic procedures) and novice surgeons (fewer than 10 laparoscopic procedures). The subjects were tested using the eye-hand coordination task of the LAP Mentor, and performance was compared between the two groups. Assessment of the laparoscopic skills was based on parameters measured by the simulator. The experienced surgeons completed the task significantly faster than the novice surgeons. The experienced surgeons also achieved a lower number of movements (NOM), better economy of movement (EOM) and faster average speed of the left instrument than the novice surgeons, whereas there were no significant differences between the two groups for the NOM, EOM and average speed of the right instrument. Eye-hand coordination skill of the nondominant hand, but not the dominant hand, measured using the LAP Mentor was able to differentiate between subjects with different laparoscopic experience. This study also provides evidence of construct validity for eye-hand coordination skill on the LAP Mentor.

Construct validity of an instrument to measure neuropathic pain in women with bladder pain syndrome.

PubMed

Arya, Lily A; Harvie, Heidi S; Andy, Uduak U; Cory, Lori; Propert, Kathleen J; Whitmore, Kristene

2013-06-01

To determine the construct validity of an instrument to measure neuropathic pain in women with bladder pain syndrome (BPS). Our hypothesis is that neuropathic, bladder, and bowel pain represent different constructs in women with BPS. Secondary planned analysis of a prospective cross-sectional study of 150 women with BPS. The relationship between neuropathic pain, urinary, and bowel symptoms was assessed. The correlation of the total neuropathic pain score with total urinary and bowel symptom scores was low to moderate (r = 0.28-0.49). The correlation of specific neuropathic pain items with bladder and bowel pain was also low to moderate (r = 0.12-0.36). Women with neuropathic pain had significantly higher scores for urinary urgency, bladder pain, abdominal pain, diarrhea, and constipation than women with non-neuropathic pain (all P < 0.0001). Somatosensory neuropathic pain and "visceral" bladder and bowel pain represent separate but related constructs in women with BPS. Copyright © 2012 Wiley Periodicals, Inc.

Evaluating the Unintended Consequences of Assessment Practices: Construct Irrelevance and Construct Underrepresentation

ERIC Educational Resources Information Center

Spurgeon, Shawn L.

2017-01-01

Construct irrelevance (CI) and construct underrepresentation (CU) are 2 major threats to validity, yet they are rarely discussed within the counseling literature. This article provides information about the relevance of these threats to internal validity. An illustrative case example will be provided to assist counselors in understanding these…

Construct validity of the MMPI-2 College Maladjustment (Mt) Scale.

PubMed

Barthlow, Deanna L; Graham, John R; Ben-Porath, Yossef S; McNulty, John L

2004-09-01

The construct validity of the MMPI-2 (Minnesota Multiphasic Personality Inventory-2) College Maladjustment (Mt) Scale was examined using 376 student clients at a university psychological clinic. A principal components analysis and correlations of Mt scale scores with clients' and therapists' ratings of symptoms and functioning showed that the Mt scale identifies the presence of maladjustment as defined in terms of depressive and anxious symptoms. There is no evidence to show that the scale is specific to college students or that it is sensitive to severe psychological disturbance. The Mt scale does not inform the clinician as to why a person is distressed. In addition, there is no evidence from this study to suggest the superiority of the Mt scale over other MMPI-2 maladjustment measures. Therapists should use the entire MMPI-2 profile, not just the Mt scale, to gain the most comprehensive and specific understanding of clients.

Laparoscopic Common Bile Duct Exploration Four-Task Training Model: Construct Validity

PubMed Central

Otaño, Natalia; Rodríguez, Omaira; Sánchez, Renata; Benítez, Gustavo; Schweitzer, Michael

2012-01-01

Background: Training models in laparoscopic surgery allow the surgical team to practice procedures in a safe environment. We have proposed the use of a 4-task, low-cost inert model to practice critical steps of laparoscopic common bile duct exploration. Methods: The performance of 3 groups with different levels of expertise in laparoscopic surgery, novices (A), intermediates (B), and experts (C), was evaluated using a low-cost inert model in the following tasks: (1) intraoperative cholangiography catheter insertion, (2) transcystic exploration, (3) T-tube placement, and (4) choledochoscope management. Kruskal-Wallis and Mann-Whitney tests were used to identify differences among the groups. Results: A total of 14 individuals were evaluated: 5 novices (A), 5 intermediates (B), and 4 experts (C). The results involving intraoperative cholangiography catheter insertion were similar among the 3 groups. As for the other tasks, the expert had better results than the other 2, in which no significant differences occurred. The proposed model is able to discriminate among individuals with different levels of expertise, indicating that the abilities that the model evaluates are relevant in the surgeon's performance in CBD exploration. Conclusions: Construct validity for tasks 2 and 3 was demonstrated. However, task 1 was no capable of distinguishing between groups, and task 4 was not statistically validated. PMID:22906323

Virtual faces expressing emotions: an initial concomitant and construct validity study.

PubMed

Joyal, Christian C; Jacob, Laurence; Cigna, Marie-Hélène; Guay, Jean-Pierre; Renaud, Patrice

2014-01-01

Facial expressions of emotions represent classic stimuli for the study of social cognition. Developing virtual dynamic facial expressions of emotions, however, would open-up possibilities, both for fundamental and clinical research. For instance, virtual faces allow real-time Human-Computer retroactions between physiological measures and the virtual agent. The goal of this study was to initially assess concomitants and construct validity of a newly developed set of virtual faces expressing six fundamental emotions (happiness, surprise, anger, sadness, fear, and disgust). Recognition rates, facial electromyography (zygomatic major and corrugator supercilii muscles), and regional gaze fixation latencies (eyes and mouth regions) were compared in 41 adult volunteers (20 ♂, 21 ♀) during the presentation of video clips depicting real vs. virtual adults expressing emotions. Emotions expressed by each set of stimuli were similarly recognized, both by men and women. Accordingly, both sets of stimuli elicited similar activation of facial muscles and similar ocular fixation times in eye regions from man and woman participants. Further validation studies can be performed with these virtual faces among clinical populations known to present social cognition difficulties. Brain-Computer Interface studies with feedback-feedforward interactions based on facial emotion expressions can also be conducted with these stimuli.

Measuring the Sensitivity and Construct Validity of 6 Utility Instruments in 7 Disease Areas.

PubMed

Richardson, Jeff; Iezzi, Angelo; Khan, Munir A; Chen, Gang; Maxwell, Aimee

2016-02-01

Health services that affect quality of life (QoL) are increasingly evaluated using cost utility analyses (CUA). These commonly employ one of a small number of multiattribute utility instruments (MAUI) to assess the effects of the health service on utility. However, the MAUI differ significantly, and the choice of instrument may alter the outcome of an evaluation. The present article has 2 objectives: 1) to compare the results of 3 measures of the sensitivity of 6 MAUI and the results of 6 tests of construct validity in 7 disease areas and 2) to rank the MAUI by each of the test results in each disease area and by an overall composite index constructed from the tests. Patients and the general public were administered a battery of instruments, which included the 6 MAUI, disease-specific QoL instruments (DSI), and 6 other comparator instruments. In each disease area, instrument sensitivity was measured 3 ways: by the unadjusted mean difference in utility between public and patient groups, by the value of the effect size, and by the correlation between MAUI and DSI scores. Content and convergent validity were tested by comparison of MAUI utilities and scores from the 6 comparator instruments. These included 2 measures of health state preferences, measures of subjective well-being and capabilities, and generic measures of physical and mental QoL derived from the SF-36. The apparent sensitivity of instruments varied significantly with the measurement method and by disease area. Validation test results varied with the comparator instruments. Notwithstanding this variability, the 15D, AQoL-8D, and the SF-6D generally achieved better test results than the QWB and EQ-5D-5L. © The Author(s) 2015.

The FACIT-Sp spiritual well-being scale: an investigation of the dimensionality, reliability and construct validity in a cognitively intact nursing home population.

PubMed

Haugan, Gørill

2015-03-01

Spiritual well-being has been found to be a strong individual predictor of overall nursing home satisfaction and a fundamental dimension of global as well as health-related quality-in-life among nursing home patients. Therefore, access to a valid and reliable measure of spiritual well-being among nursing home patients is highly warranted. The aim of this study was to investigate the dimensionality, reliability and construct validity of the Functional Assessment of Chronic Illness Therapy Spiritual Wellbeing scale in a cognitively intact nursing home population. A cross-sectional design was applied, selecting two counties in central Norway from which 20 municipalities representing 44 different nursing homes took part in this study. Long-term care was defined as 24-hour care with duration of 6 months or longer. Participants were 202 cognitively intact long-term nursing home patients fulfilling the inclusion criteria. Approval by all regulatory institutions dealing with research issues in Norway and the Management Unit at the 44 nursing homes was obtained. Explorative and confirmative factor analyses as well as correlation with selected construct were used. Though three items loaded very low (λ = 0.22, 0.26, 0.32) indicating low reliability, the three-factor model for the FACIT-Sp spiritual well-being scale provided an acceptable fit (χ(2) = 101.15 (df = 50), p-value <0.001, RMSEA = 0.075 p = 0.030, NFI = 0.90, GFI = 0.91, AGFI = 0.85) for older nursing home patients, demonstrating acceptable measurement reliability. Construct validity was supported by significant correlations in the hypothesised direction with the selected constructs. The three-factor model is an improvement over the original two-factor construct, based on these nursing home data. The measure yielded significantly factor loadings, good composite reliability and construct validity. © 2014 Nordic College of Caring Science.

Construct and Criterion Validity of the PedsQL™ 4.0 Instrument (Pediatric Quality of Life Inventory) in Colombia

PubMed Central

Amaya-Arias, Ana Carolina; Alzate, Juan Pablo; Eslava-Schmalbach, Javier H

2017-01-01

Background: This study aimed at determining the validity of the Pediatric Quality of Life Inventory 4.0 (PedsQL™ 4.0) for the measurement of health-related quality of life (HRQOL) in Colombian children. Methods: Validation study of measurement instruments. The PedsQL™ 4.0 was applied by convenience sampling to 375 pairs of children and adolescents between the ages of 5 and 17 and to their parents-caregivers, as well as to 125 parents-caregivers of children between the ages of 2 and 4 in five cities of Colombia (Bogota, Medellin, Cali, Barranquilla and Bucaramanga). Construct validity was assessed through the use of exploratory and confirmatory factor analysis, and criterion validity was assessed by correlations between the PedsQL™ 4.0 and the KIDSCREEN-27. Results: The instrument was applied to 375 children (ages 5–18) and 125 parents of children between the ages of 2 and 4. Factor analysis revealed four factors considered suitable for the sample in both the child and parent reports, whereas Bartlett's test of sphericity showed inter-correlation between variables. Scale and subscales showed proper indicators of internal consistency. It is recommended not to include or review some of the items in the Colombian version of the scale. Conclusions: The Spanish version for Colombia of the PedsQL™ 4.0 displays suitable indicators of criterion and construct validity, therefore becoming a valuable tool for measuring HRQOL in children in our country. Some modifications are recommended for the Colombian version of the scale. PMID:28900536

The DASS-14: Improving the Construct Validity and Reliability of the Depression, Anxiety, and Stress Scale in a Cohort of Health Professionals.

PubMed

Wise, Frances M; Harris, Darren W; Olver, John H

2017-01-01

Considerable research has been undertaken in evaluating the DASS-21 in a variety of clinical populations, but studies of the instrument's psychometric adequacy in healthcare professionals is lacking. This study aimed to establish and improve the construct validity and reliability of the DASS-21 in a cohort of Australian health professionals. 343 rehabilitation health professionals completed the DASS-21, along with a demographic questionnaire. Principal components analysis was performed to identify potential factors in the DASS-21. Factors were interpreted against theoretical constructs underlying the instrument. Items loading on separate factors were then subjected to reliability analysis to determine internal consistency of subscales. Items that demonstrated poor fit, or loaded onto more than one factor, were deleted to maximise the reliability of each subscale. Principal components analysis identified three dimensions (depression, anxiety, stress) in a modified version of the DASS-21 (renamed DASS-14), with appropriate construct validity and good reliability (a=0.73 to 0.88). The three dimensions accounted for over 62% of variance between items. The modified DASS-14 scale is a more parsimonious measure of depression, anxiety, and stress, with acceptable reliability and construct validity, in rehabilitation health professionals and is appropriate for use in studies of similar populations.

The Individualized Classroom Assessment Scoring System (inCLASS): Preliminary Reliability and Validity of a System for Observing Preschoolers’ Competence in Classroom Interactions

PubMed Central

Downer, Jason T.; Booren, Leslie M.; Lima, Olivia K.; Luckner, Amy E.; Pianta, Robert C.

2012-01-01

This paper introduces the Individualized Classroom Assessment Scoring System (inCLASS), an observation tool that targets children’s interactions in preschool classrooms with teachers, peers, and tasks. In particular, initial evidence is reported of the extent to which the inCLASS meets the following psychometric criteria: inter-rater reliability, normal distributions and adequate range, construct validity, and criterion-related validity. These initial findings suggest that the inCLASS has the potential to provide an authentic, contextualized assessment of young children’s classroom behaviors. Future directions for research with the inCLASS are discussed. PMID:23175598

Modeling complex treatment strategies: construction and validation of a discrete event simulation model for glaucoma.

PubMed

van Gestel, Aukje; Severens, Johan L; Webers, Carroll A B; Beckers, Henny J M; Jansonius, Nomdo M; Schouten, Jan S A G

2010-01-01

Discrete event simulation (DES) modeling has several advantages over simpler modeling techniques in health economics, such as increased flexibility and the ability to model complex systems. Nevertheless, these benefits may come at the cost of reduced transparency, which may compromise the model's face validity and credibility. We aimed to produce a transparent report on the construction and validation of a DES model using a recently developed model of ocular hypertension and glaucoma. Current evidence of associations between prognostic factors and disease progression in ocular hypertension and glaucoma was translated into DES model elements. The model was extended to simulate treatment decisions and effects. Utility and costs were linked to disease status and treatment, and clinical and health economic outcomes were defined. The model was validated at several levels. The soundness of design and the plausibility of input estimates were evaluated in interdisciplinary meetings (face validity). Individual patients were traced throughout the simulation under a multitude of model settings to debug the model, and the model was run with a variety of extreme scenarios to compare the outcomes with prior expectations (internal validity). Finally, several intermediate (clinical) outcomes of the model were compared with those observed in experimental or observational studies (external validity) and the feasibility of evaluating hypothetical treatment strategies was tested. The model performed well in all validity tests. Analyses of hypothetical treatment strategies took about 30 minutes per cohort and lead to plausible health-economic outcomes. There is added value of DES models in complex treatment strategies such as glaucoma. Achieving transparency in model structure and outcomes may require some effort in reporting and validating the model, but it is feasible.

Investigation of Item-Pair Presentation and Construct Validity of the Navy Computer Adaptive Personality Scales (NCAPS)

DTIC Science & Technology

2006-10-01

NCAPS ) Christina M. Underhill, Ph.D. Approved for public release; distribution is unlimited. NPRST-TN-06-9 October 2006...Investigation of Item-Pair Presentation and Construct Validity of the Navy Computer Adaptive Personality Scales ( NCAPS ) Christina M. Underhill, Ph.D...documents one of the steps in our development of the Navy Computer Adaptive Personality Scales ( NCAPS ). NCAPS is a computer adaptive personality measure

Validation of the Resilience Scale for Adolescents in Norwegian adolescents 13-18 years.

PubMed

Moksnes, Unni K; Haugan, Gørill

2018-03-01

Resilience is seen as a vital resource for coping and mental health in adolescents. However, there is no universally accepted theory or definition of resilience, leading to considerable challenges regarding how to operationalise and measure this construct. The study aimed at providing further knowledge of the psychometric properties (dimensionality, construct validity and internal consistency) of the 28-item version of the Resilience Scale for Adolescents (READ) in N = 1183 Norwegian adolescents, 13-18 years old. Dimensionality of READ was tested using confirmatory factor analysis (CFA). Convergent validity and reliability were tested using Pearson's correlation analysis, Cronbach's alpha and composite reliability. The CFA supported a modified, 20-item, five-factor structure with high reliability, supporting the dimensionality and internal consistency of the instrument. Convergent validity was confirmed where all factors correlated in expected directions with measures of sense of coherence, self-esteem, stress and depression. The psychometric properties of the READ need to be further evaluated in adolescents; however, the results indicate that a modified 20-item version of READ is adequate for assessing resilience in the present sample of Norwegian adolescents. © 2017 Nordic College of Caring Science.

Construct and face validity of the American College of Surgeons/Association of Program Directors in Surgery laparoscopic troubleshooting team training exercise.

PubMed

Arain, Nabeel A; Hogg, Deborah C; Gala, Rajiv B; Bhoja, Ravi; Tesfay, Seifu T; Webb, Erin M; Scott, Daniel J

2012-01-01

Our aim was to develop an objective scoring system and evaluate construct and face validity for a laparoscopic troubleshooting team training exercise. Surgery and gynecology novices (n = 14) and experts (n = 10) participated. Assessments included the following: time-out, scenario decision making (SDM) score (based on essential treatments rendered and completion time), operating room communication assessment (investigator developed), line operations safety audits (teamwork), and National Aeronautics and Space Administration-Task Load Index (workload). Significant differences were detected for SDM scores for scenarios 1 (192 vs 278; P = .01) and 3 (129 vs 225; P = .004), operating room communication assessment (67 vs 91; P = .002), and line operations safety audits (58 vs 87; P = .001), but not for time-out (46 vs 51) or scenario 2 SDM score (301 vs 322). Workload was similar for both groups and face validity (8.8 on a 10-point scale) was strongly supported. Objective decision-making scoring for 2 of 3 scenarios and communication and teamwork ratings showed construct validity. Face validity and participant feedback were excellent. Copyright © 2012 Elsevier Inc. All rights reserved.

What do Demand-Control and Effort-Reward work stress questionnaires really measure? A discriminant content validity study of relevance and representativeness of measures.

PubMed

Bell, Cheryl; Johnston, Derek; Allan, Julia; Pollard, Beth; Johnston, Marie

2017-05-01

The Demand-Control (DC) and Effort-Reward Imbalance (ERI) models predict health in a work context. Self-report measures of the four key constructs (demand, control, effort, and reward) have been developed and it is important that these measures have good content validity uncontaminated by content from other constructs. We assessed relevance (whether items reflect the constructs) and representativeness (whether all aspects of the construct are assessed, and all items contribute to that assessment) across the instruments and items. Two studies examined fourteen demand/control items from the Job Content Questionnaire and seventeen effort/reward items from the Effort-Reward Imbalance measure using discriminant content validation and a third study developed new methods to assess instrument representativeness. Both methods use judges' ratings and construct definitions to get transparent quantitative estimates of construct validity. Study 1 used dictionary definitions while studies 2 and 3 used published phrases to define constructs. Overall, 3/5 demand items, 4/9 control items, 1/6 effort items, and 7/11 reward items were uniquely classified to the appropriate theoretical construct and were therefore 'pure' items with discriminant content validity (DCV). All pure items measured a defining phrase. However, both the DC and ERI assessment instruments failed to assess all defining aspects. Finding good discriminant content validity for demand and reward measures means these measures are usable and our quantitative results can guide item selection. By contrast, effort and control measures had limitations (in relevance and representativeness) presenting a challenge to the implementation of the theories. Statement of contribution What is already known on this subject? While the reliability and construct validity of Demand-Control and Effort-Reward-Imbalance (DC and ERI) work stress measures are routinely reported, there has not been adequate investigation of their content

Construct validity and reliability of the Finnish version of the Knee Injury and Osteoarthritis Outcome Score.

PubMed

Multanen, Juhani; Honkanen, Mikko; Häkkinen, Arja; Kiviranta, Ilkka

2018-05-22

The Knee Injury and Osteoarthritis Outcome Score (KOOS) is a commonly used knee assessment and outcome tool in both clinical work and research. However, it has not been formally translated and validated in Finnish. The purpose of this study was to translate and culturally adapt the KOOS questionnaire into Finnish and to determine its validity and reliability among Finnish middle-aged patients with knee injuries. KOOS was translated and culturally adapted from English into Finnish. Subsequently, 59 patients with knee injuries completed the Finnish version of KOOS, Western Ontario and McMaster Osteoarthritis Index (WOMAC), Short-Form 36 Health Survey (SF-36) and Numeric Pain Rating Scale (Pain-NRS). The same KOOS questionnaire was re-administered 2 weeks later. Psychometric assessment of the Finnish KOOS was performed by testing its construct validity and reliability by using internal consistency, test-retest reliability and measurement error. The floor and ceiling effects were also examined. The cross-cultural adaptation revealed only minor cultural differences and was well received by the patients. For construct validity, high to moderate Spearman's Correlation Coefficients were found between the KOOS subscales and the WOMAC, SF-36, and Pain-NRS subscales. The Cronbach's alpha was from 0.79 to 0.96 for all subscales indicating acceptable internal consistency. The test-retest reliability was good to excellent, with Intraclass Correlation Coefficients ranging from 0.73 to 0.86 for all KOOS subscales. The minimal detectable change ranged from 17 to 34 on an individual level and from 2 to 4 on a group level. No floor or ceiling effects were observed. This study yielded an appropriately translated and culturally adapted Finnish version of KOOS which demonstrated good validity and reliability. Our data indicate that the Finnish version of KOOS is suitable for assessment of the knee status of Finnish patients with different knee complaints. Further studies are needed to

Cross-cultural adaptation and validation of the Sinus and Nasal Quality of Life Survey (SN-5) into Brazilian Portuguese.

PubMed

Uchoa, Priscila Regina Candido Espinola; Bezerra, Thiago Freire Pinto; Lima, Élcio Duarte; Fornazieri, Marco Aurélio; Pinna, Fabio de Rezende; Sperandio, Fabiana de Araújo; Voegels, Richard Louis

The concept of quality of life is subjective and variable definition, which depends on the individual's perception of their state of health. Quality of life questionnaires are instruments designed to measure quality of life, but most are developed in a language other than Portuguese. Questionnaires can identify the most important symptoms, focus on consultation, and assist in defining the goals of treatment. Some of these have been validated for the Portuguese language, but none in children. To validate the translation with cross-cultural adaptation and validation of the Sinus and Nasal Quality of Life Survey (SN-5) into Portuguese. Prospective study of children aged 2-12 years with sinonasal symptoms of over 30 days. The study comprised two stages: (I) translation and cross-cultural adaptation of the SN-5 into Portuguese (SN-5p); and (II) validation of the SN5-p. Statistical analysis was performed to assess internal consistency, test-retest reliability, and sensitivity, as well as construct and discriminant validity and standardization. The SN-5 was translated and adapted into Portuguese (SN-5p) and the author of the original version approved the process. Validation was carried out by administration of the SN-5p to 51 pediatric patients with sinonasal complaints (mean age, 5.8±2.5 years; range, 2-12 years). The questionnaire exhibited adequate construct validity (0.62, p<0.01), internal consistency (Cronbach's alpha=0.73), and discriminant validity (p<0.01), as well as good test-retest reproducibility (Goodman-Kruskal gamma=0.957, p<0.001), good correlation with a visual analog scale (r=0.62, p<0.01), and sensitivity to change. This study reports the successful translation and cross-cultural adaptation of the SN-5 instrument into Brazilian Portuguese. The translated version exhibited adequate psychometric properties for assessment of disease-specific quality of life in pediatric patients with sinonasal complaints. Copyright © 2016 Associação Brasileira de

[Preliminary construction of a questionnaire about knowledge of HIV/AIDS in Colombian veterans].

PubMed

Segura-Cardona, Angela; Berbesí-Fernández, Dedsy; Cardona-Arango, Doris; Ordóñez-Molina, Jaime

2011-01-01

In order to identify the level of knowledge about HIV/AIDS in Colombia veterans of war in the year 2009, a questionnaire was designed, built and validated, using a mixed design, for which three stages were followed: 1) Bibliographic review and construction of items of the questionnaire using a focus group, 2) Evaluation of content validity by a pannel of experts, 3) APLICACION of the final questionnaire, we selected non-randomly 323 people who were part of group of veterans in Colombia, and 4) Validation of the questionnaire through the evaluation of internal consistency and principal component analysis. We found that the questionnaire explored three factors: forms of infection, inadequate beliefs, and HIV prevention, which accounted for 52% of the variance. The survey showed adequate internal consistency values (Cronbach's α = 0.77). These results suggest the use of the questionnaire to assess knowledge level related to the form of infection, inaccurate beliefs and prevention of HIV-AIDS in this population.

Construct Validity and Reliability of the SARA Gait and Posture Sub-scale in Early Onset Ataxia

PubMed Central

Lawerman, Tjitske F.; Brandsma, Rick; Verbeek, Renate J.; van der Hoeven, Johannes H.; Lunsing, Roelineke J.; Kremer, Hubertus P. H.; Sival, Deborah A.

2017-01-01

Aim: In children, gait and posture assessment provides a crucial marker for the early characterization, surveillance and treatment evaluation of early onset ataxia (EOA). For reliable data entry of studies targeting at gait and posture improvement, uniform quantitative biomarkers are necessary. Until now, the pediatric test construct of gait and posture scores of the Scale for Assessment and Rating of Ataxia sub-scale (SARA) is still unclear. In the present study, we aimed to validate the construct validity and reliability of the pediatric (SARAGAIT/POSTURE) sub-scale. Methods: We included 28 EOA patients [15.5 (6–34) years; median (range)]. For inter-observer reliability, we determined the ICC on EOA SARAGAIT/POSTURE sub-scores by three independent pediatric neurologists. For convergent validity, we associated SARAGAIT/POSTURE sub-scores with: (1) Ataxic gait Severity Measurement by Klockgether (ASMK; dynamic balance), (2) Pediatric Balance Scale (PBS; static balance), (3) Gross Motor Function Classification Scale -extended and revised version (GMFCS-E&R), (4) SARA-kinetic scores (SARAKINETIC; kinetic function of the upper and lower limbs), (5) Archimedes Spiral (AS; kinetic function of the upper limbs), and (6) total SARA scores (SARATOTAL; i.e., summed SARAGAIT/POSTURE, SARAKINETIC, and SARASPEECH sub-scores). For discriminant validity, we investigated whether EOA co-morbidity factors (myopathy and myoclonus) could influence SARAGAIT/POSTURE sub-scores. Results: The inter-observer agreement (ICC) on EOA SARAGAIT/POSTURE sub-scores was high (0.97). SARAGAIT/POSTURE was strongly correlated with the other ataxia and functional scales [ASMK (rs = -0.819; p < 0.001); PBS (rs = -0.943; p < 0.001); GMFCS-E&R (rs = -0.862; p < 0.001); SARAKINETIC (rs = 0.726; p < 0.001); AS (rs = 0.609; p = 0.002); and SARATOTAL (rs = 0.935; p < 0.001)]. Comorbid myopathy influenced SARAGAIT/POSTURE scores by concurrent muscle weakness, whereas comorbid myoclonus predominantly

Construction and validation of nursing diagnoses for people in palliative care.

PubMed

Silva, Rudval Souza da; Pereira, Álvaro; Nóbrega, Maria Miriam Lima da; Mussi, Fernanda Carneiro

2017-08-03

to construct and validate nursing diagnoses for people in palliative care based on the Dignity-Conserving Care Model and the International Classification for Nursing Practice. a two-stage methodological study: 1) construction of the database of clinically and culturally relevant terms for the nursing care for people in palliative care and 2) construction of nursing diagnoses from the database of terms, based on the guidelines of the International Council of Nurses. the 262 terms validated constituted a database of terms from which 56 nursing diagnoses were developed. Of these, 33 were validated by a group of 26 experts, and classified in the three categories of the Dignity-Conserving Care Model: illness-related concerns (21); dignity-conserving repertoire (9); and social dignity inventory (3). of the 33 validated diagnoses, 18 of them could be included in the update of the Catalog of the International Classification for Nursing Practice - palliative care for a dignified death. The study contributes to support the clinical reasoning and decision making of the nurse. construir e validar diagnósticos de enfermagem para pessoas em cuidados paliativos, fundamentados no Modelo de Cuidados para Preservação da Dignidade e na Classificação Internacional para a Prática de Enfermagem. estudo metodológico operacionalizado em duas etapas: 1) construção do banco de termos relevantes, clínica e culturalmente, para a assistência de enfermagem à pessoa em cuidados paliativos e 2) construção de diagnósticos de enfermagem a partir do banco de termos, com base nas diretrizes do Conselho Internacional de Enfermeiros. os 262 termos validados constituíram um banco de termos a partir do qual foram desenvolvidos 56 diagnósticos de enfermagem. Desses, 33 foram validados por um grupo de 26 peritos, e classificados nas três categorias do Modelo de Cuidados para Preservação da Dignidade: preocupações relacionadas com a doença (21); repertório de conservação da

Face and Construct Validation of a Virtual Peg Transfer Simulator

PubMed Central

Arikatla, Venkata S; Sankaranarayanan, Ganesh; Ahn, Woojin; Chellali, Amine; De, Suvranu; Caroline, GL; Hwabejire, John; DeMoya, Marc; Schwaitzberg, Steven; Jones, Daniel B.

2013-01-01

Background The Fundamentals of Laparascopic Surgery (FLS) trainer box is now established as a standard for evaluating minimally invasive surgical skills. A particularly simple task in this trainer box is the peg transfer task which is aimed at testing the surgeon’s bimanual dexterity, hand-eye coordination, speed and precision. The Virtual Basic Laparoscopic Skill Trainer (VBLaST©) is a virtual version of the FLS tasks which allows automatic scoring and real time, subjective quantification of performance without the need of a human proctor. In this paper we report validation studies of the VBLaST© peg transfer (VBLaST-PT©) simulator. Methods Thirty-five subjects with medical background were divided into two groups: experts (PGY 4-5, fellows and practicing surgeons) and novices (PGY 1-3). The subjects were asked to perform the peg transfer task on both the FLS trainer box and the VBLaST-PT© simulator and their performance was evaluated based on established metrics of error and time. A new length of trajectory (LOT) metric has also been introduced for offline analysis. A questionnaire was used to rate the realism of the virtual system on a 5-point Likert scale. Results Preliminary face validation of the VBLaST-PT© with 34 subjects rated on a 5-point Likert scale questionnaire revealed high scores for all aspects of simulation, with 3.53 being the lowest mean score across all questions. A two-tailed Mann-Whitney performed on the total scores showed significant (p=0.001) difference between the groups. A similar test performed on the task time (p=0.002) and the length of trajectory (p=0.004) separately showed statistically significant differences between the experts and novice groups (p<0.05). The experts appear to be traversing shorter overall trajectories in less time than the novices. Conclusion VBLaST-PT© showed both face and construct validity and has promise as a substitute for the FLS to training peg transfer skills. PMID:23263645

Risk management in technovigilance: construction and validation of a medical-hospital product evaluation instrument.

PubMed

Kuwabara, Cleuza Catsue Takeda; Evora, Yolanda Dora Martinez; de Oliveira, Márcio Mattos Borges

2010-01-01

With the continuous incorporation of health technologies, hospital risk management should be implemented to systemize the monitoring of adverse effects, performing actions to control and eliminate their damage. As part of these actions, Technovigilance is active in the procedures of acquisition, use and quality control of health products and equipment. This study aimed to construct and validate an instrument to evaluate medical-hospital products. This is a quantitative, exploratory, longitudinal and methodological development study, based on the Six Sigma quality management model, which has as its principle basis the component stages of the DMAIC Cycle. For data collection and content validation, the Delphi technique was used with professionals from the Brazilian Sentinel Hospital Network. It was concluded that the instrument developed permitted the evaluation of the product, differentiating between the results of the tested brands, in line with the initial study goal of qualifying the evaluations performed.

Toward a Common Language for Measuring Patient Mobility in the Hospital: Reliability and Construct Validity of Interprofessional Mobility Measures.

PubMed

Hoyer, Erik H; Young, Daniel L; Klein, Lisa M; Kreif, Julie; Shumock, Kara; Hiser, Stephanie; Friedman, Michael; Lavezza, Annette; Jette, Alan; Chan, Kitty S; Needham, Dale M

2018-02-01

The lack of common language among interprofessional inpatient clinical teams is an important barrier to achieving inpatient mobilization. In The Johns Hopkins Hospital, the Activity Measure for Post-Acute Care (AM-PAC) Inpatient Mobility Short Form (IMSF), also called "6-Clicks," and the Johns Hopkins Highest Level of Mobility (JH-HLM) are part of routine clinical practice. The measurement characteristics of these tools when used by both nurses and physical therapists for interprofessional communication or assessment are unknown. The purposes of this study were to evaluate the reliability and minimal detectable change of AM-PAC IMSF and JH-HLM when completed by nurses and physical therapists and to evaluate the construct validity of both measures when used by nurses. A prospective evaluation of a convenience sample was used. The test-retest reliability and the interrater reliability of AM-PAC IMSF and JH-HLM for inpatients in the neuroscience department (n = 118) of an academic medical center were evaluated. Each participant was independently scored twice by a team of 2 nurses and 1 physical therapist; a total of 4 physical therapists and 8 nurses participated in reliability testing. In a separate inpatient study protocol (n = 69), construct validity was evaluated via an assessment of convergent validity with other measures of function (grip strength, Katz Activities of Daily Living Scale, 2-minute walk test, 5-times sit-to-stand test) used by 5 nurses. The test-retest reliability values (intraclass correlation coefficients) for physical therapists and nurses were 0.91 and 0.97, respectively, for AM-PAC IMSF and 0.94 and 0.95, respectively, for JH-HLM. The interrater reliability values (intraclass correlation coefficients) between physical therapists and nurses were 0.96 for AM-PAC IMSF and 0.99 for JH-HLM. Construct validity (Spearman correlations) ranged from 0.25 between JH-HLM and right-hand grip strength to 0.80 between AM-PAC IMSF and the Katz Activities of

Developing Form Assembly Specifications for Exams with Multiple Choice and Constructed Response Items: Balancing Reliability and Validity Concerns

ERIC Educational Resources Information Center

Hendrickson, Amy; Patterson, Brian; Ewing, Maureen

2010-01-01

The psychometric considerations and challenges associated with including constructed response items on tests are discussed along with how these issues affect the form assembly specifications for mixed-format exams. Reliability and validity, security and fairness, pretesting, content and skills coverage, test length and timing, weights, statistical…

The Construct Validity of the Dutch Personality Inventory for DSM-5 Personality Disorders (PID-5) in a Clinical Sample.

PubMed

Bastiaens, Tim; Claes, Laurence; Smits, Dirk; De Clercq, Barbara; De Fruyt, Filip; Rossi, Gina; Vanwalleghem, Dominique; Vermote, Rudi; Lowyck, Benedicte; Claes, Stephan; De Hert, Marc

2016-02-01

The factor structure and the convergent validity of the Personality Inventory for DSM-5 (PID-5), a self-report questionnaire designed to measure personality pathology as advocated in the fifth edition, Section III of Diagnostic and Statistical Manual of Mental Disorders (DSM-5), are already demonstrated in general population samples, but need replication in clinical samples. In 240 Flemish inpatients, we examined the factor structure of the PID-5 by means of exploratory structural equation modeling. Additionally, we investigated differences in PID-5 higher order domain scores according to gender, age and educational level, and explored convergent and discriminant validity by relating the PID-5 with the Dimensional Assessment of Personality Pathology-Basic Questionnaire and by comparing PID-5 scores of inpatients with and without a DSM-IV categorical personality disorder diagnosis. Our results confirmed the original five-factor structure of the PID-5. The reliability and the convergent and discriminant validity of the PID-5 proved to be adequate. Implications for future research are discussed. © The Author(s) 2015.

Construct validity of the Thai version of the job content questionnaire in a large population of heterogeneous occupations.

PubMed

Phakthongsuk, Pitchaya

2009-04-01

To test the construct validity of the Thai version of the job content questionnaire (TJCQ). The present descriptive study recruited 10415 participants from all occupations according to the International Standard Classification of Occupations. The instrument consisted of a 48-item of the job content questionnaire. Eight items newly developed by the authors from in-depth interviews were added. Exploratory factor analysis showed six factor models of work hazards, decision latitude, psychological demand, social support, physical demand, and job security. However, supervisor and co-worker support were not distinguished into two factors and some items distributed differently along the factors extracted. Confirmatory factor analysis supported the construct of six latent factors, although the overall fit was moderately acceptable. Cronbach's alpha coefficients higher than 0.7, supported the internal consistency of TJCQ scales except for job security (0.55). These findings suggest that TJCQ is valid and reliable for assessing job stress among Thai populations.

Validating survey measurement scales for AIDS-related knowledge and stigma among construction workers in South Africa.

PubMed

Bowen, Paul; Govender, Rajen; Edwards, Peter

2016-01-23

Construction workers in South Africa are regarded as a high-risk group in the context of HIV/AIDS. HIV testing is pivotal to controlling HIV transmission and providing palliative care and AIDS-related knowledge and stigma are key issues in addressing the likelihood of testing behaviour. In exploring these issues, various studies have employed an 11-item AIDS-related knowledge scale (Kalichman and Simbayi, AIDS Care 16:572-580, 2004) and a 9-item stigma scale (Kalichman et al., AIDS Behav 9:135-143, 2005), but little evidence exists confirming the psychometric properties of these scales. Using survey data from 512 construction workers in the Western Cape, South Africa, this research examines the validity and reliability of the two scales through exploratory and confirmatory factor analysis and internal consistency tests. From confirmatory factor analysis, a revised 10-item knowledge scale was developed (χ2 /df ratio = 1.675, CFI = 0.982, RMSEA = 0.038, and Hoelter (95 %) = 393). A revised 8-item stigma scale was also developed (χ2 /df ratio = 1.929, CFI = 0.974, RMSEA = 0.045, and Hoelter (95 %) = 380). Both revised scales demonstrated good model fit and all factor loadings were significant (p < 0.01). Reliability analysis demonstrated excellent to good internal consistency, with alpha values of 0.80 and 0.74, respectively. Both revised scales also demonstrated satisfactory convergent and divergent validity. Limitations of the original survey from which the data was obtained include the failure to properly account for respondent selection of language for completion of the survey, use of ethnicity as a proxy for identifying the native language of participants, the limited geographical area from which the survey data was collected, and the limitations associated with the convenience sample. A limitation of the validation study was the lack of available data for a more robust examination of reliability beyond internal consistency, such as test-retest reliability. The

Construct Maps: A Tool to Organize Validity Evidence

ERIC Educational Resources Information Center

McClarty, Katie Larsen

2013-01-01

The construct map is a promising tool for organizing the data standard-setting panelists interpret. The challenge in applying construct maps to standard-setting procedures will be the judicious selection of data to include within this organizing framework. Therefore, this commentary focuses on decisions about what to include in the construct map.…

[Job stress and quality of life of primary care health-workers: evidence of validity of the PECVEC questionnaire].

PubMed

Fernández-López, Juan Antonio; Fernández-Fidalgo, María; Martín-Payo, Rubén; Rödel, Andreas

2007-08-01

To evaluate the relationship between Health-Related Quality of Life (HRQL) and stress at work among Primary Care workers, as evidence of the construct validity of the Spanish version (PECVEC) of the profile of quality of life in the chronically ill (PLC) questionnaire. In addition, to check its other psychometric properties. Cross-sectional study. Eighteen primary care centres in Health Area IV, Asturias (Oviedo), Spain, sharing similar socio-demographic conditions. Two hundred and thirty-three primary care nurses and physicians. HRQL was evaluated by the 6 general dimensions of the Spanish version of the PLC. Stress at work was evaluated by the three scales of the Effort-Reward Imbalance (ERI) questionnaire. The construct validity of the PECVEC was assessed by testing the inverse associations of QoL dimensions and job stress ones, when the most important confuser variables were monitored. The non-response rate was low (<3%), and no floor effects and only small ceiling effects were observed. Internal consistency analysis and exploratory and confirmatory factor analysis demonstrated high reliability, factorial validity and convergent/divergent validity of the PECVEC. The PECVEC demonstrates adequate psychometric properties for evaluating HRQL in healthy subjects.

The construct validity of session RPE during an intensive camp in young male Karate athletes

PubMed Central

Padulo, Johnny; Chaabène, Helmi; Tabben, Montassar; Haddad, Monoem; Gevat, Cecilia; Vando, Stefano; Maurino, Lucio; Chaouachi, Anis; Chamari, Karim

2014-01-01

Summary Background: the aim of this study was to assess the validity of the session rating of perceived exertion (RPE) method and two objective HR-based methods for quantifying karate’s training load (TL) in young Karatekas. Methods: eleven athletes (age 12.50±1.84 years) participated in this study. The training period/camp was performed on 5 consecutive days with two training session (s) per-day (d). Construct validity of RPE method in young Karate athletes, was studied by correlation analysis between RPE session’s training load and both Edwards and Banister’s training impulse score’ method. Results: significant relationship was found between inter-day (n-11 × d-5 × s-2 = 110) sessions RPE and Edwards (r values from 0.84 to 0.92 p < 0.001) and Banister’s (r values from 0.84 to 0.97 p < 0.001), respectively Conclusion: this study showed that session-RPE can be considered a valid method for quantifying karate’s training load in young karate athletes. PMID:25332921

Preliminary validation of the Yale Food Addiction Scale for children.

PubMed

Gearhardt, Ashley N; Roberto, Christina A; Seamans, Marissa J; Corbin, William R; Brownell, Kelly D

2013-12-01

Evidence is growing that an addictive process may play a role in problematic eating behavior. The majority of research on this topic has examined the concept of "food addiction" solely in adult samples. If certain foods have addictive potential, children may be impacted as much as (or more) than adults due to psychological and neurobiological vulnerabilities at younger developmental stages. In the current study, we developed a measure of food addiction in children that reflects the diagnostic indicators of addiction. The content and reading level of the Yale Food Addiction Scale (YFAS) was altered to be appropriate for children (YFAS-C). The YFAS-C and other eating-related measures were administered to study participants to examine the validity and reliability of the YFAS-C. 75 children were recruited from the community ranging from lean to obese. The validation of the YFAC-C provides preliminary support for its convergent validity with like constructs and incremental validity in predicting body mass index. Internal consistency was adequate given the small number of items on the scale. The YFAS-C appears to be a helpful tool for identifying addictive-like eating in children. © 2013.

Resilience in a reborn nation: Validation of the Lithuanian Resilience Scale for Adults (RSA).

PubMed

Hilbig, Jan; Viliūnienė, Rima; Friborg, Oddgeir; Pakalniškienė, Vilmantė; Danilevičiūtė, Vita

2015-07-01

Resilience, as an ability to withstand or rebound from crisis or adversity, is becoming an increasingly significant concept in health promotion and well-being. Individuals exhibiting resilience use skills or resources flexibly to solve situational demands. The Resilience Scale for Adults (RSA) may be used to assess protective resources, and the aim of the present study was to validate the Lithuanian translation. The translated RSA was administered to a clinical (n=125) and a non clinical sample (n=499) to examine the discriminant validity of the RSA items with a confirmatory factor analysis, the internal consistency as well as construct validity by correlating it with the Quick Psycho-Affective Symptoms Scan (QPASS). The internal consistency, the test-retest stability and the factor structure were replicated as adequate, thus indicating good psychometric properties and support of discriminant validity. Females reported more resilience resources for the domains of social competence, family cohesion and social resources compared to men. The RSA subscales correlated negatively with the QPASS scores, and patients reported significantly less resilience resources than non-patients, thus indicating construct validity. Valid psychometric tools for research purposes and routine every-day use are urgently needed in Lithuania, a young nation still under numerous challenges due to social, economic and political transitions. The RSA represents a reliable and valid tool for assessing protective factors. Assessing resilience factors may extend the understanding of factors relevant for mental health problems as well as treatment prognosis beyond the capabilities of mere symptom oriented approaches. Copyright © 2015 Elsevier Inc. All rights reserved.

The Prosocial and Antisocial Behaviour in Sport Scale: further evidence for construct validity and reliability.

PubMed

Kavussanu, Maria; Stanger, Nicholas; Boardley, Ian D

2013-01-01

The purpose of this research was to provide further evidence for the construct validity (i.e., convergent, concurrent, and discriminant validity) of the Prosocial and Antisocial Behaviour in Sport Scale (PABSS), an instrument that has four subscales measuring prosocial and antisocial behaviour toward teammates and opponents. We also investigated test-retest reliability and stability of the PABSS. We conducted three studies using athletes from a variety of team sports. In Study 1, participants (N = 129) completed the PABSS and measures of physical and verbal aggression, hostility, anger, moral identity, and empathy; a sub-sample (n = 111) also completed the PABSS one week later. In Study 2, in addition to the PABSS, participants (N = 89) completed measures of competitive aggressiveness and anger, moral attitudes, moral disengagement, goal orientation, and anxiety. In Study 3, participants (N = 307) completed the PABSS and a measure of social goals. Across the three studies, the four subscales evidenced the hypothesised relationships with a number of variables. Correlations were large between the two antisocial behaviours and small between the two prosocial behaviours. Overall, the findings supported the convergent, concurrent, and discriminant validity of the scale, provided evidence for its test-retest reliability and stability, and suggest that the instrument is a valid and reliable measure of prosocial and antisocial behaviour in sport.

The Construct Validity of HPAT-Ireland for the Selection of Medical Students: Unresolved Issues and Future Research Implications

ERIC Educational Resources Information Center

Kelly, Maureen E.; O'Flynn, Siun

2017-01-01

Aptitude tests are widely used in selection. However, despite certain advantages their use remains controversial. This paper aims to critically appraise five sources of evidence for the construct validity of the Health Professions Admission Test (HPAT)-Ireland, an aptitude test used for selecting undergraduate medical students. The objectives are…

Assessment of the nursing care product (APROCENF): a reliability and construct validity study.

PubMed

Cucolo, Danielle Fabiana; Perroca, Márcia Galan

2017-04-06

to verify the reliability and construct validity estimates of the "Assessment of nursing care product" scale (APROCENF) and its applicability. this validation study included a sample of 40 (inter-rater reliability) and 172 (construct validity) assessments performed by nurses at the end of the work shift at nine inpatient services of a teaching hospital in the Brazilian Southeast. The data were collected between February and September/2014 with interruptions. Cronbach's alpha and Spearman's correlation coefficients were calculated, as well as the intraclass correlation and the weighted kappa index (inter-rater reliability). Exploratory factor analysis was used with principal component extraction and varimax rotation (construct validity). the internal consistency revealed an alpha coefficient of 0.85, item-item correlation ranging between 0.13 and 0.61 and item-total correlation between 0.43 and 0.69. Inter-rater equivalence was obtained and all items evidenced significant factor loadings. this research evidenced the reliability and construct validity of the scale to assess the nursing care product. Its application in nursing practice permits identifying improvements needed in the production process, contributing to management and care decisions. verificar as estimativas de confiabilidade e validade de construto da escala "Avaliação do produto do cuidar em enfermagem" (APROCENF) e sua aplicabilidade. este estudo de validação incluiu em sua amostra 40 (confiabilidade interavaliadores) e 172 (validade de construto) avaliações realizadas por enfermeiros ao final do turno de trabalho em nove unidades de internação de um hospital universitário do sudeste brasileiro. A coleta de dados ocorreu entre fevereiro e setembro de 2014 de forma interrupta. Foram calculados os coeficientes alfa de Cronbach e correlação de Spearman (consistência interna), a correlação intraclasse e Kappa ponderado (confiabilidade interavaliadores) e a análise fatorial exploratória foi

Construct validity of the canadian occupational performance measure in participants with tendon injury and Dupuytren disease.

PubMed

van de Ven-Stevens, Lucelle A W; Graff, Maud J L; Peters, Marlijn A M; van der Linde, Harmen; Geurts, Alexander C H

2015-05-01

In patient-centered practice, instruments need to assess outcomes that are meaningful to patients with hand conditions. It is unclear which assessment tools address these subjective perspectives best. The aim of this study was to establish the construct validity of the Canadian Occupational Performance Measure (COPM) in relation to the Disabilities of Arm, Shoulder, and Hand (DASH) questionnaire and the Michigan Hand Outcomes Questionnaire (MHQ) in people with hand conditions. It was hypothesized that COPM scores would correlate with DASH and MHQ total scores only to a moderate degree and that the COPM, DASH questionnaire, and MHQ would all correlate weakly with measures of hand impairments. This was a validation study. The COPM, DASH questionnaire, and MHQ were scored, and then hand impairments were measured (pain [numerical rating scale], active range of motion [goniometer], grip strength [dynamometer], and pinch grip strength [pinch meter]). People who had received postsurgery rehabilitation for flexor tendon injuries, extensor tendon injuries, or Dupuytren disease were eligible. Seventy-two participants were included. For all diagnosis groups, the Pearson coefficient of correlation between the DASH questionnaire and the MHQ was higher than .60, whereas the correlation between the performance scale of the COPM and either the DASH questionnaire or the MHQ was lower than .51. Correlations of these assessment tools with measures of hand impairments were lower than .46. The small sample sizes may limit the generalization of the results. The results supported the hypotheses and, thus, the construct validity of the COPM after surgery in people with hand conditions. © 2015 American Physical Therapy Association.

Validation of the Japanese version of the job crafting scale

PubMed Central

Eguchi, Hisashi; Shimazu, Akihito; Bakker, Arnold B.; Tims, Maria; Kamiyama, Kimika; Hara, Yujiro; Namba, Katsuyuki; Inoue, Akiomi; Ono, Masakatsu; Kawakami, Norito

2016-01-01

Objectives: The aim of this study was to validate the Japanese version of the job crafting scale (JCS-J). JCS measures four independent job crafting dimensions, namely increasing structural job resources, decreasing hindering job demands, increasing social job resources, and increasing challenging job demands. Methods: The translated and back-translated JCS-J questionnaires were administered online to 972 employees of a Japanese manufacturing company. The data were then divided into independent explorative and confirmative samples. Exploratory and confirmatory factor analyses were performed to evaluate the factorial validity of JCS-J. The relationship with potential consequences of job crafting (e.g., job demands, job resources, and psychological well-being) was investigated to evaluate construct validity. Internal consistency was examined to evaluate the reliability of the four JCSs. Results: An exploratory factor analysis extracted a five-factor solution. Decreasing hindering job demands was further split into two separate dimensions supporting a five- rather than four-factor structure. A series of confirmatory factor analyses revealed that the modified five-factor model that allows covariance between items fits the data best. Construct validity was generally supported by the expected correlations of each job crafting dimension with each corresponding job resource (+), job demand (+), and psychological well-being (+). Cronbach's α coefficient was sufficient for each of the four dimensions of job crafting (α ranged between 0.76 and 0.90). Conclusions: This study confirmed that JCS-J is an adequate measure of job crafting that can be used in the Japanese context. PMID:27108643

5 CFR 919.900 - Adequate evidence.

Code of Federal Regulations, 2010 CFR

2010-01-01

... 5 Administrative Personnel 2 2010-01-01 2010-01-01 false Adequate evidence. 919.900 Section 919.900 Administrative Personnel OFFICE OF PERSONNEL MANAGEMENT (CONTINUED) CIVIL SERVICE REGULATIONS.... Adequate evidence means information sufficient to support the reasonable belief that a particular act or...

5 CFR 919.900 - Adequate evidence.

Code of Federal Regulations, 2011 CFR

2011-01-01

... 5 Administrative Personnel 2 2011-01-01 2011-01-01 false Adequate evidence. 919.900 Section 919.900 Administrative Personnel OFFICE OF PERSONNEL MANAGEMENT (CONTINUED) CIVIL SERVICE REGULATIONS.... Adequate evidence means information sufficient to support the reasonable belief that a particular act or...

5 CFR 919.900 - Adequate evidence.

Code of Federal Regulations, 2014 CFR

2014-01-01

... 5 Administrative Personnel 2 2014-01-01 2014-01-01 false Adequate evidence. 919.900 Section 919.900 Administrative Personnel OFFICE OF PERSONNEL MANAGEMENT (CONTINUED) CIVIL SERVICE REGULATIONS.... Adequate evidence means information sufficient to support the reasonable belief that a particular act or...

5 CFR 919.900 - Adequate evidence.

Code of Federal Regulations, 2013 CFR

2013-01-01

... 5 Administrative Personnel 2 2013-01-01 2013-01-01 false Adequate evidence. 919.900 Section 919.900 Administrative Personnel OFFICE OF PERSONNEL MANAGEMENT (CONTINUED) CIVIL SERVICE REGULATIONS.... Adequate evidence means information sufficient to support the reasonable belief that a particular act or...

5 CFR 919.900 - Adequate evidence.

Code of Federal Regulations, 2012 CFR

2012-01-01

... 5 Administrative Personnel 2 2012-01-01 2012-01-01 false Adequate evidence. 919.900 Section 919.900 Administrative Personnel OFFICE OF PERSONNEL MANAGEMENT (CONTINUED) CIVIL SERVICE REGULATIONS.... Adequate evidence means information sufficient to support the reasonable belief that a particular act or...

Brazilian validation of the Alberta Infant Motor Scale.

PubMed

Valentini, Nadia Cristina; Saccani, Raquel

2012-03-01

The Alberta Infant Motor Scale (AIMS) is a well-known motor assessment tool used to identify potential delays in infants' motor development. Although Brazilian researchers and practitioners have used the AIMS in laboratories and clinical settings, its translation to Portuguese and validation for the Brazilian population is yet to be investigated. This study aimed to translate and validate all AIMS items with respect to internal consistency and content, criterion, and construct validity. A cross-sectional and longitudinal design was used. A cross-cultural translation was used to generate a Brazilian-Portuguese version of the AIMS. In addition, a validation process was conducted involving 22 professionals and 766 Brazilian infants (aged 0-18 months). The results demonstrated language clarity and internal consistency for the motor criteria (motor development score, α=.90; prone, α=.85; supine, α=.92; sitting, α=.84; and standing, α=.86). The analysis also revealed high discriminative power to identify typical and atypical development (motor development score, P<.001; percentile, P=.04; classification criterion, χ(2)=6.03; P=.05). Temporal stability (P=.07) (rho=.85, P<.001) was observed, and predictive power (P<.001) was limited to the group of infants aged from 3 months to 9 months. Limited predictive validity was observed, which may have been due to the restricted time that the groups were followed longitudinally. In sum, the translated version of AIMS presented adequate validity and reliability.

Problem-solving style and multicultural personality dispositions: a study of construct validity.

PubMed

Houtz, John C; Ponterotto, Joseph G; Burger, Claudia; Marino, Cherylynn

2010-06-01

This exploratory study examined the relationship between problem-solving styles and multicultural personality dispositions among 91 graduate students enrolled in an urban university located in the northeast United States. Problem-solving style was assessed with the three dimensions of the VIEW: an Assessment of Problem Solving Style. Multicultural personality was assessed with the five-factor Multicultural Personality Questionnaire (MPQ); its factors of Cultural Empathy, Open-mindedness, Social Initiative, and Flexibility correlated significantly with Explorer and External problem-solving styles, as predicted. The Emotional Stability subscale also correlated significantly with scores on Explorer style, suggesting that individuals who prefer "thinking in new directions" in problem solving are more likely to report remaining calm under stressful situations. Collectively, study results provided additional evidence of construct validity for the VIEW.

Validity and reliability of the NAB Naming Test.

PubMed

Sachs, Bonnie C; Rush, Beth K; Pedraza, Otto

2016-05-01

Confrontation naming is commonly assessed in neuropsychological practice, but few standardized measures of naming exist and those that do are susceptible to the effects of education and culture. The Neuropsychological Assessment Battery (NAB) Naming Test is a 31-item measure used to assess confrontation naming. Despite adequate psychometric information provided by the test publisher, there has been limited independent validation of the test. In this study, we investigated the convergent and discriminant validity, internal consistency, and alternate forms reliability of the NAB Naming Test in a sample of adults (Form 1: n = 247, Form 2: n = 151) clinically referred for neuropsychological evaluation. Results indicate adequate-to-good internal consistency and alternate forms reliability. We also found strong convergent validity as demonstrated by relationships with other neurocognitive measures. We found preliminary evidence that the NAB Naming Test demonstrates a more pronounced ceiling effect than other commonly used measures of naming. To our knowledge, this represents the largest published independent validation study of the NAB Naming Test in a clinical sample. Our findings suggest that the NAB Naming Test demonstrates adequate validity and reliability and merits consideration in the test arsenal of clinical neuropsychologists.

Cross-cultural adaptation and validation of the teamwork climate scale

PubMed Central

Silva, Mariana Charantola; Peduzzi, Marina; Sangaleti, Carine Teles; da Silva, Dirceu; Agreli, Heloise Fernandes; West, Michael A; Anderson, Neil R

2016-01-01

ABSTRACT OBJECTIVE To adapt and validate the Team Climate Inventory scale, of teamwork climate measurement, for the Portuguese language, in the context of primary health care in Brazil. METHODS Methodological study with quantitative approach of cross-cultural adaptation (translation, back-translation, synthesis, expert committee, and pretest) and validation with 497 employees from 72 teams of the Family Health Strategy in the city of Campinas, SP, Southeastern Brazil. We verified reliability by the Cronbach’s alpha, construct validity by the confirmatory factor analysis with SmartPLS software, and correlation by the job satisfaction scale. RESULTS We problematized the overlap of items 9, 11, and 12 of the “participation in the team” factor and the “team goals” factor regarding its definition. The validation showed no overlapping of items and the reliability ranged from 0.92 to 0.93. The confirmatory factor analysis indicated suitability of the proposed model with distribution of the 38 items in the four factors. The correlation between teamwork climate and job satisfaction was significant. CONCLUSIONS The version of the scale in Brazilian Portuguese was validated and can be used in the context of primary health care in the Country, constituting an adequate tool for the assessment and diagnosis of teamwork. PMID:27556966

Development of the Brazilian Portuguese version of the Achilles Tendon Total Rupture Score (ATRS BrP): a cross-cultural adaptation with reliability and construct validity evaluation.

PubMed

Zambelli, Roberto; Pinto, Rafael Z; Magalhães, João Murilo Brandão; Lopes, Fernando Araujo Silva; Castilho, Rodrigo Simões; Baumfeld, Daniel; Dos Santos, Thiago Ribeiro Teles; Maffulli, Nicola

2016-01-01

There is a need for a patient-relevant instrument to evaluate outcome after treatment in patients with a total Achilles tendon rupture. The purpose of this study was to undertake a cross-cultural adaptation of the Achilles Tendon Total Rupture Score (ATRS) into Brazilian Portuguese, determining the test-retest reliability and construct validity of the instrument. A five-step approach was used in the cross-cultural adaptation process: initial translation (two bilingual Brazilian translators), synthesis of translation, back-translation (two native English language translators), consensus version and evaluation (expert committee), and testing phase. A total of 46 patients were recruited to evaluate the test-retest reproducibility and construct validity of the Brazilian Portuguese version of the ATRS. Test-retest reproducibility was performed by assessing each participant on two separate occasions. The construct validity was determined by the correlation index between the ATRS and the Orthopedic American Foot and Ankle Society (AOFAS) questionnaires. The final version of the Brazilian Portuguese ATRS had the same number of questions as the original ATRS. For the reliability analysis, an ICC(2,1) of 0.93 (95 % CI: 0.88 to 0.96) with SEM of 1.56 points and MDC of 4.32 was observed, indicating excellent reliability. The construct validity showed excellent correlation with R = 0.76 (95 % CI: 0.52 to 0.89, P < 0.001). The ATRS was successfully cross-culturally validated into Brazilian Portuguese. This version was a reliable and valid measure of function in patients who suffered complete rupture of the Achilles Tendon.

Construction and Validation of the Clinical Judgment Skill Inventory: Clinical Judgment Skill Competencies That Measure Counselor Debiasing Techniques

ERIC Educational Resources Information Center

Austin, Bryan S.; Leahy, Michael J.

2015-01-01

Purpose: To construct and validate a new self-report instrument, the Clinical Judgment Skill Inventory (CJSI), inclusive of clinical judgment skill competencies that address counselor biases and evidence-based strategies. Method: An Internet-based survey design was used and an exploratory factor analysis was performed on a sample of rehabilitation…

On Validity Theory and Test Validation

ERIC Educational Resources Information Center

Sireci, Stephen G.

2007-01-01

Lissitz and Samuelsen (2007) propose a new framework for conceptualizing test validity that separates analysis of test properties from analysis of the construct measured. In response, the author of this article reviews fundamental characteristics of test validity, drawing largely from seminal writings as well as from the accepted standards. He…

Updating the OMERACT filter: implications of filter 2.0 to select outcome instruments through assessment of "truth": content, face, and construct validity.

PubMed

Tugwell, Peter; Boers, Maarten; D'Agostino, Maria-Antonietta; Beaton, Dorcas; Boonen, Annelies; Bingham, Clifton O; Choy, Ernest; Conaghan, Philip G; Dougados, Maxime; Duarte, Catia; Furst, Daniel E; Guillemin, Francis; Gossec, Laure; Heiberg, Turid; van der Heijde, Désirée M; Hewlett, Sarah; Kirwan, John R; Kvien, Tore K; Landewé, Robert B; Mease, Philip J; Østergaard, Mikkel; Simon, Lee; Singh, Jasvinder A; Strand, Vibeke; Wells, George

2014-05-01

The Outcome Measures in Rheumatology (OMERACT) Filter provides guidelines for the development and validation of outcome measures for use in clinical research. The "Truth" section of the OMERACT Filter requires that criteria be met to demonstrate that the outcome instrument meets the criteria for content, face, and construct validity. Discussion groups critically reviewed a variety of ways in which case studies of current OMERACT Working Groups complied with the Truth component of the Filter and what issues remained to be resolved. The case studies showed that there is broad agreement on criteria for meeting the Truth criteria through demonstration of content, face, and construct validity; however, several issues were identified that the Filter Working Group will need to address. These issues will require resolution to reach consensus on how Truth will be assessed for the proposed Filter 2.0 framework, for instruments to be endorsed by OMERACT.

Effects of organizational complexity and resources on construction site risk.

PubMed

Forteza, Francisco J; Carretero-Gómez, Jose M; Sesé, Albert

2017-09-01

Our research is aimed at studying the relationship between risk level and organizational complexity and resources on constructions sites. Our general hypothesis is that site complexity increases risk, whereas more resources of the structure decrease risk. A Structural Equation Model (SEM) approach was adopted to validate our theoretical model. To develop our study, 957 building sites in Spain were visited and assessed in 2003-2009. All needed data were obtained using a specific tool developed by the authors to assess site risk, structure and resources (Construction Sites Risk Assessment Tool, or CONSRAT). This tool operationalizes the variables to fit our model, specifically, via a site risk index (SRI) and 10 organizational variables. Our random sample is composed largely of small building sites with general high levels of risk, moderate complexity, and low resources on site. The model obtained adequate fit, and results showed empirical evidence that the factors of complexity and resources can be considered predictors of site risk level. Consequently, these results can help companies, managers of construction and regulators to identify which organizational aspects should be improved to prevent risks on sites and consequently accidents. Copyright © 2017 National Safety Council and Elsevier Ltd. All rights reserved.

2 CFR 180.900 - Adequate evidence.

Code of Federal Regulations, 2014 CFR

2014-01-01

... 2 Grants and Agreements 1 2014-01-01 2014-01-01 false Adequate evidence. 180.900 Section 180.900 Grants and Agreements Office of Management and Budget Guidance for Grants and Agreements OFFICE OF.... Adequate evidence means information sufficient to support the reasonable belief that a particular act or...

2 CFR 180.900 - Adequate evidence.

Code of Federal Regulations, 2011 CFR

2011-01-01

... 2 Grants and Agreements 1 2011-01-01 2011-01-01 false Adequate evidence. 180.900 Section 180.900 Grants and Agreements Office of Management and Budget Guidance for Grants and Agreements OFFICE OF.... Adequate evidence means information sufficient to support the reasonable belief that a particular act or...

Effect of Items Direction (Positive or Negative) on the Factorial Construction and Criterion Related Validity in Likert Scale

ERIC Educational Resources Information Center

Naji Qasem, Mamun Ali; Ahmad Gul, Showkeen Bilal

2014-01-01

The study was conducted to know the effect of items direction (positive or negative) on the factorial construction and criterion related validity in Likert scale. The descriptive survey research method was used for the study and the sample consisted of 510 undergraduate students selected by used random sampling technique. A scale developed by…

Construct and Predictive Validity of the Core Phonics Survey: A Diagnostic Assessment for Students with Specific Learning Disabilities

ERIC Educational Resources Information Center

Park, Yujeong; Benedict, Amber E.; Brownell, Mary T.

2014-01-01

The factor structure of the CORE Phonics Survey was analyzed using a sample of 165 students in upper elementary school with specific learning disabilities. Confirmatory factor analysis was used to identify the hypothesized constructs of the CORE Phonics Survey and predictive validity of the CORE Phonics Survey to predict students' success in word…

Development and validation of the Hospitality Axiological Scale for Humanization of Nursing Care

PubMed Central

Galán González-Serna, José María; Ferreras-Mencia, Soledad; Arribas-Marín, Juan Manuel

2017-01-01

ABSTRACT Objective: to develop and validate a scale to evaluate nursing attitudes in relation to hospitality for the humanization of nursing care. Participants: the sample consisted of 499 nursing professionals and undergraduate students of the final two years of the Bachelor of Science in Nursing program. Method: the instrument has been developed and validated to evaluate the ethical values related to hospitality using a methodological approach. Subsequently, a model was developed to measure the dimensions forming the construct hospitality. Results: the Axiological Hospitality Scale showed a high internal consistency, with Cronbach’s Alpha=0.901. The validation of the measuring instrument was performed using factorial, exploratory and confirmatory analysis techniques with high goodness of fit measures. Conclusions: the developed instrument showed an adequate validity and a high internal consistency. Based on the consistency of its psychometric properties, it is possible to affirm that the scale provides a reliable measurement of the hospitality. It was also possible to determine the dimensions or sources that embrace it: respect, responsibility, quality and transpersonal care. PMID:28793127

Resilient leadership and the organizational culture of resilience: construct validation.

PubMed

Everly, George S; Smith, Kenneth J; Lobo, Rachel

2013-01-01

Political, economic, and social unrest and uncertainty seem replete throughout the world. Within the United States, political vitriol and economic volatility have led to severe economic restrictions. Both government and private sector organizations are being asked to do more with less. The specter of dramatic changes in healthcare creates a condition of uncertainty affecting budget allocations and hiring practices. If ever there was a time when a "resilient culture" was needed, it is now. In this paper we shall discuss the application of "tipping point" theory (Gladwell, 2000) operationalized through a special form of leadership: "resilient leadership" (Everly, Strouse, Everly, 2010). Resilient leadership is consistent with Gladwells "Law of the Few" and strives to create an organizational culture of resilience by implementing an initial change within no more than 20% of an organization's workforce. It is expected that such a minority, if chosen correctly, will "tip" the rest of the organization toward enhanced resilience, ideally creating a self-sustaining culture of resilience. This paper reports on the empirical foundations and construct validation of "resilient leadership".

Validation of the Simple Shoulder Test in a Portuguese-Brazilian population. Is the latent variable structure and validation of the Simple Shoulder Test Stable across cultures?

PubMed

Neto, Jose Osni Bruggemann; Gesser, Rafael Lehmkuhl; Steglich, Valdir; Bonilauri Ferreira, Ana Paula; Gandhi, Mihir; Vissoci, João Ricardo Nickenig; Pietrobon, Ricardo

2013-01-01

The validation of widely used scales facilitates the comparison across international patient samples. The objective of this study was to translate, culturally adapt and validate the Simple Shoulder Test into Brazilian Portuguese. Also we test the stability of factor analysis across different cultures. The objective of this study was to translate, culturally adapt and validate the Simple Shoulder Test into Brazilian Portuguese. Also we test the stability of factor analysis across different cultures. The Simple Shoulder Test was translated from English into Brazilian Portuguese, translated back into English, and evaluated for accuracy by an expert committee. It was then administered to 100 patients with shoulder conditions. Psychometric properties were analyzed including factor analysis, internal reliability, test-retest reliability at seven days, and construct validity in relation to the Short Form 36 health survey (SF-36). Factor analysis demonstrated a three factor solution. Cronbach's alpha was 0.82. Test-retest reliability index as measured by intra-class correlation coefficient (ICC) was 0.84. Associations were observed in the hypothesized direction with all subscales of SF-36 questionnaire. The Simple Shoulder Test translation and cultural adaptation to Brazilian-Portuguese demonstrated adequate factor structure, internal reliability, and validity, ultimately allowing for its use in the comparison with international patient samples.

Validation of the Simple Shoulder Test in a Portuguese-Brazilian Population. Is the Latent Variable Structure and Validation of the Simple Shoulder Test Stable across Cultures?

PubMed Central

Neto, Jose Osni Bruggemann; Gesser, Rafael Lehmkuhl; Steglich, Valdir; Bonilauri Ferreira, Ana Paula; Gandhi, Mihir; Vissoci, João Ricardo Nickenig; Pietrobon, Ricardo

2013-01-01

Background The validation of widely used scales facilitates the comparison across international patient samples. The objective of this study was to translate, culturally adapt and validate the Simple Shoulder Test into Brazilian Portuguese. Also we test the stability of factor analysis across different cultures. Objective The objective of this study was to translate, culturally adapt and validate the Simple Shoulder Test into Brazilian Portuguese. Also we test the stability of factor analysis across different cultures. Methods The Simple Shoulder Test was translated from English into Brazilian Portuguese, translated back into English, and evaluated for accuracy by an expert committee. It was then administered to 100 patients with shoulder conditions. Psychometric properties were analyzed including factor analysis, internal reliability, test-retest reliability at seven days, and construct validity in relation to the Short Form 36 health survey (SF-36). Results Factor analysis demonstrated a three factor solution. Cronbach’s alpha was 0.82. Test-retest reliability index as measured by intra-class correlation coefficient (ICC) was 0.84. Associations were observed in the hypothesized direction with all subscales of SF-36 questionnaire. Conclusion The Simple Shoulder Test translation and cultural adaptation to Brazilian-Portuguese demonstrated adequate factor structure, internal reliability, and validity, ultimately allowing for its use in the comparison with international patient samples. PMID:23675436

Reliability, construct validity and determinants of 6-minute walk test performance in patients with chronic heart failure.

PubMed

Uszko-Lencer, Nicole H M K; Mesquita, Rafael; Janssen, Eefje; Werter, Christ; Brunner-La Rocca, Hans-Peter; Pitta, Fabio; Wouters, Emiel F M; Spruit, Martijn A

2017-08-01

In-depth analyses of the measurement properties of the 6-minute walk test (6MWT) in patients with chronic heart failure (CHF) are lacking. We investigated the reliability, construct validity, and determinants of the distance covered in the 6MWT (6MWD) in CHF patients. 337 patients were studied (median age 65years, 70% male, ejection fraction 35%). Participants performed two 6MWTs on subsequent days. Demographics, anthropometrics, clinical data, ejection fraction, maximal exercise capacity, body composition, lung function, and symptoms of anxiety and depression were also assessed. Construct validity was assessed in terms of convergent, discriminant and known-groups validity. Stepwise linear regression was used. 6MWT was reliable (ICC=0.90, P<0.0001). The learning effect was 31m (95%CI 27, 35m). Older age (≥65years), lower lung diffusing capacity (<80% predicted) and higher NYHA class (NYHA III) were associated with a lower likelihood of a meaningful increase in the second test (OR 0.45-0.56, P<0.05 for all). The best 6MWD had moderate-to-good correlations with peak exercise capacity (r s =0.54-0.69) and no-to-fair correlations with body composition, lung function, ejection fraction, and symptoms of anxiety and depression (r s =0.04-0.49). Patients with higher NYHA classes had lower 6MWD. 6MWD was independently associated with maximal power output during maximal exercise, estimated glomerular filtration rate and age (51.7% of the variability). 6MWT was found to be reliable and valid in patients with mild-to-moderate CHF. Maximal exercise capacity, renal function and age were significant determinants of the best 6MWD. These findings strengthen the clinical utility of the 6MWT in CHF. Copyright © 2017 Elsevier B.V. All rights reserved.

The risk of bias in systematic reviews tool showed fair reliability and good construct validity.

PubMed

Bühn, Stefanie; Mathes, Tim; Prengel, Peggy; Wegewitz, Uta; Ostermann, Thomas; Robens, Sibylle; Pieper, Dawid

2017-11-01

There is a movement from generic quality checklists toward a more domain-based approach in critical appraisal tools. This study aimed to report on a first experience with the newly developed risk of bias in systematic reviews (ROBIS) tool and compare it with A Measurement Tool to Assess Systematic Reviews (AMSTAR), that is, the most common used tool to assess methodological quality of systematic reviews while assessing validity, reliability, and applicability. Validation study with four reviewers based on 16 systematic reviews in the field of occupational health. Interrater reliability (IRR) of all four raters was highest for domain 2 (Fleiss' kappa κ = 0.56) and lowest for domain 4 (κ = 0.04). For ROBIS, median IRR was κ = 0.52 (range 0.13-0.88) for the experienced pair of raters compared to κ = 0.32 (range 0.12-0.76) for the less experienced pair of raters. The percentage of "yes" scores of each review of ROBIS ratings was strongly correlated with the AMSTAR ratings (r s  = 0.76; P = 0.01). ROBIS has fair reliability and good construct validity to assess the risk of bias in systematic reviews. More validation studies are needed to investigate reliability and applicability, in particular. Copyright © 2017 Elsevier Inc. All rights reserved.

Teachers' Professional Orientation: An Empirical Examination of the Construct Validity Using the Results of Large-Scale Factor Analyses.

ERIC Educational Resources Information Center

Chauvin, Sheila W.; Ellett, Chad D.

The construct validity of the Attitudes of Professional Autonomy (APA) as a proxy measure of professional orientation was studied. The sample consisted of all teachers in 94 schools in 6 districts in Louisiana, closely representing the statewide distribution of all schools by level and socioeconomic status. Usable data were received from 1,921…