The Nature of Science Instrument-Elementary (NOSI-E): the end of the road?

PubMed

Peoples, Shelagh M; O'Dwyer, Laura M

2014-01-01

This research continues prior work published in this journal (Peoples, O'Dwyer, Shields and Wang, 2013). The first paper described the scale development, psychometric analyses and part-validation of a theoretically-grounded Rasch-based instrument, the Nature of Science Instrument-Elementary (NOSI-E). The NOSI-E was designed to measure elementary students' understanding of the Nature of Science (NOS). In the first paper, evidence was provided for three of the six validity aspects (content, substantive and generalizability) needed to support the construct validity of the NOSI-E. The research described in this paper examines two additional validity aspects (structural and external). The purpose of this study was to determine which of three competing internal models provides reliable, interpretable, and responsive measures of students' understanding of NOS. One postulate is that the NOS construct is unidimensional;. alternatively, the NOS construct is composed of five independent unidimensional constructs (the consecutive approach). Lastly, the NOS construct is multidimensional and composed of five inter-related but separate dimensions. The vast body of evidence supported the claim that the NOS construct is multidimensional. Measures from the multidimensional model were positively related to student science achievement and students' perceptions of their classroom environment; this provided supporting evidence for the external validity aspect of the NOS construct. As US science education moves toward students learning science through engaging in authentic scientific practices and building learning progressions (NRC, 2012), it will be important to assess whether this new approach to teaching science is effective, and the NOSI-E may be used as a measure of the impact of this reform.

Validity and reliability of the Short Form 36 Health Surveys (SF-36) among patients with spondyloarthritis in Singapore.

PubMed

Kwan, Yu Heng; Fong, Warren Weng Seng; Lui, Nai Lee; Yong, Si Ting; Cheung, Yin Bun; Malhotra, Rahul; Østbye, Truls; Thumboo, Julian

2016-12-01

The Short Form 36 Health Survey (SF-36) is a popular health-related quality of life (HrQoL) tool. However, few studies have assessed its psychometric properties in patients with spondyloarthritis (SpA). We therefore aimed to assess the reliability and validity of the SF-36 in patients with SpA in Singapore. Cross-sectional data from a registry of 196 SpA patients recruited from a dedicated tertiary referral clinic in Singapore from 2011 to 2014 was used. Analyses were guided by the COnsensus-based Standards for the selection of health Measurement INstruments framework. Internal consistency reliability was assessed using Cronbach's alpha. Construct validity was assessed through 33 a priori hypotheses by correlations of the eight subscales and two summary scores of SF-36 with other health outcomes. Known-group construct validity was assessed by comparison of the means of the subscales and summary scores of the SF-36 of SpA patients and the general population of Singapore using student's t tests. Among 196 patients (155 males (79.0 %), median (range) age: 36 (17-70), 166 Chinese (84.6 %)), SF-36 scales showed high internal consistency ranging from 0.88 to 0.90. Convergent construct validity was supported as shown by fulfillment of all hypotheses. Divergent construct validity was supported, as SF-36 MCS was not associated with PGA, pain and HAQ. Known-group construct validity showed SpA patients had lower scores of 3.8-12.5 when compared to the general population at p < 0.001. This study supports the SF-36 as a valid and reliable measure of HrQoL for use in patients with SpA at a single time point.

The Motivation of Stereotypic and Repetitive Behavior: Examination of Construct Validity of the Motivation Assessment Scale

ERIC Educational Resources Information Center

Joosten, Annette V.; Bundy, Anita C.

2008-01-01

Construct validity of the Motivation Assessment Scale (MAS) (Durand, Crimmins, The Motivation Assessment Scale 1988) was studied using Rasch analysis data from 67 children (246 MASs), with dual diagnosis of autism and intellectual disability or with intellectual disability only. Results failed to support the proposed unidimensional construct or…

On Conducting Construct Validity Meta-Analyses for the Rorschach: A Reply to Tibon Czopp and Zeligman (2016).

PubMed

Mihura, Joni L; Meyer, Gregory J; Dumitrascu, Nicolae; Bombel, George

2016-01-01

We respond to Tibon Czopp and Zeligman's (2016) critique of our systematic reviews and meta-analyses of 65 Rorschach Comprehensive System (CS) variables published in Psychological Bulletin (2013). The authors endorsed our supportive findings but critiqued the same methodology when used for the 13 unsupported variables. Unfortunately, their commentary was based on significant misunderstandings of our meta-analytic method and results, such as thinking we used introspectively assessed criteria in classifying levels of support and reporting only a subset of our externally assessed criteria. We systematically address their arguments that our construct label and criterion variable choices were inaccurate and, therefore, meta-analytic validity for these 13 CS variables was artificially low. For example, the authors created new construct labels for these variables that they called "the customary CS interpretation," but did not describe their methodology nor provide evidence that their labels would result in better validity than ours. They cite studies they believe we should have included; we explain how these studies did not fit our inclusion criteria and that including them would have actually reduced the relevant CS variables' meta-analytic validity. Ultimately, criticisms alone cannot change meta-analytic support from negative to positive; Tibon Czopp and Zeligman would need to conduct their own construct validity meta-analyses.

In Search of Validity Evidence in Support of the Interpretation and Use of Assessments of Complex Constructs: Discussion of Research on Assessing 21st Century Skills

ERIC Educational Resources Information Center

Ercikan, Kadriye; Oliveri, María Elena

2016-01-01

Assessing complex constructs such as those discussed under the umbrella of 21st century constructs highlights the need for a principled assessment design and validation approach. In our discussion, we made a case for three considerations: (a) taking construct complexity into account across various stages of assessment development such as the…

Construct validity of the Thai version of the job content questionnaire in a large population of heterogeneous occupations.

PubMed

Phakthongsuk, Pitchaya

2009-04-01

To test the construct validity of the Thai version of the job content questionnaire (TJCQ). The present descriptive study recruited 10415 participants from all occupations according to the International Standard Classification of Occupations. The instrument consisted of a 48-item of the job content questionnaire. Eight items newly developed by the authors from in-depth interviews were added. Exploratory factor analysis showed six factor models of work hazards, decision latitude, psychological demand, social support, physical demand, and job security. However, supervisor and co-worker support were not distinguished into two factors and some items distributed differently along the factors extracted. Confirmatory factor analysis supported the construct of six latent factors, although the overall fit was moderately acceptable. Cronbach's alpha coefficients higher than 0.7, supported the internal consistency of TJCQ scales except for job security (0.55). These findings suggest that TJCQ is valid and reliable for assessing job stress among Thai populations.

The Virtual Shop: A new immersive virtual reality environment and scenario for the assessment of everyday memory.

PubMed

Ouellet, Émilie; Boller, Benjamin; Corriveau-Lecavalier, Nick; Cloutier, Simon; Belleville, Sylvie

2018-06-01

Assessing and predicting memory performance in everyday life is a common assignment for neuropsychologists. However, most traditional neuropsychological tasks are not conceived to capture everyday memory performance. The Virtual Shop is a fully immersive task developed to assess memory in a more ecological way than traditional neuropsychological assessments. Two studies were undertaken to assess the feasibility of the Virtual Shop and to appraise its ecological and construct validity. In study 1, 20 younger and 19 older adults completed the Virtual Shop task to evaluate its level of difficulty and the way the participants interacted with the VR material. The construct validity was examined with the contrasted-group method, by comparing the performance of younger and older adults. In study 2, 35 individuals with subjective cognitive decline completed the Virtual Shop task. Performance was correlated with an existing questionnaire evaluating everyday memory in order to appraise its ecological validity. To add further support to its construct validity, performance was correlated with traditional episodic memory and executive tasks. All participants successfully completed the Virtual Shop. The task had an appropriate level of difficulty that helped differentiate younger and older adults, supporting the feasibility and construct validity of the task. The performance on the Virtual Shop was significantly and moderately correlated with the performance on the questionnaire and on the traditional memory and executive tasks. Results support the feasibility and both the ecological and construct validity of the Virtual Shop. Copyright © 2018 The Authors. Published by Elsevier B.V. All rights reserved.

Psychometric Properties of an Instrument to Measure Mother-Infant Togetherness After Childbirth.

PubMed

Lawrence, Carol L; Norris, Anne E

2016-01-01

The purpose of this research was to evaluate the psychometric properties of a new instrument to measure mother-infant togetherness, Mother-Infant Togetherness Survey (MITS). Stage 1 examined content validity. Stage 2 pretested the readability and understandability and further examined content validity. Stage 3 examined women's ability to accurately self-report on the Delivery Events subscale. Stages 4 and 5 examined construct validity. Good content validity was obtained at the scale/subscale level (CVI = .91-1.00). Internal consistency reliability was evaluated at the scale/subscale level (α = .62-.89). Construct validity was supported with known groups testing and factor analysis. Study findings provide support for the reliability and validity of the MITS. Future research should be done to improve the internal consistency reliability of the Postpartum Events subscale.

Psychometric Properties of the Perceived Wellness Culture and Environment Support Scale.

PubMed

Melnyk, Bernadette Mazurek; Szalacha, Laura A; Amaya, Megan

2018-05-01

This study reports on the psychometric properties of the 11-item Perceived Wellness Culture and Environment Support Scale (PWCESS) and its relationship with employee healthy lifestyle beliefs and behaviors. Faculty and staff (N = 3959) at a large public university in the United States mid-west completed the PWCESS along with healthy lifestyle beliefs and behaviors scales. Data were randomly split into 2 halves to explore the PWCESS' validity and reliability and the second half to confirm findings. Principal components analysis indicated a unidimensional construct. The PWCESS was positively related to healthy lifestyle beliefs and behaviors supporting the scale's validity. Confirmatory factor analysis supported the unidimensional construct (Cronbach's α = .92). Strong evidence supports the validity and reliability of the PWCESS. Future use of this scale could guide workplace intervention strategies to improve organizational wellness culture and employee health outcomes.

Applying the transtheoretical model to tobacco cessation and prevention: a review of literature.

PubMed

Spencer, Leslie; Pagell, Francie; Hallion, Maria Elena; Adams, Troy B

2002-01-01

To comprehensively review all published, peer-reviewed research on the Transtheoretical Model (TTM) and tobacco cessation and prevention by exploring the validity of its constructs, the evidence for use of interventions based on the TTM, the description of populations using TTM constructs, and the identification of areas for further research. The three research questions answered were: "How is the validity of the TTM as applied to tobacco supported by research?" "How does the TTM describe special populations regarding tobacco use?" "What is the nature of evidence supporting the use of stage-matched tobacco interventions?" Computer Database search (PsychInfo, Medline, Current Contents, ERIC, CINAHL-Allied Health, and Pro-Quest Nursing) and manual journal search. INCLUSION/EXCLUSION CRITERIA: All English, original, research articles on the TTM as it relates to tobacco use published in peer-reviewed journals prior to March 1, 2001, were included. Commentaries, editorials, and books were not included. Articles were categorized as TTM construct validation, population descriptions using TTM constructs, or intervention evaluation using TTM constructs. Summary tables including study design, research rating, purpose, methods, findings, and implications were created. Articles were further divided into groups according to their purpose. Considering both the findings and research quality of each, the three research questions were addressed. The 148 articles reviewed included 54 validation studies, 73 population studies, and 37 interventions (some articles fit two categories). Overall, the evidence in support of the TTM as applied to tobacco use was strong, with supportive studies being more numerous and of a better design than nonsupportive studies. Using established criteria, we rated the construct validity of the entire body of literature as good; however, notable concerns exist about the staging construct. A majority of stage-matched intervention studies provided positive results and were of a better quality than those not supportive of stage-matched interventions; thus, we rated the body of literature using stage-matched tobacco interventions as acceptable and the body of literature using non-stage-matched interventions as suggestive. Population studies indicated that TTM constructs are applicable to a wide variety of general and special populations both in and outside of the United States, although a few exceptions exist. Evidence for the validity of the TTM as it applies to tobacco use is strong and growing; however, it is not conclusive. Eight different staging mechanisms were identified, raising the question of which are most valid and reliable. Interventions tailored to a smoker's stage were successful more often than nontailored interventions in promoting forward stage movement. Stage distribution is well-documented for U.S. populations; however, more research is needed for non-U.S. populations, for special populations, and on other TTM constructs.

Development, content validity, and piloting of an instrument designed to measure managers' attitude toward workplace breastfeeding support.

PubMed

Chow, Tan; Wolfe, Edward W; Olson, Beth H

2012-07-01

Manager attitude is influential in female employees' perceptions of workplace breastfeeding support. Currently, no instrument is available to assess manager attitude toward supporting women who wish to combine breastfeeding with work. We developed and piloted an instrument to measure manager attitudes toward workplace breastfeeding support entitled the "Managers' Attitude Toward Breastfeeding Support Questionnaire," an instrument that measures four constructs using 60 items that are rated agree/disagree on a 4-point Likert rating scale. We established the content validity of the Managers' Attitude Toward Breastfeeding Support Questionnaire measures through expert content review (n=22), expert assessment of item fit (n=11), and cognitive interviews (n=8). Data were collected from a purposive sample of 185 front-line managers who had experience supervising female employees, and responses were scaled using the Multidimensional Random Coefficients Multinomial Logit Model. Dimensionality analyses supported the proposed four-construct model. Reliability ranged from 0.75 to 0.86, and correlations between the constructs were moderately strong (0.47 to 0.71). Four items in two constructs exhibited model-to-data misfit and/or a low score-measure correlation. One item was revised and the other three items were retained in the Managers' Attitude Toward Breastfeeding Support Questionnaire. Findings of this study suggest that the Managers' Attitude Toward Breastfeeding Support Questionnaire measures are reliable and valid indicators of manager attitude toward workplace breastfeeding support, and future research should be conducted to establish external validity. The Managers' Attitude Toward Breastfeeding Support Questionnaire could be used to collect data in a standardized manner within and across companies to measure and compare manager attitudes toward supporting breastfeeding. Organizations can subsequently develop targeted strategies to improve support for breastfeeding employees through efforts influencing managerial attitude. Copyright © 2012 Academy of Nutrition and Dietetics. Published by Elsevier Inc. All rights reserved.

Identifying correlates of self-stigma in adults who stutter: Further establishing the construct validity of the Self-Stigma of Stuttering Scale (4S).

PubMed

Boyle, Michael P

2015-03-01

This study was set up to further establish the construct validity of the Self-Stigma of Stuttering Scale (4S) by demonstrating its associations with other established scales and replicating its original factor structure and reliability estimates. Web surveys were completed by 354 adults who stutter recruited from Board Certified Specialists in Fluency Disorders, and adult chapters of the National Stuttering Association. Participants completed a series of psychometrically validated scales measuring self-stigma, hope, empowerment, quality of life, social support, anxiety, depression, and self-rated speech disruption. Higher subscale and total stigma scores on the 4S were associated with significantly lower levels of hope, empowerment, quality of life, and social support, and significantly higher levels of anxiety, depression, and self-rated speech disruption. The original factor structure of the 4S was replicated, and reliability estimates of the subscales ranged from adequate to excellent. The findings of this study support the construct validity of the 4S and its use by clinicians and researchers intending to measure the construct of self-stigma in adults who stutter. Readers should be able to: (a) distinguish between the various components of self-stigma; (b) describe how the various components of the self-stigma model relate to hope, empowerment, quality of life, and social support, self-rated speech disruption, anxiety, and depression; (c) summarize the psychometric properties of the Self-Stigma of Stuttering Scale (4S) in terms of reliability, factor structure, and construct validity; (d) discuss how the 4S could be used in research and clinical practice. Copyright © 2015 Elsevier Inc. All rights reserved.

Psychometric properties of the revised Malay version Medical Outcome Study Social Support Survey using confirmatory factor analysis among postpartum mothers.

PubMed

Norhayati, Mohd Noor; Aniza, Abd Aziz; Nik Hazlina, Nik Hussain; Azman, Mohd Yacob

2015-12-01

Social support is an essential component for the physical and emotional well-being of postpartum mothers. The objective of this study is to determine the psychometric properties of the revised Malay version Medical Outcome Study (MOS) Social Support Survey using a confirmatory validity approach. A cross-sectional study was conducted involving 144 postpartum mothers attending Obstetric and Gynecology Clinic, Universiti Sains Malaysia Hospital. Construct validity and internal consistency assessment was performed after the translation, content validity and face validity process. The data were analyzed using SPSS 20.0 (SPSS Inc., Chicago, IL, USA) and AMOS 20.0 (SPSS Inc., Chicago, IL, USA). The original questionnaire consists of four domains (emotional/informational support, tangible support, affectionate support and positive social interaction) and 19 items. Affectionate support domain with three items only was treated as a separate construct and was not included in the factor analysis. The final confirmatory model with three constructs and 13 items demonstrated acceptable factor loadings, domain to domain correlation and best fit; (χ2[df]=1.665 [61]; P-value=0.001; Tucker-Lewis Index=0.944; comparative fit index=0.956; root mean square error of approximation=0.068). Composite reliability, average variance extracted and Cronbach's α of the domains ranged from 0.649 to 0.903; 0.390 to 0.699; 0.616 to 0.902, respectively. The study suggested that the four-factor model with 16 items (including one separate factor of affectionate) of the revised Malay version MOS Social Support Survey was acceptable to be used to measure social support after childbirth because it is valid, reliable and simple. © 2015 Wiley Publishing Asia Pty Ltd.

Testing Crites' Model of Career Maturity: A Hierarchical Strategy.

ERIC Educational Resources Information Center

Wallbrown, Fred H.; And Others

1986-01-01

Investigated the construct validity of Crites' model of career maturity and the Career Maturity Inventory (CMI). Results from a nationwide sample of adolescents, using hierarchical factor analytic methodology, indicated confirmatory support for the multidimensionality of Crites' model of career maturity, and the construct validity of the CMI as a…

Construct Validation of a Measure to Assess Sustainability of School-Wide Behavior Interventions

ERIC Educational Resources Information Center

Hume, Amanda; McIntosh, Kent

2013-01-01

This study assessed aspects of construct validity of the School-wide Universal Behavior Sustainability Index-School Teams (SUBSIST), a measure evaluating critical features of the school context related to sustainability of school-wide interventions. Participants at 217 schools implementing School-wide Positive Behavior Support (SWPBS) were…

Principals' Learning Mechanisms: Exploring an Emerging Construct

ERIC Educational Resources Information Center

Schechter, Chen; Qadach, Mowafaq

2016-01-01

This exploration of principal learning mechanisms (PLM) to support a learning-centered school aimed to develop, field-test, and validate a PLM-measuring instrument. Following exploratory and confirmatory factor analyses of items to examine factorial validity, the developed scale was correlated with other work-related established constructs (e.g.,…

Convergent and divergent validity of the Mullen Scales of Early Learning in young children with and without autism spectrum disorder.

PubMed

Swineford, Lauren B; Guthrie, Whitney; Thurm, Audrey

2015-12-01

The purpose of this study was to report on the construct, convergent, and divergent validity of the Mullen Scales of Early Learning (MSEL), a widely used test of development for young children. The sample consisted of 399 children with a mean age of 3.38 years (SD = 1.14) divided into a group of children with autism spectrum disorder (ASD) and a group of children not on the autism spectrum, with and without developmental delays. The study used the MSEL and several other measures assessing constructs relevant to the age range--including developmental skills, autism symptoms, and psychopathology symptoms--across multiple methods of assessment. Multiple-group confirmatory factor analyses revealed good overall fit and equal form of the MSEL 1-factor model across the ASD and nonspectrum groups, supporting the construct validity of the MSEL. However, neither full nor partial invariance of factor loadings was established because of the lower loadings in the ASD group compared with the nonspectrum group. Exploratory structural equation modeling revealed that other measures of developmental skills loaded together with the MSEL domain scores on a Developmental Functioning factor, supporting convergent validity of the MSEL. Divergent validity was supported by the lack of loading of MSEL domain scores on Autism Symptoms or Emotion/Behavior Problems factors. Although factor structure and loadings varied across groups, convergent and divergent validity findings were similar in the ASD and nonspectrum samples. Together, these results demonstrate evidence for the construct, convergent, and divergent validity of the MSEL using powerful data-analytic techniques. (c) 2015 APA, all rights reserved).

Development and Psychometric Testing of a Sexual Concerns Questionnaire for Kidney Transplant Recipients.

PubMed

Muehrer, Rebecca J; Lanuza, Dorothy M; Brown, Roger L; Djamali, Arjang

2015-01-01

This study describes the development and psychometric testing of the Sexual Concerns Questionnaire (SCQ) in kidney transplant (KTx) recipients. Construct validity was assessed using the Kroonenberg and Lewis exploratory/confirmatory procedure and testing hypothesized relationships with established questionnaires. Configural and weak invariance were examined across gender, dialysis history, relationship status, and transplant type. Reliability was assessed with Cronbach's alpha, composite reliability, and test-retest reliability. Factor analysis resulted in a 7-factor solution and suggests good model fit. Construct validity was also supported by the tests of hypothesized relationships. Configural and weak invariance were supported for all subgroups. Reliability of the SCQ was also supported. Findings indicate the SCQ is a valid and reliable measure of KTx recipients' sexual concerns.

Assessing social support among South Asians: the multidimensional scale of perceived social support.

PubMed

Tonsing, Kareen; Zimet, Gregory D; Tse, Samson

2012-06-01

The psychometric properties of the Multidimensional Scale of Perceived Social Support (MSPSS) of the Urdu (MSPSS-U) and Nepali (MSPSS-N) versions were investigated among Pakistani (n=148) and Nepalese (n=153) respondents living in Hong Kong. The factor analysis of the MSPSS-N conducted in this study confirmed the three factors of the original MSPSS, namely, Family, Friend, and Significant Others, while only two factors were extracted from the MSPSS-U (i.e., the Family and Friends subscales). With regard to construct validity, both the MSPSS-U and MSPSS-N were inversely correlated with depression, anxiety and stress as assessed by the Depression Anxiety Stress Scale (DASS-21). The internal reliability and construct validity of the MSPSS-U and MSPSS-N were also established and provided support for the validity of both versions as tools for measuring perceived social support among South Asian migrants. Copyright © 2012 Elsevier B.V. All rights reserved.

A Critical Review of Instruments Measuring Breastfeeding Attitudes, Knowledge, and Social Support.

PubMed

Casal, Corrine S; Lei, Ann; Young, Sera L; Tuthill, Emily L

2017-02-01

Breastfeeding provides beneficial health outcomes for infants and their mothers, and increasing its practice is a national priority in many countries. Despite increasing support to exclusively breastfeed, the prevalence at 6 months remains low. Breastfeeding behavior is influenced by a myriad of determinants, including breastfeeding attitudes, knowledge, and social support. Effective measurement of these determinants is critical to provide optimal support for women throughout the breastfeeding period. However, there are a multitude of available instruments measuring these constructs, which makes identification of an appropriate instrument challenging. Research aim: Our aim was to identify and critically examine the existing instruments measuring breastfeeding attitudes, knowledge, and social support. A total of 16 instruments was identified. Each instrument's purpose, theoretical underpinnings, and validity were analyzed. An overview, validation and adaptation for use in other settings was assessed for each instrument. Depth of reporting and validation testing differed greatly between instruments. Content, construct, and predictive validity were present for most but not all scales. When selecting and adapting instruments, attention should be paid to domains within the scale, number of items, and adaptation.

Construct Validity of the WISC-IV with a Referred Sample: Direct versus Indirect Hierarchical Structures

ERIC Educational Resources Information Center

Canivez, Gary L.

2014-01-01

The Wechsler Intelligence Scale for Children--Fourth Edition (WISC-IV) is one of the most frequently used intelligence tests in clinical assessments of children with learning difficulties. Construct validity studies of the WISC-IV have generally supported the higher order structure with four correlated first-order factors and one higher-order…

How Students Create Motivationally Supportive Learning Environments for Themselves: The Concept of Agentic Engagement

ERIC Educational Resources Information Center

Reeve, Johnmarshall

2013-01-01

The present study introduced "agentic engagement" as a newly proposed student-initiated pathway to greater achievement and greater motivational support. Study 1 developed the brief, construct-congruent, and psychometrically strong Agentic Engagement Scale. Study 2 provided evidence for the scale's construct and predictive validity, as…

Evaluating instruments for quality: testing convergent validity of the consumer emergency care satisfaction scale.

PubMed

Davis, Barbara A; Kiesel, Cynthia K; McFarland, Julie; Collard, Adressa; Coston, Kyle; Keeton, Ada

2005-01-01

Having reliable and valid instruments is a necessity for nurses and others measuring concepts such as patient satisfaction. The purpose of this article is to describe the use of convergence to test the construct validity of the Davis Consumer Emergency Care Satisfaction Scale (CECSS). Results indicate convergence of the CECSS with the Risser Patient Satisfaction Scale and 2 single-item visual analogue scales, therefore supporting construct validity. Persons measuring patient satisfaction with nurse behaviors in the emergency department can confidently use the CECSS.

Homework Stress: Construct Validation of a Measure

ERIC Educational Resources Information Center

Katz, Idit; Buzukashvili, Tamara; Feingold, Liat

2012-01-01

This article presents 2 studies aimed at validating a measure of stress experienced by children and parents around the issue of homework, applying Benson's program of validation (Benson, 1998). Study 1 provides external validity of the measure by supporting hypothesized relations between stress around homework and students' and parents' positive…

Validity: Applying Current Concepts and Standards to Gynecologic Surgery Performance Assessments

ERIC Educational Resources Information Center

LeClaire, Edgar L.; Nihira, Mikio A.; Hardré, Patricia L.

2015-01-01

Validity is critical for meaningful assessment of surgical competency. According to the Standards for Educational and Psychological Testing, validation involves the integration of data from well-defined classifications of evidence. In the authoritative framework, data from all classifications support construct validity claims. The two aims of this…

The convergent and discriminant validity of burnout measures in sport: a multi-trait/multi-method analysis.

PubMed

Cresswell, Scott L; Eklund, Robert C

2006-02-01

Athlete burnout research has been hampered by the lack of an adequate measurement tool. The Athlete Burnout Questionnaire (ABQ) and the Maslach Burnout Inventory General Survey (MBI-GS) are two recently developed self-report instruments designed to assess burnout. The convergent and discriminant validity of the ABQ and MBI-GS were assessed through multi-trait/multi-method analysis with a sporting population. Overall, the ABQ and the MBI-GS displayed acceptable convergent validity with matching subscales highly correlated, and satisfactory internal discriminant validity with lower correlations between non-matching subscales. Both scales also indicated an adequate discrimination between the concepts of burnout and depression. These findings add support to previous findings in non-sporting populations that depression and burnout are separate constructs. Based on the psychometric results, construct validity analysis and practical considerations, the results support the use of the ABQ to assess athlete burnout.

Construct Validity of the Kaufman Brief Intelligence Test, Wechsler Intelligence Scale for Children-Third Edition, and Adjustment Scales for Children and Adolescents

ERIC Educational Resources Information Center

Canivez, Gary L.; Neitzel, Ryan; Martin, Blake E.

2005-01-01

The present study reports data supporting the construct validity of the Kaufman Brief Intelligence Test (K-BIT; Kaufman & Kaufman, 1990), the Wechsler Intelligence Scale for Children-Third Edition (WISC-III; Wechsler, 1991), and the Adjustment Scales for Children and Adolescents (ASCA; McDermott, Marston, & Stott, 1993) through convergent…

The Construct Validity of Attitudes toward Career Counseling Scale for Korean College Students

ERIC Educational Resources Information Center

Nam, Suk Kyung; In Park, Hyung

2015-01-01

This study aimed to examine the construct validity of the Attitudes Toward Career Counseling Scale (ATCCS) in Korea. In Study 1, confirmatory factor analysis (CFA) was used for testing the factor structure of the scale. The results supported a two-factor (value and stigma) model, which was theoretically driven from the original study. Results of…

The presentation and preliminary validation of KIWEST using a large sample of Norwegian university staff.

PubMed

Innstrand, Siw Tone; Christensen, Marit; Undebakke, Kirsti Godal; Svarva, Kyrre

2015-12-01

The aim of the present paper is to present and validate a Knowledge-Intensive Work Environment Survey Target (KIWEST), a questionnaire developed for assessing the psychosocial factors among people in knowledge-intensive work environments. The construct validity and reliability of the measurement model where tested on a representative sample of 3066 academic and administrative staff working at one of the largest universities in Norway. Confirmatory factor analysis provided initial support for the convergent validity and internal consistency of the 30 construct KIWEST measurement model. However, discriminant validity tests indicated that some of the constructs might overlap to some degree. Overall, the KIWEST measure showed promising psychometric properties as a psychosocial work environment measure. © 2015 the Nordic Societies of Public Health.

Psychometric evaluation of the Persian version of the Templer's Death Anxiety Scale in cancer patients.

PubMed

Soleimani, Mohammad Ali; Yaghoobzadeh, Ameneh; Bahrami, Nasim; Sharif, Saeed Pahlevan; Sharif Nia, Hamid

2016-10-01

In this study, 398 Iranian cancer patients completed the 15-item Templer's Death Anxiety Scale (TDAS). Tests of internal consistency, principal components analysis, and confirmatory factor analysis were conducted to assess the internal consistency and factorial validity of the Persian TDAS. The construct reliability statistic and average variance extracted were also calculated to measure construct reliability, convergent validity, and discriminant validity. Principal components analysis indicated a 3-component solution, which was generally supported in the confirmatory analysis. However, acceptable cutoffs for construct reliability, convergent validity, and discriminant validity were not fulfilled for the three subscales that were derived from the principal component analysis. This study demonstrated both the advantages and potential limitations of using the TDAS with Persian-speaking cancer patients.

Construct validity evidence for the Male Role Norms Inventory-Short Form: A structural equation modeling approach using the bifactor model.

PubMed

Levant, Ronald F; Hall, Rosalie J; Weigold, Ingrid K; McCurdy, Eric R

2016-10-01

The construct validity of the Male Role Norms Inventory-Short Form (MRNI-SF) was assessed using a latent variable approach implemented with structural equation modeling (SEM). The MRNI-SF was specified as having a bifactor structure, and validation scales were also specified as latent variables. The latent variable approach had the advantages of separating effects of general and specific factors and controlling for some sources of measurement error. Data (N = 484) were from a diverse sample (38.8% men of color, 22.3% men of diverse sexualities) of community-dwelling and college men who responded to an online survey. The construct validity of the MRNI-SF General Traditional Masculinity Ideology factor was supported for all 4 of the proposed latent correlations with: (a) Male Role Attitudes Scale; (b) general factor of Conformity to Masculine Norms Inventory-46; (c) higher-order factor of Gender Role Conflict Scale; and (d) Personal Attributes Questionnaire-Masculinity Scale. Significant correlations with relevant other latent factors provided concurrent validity evidence for the MRNI-SF specific factors of Negativity toward Sexual Minorities, Importance of Sex, Restrictive Emotionality, and Toughness, with all 8 of the hypothesized relationships supported. However, 3 relationships concerning Dominance were not supported. (The construct validity of the remaining 2 MRNI-SF specific factors-Avoidance of Femininity and Self-Reliance through Mechanical Skills was not assessed.) Comparisons were made, and meaningful differences noted, between the latent correlations emphasized in this study and their raw variable counterparts. Results are discussed in terms of the advantages of an SEM approach and the unique characteristics of the bifactor model. (PsycINFO Database Record (c) 2016 APA, all rights reserved).

Construct Validation of the "Supports Intensity Scale-Children" and "Adult" Versions: An Application of a Pseudo Multitrait-Multimethod Approach

ERIC Educational Resources Information Center

Seo, Hyojeong; Shogren, Karrie A.; Little, Todd D.; Thompson, James R.; Wehmeyer, Michael L.

2016-01-01

This study examined the convergent validity of the "Supports Intensity Scale-Adult Version" (SIS-A; Thompson et al., 2015a) and "Supports Intensity Scale-Children's Version" (SIS-C; Thompson et al., 2016a). Data from SISOnline (n = 129,864) for the SIS-A and from the SIS-C standardization sample (n = 4,015) were used for…

Construct Validation of the "Supports Intensity Scale--Children and Adult Versions": An Application of a Pseudo Multitrait-Multimethod Approach

ERIC Educational Resources Information Center

Seo, Hyojeong; Shogren, Karrie A.; Little, Todd D.; Thompson, James R.; Wehmeyer, Michael L.

2016-01-01

This study examined the convergent validity of the "Supports Intensity Scale-Adult Version" (SIS-A; Thompson et al., 2015a) and "Supports Intensity Scale-Children's Version" (SIS-C; Thompson et al., 2016a). Data from SISOnline (n = 129,864) for the SIS-A and from the SIS-C standardization sample (n = 4,015) were used for…

The Persian Version of the "Life Satisfaction Scale": Construct Validity and Test-Re-Test Reliability among Iranian Older Adults.

PubMed

Moghadam, Manije; Salavati, Mahyar; Sahaf, Robab; Rassouli, Maryam; Moghadam, Mojgan; Kamrani, Ahmad Ali Akbari

2018-03-01

After forward-backward translation, the LSS was administered to 334 Persian speaking, cognitively healthy elderly aged 60 years and over recruited through convenience sampling. To analyze the validity of the model's constructs and the relationships between the constructs, a confirmatory factor analysis followed by PLS analysis was performed. The Construct validity was further investigated by calculating the correlations between the LSS and the "Short Form Health Survey" (SF-36) subscales measuring similar and dissimilar constructs. The LSS was re-administered to 50 participants a month later to assess the reliability. For the eight-factor model of the life satisfaction construct, adequate goodness of fit between the hypothesized model and the model derived from the sample data was attained (positive and statistically significant beta coefficients, good R-squares and acceptable GoF). Construct validity was supported by convergent and discriminant validity, and correlations between the LSS and SF-36 subscales. Minimum Intraclass Correlation Coefficient level of 0.60 was exceeded by all subscales. Minimum level of reliability indices (Cronbach's α, composite reliability and indicator reliability) was exceeded by all subscales. The Persian-version of the Life Satisfaction Scale is a reliable and valid instrument, with psychometric properties which are consistent with the original version.

Development and validation of a measure of workplace climate for healthy weight maintenance.

PubMed

Sliter, Katherine A

2013-07-01

Due to the obesity epidemic, an increasing amount of research is being conducted to better understand the antecedents and consequences of excess employee weight. One construct often of interest to researchers in this area is organizational climate. Unfortunately, a viable measure of climate, as related to employee weight, does not exist. The purpose of this study was to remedy this by developing and validating a concise, psychometrically sound measure of climate for healthy weight. An item pool was developed based on surveys of full-time employees, and a sorting task was used to eliminate ambiguous items. Items were pilot tested by a sample of 338 full-time employees, and the item pool was reduced through item response theory (IRT) and reliability analyses. Finally, the retained 14 items, comprising 3 subscales, were completed by a sample of 360 full-time employees, representing 26 different organizations from across the United States. Multilevel modeling indicated that sufficient variance was explained by group membership to support aggregation, and confirmatory factor analysis (CFA) supported the hypothesized model of 3 subscale factors and an overall climate factor. Nine hypotheses specific to construct validation were tested. Scores on the new scale correlated significantly with individual-level reports of psychological constructs (e.g., health motivation, general leadership support for health) and physiological phenomena (e.g., body mass index [BMI], physical health problems) to which they should theoretically relate, supporting construct validity. Implications for the use of this scale in both applied and research settings are discussed. PsycINFO Database Record (c) 2013 APA, all rights reserved.

Development and psychometric evaluation of supportive leadership scales.

PubMed

McGilton, Katherine S

2003-12-01

The purpose of this study was to develop and evaluate the psychometric properties of 2 supportive leadership scales, the Charge Nurse Support Scale and the Unit Manager Support Scale, designed for long-term-care environments. These 6-item self-report scales were administered to 70 nursing staff and their internal consistency reliability, test-retest reliability, content validity, factor structure, and construct validity investigated. Content validity was established with the assistance of experts. Both scales were deemed reliable. As hypothesized, a significant relationship was found between the measure of how nursing staff related to residents and measures of charge nurses' supportive behaviours (r = .42, p = .05). Reliable and valid measures of supportive leadership could be developed for use in identifying the quality of support provided to staff in long-term-care environments.

Psychometric assessment of the IBS-D Daily Symptom Diary and Symptom Event Log.

PubMed

Rosa, Kathleen; Delgado-Herrera, Leticia; Zeiher, Bernie; Banderas, Benjamin; Arbuckle, Rob; Spears, Glen; Hudgens, Stacie

2016-12-01

Diarrhea-predominant irritable bowel syndrome (IBS-D) can considerably impact patients' lives. Patient-reported symptoms are crucial in understanding the diagnosis and progression of IBS-D. This study psychometrically evaluates the newly developed IBS-D Daily Symptom Diary and Symptom Event Log (hereafter, "Event Log") according to US regulatory recommendations. A US-based observational field study was conducted to understand cross-sectional psychometric properties of the IBS-D Daily Symptom Diary and Event Log. Analyses included item descriptive statistics, item-to-item correlations, reliability, and construct validity. The IBS-D Daily Symptom Diary and Event Log had no items with excessive missing data. With the exception of two items ("frequency of gas" and "accidents"), moderate to high inter-item correlations were observed among all items of the IBS-D Daily Symptom Diary and Event Log (day 1 range 0.67-0.90). Item scores demonstrated reliability, with the exception of the "frequency of gas" and "accidents" items of the Diary and "incomplete evacuation" item of the Event Log. The pattern of correlations of the IBS-D Daily Symptom Diary and Event Log item scores with generic and disease-specific measures was as expected, moderate for similar constructs and low for dissimilar constructs, supporting construct validity. Known-groups methods showed statistically significant differences and monotonic trends in each of the IBS-D Daily Symptom Diary item scores among groups defined by patients' IBS-D severity ratings ("none"/"mild," "moderate," or "severe"/"very severe"), supporting construct validity. Initial psychometric results support the reliability and validity of the items of the IBS-D Daily Symptom Diary and Event Log.

Validity Studies of the Filial Anxiety Scale.

ERIC Educational Resources Information Center

Murray, Paul D.; And Others

1996-01-01

Factor analytic and construct validity studies were conducted to explore the validity of Cicirelli's 13-item Filial Anxiety Scale (FAS). The State-Trait Anxiety Inventory and the Marlowe-Crowne Social Desirability Scale were a part of the investigation. Results offer support for the validity of the FAS subscales and the FAS' usefulness as an…

[Validity and Reliability of Korean Version of the Spiritual Care Competence Scale].

PubMed

Chung, Mi Ja; Park, Youngrye; Eun, Young

2016-12-01

The aim of this study was to examine the validity and reliability of the Korean Version of the Spiritual Care Competence Scale (K-SCCS). A cross-sectional study design was used. The K-SCCS consisted of 26 questions to measure spiritual care competence of nurses. Participants, 228 nurses who had more than 3 years'experience as a nurse, completed the survey. Confirmatory factor analysis was used to examine the construct validity and correlations of K-SCCS and spiritual well-being (SWB) were used to examine the criterion validity of K-SCCS. Cronbach's alpha was used to test internal consistency. The construct and the criterion-related validity of K-SCCS were supported as measures of spiritual care competence. Cronbach's alpha was .95. Factor loadings of the 26 questions ranged from .60 to .96. Construct validity of K-SCCS was verified by confirmatory factor analysis (RMSEA=.08, CFI=.90, NFI=.85). Criterion validity compared to the SWB showed significant correlation (r=.44, p<.001). The findings suggest that K-SCCS serves as an appropriate measure of spiritual care competence with validity and reliability. However, further study is needed to retest the verification of the factor analysis related to factor 2 (professionalisation and improving the quality of spiritual care) and factor 3 (personal support and patient counseling). Therefore, we recommend using the total score without distinguishing subscales.

Psychometric Properties of the Physical Activity Questionnaire for Older Children in Italy: Testing the Validity among a General and Clinical Pediatric Population.

PubMed

Gobbi, Erica; Elliot, Catherine; Varnier, Maurizio; Carraro, Attilio

2016-01-01

The purpose of this research was to assess an Italian version of the Physical Activity Questionnaire for Older Children (PAQ-C-It). Three separate studies were conducted, whereby testing general psychometric properties, construct validity, concurrent validity and the factor structure of the PAQ-C-It among general and clinical pediatric population. Study 1 (n = 1170) examined the psychometric properties, internal consistency, factor structure (exploratory factor analysis, EFA) and construct validity with enjoyment perception during physical activity. Study 2 (n = 59) reported on reliability, construct validity with enjoyment and BMI, and on cross-sectional concurrent validity with objectively measured MVPA (tri-axial accelerometry) over the span of seven consecutive days. Study 3 (n = 58) examined the PAQ-C-It reliability, construct validity with BMI and VO2max as the objective measurement among a population of children with congenital heart defects (CHD). In study 2 and 3, the factor structure of the PAQ-C-It was then re-examined with an EFA. The PAQ-C-It showed acceptable to good reliability (alpha .70 to .83). Results on construct validity showed moderate but significant association with enjoyment perception (r = .30 and .36), with BMI (r = -.30 and -.79 for CHD simple form), and with the VO2max (r = .55 for CHD simple form). Significant concurrent validity with the objectively measured MVPA was reported (rho = .30, p < .05). Findings of the EFA suggested a two-factor structure for the PAQ-C-It, with items 2, 3, and 4 contributing little to the total score. This study supports the PAQ-C-It as an appropriate instrument to assess the MVPA levels of Italian children, including children with simple forms of CHD. Support is given to the possible instrument effectiveness on a large international perspective in order to level out data gathering across the globe.

Psychometric Properties of the Physical Activity Questionnaire for Older Children in Italy: Testing the Validity among a General and Clinical Pediatric Population

PubMed Central

Gobbi, Erica; Elliot, Catherine; Varnier, Maurizio; Carraro, Attilio

2016-01-01

The purpose of this research was to assess an Italian version of the Physical Activity Questionnaire for Older Children (PAQ-C-It). Three separate studies were conducted, whereby testing general psychometric properties, construct validity, concurrent validity and the factor structure of the PAQ-C-It among general and clinical pediatric population. Study 1 (n = 1170) examined the psychometric properties, internal consistency, factor structure (exploratory factor analysis, EFA) and construct validity with enjoyment perception during physical activity. Study 2 (n = 59) reported on reliability, construct validity with enjoyment and BMI, and on cross-sectional concurrent validity with objectively measured MVPA (tri-axial accelerometry) over the span of seven consecutive days. Study 3 (n = 58) examined the PAQ-C-It reliability, construct validity with BMI and VO2max as the objective measurement among a population of children with congenital heart defects (CHD). In study 2 and 3, the factor structure of the PAQ-C-It was then re-examined with an EFA. The PAQ-C-It showed acceptable to good reliability (alpha .70 to .83). Results on construct validity showed moderate but significant association with enjoyment perception (r = .30 and .36), with BMI (r = -.30 and -.79 for CHD simple form), and with the VO2max (r = .55 for CHD simple form). Significant concurrent validity with the objectively measured MVPA was reported (rho = .30, p < .05). Findings of the EFA suggested a two-factor structure for the PAQ-C-It, with items 2, 3, and 4 contributing little to the total score. This study supports the PAQ-C-It as an appropriate instrument to assess the MVPA levels of Italian children, including children with simple forms of CHD. Support is given to the possible instrument effectiveness on a large international perspective in order to level out data gathering across the globe. PMID:27228050

Systematic Review of Methods in Low-Consensus Fields: Supporting Commensuration through `Construct-Centered Methods Aggregation' in the Case of Climate Change Vulnerability Research.

PubMed

Delaney, Aogán; Tamás, Peter A; Crane, Todd A; Chesterman, Sabrina

2016-01-01

There is increasing interest in using systematic review to synthesize evidence on the social and environmental effects of and adaptations to climate change. Use of systematic review for evidence in this field is complicated by the heterogeneity of methods used and by uneven reporting. In order to facilitate synthesis of results and design of subsequent research a method, construct-centered methods aggregation, was designed to 1) provide a transparent, valid and reliable description of research methods, 2) support comparability of primary studies and 3) contribute to a shared empirical basis for improving research practice. Rather than taking research reports at face value, research designs are reviewed through inductive analysis. This involves bottom-up identification of constructs, definitions and operationalizations; assessment of concepts' commensurability through comparison of definitions; identification of theoretical frameworks through patterns of construct use; and integration of transparently reported and valid operationalizations into ideal-type research frameworks. Through the integration of reliable bottom-up inductive coding from operationalizations and top-down coding driven from stated theory with expert interpretation, construct-centered methods aggregation enabled both resolution of heterogeneity within identically named constructs and merging of differently labeled but identical constructs. These two processes allowed transparent, rigorous and contextually sensitive synthesis of the research presented in an uneven set of reports undertaken in a heterogenous field. If adopted more broadly, construct-centered methods aggregation may contribute to the emergence of a valid, empirically-grounded description of methods used in primary research. These descriptions may function as a set of expectations that improves the transparency of reporting and as an evolving comprehensive framework that supports both interpretation of existing and design of future research.

Systematic Review of Methods in Low-Consensus Fields: Supporting Commensuration through `Construct-Centered Methods Aggregation’ in the Case of Climate Change Vulnerability Research

PubMed Central

Crane, Todd A.; Chesterman, Sabrina

2016-01-01

There is increasing interest in using systematic review to synthesize evidence on the social and environmental effects of and adaptations to climate change. Use of systematic review for evidence in this field is complicated by the heterogeneity of methods used and by uneven reporting. In order to facilitate synthesis of results and design of subsequent research a method, construct-centered methods aggregation, was designed to 1) provide a transparent, valid and reliable description of research methods, 2) support comparability of primary studies and 3) contribute to a shared empirical basis for improving research practice. Rather than taking research reports at face value, research designs are reviewed through inductive analysis. This involves bottom-up identification of constructs, definitions and operationalizations; assessment of concepts’ commensurability through comparison of definitions; identification of theoretical frameworks through patterns of construct use; and integration of transparently reported and valid operationalizations into ideal-type research frameworks. Through the integration of reliable bottom-up inductive coding from operationalizations and top-down coding driven from stated theory with expert interpretation, construct-centered methods aggregation enabled both resolution of heterogeneity within identically named constructs and merging of differently labeled but identical constructs. These two processes allowed transparent, rigorous and contextually sensitive synthesis of the research presented in an uneven set of reports undertaken in a heterogenous field. If adopted more broadly, construct-centered methods aggregation may contribute to the emergence of a valid, empirically-grounded description of methods used in primary research. These descriptions may function as a set of expectations that improves the transparency of reporting and as an evolving comprehensive framework that supports both interpretation of existing and design of future research. PMID:26901409

Validity of the Microcomputer Evaluation Screening and Assessment Aptitude Scores.

ERIC Educational Resources Information Center

Janikowski, Timothy P.; And Others

1991-01-01

Examined validity of Microcomputer Evaluation Screening and Assessment (MESA) aptitude scores relative to General Aptitude Test Battery (GATB) using multitrait-multimethod correlational analyses. Findings from 54 rehabilitation clients and 29 displaced workers revealed no evidence to support the construct validity of the MESA. (Author/NB)

Convergent and Discriminant Validity of the Microcomputer Evaluation Screening and Assessment (MESA) Interest Survey.

ERIC Educational Resources Information Center

Janikowski, Timothy P.; And Others

1990-01-01

Examined construct validity of Microcomputer Evaluation Screening and Assessment (MESA) Interest Survey. Administered MESA and United States Employment Service (USES) Interest Inventory to 74 volunteer rehabilitation clients. Evidence supported convergent and discriminant validity of MESA. Found fewer significant intercorrelations among MESA…

Refinement and Further Validation of the Decisional Process Inventory.

ERIC Educational Resources Information Center

Hartung, Paul J.; Marco, Cynthia D.

1998-01-01

The Decisional Process Inventory is a Gestalt theory-based measure of career decision-making and level of career indecision. Results from a sample of 183 undergraduates supported its content, construct, and concurrent validity. (SK)

Evidence of Convergent and Discriminant Validity of Child, Teacher, and Peer Reports of Teacher-Student Support

PubMed Central

Li, Yan; Hughes, Jan N.; Kwok, Oi-man; Hsu, Hsien-Yuan

2012-01-01

This study investigated the construct validity of measures of teacher-student support in a sample of 709 ethnically diverse second and third grade academically at-risk students. Confirmatory factor analysis investigated the convergent and discriminant validities of teacher, child, and peer reports of teacher-student support and child conduct problems. Results supported the convergent and discriminant validity of scores on the measures. Peer reports accounted for the largest proportion of trait variance and non-significant method variance. Child reports accounted for the smallest proportion of trait variance and the largest method variance. A model with two latent factors provided a better fit to the data than a model with one factor, providing further evidence of the discriminant validity of measures of teacher-student support. Implications for research, policy, and practice are discussed. PMID:21767024

Construct validity of the Moral Development Scale for Professionals (MDSP).

PubMed

Söderhamn, Olle; Bjørnestad, John Olav; Skisland, Anne; Cliffordson, Christina

2011-01-01

The aim of this study was to investigate the construct validity of the Moral Development Scale for Professionals (MDSP) using structural equation modeling. The instrument is a 12-item self-report instrument, developed in the Scandinavian cultural context and based on Kohlberg's theory. A hypothesized simplex structure model underlying the MDSP was tested through structural equation modeling. Validity was also tested as the proportion of respondents older than 20 years that reached the highest moral level, which according to the theory should be small. A convenience sample of 339 nursing students with a mean age of 25.3 years participated. Results confirmed the simplex model structure, indicating that MDSP reflects a moral construct empirically organized from low to high. A minority of respondents >20 years of age (13.5%) scored more than 80% on the highest moral level. The findings support the construct validity of the MDSP and the stages and levels in Kohlberg's theory.

Statistically Controlling for Confounding Constructs Is Harder than You Think

PubMed Central

Westfall, Jacob; Yarkoni, Tal

2016-01-01

Social scientists often seek to demonstrate that a construct has incremental validity over and above other related constructs. However, these claims are typically supported by measurement-level models that fail to consider the effects of measurement (un)reliability. We use intuitive examples, Monte Carlo simulations, and a novel analytical framework to demonstrate that common strategies for establishing incremental construct validity using multiple regression analysis exhibit extremely high Type I error rates under parameter regimes common in many psychological domains. Counterintuitively, we find that error rates are highest—in some cases approaching 100%—when sample sizes are large and reliability is moderate. Our findings suggest that a potentially large proportion of incremental validity claims made in the literature are spurious. We present a web application (http://jakewestfall.org/ivy/) that readers can use to explore the statistical properties of these and other incremental validity arguments. We conclude by reviewing SEM-based statistical approaches that appropriately control the Type I error rate when attempting to establish incremental validity. PMID:27031707

The Chinese Version of the Self-Report Family Inventory: Reliability and Validity.

ERIC Educational Resources Information Center

Shek, Daniel T. L.; Lai, Kelly Y. C.

2001-01-01

Reliability and validity of Chinese Self-Report Family Inventory (C-SFI) were examined in three studies. Study 1 showed C-SFI was temporally stable and internally consistent. Study 2 indicated C-SFI could discriminate between clinical and nonclinical groups. Study 3 gave support for internal consistency, concurrent validity and construct validity.…

Factorial validity of the Delta Healthy Eating Attitudes Scale related to diet quality

USDA-ARS?s Scientific Manuscript database

The objective of this study was to establish factorial validity of decisional balance (DB), self-efficacy (SE) and social support (SS) psychosocial constructs and convergent validity related to diet quality. A sample (N=319) of predominantly African American women from the Mississippi Communities fo...

Are loss of control while eating and overeating valid constructs? A critical review of the literature

PubMed Central

Goldschmidt, Andrea B.

2017-01-01

Background Binge eating is a marker of weight gain and obesity, and a hallmark feature of eating disorders. Yet, its component constructs—overeating and loss of control (LOC) while eating—are poorly understood and difficult to measure. Objective To critically review the human literature concerning the validity of LOC and overeating across the age and weight spectrum. Data sources English-language articles addressing the face, convergent, discriminant, and predictive validity of LOC and overeating were included. Results LOC and overeating appear to have adequate face validity. Emerging evidence supports the convergent and predictive validity of the LOC construct, given its unique cross-sectional and prospective associations with numerous anthropometric, psychosocial, and eating behavior-related factors. Overeating may be best conceptualized as a marker of excess weight status. Limitations Binge eating constructs, particularly in the context of subjectively large episodes, are challenging to measure reliably. Few studies addressed overeating in the absence of LOC, thereby limiting conclusions about the validity of the overeating construct independent of LOC. Additional studies addressing the discriminant validity of both constructs are warranted. Discussion Suggestions for future weight-related research and for appropriately defining binge eating in the eating disorders diagnostic scheme are presented. PMID:28165655

Assessing the stability of human locomotion: a review of current measures

PubMed Central

Bruijn, S. M.; Meijer, O. G.; Beek, P. J.; van Dieën, J. H.

2013-01-01

Falling poses a major threat to the steadily growing population of the elderly in modern-day society. A major challenge in the prevention of falls is the identification of individuals who are at risk of falling owing to an unstable gait. At present, several methods are available for estimating gait stability, each with its own advantages and disadvantages. In this paper, we review the currently available measures: the maximum Lyapunov exponent (λS and λL), the maximum Floquet multiplier, variability measures, long-range correlations, extrapolated centre of mass, stabilizing and destabilizing forces, foot placement estimator, gait sensitivity norm and maximum allowable perturbation. We explain what these measures represent and how they are calculated, and we assess their validity, divided up into construct validity, predictive validity in simple models, convergent validity in experimental studies, and predictive validity in observational studies. We conclude that (i) the validity of variability measures and λS is best supported across all levels, (ii) the maximum Floquet multiplier and λL have good construct validity, but negative predictive validity in models, negative convergent validity and (for λL) negative predictive validity in observational studies, (iii) long-range correlations lack construct validity and predictive validity in models and have negative convergent validity, and (iv) measures derived from perturbation experiments have good construct validity, but data are lacking on convergent validity in experimental studies and predictive validity in observational studies. In closing, directions for future research on dynamic gait stability are discussed. PMID:23516062

Development and Validation of a Multimedia-based Assessment of Scientific Inquiry Abilities

NASA Astrophysics Data System (ADS)

Kuo, Che-Yu; Wu, Hsin-Kai; Jen, Tsung-Hau; Hsu, Ying-Shao

2015-09-01

The potential of computer-based assessments for capturing complex learning outcomes has been discussed; however, relatively little is understood about how to leverage such potential for summative and accountability purposes. The aim of this study is to develop and validate a multimedia-based assessment of scientific inquiry abilities (MASIA) to cover a more comprehensive construct of inquiry abilities and target secondary school students in different grades while this potential is leveraged. We implemented five steps derived from the construct modeling approach to design MASIA. During the implementation, multiple sources of evidence were collected in the steps of pilot testing and Rasch modeling to support the validity of MASIA. Particularly, through the participation of 1,066 8th and 11th graders, MASIA showed satisfactory psychometric properties to discriminate students with different levels of inquiry abilities in 101 items in 29 tasks when Rasch models were applied. Additionally, the Wright map indicated that MASIA offered accurate information about students' inquiry abilities because of the comparability of the distributions of student abilities and item difficulties. The analysis results also suggested that MASIA offered precise measures of inquiry abilities when the components (questioning, experimenting, analyzing, and explaining) were regarded as a coherent construct. Finally, the increased mean difficulty thresholds of item responses along with three performance levels across all sub-abilities supported the alignment between our scoring rubrics and our inquiry framework. Together with other sources of validity in the pilot testing, the results offered evidence to support the validity of MASIA.

The Riso-Hudson Enneagram Type Indicator: Estimates of Reliability and Validity

ERIC Educational Resources Information Center

Newgent, Rebecca A.; Parr, Patricia E.; Newman, Isadore; Higgins, Kristin K.

2004-01-01

This investigation was conducted to estimate the reliability and validity of scores on the Riso-Hudson Enneagram Type Indicator (D. R. Riso & R. Hudson, 1999a). Results of 287 participants were analyzed. Alpha suggests an adequate degree of internal consistency. Evidence provides mixed support for construct validity using correlational and…

Measurement Development and Validation of the Family Supportive Supervisor Behavior Short-Form (FSSB-SF)

PubMed Central

Hammer, Leslie B.; Kossek, Ellen Ernst; Bodner, Todd; Crain, Tori

2013-01-01

Recently, scholars have demonstrated the importance of Family Supportive Supervisor Behaviors (FSSB), defined as behaviors exhibited by supervisors that are supportive of employees’ family roles, in relation to health, well-being, and organizational outcomes. FSSB was originally conceptualized as a multidimensional, superordinate construct with four subordinate dimensions assessed with 14 items: emotional support, instrumental support, role modeling behaviors, and creative work-family management. Retaining one item from each dimension, two studies were conducted to support the development and use of a new FSSB-Short Form (FSSB-SF). Study 1 draws on the original data from the FSSB validation study of retail employees to determine if the results using the 14-item measure replicate with the shorter 4-item measure. Using data from a sample of 823 information technology professionals and their 219 supervisors, Study 2 extends the validation of the FSSB-SF to a new sample of professional workers and new outcome variables. Results from multilevel confirmatory factor analyses and multilevel regression analyses provide evidence of construct and criterion-related validity of the FSSB-SF, as it was significantly related to work-family conflict, job satisfaction, turnover intentions, control over work hours, obligation to work when sick, perceived stress, and reports of family time adequacy. We argue that it is important to develop parsimonious measures of work-family specific support to ensure supervisor support for work and family is mainstreamed into organizational research and practice. PMID:23730803

Measurement development and validation of the Family Supportive Supervisor Behavior Short-Form (FSSB-SF).

PubMed

Hammer, Leslie B; Ernst Kossek, Ellen; Bodner, Todd; Crain, Tori

2013-07-01

Recently, scholars have demonstrated the importance of Family Supportive Supervisor Behaviors (FSSB), defined as behaviors exhibited by supervisors that are supportive of employees' family roles, in relation to health, well-being, and organizational outcomes. FSSB was originally conceptualized as a multidimensional, superordinate construct with four subordinate dimensions assessed with 14 items: emotional support, instrumental support, role modeling behaviors, and creative work-family management. Retaining one item from each dimension, two studies were conducted to support the development and use of a new FSSB-Short Form (FSSB-SF). Study 1 draws on the original data from the FSSB validation study of retail employees to determine whether the results using the 14-item measure replicate with the shorter 4-item measure. Using data from a sample of 823 information technology professionals and their 219 supervisors, Study 2 extends the validation of the FSSB-SF to a new sample of professional workers and new outcome variables. Results from multilevel confirmatory factor analyses and multilevel regression analyses provide evidence of construct and criterion-related validity of the FSSB-SF, as it was significantly related to work-family conflict, job satisfaction, turnover intentions, control over work hours, obligation to work when sick, perceived stress, and reports of family time adequacy. We argue that it is important to develop parsimonious measures of work-family specific support to ensure supervisor support for work and family is mainstreamed into organizational research and practice. PsycINFO Database Record (c) 2013 APA, all rights reserved.

Measuring Steady-State Oxygen Uptake during the 6-Min Walk Test in Adults with Cerebral Palsy: Feasibility and Construct Validity

ERIC Educational Resources Information Center

Maltais, Desiree B.; Robitaille, Nancy-Michelle; Dumas, Francine; Boucher, Normand; Richards, Carol L.

2012-01-01

This study evaluated the feasibility of measuring steady-state oxygen uptake (V[Combining Dot Above]O[subscript 2]) during the 6-min walk test (6MWT) in adults with cerebral palsy (CP) who walk without support and whether there is construct validity for net 6MWT V[Combining Dot Above]O[subscript 2] as a measure of their walking ability.…

Systematic review on the effectiveness of augmented reality applications in medical training.

PubMed

Barsom, E Z; Graafland, M; Schijven, M P

2016-10-01

Computer-based applications are increasingly used to support the training of medical professionals. Augmented reality applications (ARAs) render an interactive virtual layer on top of reality. The use of ARAs is of real interest to medical education because they blend digital elements with the physical learning environment. This will result in new educational opportunities. The aim of this systematic review is to investigate to which extent augmented reality applications are currently used to validly support medical professionals training. PubMed, Embase, INSPEC and PsychInfo were searched using predefined inclusion criteria for relevant articles up to August 2015. All study types were considered eligible. Articles concerning AR applications used to train or educate medical professionals were evaluated. Twenty-seven studies were found relevant, describing a total of seven augmented reality applications. Applications were assigned to three different categories. The first category is directed toward laparoscopic surgical training, the second category toward mixed reality training of neurosurgical procedures and the third category toward training echocardiography. Statistical pooling of data could not be performed due to heterogeneity of study designs. Face-, construct- and concurrent validity was proven for two applications directed at laparoscopic training, face- and construct validity for neurosurgical procedures and face-, content- and construct validity in echocardiography training. In the literature, none of the ARAs completed a full validation process for the purpose of use. Augmented reality applications that support blended learning in medical training have gained public and scientific interest. In order to be of value, applications must be able to transfer information to the user. Although promising, the literature to date is lacking to support such evidence.

The development and psychometric testing of East Asian Acculturation Scale among Asian immigrant women in Taiwan.

PubMed

Kuo, Shu-Fen; Chang, Wen-Yin; Chang, Lu-I; Chou, Yu-Hua; Chen, Ching-Min

2013-01-01

This is a report of development and psychometric testing of the East Asian Acculturation Measure-Chinese version (EAAM-C) scale. An instrument validation design with a cross-sectional survey was conducted. The process was carried in two phases. In Phase 1, Barry's East Asian Acculturation Measure was translated and back translated to evaluate its content, face validity, and feasibility validity. In Phase 2, the 16-item EAAM-C was pilot-tested among 485 female immigrants for test-retest reliability, internal consistency, theoretically-supported construct validity and concurrent validity. The pilot work and the survey results indicated the tools possessed adequate content and face validity. The Cronbach's Alphas for the EAAM-C was 0.72, and 0.76-0.79 for its subscales, and the correlation of test-retest reliability (at 3 weeks) was 0.75. After dropping one item, four theoretically-supported factors which explained 61.82% of the variance were abstracted using exploratory factor analysis: assimilation, integration, separation, and marginalization. Based on the underlying four-factor theoretical structures of the EAAM, the confirmatory factor analysis of the EAAM-C was further examined. The analysis revealed that the four-factor model was an acceptable fit for the data which demonstrated adequate finding in its construct validity. These factors were inter-correlated, and showed statistically significant correlation with the Chinese Health Questionnaire, indicating adequate concurrent validity. The scale shows acceptable validity and consistency, and suggests that immigrant acculturation is a complex construct. This quick evaluation instrument can be applied to assess clients' acculturation and in further developing certain interventions to improve their health.

Reliability and validity of a new HIV-specific questionnaire with adults living with HIV in Canada and Ireland: the HIV Disability Questionnaire (HDQ).

PubMed

O'Brien, Kelly K; Solomon, Patricia; Bergin, Colm; O'Dea, Siobhán; Stratford, Paul; Iku, Nkem; Bayoumi, Ahmed M

2015-08-12

Our aim was to assess internal consistency reliability, construct validity, and test-retest reliability of the HDQ with adults living with HIV in Canada and Ireland. We recruited adults 18 years of age or older living with HIV from hospital clinics and AIDS service organizations in Canada and Ireland. We administered the HDQ paired with reference measures (World Health Organization Disability Assessment Schedule, SF-36 Questionnaire, Medical Outcomes Study Social Support Survey), and a demographic questionnaire. We calculated HDQ disability presence, severity and episodic scores (scored from 0-100). We calculated Cronbach's alpha and Intraclass Correlation Coefficients (ICC) (Canada only) for the disability severity and episodic scores and considered coefficients >0.80 and >0.70 as acceptable, respectively. To assess construct validity, we tested 40 a priori hypotheses of correlations between scores on the HDQ and reference measures and two known group hypotheses comparing HDQ presence and severity scores based on age and comorbidity. We considered acceptance of at least 75% of hypotheses as demonstrating support for construct validity. Of the 235 participants (139 Canada; 96 Ireland), the majority were men (74% Ireland; 82% Canada) and were taking antiretroviral therapy (88% Ireland; 91% Canada). Compared with Irish participants, Canadian participants were older (median age: 48 versus 41 years) and reported living with a higher median number of comorbidities (4 versus 1). Cronbach's alpha for Irish and Canadian participants were 0.97 (95% confidence interval (CI): 0.97-0.98) and 0.96 (95 % CI: 0.95-0.98), respectively, for the severity scale and 0.98 (95 % CI: 0.97-0.98) and 0.96 (95 % CI: 0.95-0.98), respectively, for the episodic scale. Of the 40 construct validity correlation hypotheses, 32 (80%) and 22 (55%) were supported among the Canadian and Irish samples respectively; both (100%) known group hypotheses were also supported. ICC values for Canadian participants ranged from 0.80 (95 % CI: 0.71, 0.86) in the cognitive domain to 0.89 (95 % CI: 0.83, 0.92) in the social inclusion domain. The HDQ demonstrates internal consistency reliability and a variable degree of construct validity when administered to adults living with HIV in Canada and Ireland. The HDQ demonstrates test-retest reliability when administered to adults with HIV in Canada. Further validation of the HDQ outside of Canada is needed.

Validation of learning style measures: implications for medical education practice.

PubMed

Chapman, Dane M; Calhoun, Judith G

2006-06-01

It is unclear which learners would most benefit from the more individualised, student-structured, interactive approaches characteristic of problem-based and computer-assisted learning. The validity of learning style measures is uncertain, and there is no unifying learning style construct identified to predict such learners. This study was conducted to validate learning style constructs and to identify the learners most likely to benefit from problem-based and computer-assisted curricula. Using a cross-sectional design, 3 established learning style inventories were administered to 97 post-Year 2 medical students. Cognitive personality was measured by the Group Embedded Figures Test, information processing by the Learning Styles Inventory, and instructional preference by the Learning Preference Inventory. The 11 subscales from the 3 inventories were factor-analysed to identify common learning constructs and to verify construct validity. Concurrent validity was determined by intercorrelations of the 11 subscales. A total of 94 pre-clinical medical students completed all 3 inventories. Five meaningful learning style constructs were derived from the 11 subscales: student- versus teacher-structured learning; concrete versus abstract learning; passive versus active learning; individual versus group learning, and field-dependence versus field-independence. The concurrent validity of 10 of 11 subscales was supported by correlation analysis. Medical students most likely to thrive in a problem-based or computer-assisted learning environment would be expected to score highly on abstract, active and individual learning constructs and would be more field-independent. Learning style measures were validated in a medical student population and learning constructs were established for identifying learners who would most likely benefit from a problem-based or computer-assisted curriculum.

Validity and reliability testing of the Prenatal Psychosocial Profile.

PubMed

Curry, M A; Campbell, R A; Christian, M

1994-04-01

Two studies of low-income pregnant women (N = 179) were done to examine the validity and reliability of the Prenatal Psychosocial Profile (PPP). The PPP, a composite of the Rosenberg Self-Esteem Scale, the Support Behaviors Inventory, and a newly developed measure of stress, is a brief, comprehensive clinical assessment of psychosocial risk during pregnancy. Construct validity of the stress scale was supported by theoretically predicted negative correlations with self-esteem, partner support, and support from others (N = 91). Convergent validity of the stress scale was demonstrated by a correlation of .71 with the Difficult Life Circumstances Scale. Adequate levels of internal consistency were found. Interrelationships between the four subscales were consistent with the underlying conceptualization, and there was beginning evidence of the factorial independence of the subscales.

Users’ Support as a Social Resource in Educational Services: Construct Validity and Measurement Invariance of the User-Initiated Support Scale (UISS)

PubMed Central

Loera, Barbara; Martini, Mara; Viotti, Sara; Converso, Daniela

2016-01-01

Social support is an important resource for reducing the risks of stress and burnout at work. It seems to be particularly helpful for educational and social professionals. The constant and intense relationships with users that characterize this kind of service can be very demanding, increasing stress and leading to burnout. While significant attention has been paid to supervisors and colleagues in the literature, users have rarely been considered as possible sources of social support. The only exception is the Zimmermann et al.’s (2011) research, focused on customer support as a resource for workers’ well-being. This paper proposes the validation of the customer-initiated support scale developed by Zimmermann et al. (2011), translated into Italian and focused on educational services users (children’s parents), to measure the user support perceived by workers: the User-Initiated Support Scale (UISS). In Study 1 (105 teachers), which specifically involved educators and kindergarten teachers, the items and scale properties were preliminarily examined using descriptive analyses and exploratory factor analysis (EFA). In Study 2 (304 teachers), the construct and criterion validity and scale dimensionality were analyzed using confirmatory factor analysis (CFA). In Study 3 (304 teachers from Study 2 and 296 educators), measurement invariance (MI) was tested. The EFA results from Study 1 showed a one-factor solution (explained variance, 67.2%). The scale showed good internal coherence (alpha = 0.88). The CFA in Study 2 validated the one-factor solution (comparative fit index = 0.987; standardized root mean square residual = 0.054). Bivariate correlations confirmed construct validity; the UISS was positively associated (convergent) with user gratitude, and not associated (divergent) with disproportionate customer expectations. Regarding the criterion validity test, the UISS was strongly correlated with burnout and job satisfaction. The analysis of MI performed on the Study 3 data confirmed the equality of the parameters of the covariance structure model between the two samples of kindergarten teachers and educators. This research study offers a useful version of a tool for measuring a crucial, but often ignored, protective resource for all professionals working directly with people (patients, students, and service users) that can represent important sources of well-being, directly or indirectly lessening the negative impacts of job demands. PMID:27602008

Users' Support as a Social Resource in Educational Services: Construct Validity and Measurement Invariance of the User-Initiated Support Scale (UISS).

PubMed

Loera, Barbara; Martini, Mara; Viotti, Sara; Converso, Daniela

2016-01-01

Social support is an important resource for reducing the risks of stress and burnout at work. It seems to be particularly helpful for educational and social professionals. The constant and intense relationships with users that characterize this kind of service can be very demanding, increasing stress and leading to burnout. While significant attention has been paid to supervisors and colleagues in the literature, users have rarely been considered as possible sources of social support. The only exception is the Zimmermann et al.'s (2011) research, focused on customer support as a resource for workers' well-being. This paper proposes the validation of the customer-initiated support scale developed by Zimmermann et al. (2011), translated into Italian and focused on educational services users (children's parents), to measure the user support perceived by workers: the User-Initiated Support Scale (UISS). In Study 1 (105 teachers), which specifically involved educators and kindergarten teachers, the items and scale properties were preliminarily examined using descriptive analyses and exploratory factor analysis (EFA). In Study 2 (304 teachers), the construct and criterion validity and scale dimensionality were analyzed using confirmatory factor analysis (CFA). In Study 3 (304 teachers from Study 2 and 296 educators), measurement invariance (MI) was tested. The EFA results from Study 1 showed a one-factor solution (explained variance, 67.2%). The scale showed good internal coherence (alpha = 0.88). The CFA in Study 2 validated the one-factor solution (comparative fit index = 0.987; standardized root mean square residual = 0.054). Bivariate correlations confirmed construct validity; the UISS was positively associated (convergent) with user gratitude, and not associated (divergent) with disproportionate customer expectations. Regarding the criterion validity test, the UISS was strongly correlated with burnout and job satisfaction. The analysis of MI performed on the Study 3 data confirmed the equality of the parameters of the covariance structure model between the two samples of kindergarten teachers and educators. This research study offers a useful version of a tool for measuring a crucial, but often ignored, protective resource for all professionals working directly with people (patients, students, and service users) that can represent important sources of well-being, directly or indirectly lessening the negative impacts of job demands.

Construct validity of the Moral Development Scale for Professionals (MDSP)

PubMed Central

Söderhamn, Olle; Bjørnestad, John Olav; Skisland, Anne; Cliffordson, Christina

2011-01-01

The aim of this study was to investigate the construct validity of the Moral Development Scale for Professionals (MDSP) using structural equation modeling. The instrument is a 12-item self-report instrument, developed in the Scandinavian cultural context and based on Kohlberg’s theory. A hypothesized simplex structure model underlying the MDSP was tested through structural equation modeling. Validity was also tested as the proportion of respondents older than 20 years that reached the highest moral level, which according to the theory should be small. A convenience sample of 339 nursing students with a mean age of 25.3 years participated. Results confirmed the simplex model structure, indicating that MDSP reflects a moral construct empirically organized from low to high. A minority of respondents >20 years of age (13.5%) scored more than 80% on the highest moral level. The findings support the construct validity of the MDSP and the stages and levels in Kohlberg’s theory. PMID:21655343

Psychometrics of the PHQ-9 as a measure of depressive symptoms in patients with heart failure.

PubMed

Hammash, Muna H; Hall, Lynne A; Lennie, Terry A; Heo, Seongkum; Chung, Misook L; Lee, Kyoung Suk; Moser, Debra K

2013-10-01

Depression in patients with heart failure commonly goes undiagnosed and untreated. The Patient Health Questionnaire-9 (PHQ-9) is a simple, valid measure of depressive symptoms that may facilitate clinical assessment. It has not been validated in patients with heart failure. To test the reliability, and concurrent and construct validity of the PHQ-9 in patients with heart failure. A total of 322 heart failure patients (32% female, 61 ± 12 years, 56% New York Heart Association class III/IV) completed the PHQ-9, the Beck Depression Inventory-II (BDI-II), and the Control Attitudes Scale (CAS). Cronbach's alpha of .83 supported the internal consistency reliability of the PHQ-9 in this sample. Inter-item correlations (range .22-.66) and item-total correlation (except item 9) supported homogeneity of the PHQ-9. Spearman's rho of .80, (p < .001) between the PHQ-9 and the BDI-II supported the concurrent validity as did the agreement between the PHQ-9 and the BDI-II (Kappa = 0.64, p < .001). At cut-off score of 10, the PHQ-9 was 70% sensitive and 92% specific in identifying depressive symptoms, using the BDI-II scores as the criterion for comparison. Differences in PHQ-9 scores by level of perceived control measured by CAS (t(318) = -5.05, p < .001) supported construct validity. The PHQ-9 is a reliable, valid measure of depressive symptoms in patients with heart failure.

Validity and usability of a professional association's web-based knowledge translation portal: American Physical Therapy Association's PTNow.org.

PubMed

Deutsch, Judith E; Romney, Wendy; Reynolds, Jan; Manal, Tara Jo

2015-10-08

PTNow.org is an evidence-based, on-line portal created by a professional membership association to promote use of evidence in practice and to help decrease unwarranted variation in practice. The site contains synthesis documents designed to promote efficient clinical reasoning. These documents were written and peer-reviewed by teams of content experts and master clinicians. The purpose of this paper is to report on the content and construct validity as well as usability of the site. Physical therapist participants used clinical summaries (available in 3 formats--as a full summary with hyperlinks, "quick takes" with hyperlinks, and a portable two-page version) on the PTNow.org site to answer knowledge acquisition and clinical reasoning questions related to four patient scenarios. They also responded to questions about ease of use related to website navigation and about format and completeness of information using a 1-5 Likert scale. Responses were coded to reflect how participants used the site and then were summarized descriptively. Preferences for clinical summary format were analyzed using an analysis of variance (ANOVA) and a Dunnett T3 post hoc analysis. Seventeen participants completed the study. Clinical relevance and completeness ratings by experienced clinicians, which were used as the measure of content validity, ranged from 3.1 to 4.6 on a 5 point scale. Construct validity based on the information on the PTNow.org site was supported for knowledge acquisition questions 66 % of the time and for clinical reasoning questions 40 % of the time. Usability ratings for the full clinical summary were 4.6 (1.2); for the quick takes, 3.5 (.98); and for the portable clinical summary, 4.0 (.45). Participants preferred the full clinical summary over the other two formats (F = 5.908, P = 0.007). One hundred percent of the participants stated that they would recommend the PTNow site to their colleagues. Prelimary evidence supported both content validity and construct validity of knowledge acquisition, and partially supported construct validity of clinical reasoning for the clinical summaries on the PTNow.org site. Usability was supported, with users preferring the full clinical summary over the other two formats. Iterative design is ongoing.

Validity of the Mayer-Salovey-Caruso Emotional Intelligence Test: Youth Version-Research Edition

ERIC Educational Resources Information Center

Peters, Christine; Kranzler, John H.; Rossen, Eric

2009-01-01

This study examines the criterion-related validity evidence of scores on the Mayer-Salovey-Caruso Emotional Intelligence Test: Youth Version-Research Version. The authors also investigate the relationship between scores on the MSCEIT-YV and chronological age. Results provide initial support for the construct validity of the MSCEIT-YV but also…

Evidence of Construct Validity in Published Achievement Tests.

ERIC Educational Resources Information Center

Nolet, Victor; Tindal, Gerald

Valid interpretation of test scores is the shared responsibility of the test designer and the test user. Test publishers must provide evidence of the validity of the decisions their tests are intended to support, while test users are responsible for analyzing this evidence and subsequently using the test in the manner indicated by the publisher.…

The SASSI-3 Face Valid other Drugs Scale: A Psychometric Investigation (Substance Abuse Subtle Screening Inventory-3)

ERIC Educational Resources Information Center

Laux, John M.; Perera-Diltz, Dilani; Smirnoff, Jennifer B.; Salyers, Kathleen M.

2005-01-01

The authors investigated the psychometric capabilities of the Face Valid Other Drugs (FVOD) scale of the Substance Abuse Subtle Screening Inventory-3 (SASSI-3; G. A. Miller, 1999). Internal consistency reliability estimates and construct validity factor analysis for 230 college students provided initial support for the psychometric properties of…

The Online Social Support Scale: Measure development and validation.

PubMed

Nick, Elizabeth A; Cole, David A; Cho, Sun-Joo; Smith, Darcy K; Carter, T Grace; Zelkowitz, Rachel L

2018-05-21

A new measure, the Online Social Support Scale, was developed based on previous theory, research, and measurement of in-person social support. It includes four subscales: Esteem/Emotional Support, Social Companionship, Informational Support, and Instrumental Support. In college and community samples, factor analytic and item response theory results suggest that subtypes of in-person social support also pertain in the online world. Evidence of reliability, convergent validity, and discriminant validity provide excellent psychometric support for the measure. Construct validity accrues to the measure vis-à-vis support for three hypotheses: (a) Various broad types of Internet platforms for social interactions are differentially associated with online social support and online victimization; (b) similar to in-person social support, online social support offsets the adverse effect of negative life events on self-esteem and depression-related outcome; and (c) online social support counteracts the effects of online victimization in much the same way that in-person friends in one social niche counterbalance rejection in other social niches. (PsycINFO Database Record (c) 2018 APA, all rights reserved).

The brief multidimensional students' life satisfaction scale-college version.

PubMed

Zullig, Keith J; Huebner, E Scott; Patton, Jon M; Murray, Karen A

2009-01-01

To investigate the psychometric properties of the BMSLSS-College among 723 college students. Internal consistency estimates explored scale reliability, factor analysis explored construct validity, and known-groups validity was assessed using the National College Youth Risk Behavior Survey and Harvard School of Public Health College Alcohol Study. Criterion-related validity was explored through analyses with the CDC's health-related quality of life scale and a social isolation scale. Acceptable internal consistency reliability, construct, known-groups, and criterion-related validity were established. Findings offer preliminary support for the BMSLSS-C; it could be useful in large-scale research studies, applied screening contexts, and for program evaluation purposes toward achieving Healthy People 2010 objectives.

Measuring treatment satisfaction in MS: Is the Treatment Satisfaction Questionnaire for Medication fit for purpose?

PubMed

Vermersch, Patrick; Hobart, Jeremy; Dive-Pouletty, Catherine; Bozzi, Sylvie; Hass, Steven; Coyle, Patricia K

2017-04-01

The Treatment Satisfaction Questionnaire for Medication (TSQM) was designed to assess patient treatment satisfaction in chronic diseases. Its performance has not been examined in multiple sclerosis (MS). The 14 items of the TSQM cover four domains: Effectiveness, Side Effects, Convenience, and Global Satisfaction. To evaluate performance of the TSQM in patients with relapsing MS, using data collected from the TENERE study (NCT00883337), in which 324 patients received oral teriflunomide or subcutaneous interferon beta-1a for ⩾48 weeks. Five measurement properties were examined using traditional psychometric methods: data completeness, scale-to-sample targeting, scaling assumptions, reliability (including test-retest), and construct validity (internal: item-level scaling success, confirmatory factor analysis, and exploratory factor analysis; external: convergence, discrimination, and group differences). There were few (<2%) missing item data; domain scores could be computed for all patients. Score distributions were skewed toward higher satisfaction; two domains had marked ceiling effects. Scaling assumptions were supported. Internal consistency reliability was high (Cronbach's α > 0.90). Internal validity tests supported item groupings. Correlations supported convergent and discriminant construct validity; hypothesis testing supported group differences validity. This investigation found the TSQM to be a useful tool, exhibiting good psychometric measurement properties in patients with relapsing MS in the TENERE study.

Expanding the Nomological Net of the Pathological Narcissism Inventory: German Validation and Extension in a Clinical Inpatient Sample.

PubMed

Morf, Carolyn C; Schürch, Eva; Küfner, Albrecht; Siegrist, Philip; Vater, Aline; Back, Mitja; Mestel, Robert; Schröder-Abé, Michela

2017-06-01

The Pathological Narcissism Inventory (PNI) is a multidimensional measure for assessing grandiose and vulnerable features in narcissistic pathology. The aim of the present research was to construct and validate a German translation of the PNI and to provide further information on the PNI's nomological net. Findings from a first study confirm the psychometric soundness of the PNI and replicate its seven-factor first-order structure. A second-order structure was also supported but with several equivalent models. A second study investigating associations with a broad range of measures ( DSM Axis I and II constructs, emotions, personality traits, interpersonal and dysfunctional behaviors, and well-being) supported the concurrent validity of the PNI. Discriminant validity with the Narcissistic Personality Inventory was also shown. Finally, in a third study an extension in a clinical inpatient sample provided further evidence that the PNI is a useful tool to assess the more pathological end of narcissism.

Construct Validity of Selected Measures of Physical Activity Beliefs and Motives in Fifth and Sixth Grade Boys and Girls

PubMed Central

Saunders, Ruth P.; McIver, Kerry L.; Dowda, Marsha; Pate, Russell R.

2013-01-01

Objective Scales used to measure selected social-cognitive beliefs and motives for physical activity were tested among boys and girls. Methods Covariance modeling was applied to responses obtained from large multi-ethnic samples of students in the fifth and sixth grades. Results Theoretically and statistically sound models were developed, supporting the factorial validity of the scales in all groups. Multi-group longitudinal invariance was confirmed between boys and girls, overweight and normal weight students, and non-Hispanic black and white children. The construct validity of the scales was supported by hypothesized convergent and discriminant relationships within a measurement model that included correlations with physical activity (MET • min/day) measured by an accelerometer. Conclusions Scores from the scales provide valid assessments of selected beliefs and motives that are putative mediators of change in physical activity among boys and girls, as they begin the understudied transition from the fifth grade into middle school, when physical activity naturally declines. PMID:23459310

Construct validity of selected measures of physical activity beliefs and motives in fifth and sixth grade boys and girls.

PubMed

Dishman, Rod K; Saunders, Ruth P; McIver, Kerry L; Dowda, Marsha; Pate, Russell R

2013-06-01

Scales used to measure selected social-cognitive beliefs and motives for physical activity were tested among boys and girls. Covariance modeling was applied to responses obtained from large multi-ethnic samples of students in the fifth and sixth grades. Theoretically and statistically sound models were developed, supporting the factorial validity of the scales in all groups. Multi-group longitudinal invariance was confirmed between boys and girls, overweight and normal weight students, and non-Hispanic black and white children. The construct validity of the scales was supported by hypothesized convergent and discriminant relationships within a measurement model that included correlations with physical activity (MET • min/day) measured by an accelerometer. Scores from the scales provide valid assessments of selected beliefs and motives that are putative mediators of change in physical activity among boys and girls, as they begin the understudied transition from the fifth grade into middle school, when physical activity naturally declines.

Evidence for the construct validity of self-motivation as a correlate of exercise adherence in French older adults.

PubMed

André, Nathalie; Dishman, Rod K

2012-04-01

Exercise adherence involves a number of sociocognitive factors that influence the adoption and maintenance of regular physical activity. Among trait-like factors, self-motivation is believed to be a unique predictor of persistence during behavior change. The aim of this study was to validate the factor structure of a French version of the Self-Motivation Inventory (SMI) and to provide initial convergent and discriminant evidence for its construct validity as a correlate of exercise adherence. Four hundred seventy-one elderly were recruited and administered the SMI-10. Structural equation modeling tested the relation of SMI-10 scores with exercise adherence in a correlated network that included decisional balance and perceived quality of life. Acceptable evidence was found to support the factor validity and measurement equivalence of the French version of the SMI-10. Moreover, self-motivation was related to exercise adherence independently of decisional balance and perceived quality of life, providing initial evidence for construct validity.

Development and Validation of the Minnesota Borderline Personality Disorder Scale (MBPD)

PubMed Central

Bornovalova, Marina A.; Hicks, Brian M.; Patrick, Christopher J.; Iacono, William G.; McGue, Matt

2011-01-01

While large epidemiological datasets can inform research on the etiology and development of borderline personality disorder (BPD), they rarely include BPD measures. In some cases, however, proxy measures can be constructed using instruments already in these datasets. In this study we developed and validated a self-report measure of BPD from the Multidimensional Personality Questionnaire (MPQ). Items for the new instrument—the Minnesota BPD scale (MBPD)—were identified and refined using three large samples: undergraduates, community adolescent twins, and urban substance users. We determined the construct validity of the MBPD by examining its association with (1) diagnosed BPD, (2) questionnaire reported BPD symptoms, and (3) clinical variables associated with BPD: suicidality, trauma, disinhibition, internalizing distress, and substance use. We also tested the MBPD in two prison inmate samples. Across samples, the MBPD correlated with BPD indices and external criteria, and showed incremental validity above measures of negative affect, thus supporting its construct validity as a measure of BPD. PMID:21467094

Using Scratch with Primary School Children: An Evaluation of Games Constructed to Gauge Understanding of Programming Concepts

ERIC Educational Resources Information Center

Wilson, Amanda; Hainey, Thomas; Connolly, Thomas M.

2013-01-01

Newer approaches such as games-based learning (GBL) and games-based construction are being adopted to motivate and engage students within the Curriculum for Excellence (CfE) in Scotland. GBL and games-based construction suffer from a dearth of empirical evidence supporting their validity as teaching and learning approaches. To address this issue…

Development and validation of the Delaying Gratification Inventory.

PubMed

Hoerger, Michael; Quirk, Stuart W; Weed, Nathan C

2011-09-01

Deficits in gratification delay are associated with a broad range of public health problems, such as obesity, risky sexual behavior, and substance abuse. However, 6 decades of research on the construct has progressed less quickly than might be hoped, largely because of measurement issues. Although past research has implicated 5 domains of delay behavior, involving food, physical pleasures, social interactions, money, and achievement, no published measure to date has tapped all 5 components of the content domain. Existing measures have been criticized for limitations related to efficiency, reliability, and construct validity. Using an innovative Internet-mediated approach to survey construction, we developed the 35-item 5-factor Delaying Gratification Inventory (DGI). Evidence from 4 studies and a large, diverse sample of respondents (N = 10,741) provided support for the psychometric properties of the measure. Specifically, scores on the DGI demonstrated strong internal consistency and test-retest reliability for the 35-item composite, each of the 5 domains, and a 10-item short form. The 5-factor structure fit the data well and had good measurement invariance across subgroups. Construct validity was supported by correlations with scores on closely related self-control measures, behavioral ratings, Big Five personality trait measures, and measures of adjustment and psychopathology, including those on the Minnesota Multiphasic Personality Inventory-2-Restructured Form. DGI scores also showed incremental validity in accounting for well-being and health-related variables. The present investigation holds implications for improving public health, accelerating future research on gratification delay, and facilitating survey construction research more generally by demonstrating the suitability of an Internet-mediated strategy.

Development and validation of the Delaying Gratification Inventory

PubMed Central

Hoerger, Michael; Quirk, Stuart W.; Weed, Nathan C.

2011-01-01

Deficits in gratification delay are associated with a broad range of public health problems, such as obesity, risky sexual behavior, and substance abuse. However, six decades of research on the construct has progressed less quickly than might be hoped, largely due to measurement issues. Although past research implicates five domains of delay behavior, involving food, physical pleasures, social interactions, money, and achievement, no published measure to date has tapped all five components of the content domain. Existing measures have been criticized for limitations related to efficiency, reliability, and construct validity. Using an innovative Internet-mediated approach to survey construction, we developed the 35-item five-factor Delaying Gratification Inventory (DGI). Evidence from four studies and a large, diverse sample of respondents (N = 10,741) provided support for the psychometric properties of the measure. Specifically, scores on the DGI demonstrated strong internal consistency and test-retest reliability for the 35-item composite, each of the five domains, and a 10-item short-form. The five-factor structure fit the data well and had good measurement invariance across subgroups. Construct validity was supported by correlations with scores on closely-related self-control measures, behavioral ratings, Big Five personality trait measures, and measures of adjustment and psychopathology, including those on the Minnesota Multiphasic Personality Inventory-2-Restructured Form (MMPI-2-RF). DGI scores also showed incremental validity in accounting for well-being and health-related variables. The present investigation holds implications for improving public health, accelerating future research on gratification delay, and facilitating survey construction research more generally by demonstrating the suitability of an Internet-mediated strategy. PMID:21480721

The Social Physique Anxiety Scale: construct validity in adolescent females.

PubMed

McAuley, E; Burman, G

1993-09-01

Hart, Leary, and Rejeski have developed the Social Physique Anxiety Scale (SPA), a measure of the anxiety experienced in response to having one's physique evaluated by other people. The present study cross-validated the psychometric properties of this measure in a sample (N = 236) of adolescent competitive female gymnasts. Employing structural equation modeling, the proposed unidimensional factor structure of the SPA was supported, although some questions regarding the robustness of the fit are raised. Construct validity was demonstrated by significant inverse relationships between aspects of physical efficacy (perceived physical ability and physical self-presentation confidence) and degree of social physique anxiety. These findings are discussed in terms of possible alternative factor structures and integration of social anxiety and other psychosocial constructs to better understand physical activity behavior.

Construct Validity of the Relationship Profile Test: Links with measures of psychopathology and adult attachment

PubMed Central

Haggerty, Greg; Bornstein, Robert F.; Khalid, Mohammad; Sharma, Vishal; Riaz, Usman; Blanchard, Mark; Siefert, Caleb J; Sinclair, Samuel J.

2015-01-01

This study assessed the construct validity of the Relationship Profile Test (RPT; Bornstein & Languirand, 2003) with a substance abuse sample. One hundred-eight substance abuse patients completed the RPT, Experiences in Close Relationships Scale (ECR-SF; Wei, Russell, Mallinckrodt, & Vogel, 2007), Personality Assessment Inventory (PAI; Morey, 1991), and Symptom Checklist-90-Revised (SCL-90-R: Derogatis 1983). Results suggest that the RPT has good construct validity when compared against theoretically related broadband measures of personality, psychopathology and adult attachment. Overall, health hependency was negatively related to measures of psychopathology and insecure attachment, and overdependence was positively related to measures of psychopathology and attachment anxiety. Many of the predictions regarding RPT detachment and the criterion measures were not supported. Implications of these findings are discussed. PMID:26620463

The Chinese version of hospital anxiety and depression scale: Psychometric properties in Chinese cancer patients and their family caregivers.

PubMed

Li, Qiuping; Lin, Yi; Hu, Caiping; Xu, Yinghua; Zhou, Huiya; Yang, Liping; Xu, Yongyong

2016-12-01

The Hospital Anxiety and Depression Scale (HADS) acts as one of the most frequently used self-reported measures in cancer practice. The evidence for construct validity of HADS, however, remains inconclusive. The objective of this study is to evaluate the psychometric properties of the Chinese version HADS (C-HADS) in terms of construct validity, internal consistency reliability, and concurrent validity in dyads of Chinese cancer patients and their family caregivers. This was a cross-sectional study, conducted in multiple centers: one hospital in each of the seven different administrative regions in China from October 2014 to May 2015. A total of 641 dyads, consisting of cancer patients and family caregivers, completed a survey assessing their demographic and background information, anxiety and depression using C-HADS, and quality of life (QOL) using Chinese version SF-12. Data analysis methods included descriptive statistics, confirmatory factor analysis (CFA), and Pearson correlations. Both the two-factor and one-factor models offered the best and adequate fit to the data in cancer patients and family caregivers respectively. The comparison of the two-factor and single-factor models supports the basic assumption of two-factor construct of C-HADS. The overall and two subscales of C-HADS in both cancer patients and family caregivers had good internal consistency and acceptable concurrent validity. The Chinese version of the HADS may be a reliable and valid screening tool, as indicated by its original two-factor structure. The finding supports the basic assumption of two-factor construct of HADS. Copyright © 2016 Elsevier Ltd. All rights reserved.

The Self-Presentation Motives for Physical Activity Questionnaire: Instrument Development and Preliminary Construct Validity Evidence.

PubMed

Howle, Timothy C; Dimmock, James A; Whipp, Peter R; Jackson, Ben

2015-06-01

With the aim of advancing the literature on impression management in physical activity settings, we developed a theoretically derived 2 by 2 instrument that was designed to measure different types of context-specific self-presentation motives. Following item generation and expert review (Study 1), the instrument was completed by 206 group exercise class attendees (Study 2) and 463 high school physical education students (Study 3). Our analyses supported the intended factor structure (i.e., reflecting acquisitive-agentic, acquisitive-communal, protective-agentic, and protective-communal motives). We found some support for construct validity, and the self-presentation motives were associated with variables of theoretical and applied interest (e.g., impression motivation and construction, social anxiety, social and achievement goals, efficacy beliefs, engagement). Taken together, the results indicate that the Self-presentation Motives for Physical Activity Questionnaire (SMPAQ) may be useful for measuring various types of self-presentation motives in physical activity settings.

Ada compiler validation summary report. Certificate number: 891116W1. 10191. Intel Corporation, IPSC/2 Ada, Release 1. 1, IPSC/2 parallel supercomputer, system resource manager host and IPSC/2 parallel supercomputer, CX-1 nodes target

DOE Office of Scientific and Technical Information (OSTI.GOV)

Not Available

1989-11-16

This VSR documents the results of the validation testing performed on an Ada compiler. Testing was carried out for the following purposes: To attempt to identify any language constructs supported by the compiler that do not conform to the Ada Standard; To attempt to identify any language constructs not supported by the compiler but required by the Ada Standard; and To determine that the implementation-dependent behavior is allowed by the Ada Standard. Testing of this compiler was conducted by SofTech, Inc. under the direction of he AVF according to procedures established by the Ada Joint Program Office and administered bymore » the Ada Validation Organization (AVO). On-side testing was completed 16 November 1989 at Aloha OR.« less

Measuring Empathy in Pharmacy Students

PubMed Central

Van Winkle, Lon J.; Hojat, Mohammadreza

2011-01-01

Objective. To validate the Jefferson Scale of Empathy-Health Profession Students version (JSE-HPS) in pharmacy students. Methods. The JSE-HPS (20 items), adapted from the original Jefferson Scale of Empathy for use among students in the healthcare professions, was completed by 187 first-year pharmacy students at Midwestern University Chicago College of Pharmacy. Results. Two factors, “perspective-taking” and “compassionate care,” emerged from factor analysis in this study, accounting for 31% and 8% of the variance, respectively. These factors are similar to the prominent ones reported in previous research involving physicians and medical students, supporting the construct validity of this instrument for pharmacy students. In the current study, mean JSE-HPS score was comparable to those reported for medical students, and consistent with previous findings with medical students and physicians. Women scored significantly higher than men. Conclusions. Findings support the construct validity and reliability of the JSE-HPS for measuring empathy in pharmacy students. PMID:21931447

Beliefs about language development: construct validity evidence.

PubMed

Donahue, Mavis L; Fu, Qiong; Smith, Everett V

2012-01-01

Understanding language development is incomplete without recognizing children's sociocultural environments, including adult beliefs about language development. Yet there is a need for data supporting valid inferences to assess these beliefs. The current study investigated the psychometric properties of data from a survey (MODeL) designed to explore beliefs in the popular culture, and their alignment with more formal theories. Support for the content, substantive, structural, generalizability, and external aspects of construct validity of the data were investigated. Subscales representing Behaviorist, Cognitive, Nativist, and Sociolinguistic models were identified as dimensions of beliefs. More than half of the items showed a high degree of consensus, suggesting culturally-transmitted beliefs. Behaviorist ideas were most popular. Bilingualism and ethnicity were related to Cognitive and Sociolinguistic beliefs. Identifying these beliefs may clarify the nature of child-directed speech, and enable the design of language intervention programs that are congruent with family and cultural expectations.

Assessment of the psychometric properties of the Family Management Measure.

PubMed

Knafl, Kathleen; Deatrick, Janet A; Gallo, Agatha; Dixon, Jane; Grey, Margaret; Knafl, George; O'Malley, Jean

2011-06-01

This paper reports development of the Family Management Measure (FaMM) of parental perceptions of family management of chronic conditions. By telephone interview, 579 parents of children age 3 to 19 with a chronic condition (349 partnered mothers, 165 partners, 65 single mothers) completed the FaMM and measures of child functional status and behavioral problems and family functioning. Analyses addressed reliability, factor structure, and construct validity. Exploratory factor analysis yielded six scales: Child's Daily Life, Condition Management Ability, Condition Management Effort, Family Life Difficulty, Parental Mutuality, and View of Condition Impact. Internal consistency reliability ranged from .72 to .91, and test-retest reliability from .71 to .94. Construct validity was supported by significant correlations in hypothesized directions between FaMM scales and established measures. Results support FaMM's; reliability and validity, indicating it performs in a theoretically meaningful way and taps distinct aspects of family response to childhood chronic conditions.

Grid workflow validation using ontology-based tacit knowledge: A case study for quantitative remote sensing applications

NASA Astrophysics Data System (ADS)

Liu, Jia; Liu, Longli; Xue, Yong; Dong, Jing; Hu, Yingcui; Hill, Richard; Guang, Jie; Li, Chi

2017-01-01

Workflow for remote sensing quantitative retrieval is the ;bridge; between Grid services and Grid-enabled application of remote sensing quantitative retrieval. Workflow averts low-level implementation details of the Grid and hence enables users to focus on higher levels of application. The workflow for remote sensing quantitative retrieval plays an important role in remote sensing Grid and Cloud computing services, which can support the modelling, construction and implementation of large-scale complicated applications of remote sensing science. The validation of workflow is important in order to support the large-scale sophisticated scientific computation processes with enhanced performance and to minimize potential waste of time and resources. To research the semantic correctness of user-defined workflows, in this paper, we propose a workflow validation method based on tacit knowledge research in the remote sensing domain. We first discuss the remote sensing model and metadata. Through detailed analysis, we then discuss the method of extracting the domain tacit knowledge and expressing the knowledge with ontology. Additionally, we construct the domain ontology with Protégé. Through our experimental study, we verify the validity of this method in two ways, namely data source consistency error validation and parameters matching error validation.

Experimental validation of bracing recommendations for long-span concrete girders : final report.

DOT National Transportation Integrated Search

2012-12-01

During bridge construction, flexible support conditions provided by steel-reinforced neoprene bearing pads supporting precast, prestressed concrete girders may allow the girders to become unstable, rolling about an axis parallel to the span of the gi...

Mother reports of maternal support following child sexual abuse: Preliminary psychometric data on the Maternal Self-report Support Questionnaire (MSSQ).

PubMed

Smith, Daniel W; Sawyer, Genelle K; Jones, Lisa M; Cross, Theodore; McCart, Michael R; Ralston, M Elizabeth

2010-10-01

Maternal support is an important factor in predicting outcomes following disclosure of child sexual abuse; however, definition of the construct has been unclear and existing measures of maternal support are utilized inconsistently and have limited psychometric data. The purpose of this study was to develop a reliable and valid mother-report measure for assessing maternal support following the disclosure of child sexual abuse. Data from 2 very similar samples of mother-child pairs seeking forensic evaluation following the discovery of child sexual abuse were combined, resulting in a final sample of 246. Exploratory factor analysis resulted in two reliable 7-item factors labeled "Emotional Support" and "Blame/Doubt," each of which had acceptable internal consistency. Analyses with a child-report measure of general maternal support the construct validity of the MSSQ. Concurrent validity analyses revealed unique relations with maternal ratings of child behavior problems and case characteristic data. The study resulted in the development of a brief, easily scored self-report measure of maternal support with reasonable preliminary psychometric properties that could easily be utilized in other studies of sexually abused children. Adoption of this promising measure in future research will reduce the lack of cross-study measurement comparability that has characterized the maternal support literature to date, increase the feasibility of expanding upon current literature on maternal support, and may produce important information leading to clinical and theoretical innovation. Copyright © 2010. Published by Elsevier Ltd.

Construct validity of adolescents' self-reported big five personality traits: importance of conceptual breadth and initial validation of a short measure.

PubMed

Morizot, Julien

2014-10-01

While there are a number of short personality trait measures that have been validated for use with adults, few are specifically validated for use with adolescents. To trust such measures, it must be demonstrated that they have adequate construct validity. According to the view of construct validity as a unifying form of validity requiring the integration of different complementary sources of information, this article reports the evaluation of content, factor, convergent, and criterion validities as well as reliability of adolescents' self-reported personality traits. Moreover, this study sought to address an inherent potential limitation of short personality trait measures, namely their limited conceptual breadth. In this study, starting with items from a known measure, after the language-level was adjusted for use with adolescents, items tapping fundamental primary traits were added to determine the impact of added conceptual breadth on the psychometric properties of the scales. The resulting new measure was named the Big Five Personality Trait Short Questionnaire (BFPTSQ). A group of expert judges considered the items to have adequate content validity. Using data from a community sample of early adolescents, the results confirmed the factor validity of the Big Five structure in adolescence as well as its measurement invariance across genders. More important, the added items did improve the convergent and criterion validities of the scales, but did not negatively affect their reliability. This study supports the construct validity of adolescents' self-reported personality traits and points to the importance of conceptual breadth in short personality measures. © The Author(s) 2014.

The Development and Validation of an Inventory of Effective School Function.

ERIC Educational Resources Information Center

Carter, Jacquelyn; Michael, William B.

1995-01-01

The Effective School Function Inventory was constructed to operationalize the major constructs of efficient school operation. An analysis with 124 teachers identified 4 meaningful factors: (1) supportive collegial interaction; (2) cooperative facilitation of goal attainment in learning/sharing; (3) morally oriented leadership; and (4)…

Evaluating and Comparing Singaporean and Taiwanese Eighth Graders' Conceptions of Science Assessment

ERIC Educational Resources Information Center

Lin, Tzung-Jin; Tan, Aik-Ling; Lee, Min-Hsien; Tsai, Chin-Chung

2017-01-01

Background: Researchers have indicated that assessment practices and methods should support learners' construction of meaningful understanding of knowledge. Understanding students' conceptions of assessment will enable us to construct more realistic, valid and fair assessments. Learners' conceptualization of assessment would be imperative to serve…

Validating a Technology Enhanced Student-Centered Learning Model

ERIC Educational Resources Information Center

Kang, Myunghee; Hahn, Jungsun; Chung, Warren

2015-01-01

The Technology Enhanced Student Centered Learning (TESCL) Model in this study presents the core factors that ensure the quality of learning in a technology-supported environment. Although the model was conceptually constructed using a student-centered learning framework and drawing upon previous studies, it should be validated through real-world…

Examining the Cultural Validity of a College Student Engagement Survey for Latinos

ERIC Educational Resources Information Center

Hernandez, Ebelia; Mobley, Michael; Coryell, Gayle; Yu, En-Hui; Martinez, Gladys

2013-01-01

Using critical race theory and quantitative criticalist stance, this study examines the construct validity of an engagement survey, "Student Experiences in the Research University" (SERU) for Latino college students through exploratory factor analysis. Results support the principal seven-factor SERU model. However subfactors exhibited…

Identifying Sources of Bias in the WISC-R.

ERIC Educational Resources Information Center

Vance, Booney; Sabatino, David

1991-01-01

The issues of construct validity, predictive validity, and item content bias on the Wechsler Intelligence Scale for Children-Revised (WISC-R) are examined. The review concludes that most objective data have not supported the issue of bias of the WISC-R when used with children of different ethnic backgrounds. (JDD)

A Test of the Inventory of Attitudes towards Seeking Mental Health Services

ERIC Educational Resources Information Center

Hyland, Philip; Boduszek, Daniel; Dhingra, Katie; Shevlin, Mark; Maguire, Rebecca; Morley, Kevin

2015-01-01

This study investigates the construct validity, composite reliability and concurrent validity of the "Inventory of attitudes towards seeking mental health services" (IASMHS). A large sample of Irish police officers (N = 331) participated in the study. Confirmatory factor analysis supported the three-factor structure of the scale, while…

Internal consistency reliability and validity of the Arabic translation of the Mathematics Teaching Efficacy Beliefs Instrument.

PubMed

Alkhateeb, Haitham M

2004-06-01

The Arabic translation of the Mathematics Teaching Efficacy Beliefs was completed by 144 undergraduate students (M age=20.6) in Jordan. The findings support the internal reliability of the Arabic translation of the Mathematics Teaching Efficacy Beliefs as well as its construct validity.

The Multifactorial Nature of Extraversion-Introversion in the Myers-Briggs Type Indicator and Eysenck Personality Inventory.

ERIC Educational Resources Information Center

Sipps, Gary J.; Alexander, Ralph A.

1987-01-01

The construct validity of extraversion-introversion was explored, as measured by the Myers Briggs Type Indicator (MBTI) and the Eysenck Personality Inventory. Findings supported the complexity of extraversion-introversion. Two MBTI scales, Extraversion Introversion and Judging Perceiving, were factorially valid measures of impulsivity…

Calibration of the Dutch-Flemish PROMIS Pain Behavior item bank in patients with chronic pain.

PubMed

Crins, M H P; Roorda, L D; Smits, N; de Vet, H C W; Westhovens, R; Cella, D; Cook, K F; Revicki, D; van Leeuwen, J; Boers, M; Dekker, J; Terwee, C B

2016-02-01

The aims of the current study were to calibrate the item parameters of the Dutch-Flemish PROMIS Pain Behavior item bank using a sample of Dutch patients with chronic pain and to evaluate cross-cultural validity between the Dutch-Flemish and the US PROMIS Pain Behavior item banks. Furthermore, reliability and construct validity of the Dutch-Flemish PROMIS Pain Behavior item bank were evaluated. The 39 items in the bank were completed by 1042 Dutch patients with chronic pain. To evaluate unidimensionality, a one-factor confirmatory factor analysis (CFA) was performed. A graded response model (GRM) was used to calibrate the items. To evaluate cross-cultural validity, Differential item functioning (DIF) for language (Dutch vs. English) was evaluated. Reliability of the item bank was also examined and construct validity was studied using several legacy instruments, e.g. the Roland Morris Disability Questionnaire. CFA supported the unidimensionality of the Dutch-Flemish PROMIS Pain Behavior item bank (CFI = 0.960, TLI = 0.958), the data also fit the GRM, and demonstrated good coverage across the pain behavior construct (threshold parameters range: -3.42 to 3.54). Analysis showed good cross-cultural validity (only six DIF items), reliability (Cronbach's α = 0.95) and construct validity (all correlations ≥0.53). The Dutch-Flemish PROMIS Pain Behavior item bank was found to have good cross-cultural validity, reliability and construct validity. The development of the Dutch-Flemish PROMIS Pain Behavior item bank will serve as the basis for Dutch-Flemish PROMIS short forms and computer adaptive testing (CAT). © 2015 European Pain Federation - EFIC®

The Trunk Impairment Scale - modified to ordinal scales in the Norwegian version.

PubMed

Gjelsvik, Bente; Breivik, Kyrre; Verheyden, Geert; Smedal, Tori; Hofstad, Håkon; Strand, Liv Inger

2012-01-01

To translate the Trunk Impairment Scale (TIS), a measure of trunk control in patients after stroke, into Norwegian (TIS-NV), and to explore its construct validity, internal consistency, intertester and test-retest reliability. TIS was translated according to international guidelines. The validity study was performed on data from 201 patients with acute stroke. Fifty patients with stroke and acquired brain injury were recruited to examine intertester and test-retest reliability. Construct validity was analyzed with exploratory and confirmatory factor analysis and item response theory, internal consistency with Cronbach's alpha test, and intertester and test-retest reliability with kappa and intraclass correlation coefficient tests. The back-translated version of TIS-NV was validated by the original developer. The subscale Static sitting balance was removed. By combining items from the subscales Dynamic sitting balance and Coordination, six ordinal superitems (testlets) were constructed. The TIS-NV was renamed the modified TIS-NV (TIS-modNV). After modifications the TIS-modNV fitted well to a locally dependent unidimensional item response theory model. It demonstrated good construct validity, excellent internal consistency, and high intertester and test-retest reliability for the total score. This study supports that the TIS-modNV is a valid and reliable scale for use in clinical practice and research.

Fruit and vegetable shopping practices and social support scales: A validation.

PubMed

Baranowski, Tom; Missaghian, Mariam; Broadfoot, Alison; Watson, Kathy; Cullen, Karen; Nicklas, Theresa; Fisher, Jennifer; Baranowski, Janice; O'Donnell, Sharon

2006-01-01

To assess the psychometric characteristics of new scales of shopping practices and social support for purchasing fruits and vegetables. Participants were recruited in front of diverse grocery stores. Telephone data collection was done on 2 occasions, separated by 6 weeks. 166 food shoppers with children at home participated. New scales of food shopping practices and social support for purchasing fruits and vegetables were psychometrically analyzed and related to a measure of home fruit or vegetable availability as a test of construct validity. Both classical test and item response theory procedures were used. Correlations related the new measures to home fruit and vegetable availability. Single dimension scales were specified for fruit and vegetable shopping practices (35% of the variance), fruit purchase social support (53% of the variance), and vegetable purchase social support (52% of the variance). Item response theory difficulty estimates varied from -0.64 to 0.73 for fruit and vegetable shopping practices, from -0.55 to 0.33 for fruit purchase social support, and from -0.55 to 0.34 for vegetable social support. Each scale significantly correlated with home fruit and vegetable availability (construct validity), even after controlling for social desirability of response (0.19 for shopping practices, 0.37 for fruit purchasing social support, and 0.28 for vegetable purchasing social support). Person separation reliability was 0.80 for food shopping practices, 0.74 for fruit purchasing social support, and 0.73 for vegetable purchasing social support. The scales performed well. These scales are now available to help better understand fruit and vegetable shopping practices, fruit purchase social support, and vegetable purchase social support.

Development and validity of a scale to measure workplace culture of health.

PubMed

Kwon, Youngbum; Marzec, Mary L; Edington, Dee W

2015-05-01

To describe the development of and test the validity and reliability of the Workplace Culture of Health (COH) scale. Exploratory factor analysis and confirmatory factor analysis were performed on data from a health care organization (N = 627). To verify the factor structure, confirmatory factor analysis was performed on a second data set from a medical equipment manufacturer (N = 226). The COH scale included a structure of five orthogonal factors: senior leadership and polices, programs and rewards, quality assurance, supervisor support, and coworker support. With regard to construct validity (convergent and discriminant) and reliability, two different US companies showed the same factorial structure, satisfactory fit statistics, and suitable internal and external consistency. The COH scale represents a reliable and valid scale to assess the workplace environment and culture for supporting health.

Utility of pedometers for assessing physical activity: construct validity.

PubMed

Tudor-Locke, Catrine; Williams, Joel E; Reis, Jared P; Pluto, Delores

2004-01-01

Valid assessment of physical activity is necessary to fully understand this important health-related behaviour for research, surveillance, intervention and evaluation purposes. This article is the second in a companion set exploring the validity of pedometer-assessed physical activity. The previous article published in Sports Medicine dealt with convergent validity (i.e. the extent to which an instrument's output is associated with that of other instruments intended to measure the same exposure of interest). The present focus is on construct validity. Construct validity is the extent to which the measurement corresponds with other measures of theoretically-related parameters. Construct validity is typically evaluated by correlational analysis, that is, the magnitude of concordance between two measures (e.g. pedometer-determined steps/day and a theoretically-related parameter such as age, anthropometric measures and fitness). A systematic literature review produced 29 articles published since > or =1980 directly relevant to construct validity of pedometers in relation to age, anthropometric measures and fitness. Reported correlations were combined and a median r-value was computed. Overall, there was a weak inverse relationship (median r = -0.21) between age and pedometer-determined physical activity. A weak inverse relationship was also apparent with both body mass index and percentage overweight (median r = -0.27 and r = -0.22, respectively). Positive relationships regarding indicators of fitness ranged from weak to moderate depending on the fitness measure utilised: 6-minute walk test (median r = 0.69), timed treadmill test (median r = 0.41) and estimated maximum oxygen uptake (median r = 0.22). Studies are warranted to assess the relationship of pedometer-determined physical activity with other important health-related outcomes including blood pressure and physiological parameters such as blood glucose and lipid profiles. The aggregated evidence of convergent validity (presented in the previous companion article) and construct validity herein provides support for considering simple and inexpensive pedometers in both research and practice.

Developing a Workflow Composite Score to Measure Clinical Information Logistics. A Top-down Approach.

PubMed

Liebe, J D; Hübner, U; Straede, M C; Thye, J

2015-01-01

Availability and usage of individual IT applications have been studied intensively in the past years. Recently, IT support of clinical processes is attaining increasing attention. The underlying construct that describes the IT support of clinical workflows is clinical information logistics. This construct needs to be better understood, operationalised and measured. It is therefore the aim of this study to propose and develop a workflow composite score (WCS) for measuring clinical information logistics and to examine its quality based on reliability and validity analyses. We largely followed the procedural model of MacKenzie and colleagues (2011) for defining and conceptualising the construct domain, for developing the measurement instrument, assessing the content validity, pretesting the instrument, specifying the model, capturing the data and computing the WCS and testing the reliability and validity. Clinical information logistics was decomposed into the descriptors data and information, function, integration and distribution, which embraced the framework validated by an analysis of the international literature. This framework was refined selecting representative clinical processes. We chose ward rounds, pre- and post-surgery processes and discharge as sample processes that served as concrete instances for the measurements. They are sufficiently complex, represent core clinical processes and involve different professions, departments and settings. The score was computed on the basis of data from 183 hospitals of different size, ownership, location and teaching status. Testing the reliability and validity yielded encouraging results: the reliability was high with r(split-half) = 0.89, the WCS discriminated between groups; the WCS correlated significantly and moderately with two EHR models and the WCS received good evaluation results by a sample of chief information officers (n = 67). These findings suggest the further utilisation of the WCS. As the WCS does not assume ideal workflows as a gold standard but measures IT support of clinical workflows according to validated descriptors a high portability of the WCS to other hospitals in other countries is very likely. The WCS will contribute to a better understanding of the construct clinical information logistics.

Development and Validity of Western University's On-Road Assessment.

PubMed

Classen, Sherrilene; Krasniuk, Sarah; Alvarez, Liliana; Monahan, Miriam; Morrow, Sarah A; Danter, Tim

2017-01-01

Although used across North America, many on-road studies do not explicitly document the content and metrics of on-road courses and accompanying assessments. This article discusses the development of the University of Western Ontario's on-road course, and elucidates the validity of its accompanying on-road assessment. We identified main components for developing an on-road course and used measurement theory to establish face, content, and initial construct validity. Five adult volunteer drivers and 30 drivers with multiple sclerosis participated in the study. The road course had face and content validity, representing 100% of roadway components determined through a content validity matrix and index. The known-groups method showed that debilitated drivers (vs. not debilitated), made more driving errors ( W = 463.50, p = .03), and failed the on-road course, indicating preliminary construct validity of the on-road assessment. This research guides and empirically supports a process for developing a road course and its assessment.

Construction and Validation of a Women's Autonomy Measurement Scale with Reference to Utilization of Maternal Health Care Services in Nepal.

PubMed

Bhandari, T R; Dangal, G; Sarma, P S; Kutty, V R

2014-01-01

Women's autonomy is one of the predictors of maternal health care service utilization. This study aimed to construct and validate a scale for measuring women's autonomy with relevance to developing countries. We conducted a study for construction and validation of a scale in Rupandehi and further validated in Kapilvastu districts of Nepal. Initially, we administered a 24-item preliminary scale and finalized a 23-item scale using psychometric tests. After defining the construct of women's autonomy, we pooled 194 items and selected 24 items to develop a preliminary scale. The scale development process followed different steps i.e. definition of construct, generation of items pool, pretesting, analysis of psychometric test and further validation. The new scale was strongly supported by Cronbach's Alpha value (0.84), test-retest Pearson correlation (0.87), average content validity ratio (0.8) and overall agreement- Kappa value of the items (0.83) whereas all values were found satisfactory. From factor analysis, we selected 23 items for the final scale which show good convergent and discriminant validity. From preliminary draft, we removed one item; the remaining 23 items were loaded in five factors. All five factors had single loading items by suppressing absolute coefficient value less than 0.45 and average coefficient was more than 0.60 of each factor. Similarly, the factors and loaded items had good convergent and discriminant validity which further showed strong measurement capacity of the scale. The new scale is a reliable tool for assessing women's autonomy in developing countries. We recommend for further use and validation of the scale for ensuring the measurement capacity.

Innovative learning model for improving students’ argumentation skill and concept understanding on science

NASA Astrophysics Data System (ADS)

Nafsiati Astuti, Rini

2018-04-01

Argumentation skill is the ability to compose and maintain arguments consisting of claims, supports for evidence, and strengthened-reasons. Argumentation is an important skill student needs to face the challenges of globalization in the 21st century. It is not an ability that can be developed by itself along with the physical development of human, but it must be developed under nerve like process, giving stimulus so as to require a person to be able to argue. Therefore, teachers should develop students’ skill of arguing in science learning in the classroom. The purpose of this study is to obtain an innovative learning model that are valid in terms of content and construct in improving the skills of argumentation and concept understanding of junior high school students. The assessment of content validity and construct validity was done through Focus Group Discussion (FGD), using the content and construct validation sheet, book model, learning video, and a set of learning aids for one meeting. Assessment results from 3 (three) experts showed that the learning model developed in the category was valid. The validity itself shows that the developed learning model has met the content requirement, the student needs, state of the art, strong theoretical and empirical foundation and construct validity, which has a connection of syntax stages and components of learning model so that it can be applied in the classroom activities

Experimentally Manipulating Items Informs on the (Limited) Construct and Criterion Validity of the Humor Styles Questionnaire

PubMed Central

Ruch, Willibald; Heintz, Sonja

2017-01-01

How strongly does humor (i.e., the construct-relevant content) in the Humor Styles Questionnaire (HSQ; Martin et al., 2003) determine the responses to this measure (i.e., construct validity)? Also, how much does humor influence the relationships of the four HSQ scales, namely affiliative, self-enhancing, aggressive, and self-defeating, with personality traits and subjective well-being (i.e., criterion validity)? The present paper answers these two questions by experimentally manipulating the 32 items of the HSQ to only (or mostly) contain humor (i.e., construct-relevant content) or to substitute the humor content with non-humorous alternatives (i.e., only assessing construct-irrelevant context). Study 1 (N = 187) showed that the HSQ affiliative scale was mainly determined by humor, self-enhancing and aggressive were determined by both humor and non-humorous context, and self-defeating was primarily determined by the context. This suggests that humor is not the primary source of the variance in three of the HQS scales, thereby limiting their construct validity. Study 2 (N = 261) showed that the relationships of the HSQ scales to the Big Five personality traits and subjective well-being (positive affect, negative affect, and life satisfaction) were consistently reduced (personality) or vanished (subjective well-being) when the non-humorous contexts in the HSQ items were controlled for. For the HSQ self-defeating scale, the pattern of relationships to personality was also altered, supporting an positive rather than a negative view of the humor in this humor style. The present findings thus call for a reevaluation of the role that humor plays in the HSQ (construct validity) and in the relationships to personality and well-being (criterion validity). PMID:28473794

A test of the validity of the motivational interviewing treatment integrity code.

PubMed

Forsberg, Lars; Berman, Anne H; Kallmén, Håkan; Hermansson, Ulric; Helgason, Asgeir R

2008-01-01

To evaluate the Swedish version of the Motivational Interviewing Treatment Code (MITI), MITI coding was applied to tape-recorded counseling sessions. Construct validity was assessed using factor analysis on 120 MITI-coded sessions. Discriminant validity was assessed by comparing MITI coding of motivational interviewing (MI) sessions with information- and advice-giving sessions as well as by comparing MI-trained practitioners with untrained practitioners. A principal-axis factoring analysis yielded some evidence for MITI construct validity. MITI differentiated between practitioners with different levels of MI training as well as between MI practitioners and advice-giving counselors, thus supporting discriminant validity. MITI may be used as a training tool together with supervision to confirm and enhance MI practice in clinical settings. MITI can also serve as a tool for evaluating MI integrity in clinical research.

Construction and Initial Validation of the Multiracial Experiences Measure (MEM)

PubMed Central

Yoo, Hyung Chol; Jackson, Kelly; Guevarra, Rudy P.; Miller, Matthew J.; Harrington, Blair

2015-01-01

This article describes the development and validation of the Multiracial Experiences Measure (MEM): a new measure that assesses uniquely racialized risks and resiliencies experienced by individuals of mixed racial heritage. Across two studies, there was evidence for the validation of the 25-item MEM with 5 subscales including Shifting Expressions, Perceived Racial Ambiguity, Creating Third Space, Multicultural Engagement, and Multiracial Discrimination. The 5-subscale structure of the MEM was supported by a combination of exploratory and confirmatory factor analyses. Evidence of criterion-related validity was partially supported with MEM subscales correlating with measures of racial diversity in one’s social network, color-blind racial attitude, psychological distress, and identity conflict. Evidence of discriminant validity was supported with MEM subscales not correlating with impression management. Implications for future research and suggestions for utilization of the MEM in clinical practice with multiracial adults are discussed. PMID:26460977

Measuring hope among families impacted by cognitive impairment

PubMed Central

Hunsaker, Amanda E.; Terhorst, Lauren; Gentry, Amanda; Lingler, Jennifer H.

2014-01-01

The current exploratory investigation aims to establish the reliability and validity of a hope measure, the Herth Hope Index (HHI), among families impacted by early cognitive impairment (N=96). Exploratory factor analysis was used to examine the dimensionality of the measure. Bivariate analyses were used to examine construct validity. The sample had moderately high hope scores. A two-factor structure emerged from the factor analysis, explaining 51.44% of the variance. Both factors exhibited strong internal consistency (Cronbach’s alphas ranged from .83 to .86). Satisfaction with social support was positively associated with hope, supporting convergent validity. Neurocognitive status, illness insight and depression were not associated with hope, indicating discriminant validity. Families impacted by cognitive impairment may maintain hope in the face of a potentially progressive illness, regardless of cognitive status. The HHI can be utilized as a reliable and valid measure of hope by practitioners providing support to families impacted by cognitive impairment. PMID:24784938

Construction and initial validation of the Multiracial Experiences Measure (MEM).

PubMed

Yoo, Hyung Chol; Jackson, Kelly F; Guevarra, Rudy P; Miller, Matthew J; Harrington, Blair

2016-03-01

This article describes the development and validation of the Multiracial Experiences Measure (MEM): a new measure that assesses uniquely racialized risks and resiliencies experienced by individuals of mixed racial heritage. Across 2 studies, there was evidence for the validation of the 25-item MEM with 5 subscales including Shifting Expressions, Perceived Racial Ambiguity, Creating Third Space, Multicultural Engagement, and Multiracial Discrimination. The 5-subscale structure of the MEM was supported by a combination of exploratory and confirmatory factor analyses. Evidence of criterion-related validity was partially supported with MEM subscales correlating with measures of racial diversity in one's social network, color-blind racial attitude, psychological distress, and identity conflict. Evidence of discriminant validity was supported with MEM subscales not correlating with impression management. Implications for future research and suggestions for utilization of the MEM in clinical practice with multiracial adults are discussed. (c) 2016 APA, all rights reserved).

The Swedish Exercise Self-Efficacy Scale (ESES-S): reliability and validity in a rheumatoid arthritis population.

PubMed

Nessen, Thomas; Demmelmaier, Ingrid; Nordgren, Birgitta; Opava, Christina H

2015-01-01

The aim of the present study was to investigate aspects of reliability and validity of the Exercise Self-Efficacy Scale (ESES-S) in a rheumatoid arthritis (RA) population. A total of 244 people with RA participating in a physical activity study were included. The six-item ESES-S, exploring confidence in performing exercise, was assessed for test-retest reliability over 4-6 months, and for internal consistency. Construct validity investigated correlation with similar and other constructs. An intraclass correlation coefficient (ICC) of 0.59 (95% CI 0.37-0.73) was found for 84 participants with stable health perceptions between measurement occasions. Cronbach's alpha coefficients of 0.87 and 0.89 were found at the first and second measurements. Corrected item-total correlation single ESES-S items ranged between 0.53 and 0.73. Construct convergent validity for the ESES-S was partly confirmed by correlations with health-enhancing physical activity and outcome expectations respectively (Pearson's r = 0.18, p < 0.01). Construct divergent validity was confirmed by the absence of correlations with age or gender. No floor or ceiling effects were found for ESES-S. The results indicate that the ESES-S has moderate test-retest reliability and respectable internal consistency in people with RA. Construct validity was partially supported in the present sample. Further research on construct validity of the ESES-S is recommended. Physical exercise is crucial for management of symptoms and co-morbidity in rheumatoid arthritis. Self-efficacy for exercise is important to address in rehabilitation as it regulates exercise motivation and behavior. Measurement properties of self-efficacy scales need to be assessed in specific populations and different languages.

Validity of the Brazilian version of the Godin-Shephard Leisure-Time Physical Activity Questionnaire.

PubMed

João, Thaís Moreira São; Rodrigues, Roberta Cunha Matheus; Gallani, Maria Cecília Bueno Jayme; Miura, Cinthya Tamie Passos; Domingues, Gabriela de Barros Leite; Amireault, Steve; Godin, Gaston

2015-09-01

This study provides evidence of construct validity for the Brazilian version of the Godin-Shephard Leisure-Time Physical Activity Questionnaire (GSLTPAQ), a 1-item instrument used among 236 participants referred for cardiopulmonary exercise testing. The Baecke Habitual Physical Activity Questionnaire (Baecke-HPA) was used to evaluate convergent and divergent validity. The self-reported measure of walking (QCAF) evaluated the convergent validity. Cardiorespiratory fitness assessed convergent validity by the Veterans Specific Activity Questionnaire (VSAQ), peak measured (VO2peak) and maximum predicted (VO2pred) oxygen uptake. Partial adjusted correlation coefficients between the GSLTPAQ, Baecke-HPA, QCAF, VO2pred and VSAQ provided evidence for convergent validity; while divergent validity was supported by the absence of correlations between the GSLTPAQ and the Occupational Physical Activity domain (Baecke-HPA). The GSLTPAQ presents level 3 of evidence of construct validity and may be useful to assess leisure-time physical activity among patients with cardiovascular disease and healthy individuals.

Measuring Hope Among Children Affected by Armed Conflict: Cross-Cultural Construct Validity of the Children's Hope Scale.

PubMed

Haroz, Emily E; Jordans, Mark; de Jong, Joop; Gross, Alden; Bass, Judith; Tol, Wietse

2017-06-01

We investigated the cross-cultural construct validity of hope, a factor associated with mental health protection and promotion, using the Children's Hope Scale (CHS). The sample ( n = 1,057; 48% girls) included baseline data from three cluster-randomized controlled trials with children affected by armed conflict ( n = 329 Burundi; n = 403 Indonesia; n = 325 Nepal). The confirmatory factor analysis in each country indicated good fit for the hypothesized two-factor model. Analysis by gender indicated that configural invariance was supported and that scalar invariance was demonstrated in Indonesia. However, metric and scalar invariance were not supported in Burundi and Nepal. In country comparisons, configural and metric invariance were met, but scalar invariance was not supported. Evidence from this study supports the use of the CHS within various sociocultural settings and across genders, but direct comparisons of CHS scores across groups should be done with caution. Rigorous evaluations of the measurement properties of mental health protective and promotive factors are necessary to inform both research and practice.

Using Negotiated Joining to Construct and Fill Open-ended Roles in Elite Culinary Groups.

PubMed

Tan, Vaughn

2015-03-01

This qualitative study examines membership processes in groups operating in an uncertain environment that prevents them from fully predefining new members' roles. I describe how nine elite high-end, cutting-edge culinary groups in the U.S. and Europe, ranging from innovative restaurants to culinary R&D groups, use negotiated joining-a previously undocumented process-to systematically construct and fill these emergent, open-ended roles. I show that negotiated joining is a consistently patterned, iterative process that begins with a role that both aspirant and target group explicitly understand to be provisional. This provisional role is then jointly modified and constructed by the aspirant and target group through repeated iterations of proposition, validation through trial and evaluation, and selective integration of validated role components. The initially provisional role stabilizes and the aspirant achieves membership if enough role components are validated; otherwise the negotiated joining process is abandoned. Negotiated joining allows the aspirant and target group to learn if a mutually desirable role is likely and, if so, to construct such a role. In addition, the provisional roles in negotiated joining can support absorptive capacity by allowing novel role components to enter target groups through aspirants' efforts to construct stable roles for themselves, while the internal adjustment involved in integrating newly validated role components can have the unintended side effect of supporting adaptation by providing opportunities for the groups to use these novel role components to modify their role structure and goals to suit a changing and uncertain environment. Negotiated joining thus reveals role ambiguity's hitherto unexamined beneficial consequences and provides a foundation for a contingency theory of new-member acquisition.

Using Negotiated Joining to Construct and Fill Open-ended Roles in Elite Culinary Groups

PubMed Central

Tan, Vaughn

2015-01-01

This qualitative study examines membership processes in groups operating in an uncertain environment that prevents them from fully predefining new members’ roles. I describe how nine elite high-end, cutting-edge culinary groups in the U.S. and Europe, ranging from innovative restaurants to culinary R&D groups, use negotiated joining—a previously undocumented process—to systematically construct and fill these emergent, open-ended roles. I show that negotiated joining is a consistently patterned, iterative process that begins with a role that both aspirant and target group explicitly understand to be provisional. This provisional role is then jointly modified and constructed by the aspirant and target group through repeated iterations of proposition, validation through trial and evaluation, and selective integration of validated role components. The initially provisional role stabilizes and the aspirant achieves membership if enough role components are validated; otherwise the negotiated joining process is abandoned. Negotiated joining allows the aspirant and target group to learn if a mutually desirable role is likely and, if so, to construct such a role. In addition, the provisional roles in negotiated joining can support absorptive capacity by allowing novel role components to enter target groups through aspirants’ efforts to construct stable roles for themselves, while the internal adjustment involved in integrating newly validated role components can have the unintended side effect of supporting adaptation by providing opportunities for the groups to use these novel role components to modify their role structure and goals to suit a changing and uncertain environment. Negotiated joining thus reveals role ambiguity’s hitherto unexamined beneficial consequences and provides a foundation for a contingency theory of new-member acquisition. PMID:26273105

An examination of the Rosenberg Self-Esteem Scale using collegiate wheelchair basketball student athletes.

PubMed

Vermillion, Mark; Dodder, Richard A

2007-04-01

The purpose was to examine the construct validity of the Rosenberg Self-esteem Scale (RSES). The construct validity of the scale was examined by applying it to collegiate wheelchair basketball student athletes at an NCAA sanctioned wheelchair basketball tournament at a mid-sized university in the south central United States (N=68). In accordance with previous research on the scale, Cronbach alpha was .86; confirmatory factor analysis supported a one-factor structure. The scale is useful for measuring global self-esteem in collegiate wheelchair basketball student athletes.

Construction of pDUO: A bicistronic shuttle vector series for dual expression of recombinant proteins

USDA-ARS?s Scientific Manuscript database

Our ability to genetically manipulate microbial systems is often hampered by the availability of genetic tools. Thus, there is a need for the continued expansion of our molecular tool box. In support of this expansion, this study reports the design, construction, and validation of a new shuttle vect...

Development and validation of a questionnaire assessing the perceived control in health care among older adults with care needs in the Netherlands.

PubMed

Claassens, L; Terwee, C B; Deeg, D J H; Broese van Groenou, M I; Widdershoven, G A M; Huisman, M

2016-04-01

In response to the increased emphasis placed on older people's self-reliance in many welfare societies, we aimed to develop and validate a measurement instrument, assessing perceived control in health care among older adults with care needs. The target group consists of older people who live (semi-)independently and use professional health care, with or without informal care. Phase I (development) of the study consisted of the construction of the instrument based on the input from a variety of stakeholders. Phase II (validation) entailed a quantitative study in a sample of 247 respondents selected from the Longitudinal Aging Study Amsterdam, to assess the instrument's construct validity (structural validity and hypotheses testing) and reliability (internal consistency). The questionnaire consists of 29 items, related to organizing professional care, communication with care professionals, health management in the home situation, planning (more) complex care in the future, and perceived support from the social network. Based on a factor analysis, we identified three subscales: (I.) 'perceived personal control in health care'; (II.) 'anticipated personal control regarding future health care'; and (III.) 'perceived support from the social network,' with internal consistencies varying from Cronbach's α = .71 to .90. Factor I was associated with mastery, self-efficacy, self-esteem (r = .31-.35) and factor III with social loneliness (r = -.42). Factor II correlated less strongly with mastery, self-efficacy, and self-esteem (r < .30). Our questionnaire revealed sufficient construct validity and internal consistency. The instrument provides a basis for further quantitative research regarding control, especially in relation to health care-related outcomes.

The ad-libitum alcohol 'taste test': secondary analyses of potential confounds and construct validity.

PubMed

Jones, Andrew; Button, Emily; Rose, Abigail K; Robinson, Eric; Christiansen, Paul; Di Lemma, Lisa; Field, Matt

2016-03-01

Motivation to drink alcohol can be measured in the laboratory using an ad-libitum 'taste test', in which participants rate the taste of alcoholic drinks whilst their intake is covertly monitored. Little is known about the construct validity of this paradigm. The objective of this study was to investigate variables that may compromise the validity of this paradigm and its construct validity. We re-analysed data from 12 studies from our laboratory that incorporated an ad-libitum taste test. We considered time of day and participants' awareness of the purpose of the taste test as potential confounding variables. We examined whether gender, typical alcohol consumption, subjective craving, scores on the Alcohol Use Disorders Identification Test and perceived pleasantness of the drinks predicted ad-libitum consumption (construct validity). We included 762 participants (462 female). Participant awareness and time of day were not related to ad-libitum alcohol consumption. Males drank significantly more alcohol than females (p < 0.001), and individual differences in typical alcohol consumption (p = 0.04), craving (p < 0.001) and perceived pleasantness of the drinks (p = 0.04) were all significant predictors of ad-libitum consumption. We found little evidence that time of day or participant awareness influenced alcohol consumption. The construct validity of the taste test was supported by relationships between ad-libitum consumption and typical alcohol consumption, craving and pleasantness ratings of the drinks. The ad-libitum taste test is a valid method for the assessment of alcohol intake in the laboratory.

Psychometric Properties of the Persian Version of Spiritual Well-Being Scale in Patients with Acute Myocardial Infarction.

PubMed

Soleimani, Mohammad Ali; Pahlevan Sharif, Saeed; Allen, Kelly A; Yaghoobzadeh, Ameneh; Sharif Nia, Hamid; Gorgulu, Ozkan

2017-12-01

The purpose of this study was to assess the psychometric properties of the Persian version of Spiritual Well-Being Scale (SWBS) in patients with acute myocardial infarction. A multisite, cross-sectional survey was employed to determine the instrument's reliability (Cronbach's α and construct reliability) and validity (face, content, and construct). Using systematic sampling of adult outpatients at primary care clinic sites in the Qazvin City, Iran (N = 300), it was found that the Cronbach's alpha and construct reliability of both factors associated with the SWBS were above 0.7. The construct validity of the scale was determined using exploratory factor analysis. The findings supported two factors: relation with God and relation with life. Further investigation through confirmatory factor analysis (eigenvalues of greater than one) confirmed a third factor construct associated with the SWBS. A total of 50.65 % of the variance were explained by these three factors. The overall findings of the study demonstrated that the SWBS is a valid and reliable instrument that has potential utility in future research and clinical practice settings.

Workplace incivility in Japan: Reliability and validity of the Japanese version of the modified Work Incivility Scale.

PubMed

Tsuno, Kanami; Kawakami, Norito; Shimazu, Akihito; Shimada, Kyoko; Inoue, Akiomi; P Leiter, Michael

2017-05-25

Although incivility is a common interpersonal mistreatment and associated with poor mental health, there are few studies about it in Asian countries. The aim of this study was to develop the Japanese version of the modified Work Incivility Scale (J-MWIS), investigate its reliability and validity, and reveal the prevalence of incivility among Japanese employees in comparison with data on Canadian employees. A total of 2,191 Japanese and 1,071 Canadian employees were surveyed, using either the J-MWIS or MWIS. Japanese employees additionally answered questions on civility, worksite social support, workplace bullying, psychological distress, intention to leave, and work engagement to investigate construct validity. At least one form of workplace incivility was experienced by both Japanese (52.3%) and Canadian (86.0%) employees in the previous month. Internal consistency reliability of the J-MWIS was acceptable (α=0.71-0.81), and correlation analyses also confirmed its construct validity as expected. Workplace incivility was associated with lower workgroup civility, lower supervisor and coworker support, higher workplace bullying, higher psychological distress, higher intention to leave, and lower work engagement. Confirmatory factor analyses showed that the original three-factor model (supervisor incivility, coworker incivility, and instigated incivility) fitted moderately in both Japan and Canada data, though the privacy/overfamiliarity factor was additionally extracted from exploratory factor analysis for the J-MWIS. The results of this study suggested that the J-MWIS has moderate internal consistency reliability and good construct validity.

Workplace incivility in Japan: Reliability and validity of the Japanese version of the modified Work Incivility Scale

PubMed Central

Tsuno, Kanami; Kawakami, Norito; Shimazu, Akihito; Shimada, Kyoko; Inoue, Akiomi; P. Leiter, Michael

2017-01-01

Objectives: Although incivility is a common interpersonal mistreatment and associated with poor mental health, there are few studies about it in Asian countries. The aim of this study was to develop the Japanese version of the modified Work Incivility Scale (J-MWIS), investigate its reliability and validity, and reveal the prevalence of incivility among Japanese employees in comparison with data on Canadian employees. Methods: A total of 2,191 Japanese and 1,071 Canadian employees were surveyed, using either the J-MWIS or MWIS. Japanese employees additionally answered questions on civility, worksite social support, workplace bullying, psychological distress, intention to leave, and work engagement to investigate construct validity. Results: At least one form of workplace incivility was experienced by both Japanese (52.3%) and Canadian (86.0%) employees in the previous month. Internal consistency reliability of the J-MWIS was acceptable (α=0.71-0.81), and correlation analyses also confirmed its construct validity as expected. Workplace incivility was associated with lower workgroup civility, lower supervisor and coworker support, higher workplace bullying, higher psychological distress, higher intention to leave, and lower work engagement. Confirmatory factor analyses showed that the original three-factor model (supervisor incivility, coworker incivility, and instigated incivility) fitted moderately in both Japan and Canada data, though the privacy/overfamiliarity factor was additionally extracted from exploratory factor analysis for the J-MWIS. Conclusions: The results of this study suggested that the J-MWIS has moderate internal consistency reliability and good construct validity. PMID:28302927

Factor Structure and Initial Validation of a Multidimensional Measure of Difficulties in the Regulation of Positive Emotions: The DERS-Positive

PubMed Central

Weiss, Nicole H.; Gratz, Kim L.; Lavender, Jason M.

2015-01-01

Emotion regulation difficulties are a transdiagnostic construct relevant to numerous clinical difficulties. Although the Difficulties in Emotion Regulation Scale (Gratz & Roemer, 2004) is a multidimensional measure of maladaptive ways of responding to emotions, it focuses on difficulties with the regulation of negative emotions and does not assess emotion dysregulation in the form of problematic responding to positive emotions. The aim of this study was to develop and validate a measure of clinically-relevant difficulties in the regulation of positive emotions (DERS-Positive). Findings revealed a 3-factor structure and supported the internal consistency and construct validity of the total and subscale scores. PMID:25576185

Factor Structure and Initial Validation of a Multidimensional Measure of Difficulties in the Regulation of Positive Emotions: The DERS-Positive.

PubMed

Weiss, Nicole H; Gratz, Kim L; Lavender, Jason M

2015-05-01

Emotion regulation difficulties are a transdiagnostic construct relevant to numerous clinical difficulties. Although the Difficulties in Emotion Regulation Scale (DERS) is a multidimensional measure of maladaptive ways of responding to emotions, it focuses on difficulties with the regulation of negative emotions and does not assess emotion dysregulation in the form of problematic responding to positive emotions. The aim of this study was to develop and validate a measure of clinically relevant difficulties in the regulation of positive emotions (DERS-Positive). Findings revealed a three-factor structure and supported the internal consistency and construct validity of the total and subscale scores. © The Author(s) 2015.

Construct Validity of the Autism Impact Measure (AIM).

PubMed

Mazurek, Micah O; Carlson, Coleen; Baker-Ericzén, Mary; Butter, Eric; Norris, Megan; Kanne, Stephen

2018-01-17

The Autism Impact Measure (AIM) was designed to track incremental change in frequency and impact of core ASD symptoms. The current study examined the structural and convergent validity of the AIM in a large sample of children with ASD. The results of a series of exploratory and confirmatory factor analyses yielded a final model with five theoretically and empirically meaningful subdomains: Repetitive Behavior, Atypical Behavior, Communication, Social Reciprocity, and Peer Interaction. The final model showed very good fit both overall and for each of the five factors, indicating excellent structural validity. AIM subdomain scores were significantly correlated with measures of similar constructs across all five domains. The results provide further support for the psychometric properties of the AIM.

Social Network Map: Some Further Refinements on Administration.

ERIC Educational Resources Information Center

Tracy, Elizabeth M.; Abell, Neil

1994-01-01

Notes that social network mapping techniques have been advanced as means of assessing social and environmental resources. Addresses issue of convergent construct validity, correlations among dimensions of perceived social support as measured by social network data with other standardized social support instruments. Findings confirm that structural…

Construct Validity of Symptom Checklist-90-Revised (SCL-90-R) and General Health Questionnaire-28 (GHQ-28) in Patients with Drug Addiction and Diabetes, and Normal Population

PubMed Central

ARDAKANI, Abolfazl; SEGHATOLESLAM, Tahereh; HABIL, Hussain; JAMEEI, Fahimeh; RASHID, Rusdi; ZAHIRODIN, Alireza; MOTLAQ, Farid; MASJIDI ARANI, Abbas

2016-01-01

Background: Given that validity is the baseline of psychological assessments, there is a need to provide evidence-based data for construct validity of such scales to advance the clinicians for evaluating psychiatric morbidity in psychiatric and psychosomatic setting. Methods: This comparative cross-sectional study aimed to investigate the construct validity of the Malaysian version of the GHQ-28 and the SCL-90-R. The sample comprised 660 individuals including diabetics, drug dependents, and normal population. The research scales were administered to the participants. Convergent and discriminant validity of both scales were investigated by Confirmatory Factor Analysis (CFA) using AMOS. The Pearson correlation coefficient was utilized to obtain the relationship between the two scales. Results: The internal consistency of the GHQ-28 and SCL-90-R were highly acceptable, and confirmatory factor analysis confirmed the convergent validity of both scales. The results of this study revealed that the construct validity of GHQ-28 was acceptable, whereas discriminant validity of SCL-90-R was not adequate. According to Pearson correlation coefficient the relationships between three common subscales of the GHQ-28 and SCL-90-R were significantly positive; somatization (r=0.671, P<0.01), Anxiety (r=0.728, P<0.01), and Depression (r=0.660, P <0.01). Conclusions: This study replicated the construct of the Malaysian version of GHQ-28, yet failed to support the nine-factor structure of the SCL-90-R. Therefore, multidimensionality of the SCL-90-R as clinical purposes is questionable, and it may be a better unitary measure for assessing and screening mental disorders. Further research need to be carried out to prove this finding. PMID:27252914

Measuring personal recovery - psychometric properties of the Swedish Questionnaire about the Process of Recovery (QPR-Swe).

PubMed

Argentzell, Elisabeth; Hultqvist, Jenny; Neil, Sandra; Eklund, Mona

2017-10-01

Personal recovery, defined as an individual process towards meaning, is an important target within mental health services. Measuring recovery hence requires reliable and valid measures. The Process of Recovery Questionnaire (QPR) was developed for that purpose. The aim was to develop a Swedish version of the QPR (QPR-Swe) and explore its psychometric properties in terms of factor structure, internal consistency, construct validity and sensitivity to change. A total of 226 participants entered the study. The factor structure was investigated by Principal Component Analysis and Scree plot. Construct validity was addressed in terms of convergent validity against indicators of self-mastery, self-esteem, quality of life and self-rated health. A one-factor solution of QPR-Swe received better support than a two-factor solution. Good internal consistency was indicated, α = 0.92, and construct validity was satisfactory. The QPR-Swe showed preliminary sensitivity to change. The QPR-Swe showed promising initial psychometric properties in terms of internal consistency, convergent validity and sensitivity to change. The QPR-Swe is recommended for use in research and clinical contexts to assess personal recovery among people with mental illness.

Effectively Coping With Task Stress: A Study of the Validity of the Trait Emotional Intelligence Questionnaire-Short Form (TEIQue-SF).

PubMed

O'Connor, Peter; Nguyen, Jessica; Anglim, Jeromy

2017-01-01

In this study, we investigated the validity of the Trait Emotional Intelligence Questionnaire-Short Form (TEIQue-SF; Petrides, 2009) in the context of task-induced stress. We used a total sample of 225 volunteers to investigate (a) the incremental validity of the TEIQue-SF over other predictors of coping with task-induced stress, and (b) the construct validity of the TEIQue-SF by examining the mechanisms via which scores from the TEIQue-SF predict coping outcomes. Results demonstrated that the TEIQue-SF possessed incremental validity over the Big Five personality traits in the prediction of emotion-focused coping. Results also provided support for the construct validity of the TEIQue-SF by demonstrating that this measure predicted adaptive coping via emotion-focused channels. Specifically, results showed that, following a task stressor, the TEIQue-SF predicted low negative affect and high task performance via high levels of emotion-focused coping. Consistent with the purported theoretical nature of the trait emotional intelligence (EI) construct, trait EI as assessed by the TEIQue-SF primarily enhances affect and performance in stressful situations by regulating negative emotions.

Development and Validity Testing of an Arthritis Self-Management Assessment Tool.

PubMed

Oh, HyunSoo; Han, SunYoung; Kim, SooHyun; Seo, WhaSook

Because of the chronic, progressive nature of arthritis and the substantial effects it has on quality of life, patients may benefit from self-management. However, no valid, reliable self-management assessment tool has been devised for patients with arthritis. This study was conducted to develop a comprehensive self-management assessment tool for patients with arthritis, that is, the Arthritis Self-Management Assessment Tool (ASMAT). To develop a list of qualified items corresponding to the conceptual definitions and attributes of arthritis self-management, a measurement model was established on the basis of theoretical and empirical foundations. Content validity testing was conducted to evaluate whether listed items were suitable for assessing arthritis self-management. Construct validity and reliability of the ASMAT were tested. Construct validity was examined using confirmatory factor analysis and nomological validity. The 32-item ASMAT was developed with a sample composed of patients in a clinic in South Korea. Content validity testing validated the 32 items, which comprised medical (10 items), behavioral (13 items), and psychoemotional (9 items) management subscales. Construct validity testing of the ASMAT showed that the 32 items properly corresponded with conceptual constructs of arthritis self-management, and were suitable for assessing self-management ability in patients with arthritis. Reliability was also well supported. The ASMAT devised in the present study may aid the evaluation of patient self-management ability and the effectiveness of self-management interventions. The authors believe the developed tool may also aid the identification of problems associated with the adoption of self-management practice, and thus improve symptom management, independence, and quality of life of patients with arthritis.

Validating the Demand Control Support Questionnaire among white-collar employees in Switzerland and the United States.

PubMed

Mauss, Daniel; Herr, Raphael M; Theorell, Töres; Angerer, Peter; Li, Jian

2018-01-01

The Demand Control Support Questionnaire (DCSQ) is an established self-reported tool to measure a stressful work environment. Validated German and English versions are however currently missing. The aim of this study was therefore to evaluate the psychometric properties of German and English versions of the DCSQ among white-collar employees in Switzerland and the US. This cross-sectional study was carried out on 499 employees in Switzerland and 411 in the US, respectively. The 17-item DCSQ with three scales assessed psychosocial stress at work (psychological demands, decision latitude, and social support at work). Depressive symptoms were measured by the 2-item Patient Health Questionnaire. Cronbach's α and item-total correlations tested the scale reliability (internal consistency). Construct validity of the questionnaire was examined using exploratory factor analysis (EFA). Logistic regressions estimated associations of each scale and job strain with depressive symptoms (criterion validity). In both samples, all DCSQ scales presented satisfactory internal consistency (Cronbach's α ≥ 0.72; item-total correlations ≥ 0.33), and EFA showed the 17 items loading on three factors, which is in line with the theoretically assumed structure of the DCSQ construct. Moreover, all three scales as well as high job strain were significantly associated with depressive symptoms. The associations were stronger in the US sample. The German and the English versions of the DCSQ seem to be reliable and valid instruments to measure psychosocial stress based on the job demand-control-support model in the workplace of white-collar employees in Switzerland and the US.

MATES in Construction: Impact of a Multimodal, Community-Based Program for Suicide Prevention in the Construction Industry

PubMed Central

Gullestrup, Jorgen; Lequertier, Belinda; Martin, Graham

2011-01-01

A large-scale workplace-based suicide prevention and early intervention program was delivered to over 9,000 construction workers on building sites across Queensland. Intervention components included universal General Awareness Training (GAT; general mental health with a focus on suicide prevention); gatekeeper training provided to construction worker volunteer ‘Connectors’; Suicide First Aid (ASIST) training offered to key workers; outreach support provided by trained and supervised MIC staff; state-wide suicide prevention hotline; case management service; and postvention support provided in the event of a suicide. Findings from over 7,000 workers (April 2008 to November 2010) are reported, indicating strong construction industry support, with 67% building sites and employers approached agreeing to participate in MIC. GAT participants demonstrated significantly increased suicide prevention awareness compared with a comparison group. Connector training participants rated MIC as helpful and effective, felt prepared to intervene with a suicidal person, and knew where to seek help for a suicidal individual following the training. Workers engaged positively with the after-hours crisis support phone line and case management. MIC provided postvention support to 10 non-MIC sites and sites engaged with MIC, but not yet MIC-compliant. Current findings support the potential effectiveness and social validity of MIC for preventing suicide in construction workers. PMID:22163201

A New Tool for Nutrition App Quality Evaluation (AQEL): Development, Validation, and Reliability Testing

PubMed Central

Huang, Wenhao; Chapman-Novakofski, Karen M

2017-01-01

Background The extensive availability and increasing use of mobile apps for nutrition-based health interventions makes evaluation of the quality of these apps crucial for integration of apps into nutritional counseling. Objective The goal of this research was the development, validation, and reliability testing of the app quality evaluation (AQEL) tool, an instrument for evaluating apps’ educational quality and technical functionality. Methods Items for evaluating app quality were adapted from website evaluations, with additional items added to evaluate the specific characteristics of apps, resulting in 79 initial items. Expert panels of nutrition and technology professionals and app users reviewed items for face and content validation. After recommended revisions, nutrition experts completed a second AQEL review to ensure clarity. On the basis of 150 sets of responses using the revised AQEL, principal component analysis was completed, reducing AQEL into 5 factors that underwent reliability testing, including internal consistency, split-half reliability, test-retest reliability, and interrater reliability (IRR). Two additional modifiable constructs for evaluating apps based on the age and needs of the target audience as selected by the evaluator were also tested for construct reliability. IRR testing using intraclass correlations (ICC) with all 7 constructs was conducted, with 15 dietitians evaluating one app. Results Development and validation resulted in the 51-item AQEL. These were reduced to 25 items in 5 factors after principal component analysis, plus 9 modifiable items in two constructs that were not included in principal component analysis. Internal consistency and split-half reliability of the following constructs derived from principal components analysis was good (Cronbach alpha >.80, Spearman-Brown coefficient >.80): behavior change potential, support of knowledge acquisition, app function, and skill development. App purpose split half-reliability was .65. Test-retest reliability showed no significant change over time (P>.05) for all but skill development (P=.001). Construct reliability was good for items assessing age appropriateness of apps for children, teens, and a general audience. In addition, construct reliability was acceptable for assessing app appropriateness for various target audiences (Cronbach alpha >.70). For the 5 main factors, ICC (1,k) was >.80, with a P value of <.05. When 15 nutrition professionals evaluated one app, ICC (2,15) was .98, with a P value of <.001 for all 7 constructs when the modifiable items were specified for adults seeking weight loss support. Conclusions Our preliminary effort shows that AQEL is a valid, reliable instrument for evaluating nutrition apps’ qualities for clinical interventions by nutrition clinicians, educators, and researchers. Further efforts in validating AQEL in various contexts are needed. PMID:29079554

Development and construct validation of the Client-Centredness of Goal Setting (C-COGS) scale.

PubMed

Doig, Emmah; Prescott, Sarah; Fleming, Jennifer; Cornwell, Petrea; Kuipers, Pim

2015-07-01

Client-centred philosophy is integral to occupational therapy practice and client-centred goal planning is considered fundamental to rehabilitation. Evaluation of whether goal-planning practices are client-centred requires an understanding of the client's perspective about goal-planning processes and practices. The Client-Centredness of Goal Setting (C-COGS) was developed for use by practitioners who seek to be more client-centred and who require a scale to guide and evaluate individually orientated practice, especially with adults with cognitive impairment related to acquired brain injury. To describe development of the C-COGS scale and examine its construct validity. The C-COGS was administered to 42 participants with acquired brain injury after multidisciplinary goal planning. C-COGS scores were correlated with the Canadian Occupational Performance Measure (COPM) importance scores, and measures of therapeutic alliance, motivation, and global functioning to establish construct validity. The C-COGS scale has three subscales evaluating goal alignment, goal planning participation, and client-centredness of goals. The C-COGS subscale items demonstrated moderately significant correlations with scales measuring similar constructs. Findings provide preliminary evidence to support the construct validity of the C-COGS scale, which is intended to be used to evaluate and reflect on client-centred goal planning in clinical practice, and to highlight factors contributing to best practice rehabilitation.

Bimanual Fine Motor Function (BFMF) Classification in Children with Cerebral Palsy: Aspects of Construct and Content Validity.

PubMed

Elvrum, Ann-Kristin G; Andersen, Guro L; Himmelmann, Kate; Beckung, Eva; Öhrvall, Ann-Marie; Lydersen, Stian; Vik, Torstein

2016-01-01

The Bimanual Fine Motor Function (BFMF) is currently the principal classification of hand function recorded by the Surveillance of Cerebral Palsy in Europe (SCPE) register. The BFMF is used in a number of epidemiological studies, but has not yet been validated. To examine aspects of construct and content validity of the BFMF. Construct validity of the BFMF was assessed by comparison with the Manual Ability Classification System (MACS) using register-based data from 539 children born 1999-2003 (304 boys; 4-12 years). The high correlation with the MACS (Spearman's rho = 0.89, CI: 0.86-0.91, p<.001) supports construct validity of the BFMF. The content of the BFMF was appraised through literature review, and by using the ICF-CY as a framework to compare the BFMF and MACS. The items hold, grasp and manipulate were found to be relevant to describe increasingly advanced fine motor abilities in children with CP, but the description of the BFMF does not state whether it is a classification of fine motor capacity or performance. Our results suggest that the BFMF may provide complementary information to the MACS regarding fine motor function and actual use of the hands, particularly if used as a classification of fine motor capacity.

Support for Secondary Education of U.S.-Mexico Border Residents: The Construction and Validation of the Global Higher Education Support Scale (GHESS)

ERIC Educational Resources Information Center

Rogers, Darrin L.; Richardson, Rosalva

2011-01-01

Support for students before planning, planning to enter, and while enrolled in higher education is needed to ensure academic achievement, especially among U.S. Hispanics. Measures for determining the nature of student support or obstruction are necessary if we are to understand academic achievement and its development among U.S. Hispanic learners.…

Poor Validity of the DSM-IV Schizoid Personality Disorder Construct as a Diagnostic Category.

PubMed

Hummelen, Benjamin; Pedersen, Geir; Wilberg, Theresa; Karterud, Sigmund

2015-06-01

This study sought to evaluate the construct validity of schizoid personality disorder (SZPD) by investigating a sample of 2,619 patients from the Norwegian Network of Personality-Focused Treatment Programs by a variety of statistical techniques. Nineteen patients (0.7%) reached the diagnostic threshold of SZPD. Results from the factor analyses indicated that SZPD consists of three factors: social detachment, withdrawal, and restricted affectivity/ anhedonia. Overall, internal consistency and diagnostic efficiency were poor and best for the criteria that belong to the social detachment factor. These findings pose serious questions about the clinical utility of SZPD as a diagnostic category. On the other hand, the three factors were in concordance with findings from previous studies and with the trait model for personality disorders in DSM-5, supporting the validity of SZPD as a dimensional construct. The authors recommend that SZPD should be deleted as a diagnostic category in future editions of DSM-5.

Psychological collectivism: a measurement validation and linkage to group member performance.

PubMed

Jackson, Christine L; Colquitt, Jason A; Wesson, Michael J; Zapata-Phelan, Cindy P

2006-07-01

The 3 studies presented here introduce a new measure of the individual-difference form of collectivism. Psychological collectivism is conceptualized as a multidimensional construct with the following 5 facets: preference for in-groups, reliance on in-groups, concern for in-groups, acceptance of in-group norms, and prioritization of in-group goals. Study 1 developed and tested the new measure in a sample of consultants. Study 2 cross-validated the measure using an alumni sample of a Southeastern university, assessing its convergent validity with other collectivism measures. Study 3 linked scores on the measure to 4 dimensions of group member performance (task performance, citizenship behavior, counterproductive behavior, and withdrawal behavior) in a computer software firm and assessed discriminant validity using the Big Five. The results of the studies support the construct validity of the measure and illustrate the potential value of collectivism as a predictor of group member performance. ((c) 2006 APA, all rights reserved).

Measurement of perceived competence in Dutch children with mild intellectual disabilities.

PubMed

Elias, C; Vermeer, A; 't Hart, H

2005-04-01

Little research has been conducted on the perceived competence of children with mild intellectual disabilities (MID). One of the reasons for the marked absence of research appears to be the lack of reliable and clearly valid measurement instruments for this particular group of children. In the present study, it was examined whether a pictorial scale originally designed to measure perceived competence in typically developing children could successfully be used with children with MID. The pictorial scale was administered to a group of 106 children with MID. The construct validity, reliability and stability of the scale were investigated. The results of the exploratory factor analyses and the confirmatory factor analyses supported the conceptual framework proposed. The construct validity was also supported by the pattern of intercorrelations between the subscales. The scale had adequate internal consistency and the stability analyses showed sufficient stability across a 4-month period. The findings show the psychometric properties of the pictorial scale to justify its use with children with MID.

The application of transformational leadership theory to parenting: questionnaire development and implications for adolescent self-regulatory efficacy and life satisfaction.

PubMed

Morton, Katie L; Barling, Julian; Rhodes, Ryan E; Mâsse, Louise C; Zumbo, Bruno D; Beauchamp, Mark R

2011-10-01

We draw upon transformational leadership theory to develop an instrument to measure transformational parenting for use with adolescents. First, potential items were generated that were developmentally appropriate and evidence for content validity was provided through the use of focus groups with parents and adolescents. We subsequently provide evidence for several aspects of construct validity of measures derived from the Transformational Parenting Questionnaire (TPQ). Data were collected from 857 adolescents (M(age) = 14.70 years), who rated the behaviors of their mothers and fathers. The results provided support for a second-order measurement model of transformational parenting. In addition, positive relationships between mothers' and fathers' transformational parenting behaviors, adolescents' self-regulatory efficacy for physical activity and healthy eating, and life satisfaction were found. The results of this research support the application of transformational leadership theory to parenting behaviors, as well as the construct validity of measures derived from the TPQ.

Effective Board Leadership: Factors Associated with Student Achievement

ERIC Educational Resources Information Center

Johnson, Paul A.

2013-01-01

The purpose of this study was to establish the content, construct, and predictive validity of the Effective Board Leadership Practices Survey (EBLPS). The EBLPS was designed to measure the leadership practices of boards of education that support student achievement. A literature review identified 12 board leadership practices supportive of student…

A Cultural Insight into the Development of Teacher Autonomy Support Scale: A Self-Determination Theory Perspective

ERIC Educational Resources Information Center

Awang-Hashim, Rosna; Thaliah, Rajaletchumi; Kaur, Amrita

2017-01-01

Purpose: The cross-cultural significance of autonomy within self-determination theory is divisive on universal significance. This paper aims to report a sequential exploratory mixed methods study conducted to construct and validate a scale to investigate how, in Malaysian context, the construct of autonomy is conceptualized in comparison with the…

Evaluating and comparing Singaporean and Taiwanese eighth graders' conceptions of science assessment

NASA Astrophysics Data System (ADS)

Lin, Tzung-Jin; Tan, Aik-Ling; Lee, Min-Hsien; Tsai, Chin-Chung

2017-10-01

Background: Researchers have indicated that assessment practices and methods should support learners' construction of meaningful understanding of knowledge. Understanding students' conceptions of assessment will enable us to construct more realistic, valid and fair assessments. Learners' conceptualization of assessment would be imperative to serve as an essential reference to evaluate their learning progress.

Same but different: Comparative modes of information processing are implicated in the construction of perceptions of autonomy support.

PubMed

Lee, Rebecca Rachael; Chatzisarantis, Nikos L D

2017-11-01

An implicit assumption behind tenets of self-determination theory is that perceptions of autonomy support are a function of absolute modes of information processing. In this study, we examined whether comparative modes of information processing were implicated in the construction of perceptions of autonomy support. In an experimental study, we demonstrated that participants employed comparative modes of information processing in evaluating receipt of small, but not large, amounts of autonomy support. In addition, we found that social comparison processes influenced a number of outcomes that are empirically related to perceived autonomy support such as sense of autonomy, positive affect, perceived usefulness, and effort. Findings shed new light upon the processes underpinning construction of perceptions related to autonomy support and yield new insights into how to increase the predictive validity of models that use autonomy support as a determinant of motivation and psychological well-being. © 2017 The British Psychological Society.

Hopes and Cautions for Instrument-Based Evaluation of Consent Capacity: Results of a Construct Validity Study of Three Instruments

PubMed Central

Moye, Jennifer; Azar, Annin R.; Karel, Michele J.; Gurrera, Ronald J.

2016-01-01

Does instrument based evaluation of consent capacity increase the precision and validity of competency assessment or does ostensible precision provide a false sense of confidence without in fact improving validity? In this paper we critically examine the evidence for construct validity of three instruments for measuring four functional abilities important in consent capacity: understanding, appreciation, reasoning, and expressing a choice. Instrument based assessment of these abilities is compared through investigation of a multi-trait multi-method matrix in 88 older adults with mild to moderate dementia. Results find variable support for validity. There appears to be strong evidence for good hetero-method validity for the measurement of understanding, mixed evidence for validity in the measurement of reasoning, and strong evidence for poor hetero-method validity for the concepts of appreciation and expressing a choice, although the latter is likely due to extreme range restrictions. The development of empirically based tools for use in capacity evaluation should ultimately enhance the reliability and validity of assessment, yet clearly more research is needed to define and measure the constructs of decisional capacity. We would also emphasize that instrument based assessment of capacity is only one part of a comprehensive evaluation of competency which includes consideration of diagnosis, psychiatric and/or cognitive symptomatology, risk involved in the situation, and individual and cultural differences. PMID:27330455

Factorial validity and internal consistency of the motivational climate in physical education scale.

PubMed

Soini, Markus; Liukkonen, Jarmo; Watt, Anthony; Yli-Piipari, Sami; Jaakkola, Timo

2014-01-01

The aim of the study was to examine the construct validity and internal consistency of the Motivational Climate in Physical Education Scale (MCPES). A key element of the development process of the scale was establishing a theoretical framework that integrated the dimensions of task- and ego involving climates in conjunction with autonomy, and social relatedness supporting climates. These constructs were adopted from the self-determination and achievement goal theories. A sample of Finnish Grade 9 students, comprising 2,594 girls and 1,803 boys, completed the 18-item MCPES during one physical education class. The results of the study demonstrated that participants had highest mean in task-involving climate and the lowest in autonomy climate and ego-involving climate. Additionally, autonomy, social relatedness, and task- involving climates were significantly and strongly correlated with each other, whereas the ego- involving climate had low or negligible correlations with the other climate dimensions.The construct validity of the MCPES was analyzed using confirmatory factor analysis. The statistical fit of the four-factor model consisting of motivational climate factors supporting perceived autonomy, social relatedness, task-involvement, and ego-involvement was satisfactory. The results of the reliability analysis showed acceptable internal consistencies for all four dimensions. The Motivational Climate in Physical Education Scale can be considered as psychometrically valid tool to measure motivational climate in Finnish Grade 9 students. Key PointsThis study developed Motivational Climate in School Physical Education Scale (MCPES). During the development process of the scale, the theoretical framework using dimensions of task- and ego involving as well as autonomy, and social relatedness supporting climates was constructed. These constructs were adopted from the self-determination and achievement goal theories.The statistical fit of the four-factor model of the MCPES consisting of motivational climate factors supporting perceived autonomy, social relatedness, task-involvement, and ego-involvement was satisfactory. Additionally, the results of the reliability analysis showed acceptable internal consistencies for all four dimensions.The results of the study demonstrated that participants had highest mean in task-involving climate and the lowest in autonomy climate.Autonomy, social relatedness, and task climate were significantly and strongly correlated with each other, whereas the ego climate factor had low or negligible correlations with the other three factors.

Factorial Validity and Internal Consistency of the Motivational Climate in Physical Education Scale

PubMed Central

Soini, Markus; Liukkonen, Jarmo; Watt, Anthony; Yli-Piipari, Sami; Jaakkola, Timo

2014-01-01

The aim of the study was to examine the construct validity and internal consistency of the Motivational Climate in Physical Education Scale (MCPES). A key element of the development process of the scale was establishing a theoretical framework that integrated the dimensions of task- and ego involving climates in conjunction with autonomy, and social relatedness supporting climates. These constructs were adopted from the self-determination and achievement goal theories. A sample of Finnish Grade 9 students, comprising 2,594 girls and 1,803 boys, completed the 18-item MCPES during one physical education class. The results of the study demonstrated that participants had highest mean in task-involving climate and the lowest in autonomy climate and ego-involving climate. Additionally, autonomy, social relatedness, and task- involving climates were significantly and strongly correlated with each other, whereas the ego- involving climate had low or negligible correlations with the other climate dimensions.The construct validity of the MCPES was analyzed using confirmatory factor analysis. The statistical fit of the four-factor model consisting of motivational climate factors supporting perceived autonomy, social relatedness, task-involvement, and ego-involvement was satisfactory. The results of the reliability analysis showed acceptable internal consistencies for all four dimensions. The Motivational Climate in Physical Education Scale can be considered as psychometrically valid tool to measure motivational climate in Finnish Grade 9 students. Key Points This study developed Motivational Climate in School Physical Education Scale (MCPES). During the development process of the scale, the theoretical framework using dimensions of task- and ego involving as well as autonomy, and social relatedness supporting climates was constructed. These constructs were adopted from the self-determination and achievement goal theories. The statistical fit of the four-factor model of the MCPES consisting of motivational climate factors supporting perceived autonomy, social relatedness, task-involvement, and ego-involvement was satisfactory. Additionally, the results of the reliability analysis showed acceptable internal consistencies for all four dimensions. The results of the study demonstrated that participants had highest mean in task-involving climate and the lowest in autonomy climate. Autonomy, social relatedness, and task climate were significantly and strongly correlated with each other, whereas the ego climate factor had low or negligible correlations with the other three factors. PMID:24570617

The Work-Related Flow Inventory: Construction and Initial Validation of the WOLF

ERIC Educational Resources Information Center

Bakker, Arnold B.

2008-01-01

The WOrk-reLated Flow inventory (WOLF) measures flow at work, defined as a short-term peak experience characterized by absorption, work enjoyment, and intrinsic work motivation. Results of Study 1 among 7 samples of employees (total N=1346) from different occupational groups offer support for the factorial validity and reliability of the WOLF.…

Validity Evidence for the Use of the Preventive Resources Inventory with College Students

ERIC Educational Resources Information Center

Lambert, Richard G.; McCarthy, Christopher J.; Gilbert, Trae; Sebree, Mikaela; Steinley-Bumgarner, Michelle

2006-01-01

Measurement properties of scores from the Preventive Resources Inventory (C. J. McCarthy & R. G. Lambert, 2001), a measure of stress-prevention resources, were evaluated. Sample-specific construct validity of 3 primary scales was supported. A 4th, Self-Acceptance, functioned as a higher order factor. Differences were found between those reporting…

Tests of the Construct Validity of Occupational Stress Measures with College Students: Failure to Support Discriminant Validity.

ERIC Educational Resources Information Center

Meier, Scott T.

1991-01-01

Examined correlations among stress, anxiety, and depression scales in 129 college students, as well as ability of measures of depression and anxiety to add to predictive power of occupational stress for recognition memory task and self-reported physical symptoms. Results indicated that stress, depression, and anxiety measures were moderately to…

Perfectionism in Intimate Relationships: The Dyadic Almost Perfect Scale

ERIC Educational Resources Information Center

Shea, Andrew J.; Slaney, Robert B.; Rice, Kenneth G.

2006-01-01

The authors describe 2 studies on the development of the Dyadic Almost Perfect Scale (A. J. Shea & R. B. Slaney, 1999). In Study 1 (N = 389), confirmatory analyses validated the factor structure of the measure, and additional results supported the reliability and construct validity of the subscale scores. In Study 2 (N = 280), data again…

Construction and validation of forms: systematization of the care of people under hemodialysis.

PubMed

Arreguy-Sena, Cristina; Marques, Tais de Oliveira; Souza, Luciene Carnevale de; Alvarenga-Martins, Nathália; Krempser, Paula; Braga, Luciene Muniz; Parreira, Pedro Miguel Dos Santos Dinis

2018-01-01

create and validate forms to subsidize the systematization of nursing care with people on hemodialysis. institutional case study to support the systematization of assistance from the construction of forms for data collection, diagnoses, interventions and nursing results, using cross-mapping, Risner's reasoning, Neuman's theory, taxonomies of diagnoses, interventions and nursing results with application in clinical practice and validation by focal group with specialist nurses. 18 people on hemodialysis and 7 nurses participated. Consensus content of form matter with specialist nurses in the area (Crombach 0.86). The papers captured 43 diagnoses, 26 interventions and 78 nursing results depicting human responses in their singularities. the validated forms fill a gap by enabling the capture of human responses from people on hemodialysis and by subsidizing the planning of nursing care on a scientific basis.

Sustained Implementation Support Scale: Validation of a Measure of Program Characteristics and Workplace Functioning for Sustained Program Implementation.

PubMed

Hodge, Lauren M; Turner, Karen M T; Sanders, Matthew R; Filus, Ania

2017-07-01

An evaluation measure of enablers and inhibitors to sustained evidence-based program (EBP) implementation may provide a useful tool to enhance organizations' capacity. This paper outlines preliminary validation of such a measure. An expert informant and consumer feedback approach was used to tailor constructs from two existing measures assessing key domains associated with sustained implementation. Validity and reliability were evaluated for an inventory composed of five subscales: Program benefits, Program burden, Workplace support, Workplace cohesion, and Leadership style. Exploratory and confirmatory factor analysis with a sample of 593 Triple P-Positive Parenting Program-practitioners led to a 28-item scale with good reliability and good convergent, discriminant, and predictive validity. Practitioners sustaining implementation at least 3 years post-training were more likely to have supervision/peer support, reported higher levels of program benefit, workplace support, and positive leadership style, and lower program burden compared to practitioners who were non-sustainers.

Validating the German Version of the Quality of Relationship Inventory: Confirming the Three-Factor Structure and Report of Psychometric Properties

PubMed Central

Reiner, Iris; Beutel, Manfred; Skaletz, Christian; Brähler, Elmar; Stöbel-Richter, Yve

2012-01-01

Research on psychosocial influences such as relationship characteristics has received increased attention in the clinical as well as social-psychological field. Several studies demonstrated that the quality of relationships, in particular with respect to the perceived support within intimate relationships, profoundly affects individuals' mental and physical health. There is, however, a limited choice of valid and internationally known assessments of relationship quality in Germany. We report the validation of the German version of the Quality of Relationships Inventory (QRI). First, we evaluated its factor structure in a representative German sample of 1.494 participants by means of confirmatory factor analysis. Our findings support the previously proposed three-factor structure. Second, importance and satisfaction with different relationship domains (family/children and relationship/sexuality) were linked with the QRI scales, demonstrating high construct validity. Finally, we report sex and age differences regarding the perceived relationship support, conflict and depth in our German sample. In conclusion, the QRI is a reliable and valid measurement to assess social support in romantic relationships in the German population. PMID:22662151

Individual differences in situation awareness: Validation of the Situationism Scale

PubMed Central

Roberts, Megan E.; Gibbons, Frederick X.; Gerrard, Meg; Klein, William M. P.

2015-01-01

This paper concerns the construct of lay situationism—an individual’s belief in the importance of a behavior’s context. Study 1 identified a 13-item Situationism Scale, which demonstrated good reliability and validity. In particular, higher situationism was associated with greater situation-control (strategies to manipulate the environment in order to avoid temptation). Subsequent laboratory studies indicated that people higher on the situationism subscales used greater situation-control by sitting farther from junk food (Study 2) and choosing to drink non-alcoholic beverages before a cognitive task (Study 3). Overall, findings provide preliminary support for the psychometric validity and predictive utility of the Situationism Scale and offer this individual difference construct as a means to expand self-regulation theory. PMID:25329242

Measuring hope among families impacted by cognitive impairment.

PubMed

Hunsaker, Amanda E; Terhorst, Lauren; Gentry, Amanda; Lingler, Jennifer H

2016-07-01

The current exploratory investigation aims to establish the reliability and validity of a hope measure, the Herth Hope Index, among families impacted by early cognitive impairment (N = 96). Exploratory factor analysis was used to examine the dimensionality of the measure. Bivariate analyses were used to examine construct validity. The sample had moderately high hope scores. A two-factor structure emerged from the factor analysis, explaining 51.44% of the variance. Both factors exhibited strong internal consistency (Cronbach's alphas ranged from .83 to .86). Satisfaction with social support was positively associated with hope, supporting convergent validity. Neurocognitive status, illness insight, and depression were not associated with hope, indicating discriminant validity. Families impacted by cognitive impairment may maintain hope in the face of a potentially progressive illness, regardless of cognitive status. The Herth Hope Index can be utilized as a reliable and valid measure of hope by practitioners providing support to families impacted by cognitive impairment. © The Author(s) 2014.

Restraint and the question of validity.

PubMed

Paterson, Brodie; Duxbury, Joy

2007-07-01

Restraint as an intervention in the management of acute mental distress has a long history that predates the existence of psychiatry. However, it remains a source of controversy with an ongoing debate as to its role. This article critically explores what to date has seemingly been only implicit in the debate surrounding the role of restraint: how should the concept of validity be interpreted when applied to restraint as an intervention? The practice of restraint in mental health is critically examined using two post-positivist constructions of validity, the pragmatic and the psychopolitical, by means of a critical examination of the literature. The current literature provides only weak support for the pragmatic validity of restraint as an intervention and no support to date for its psychopolitical validity. Judgements regarding the validity of any intervention that is coercive must include reference to the psychopolitical dimensions of both practice and policy.

Passion: Does one scale fit all? Construct validity of two-factor passion scale and psychometric invariance over different activities and languages.

PubMed

Marsh, Herbert W; Vallerand, Robert J; Lafrenière, Marc-André K; Parker, Philip; Morin, Alexandre J S; Carbonneau, Noémie; Jowett, Sophia; Bureau, Julien S; Fernet, Claude; Guay, Frédéric; Salah Abduljabbar, Adel; Paquet, Yvan

2013-09-01

The passion scale, based on the dualistic model of passion, measures 2 distinct types of passion: Harmonious and obsessive passions are predictive of adaptive and less adaptive outcomes, respectively. In a substantive-methodological synergy, we evaluate the construct validity (factor structure, reliability, convergent and discriminant validity) of Passion Scale responses (N = 3,571). The exploratory structural equation model fit to the data was substantially better than the confirmatory factor analysis solution, and resulted in better differentiated (less correlated) factors. Results from a 13-model taxonomy of measurement invariance supported complete invariance (factor loadings, factor correlations, item uniquenesses, item intercepts, and latent means) over language (French vs. English; the instrument was originally devised in French, then translated into English) and gender. Strong measurement partial invariance over 5 passion activity groups (leisure, sport, social, work, education) indicates that the same set of items is appropriate for assessing passion across a wide variety of activities--a previously untested, implicit assumption that greatly enhances practical utility. Support was found for the convergent and discriminant validity of the harmonious and obsessive passion scales, based on a set of validity correlates: life satisfaction, rumination, conflict, time investment, activity liking and valuation, and perceiving the activity as a passion.

Genetic and Environmental Influences of General Cognitive Ability: Is g a valid latent construct?

PubMed Central

Panizzon, Matthew S.; Vuoksimaa, Eero; Spoon, Kelly M.; Jacobson, Kristen C.; Lyons, Michael J.; Franz, Carol E.; Xian, Hong; Vasilopoulos, Terrie; Kremen, William S.

2014-01-01

Despite an extensive literature, the “g” construct remains a point of debate. Different models explaining the observed relationships among cognitive tests make distinct assumptions about the role of g in relation to those tests and specific cognitive domains. Surprisingly, these different models and their corresponding assumptions are rarely tested against one another. In addition to the comparison of distinct models, a multivariate application of the twin design offers a unique opportunity to test whether there is support for g as a latent construct with its own genetic and environmental influences, or whether the relationships among cognitive tests are instead driven by independent genetic and environmental factors. Here we tested multiple distinct models of the relationships among cognitive tests utilizing data from the Vietnam Era Twin Study of Aging (VETSA), a study of middle-aged male twins. Results indicated that a hierarchical (higher-order) model with a latent g phenotype, as well as specific cognitive domains, was best supported by the data. The latent g factor was highly heritable (86%), and accounted for most, but not all, of the genetic effects in specific cognitive domains and elementary cognitive tests. By directly testing multiple competing models of the relationships among cognitive tests in a genetically-informative design, we are able to provide stronger support than in prior studies for g being a valid latent construct. PMID:24791031

Clarifying Relationships among Work and Family Social Support, Stressors, and Work-Family Conflict

ERIC Educational Resources Information Center

Michel, Jesse S.; Mitchelson, Jacqueline K.; Pichler, Shaun; Cullen, Kristin L.

2010-01-01

Although work and family social support predict role stressors and work-family conflict, there has been much ambiguity regarding the conceptual relationships among these constructs. Using path analysis on meta-analytically derived validity coefficients (528 effect sizes from 156 samples), we compare three models to address these concerns and…

The Feedback Environment Scale: Construct Definition, Measurement, and Validation

ERIC Educational Resources Information Center

Steelman, Lisa A.; Levy, Paul E.; Snell, Andrea F.

2004-01-01

Managers are increasingly being held accountable for providing resources that support employee development, particularly in the form of feedback and coaching. To support managers as trainers and coaches, organizations must provide managers with the tools they need to succeed in this area. This article presents a new tool to assist in the diagnosis…

ENCOMPASS: A SAGA based environment for the compositon of programs and specifications, appendix A

NASA Technical Reports Server (NTRS)

Terwilliger, Robert B.; Campbell, Roy H.

1985-01-01

ENCOMPASS is an example integrated software engineering environment being constructed by the SAGA project. ENCOMPASS supports the specification, design, construction and maintenance of efficient, validated, and verified programs in a modular programming language. The life cycle paradigm, schema of software configurations, and hierarchical library structure used by ENCOMPASS is presented. In ENCOMPASS, the software life cycle is viewed as a sequence of developments, each of which reuses components from the previous ones. Each development proceeds through the phases planning, requirements definition, validation, design, implementation, and system integration. The components in a software system are modeled as entities which have relationships between them. An entity may have different versions and different views of the same project are allowed. The simple entities supported by ENCOMPASS may be combined into modules which may be collected into projects. ENCOMPASS supports multiple programmers and projects using a hierarchical library system containing a workspace for each programmer; a project library for each project, and a global library common to all projects.

Measuring Hope Among Children Affected by Armed Conflict: Cross-Cultural Construct Validity of the Children’s Hope Scale

PubMed Central

Haroz, Emily E.; Jordans, Mark; de Jong, Joop; Gross, Alden; Bass, Judith; Tol, Wietse

2018-01-01

We investigated the cross-cultural construct validity of hope, a factor associated with mental health protection and promotion, using the Children’s Hope Scale (CHS). The sample (n = 1,057; 48% girls) included baseline data from three cluster-randomized controlled trials with children affected by armed conflict (n = 329 Burundi; n = 403 Indonesia; n = 325 Nepal). The confirmatory factor analysis in each country indicated good fit for the hypothesized two-factor model. Analysis by gender indicated that configural invariance was supported and that scalar invariance was demonstrated in Indonesia. However, metric and scalar invariance were not supported in Burundi and Nepal. In country comparisons, configural and metric invariance were met, but scalar invariance was not supported. Evidence from this study supports the use of the CHS within various sociocultural settings and across genders, but direct comparisons of CHS scores across groups should be done with caution. Rigorous evaluations of the measurement properties of mental health protective and promotive factors are necessary to inform both research and practice. PMID:26508802

Adolescents' protection motivation and smoking behaviour.

PubMed

Thrul, Johannes; Stemmler, Mark; Bühler, Anneke; Kuntsche, Emmanuel

2013-08-01

The protection motivation theory (PMT) is a well-known theory of behaviour change. This study tested the applicability of the sub-constructs of threat and coping appraisal in predicting adolescents' smoking-related behavioural intentions and smoking behaviour longitudinally. Adolescents (N = 494) aged 11-16 years and not currently smoking at baseline participated in the study. Predictive validity of PMT constructs was tested in a path analysis model. Self-efficacy significantly predicted behavioural intention at baseline, which significantly predicted behavioural intention at follow-up, which in turn predicted smoking behaviour at follow-up. The effect of self-efficacy on behavioural intention at follow-up was mediated by behavioural intention at baseline and the effect of self-efficacy on smoking behaviour was mediated by behavioural intention at baseline and follow-up. In conclusion, we found support for one part of the PMT, namely for the predictive validity of the coping appraisal construct self-efficacy in predicting adolescents' smoking-related behavioural intention and smoking behaviour. These results fail to support the appropriateness of the PMT's construct threat appraisal in longitudinally predicting adolescents' smoking as well as the applicability of communicating fear and negative information as preventive interventions for this target group.

Psychometric properties of the Symptom Status Questionnaire-Heart Failure.

PubMed

Heo, Seongkum; Moser, Debra K; Pressler, Susan J; Dunbar, Sandra B; Mudd-Martin, Gia; Lennie, Terry A

2015-01-01

Many patients with heart failure (HF) experience physical symptoms, poor health-related quality of life (HRQOL), and high rates of hospitalization. Physical symptoms are associated with HRQOL and are major antecedents of hospitalization. However, reliable and valid physical symptom instruments have not been established. Therefore, this study examined the psychometric properties of the Symptom Status Questionnaire-Heart Failure (SSQ-HF) in patients with HF. Data on symptoms using the SSQ-HF were collected from 249 patients (aged 61 years, 67% male, 45% in New York Heart Association functional class III/IV). Internal consistency reliability was assessed using Cronbach's α. Item homogeneity was assessed using item-total and interitem correlations. Construct validity was assessed using factor analysis and testing hypotheses on known relationships. Data on depressive symptoms (Beck Depression Inventory II), HRQOL (Minnesota Living With Heart Failure Questionnaire), and event-free survival were collected to test known relationships. Internal consistency reliability was supported: Cronbach's α was .80. Item-total correlation coefficients and interitem correlation coefficients were acceptable. Factor analysis supported the construct validity of the instrument. More severe symptoms were associated with more depressive symptoms, poorer HRQOL, and more risk for hospitalization, emergency department visit, or death, controlling for covariates. The findings of this study support the reliability and validity of the SSQ-HF. Clinicians and researchers can use this instrument to assess physical symptoms in patients with HF.

Absorption in Sport: A Cross-Validation Study

PubMed Central

Koehn, Stefan; Stavrou, Nektarios A. M.; Cogley, Jeremy; Morris, Tony; Mosek, Erez; Watt, Anthony P.

2017-01-01

Absorption has been identified as readiness for experiences of deep involvement in the task. Conceptually, absorption is a key psychological construct, incorporating experiential, cognitive, and motivational components. Although, no operationalization of the construct has been provided to facilitate research in this area, the purpose of this research was the development and examination of the psychometric properties of a sport-specific measure of absorption that evolved from the use of the modified Tellegen Absorption Scale (MODTAS; Jamieson, 2005) in mainstream psychology. The study aimed to provide evidence of the psychometric properties, reliability, and validity of the Measure of Absorption in Sport Contexts (MASCs). The psychometric examination included a calibration sample from Scotland and a cross-validation sample from Australia using a cross-sectional design. The item pool was developed based on existing items from the modified Tellegen Absorption Scale (Jamieson, 2005). The MODTAS items were reworded and translated into a sport context. The Scottish sample consisted of 292 participants and the Australian sample of 314 participants. Congeneric model testing and confirmatory factor analysis for both samples and multi-group invariance testing across samples was used. In the cross-validation sample the MASC subscales showed acceptable internal consistency and construct reliability (≥0.70). Excellent fit indices were found for the final 18-item, six-factor measure in the cross-validation sample, χ(120)2 = 197.486, p < 0.001; CFI = 0.957; TLI = 0.945; RMSEA = 0.045; SRMR = 0.044. Multi-group invariance testing revealed no differences in item meaning, except for two items. The MASC and the Dispositional Flow Scale-2 showed moderate-to-strong positive correlations in both samples, r = 0.38, p < 0.001 and r = 0.42, p < 0.001, supporting the external validity of the MASC. This article provides initial evidence in support of the psychometric properties, reliability, and validity of the sport-specific measure of absorption. The MASC provides rich research opportunities in sport psychology that can enhance the theoretical understanding between absorption and related constructs and facilitate future intervention studies. PMID:28883802

The Reliability and Validity of the Coopersmith Self-Esteem Inventory for a Sample of Filipino High School Girls.

ERIC Educational Resources Information Center

Watkins, David; Astilla, Estela

1980-01-01

Evidence is presented partially supporting the reliability and construct validity of the Coopersmith Self-Esteem Inventory with Filipino adolescent girls. A test-retest coefficient of 0.61 was found over a nine-month period. Self-esteem scores were significantly associated with IQ scores and teacher ratings of pupils' self-esteem. (Author/BW)

Norms and Construct Validity of the Rosenberg Self-Esteem Scale in Canadian High School Populations: Implications for Counselling.

ERIC Educational Resources Information Center

Bagley, Christopher; Bolitho, Floyd; Bertrand, Lorne

1997-01-01

Reports on instrument validity regarding self-esteem among high school students (N=2,108) in the Province of Alberta. Results indicate significant variation of mean scores across age-groups within female students even though females had significantly lower self-esteem than males. Findings support the reliability of the self-esteem instrument. (RJM)

Construct and face validity of the American College of Surgeons/Association of Program Directors in Surgery laparoscopic troubleshooting team training exercise.

PubMed

Arain, Nabeel A; Hogg, Deborah C; Gala, Rajiv B; Bhoja, Ravi; Tesfay, Seifu T; Webb, Erin M; Scott, Daniel J

2012-01-01

Our aim was to develop an objective scoring system and evaluate construct and face validity for a laparoscopic troubleshooting team training exercise. Surgery and gynecology novices (n = 14) and experts (n = 10) participated. Assessments included the following: time-out, scenario decision making (SDM) score (based on essential treatments rendered and completion time), operating room communication assessment (investigator developed), line operations safety audits (teamwork), and National Aeronautics and Space Administration-Task Load Index (workload). Significant differences were detected for SDM scores for scenarios 1 (192 vs 278; P = .01) and 3 (129 vs 225; P = .004), operating room communication assessment (67 vs 91; P = .002), and line operations safety audits (58 vs 87; P = .001), but not for time-out (46 vs 51) or scenario 2 SDM score (301 vs 322). Workload was similar for both groups and face validity (8.8 on a 10-point scale) was strongly supported. Objective decision-making scoring for 2 of 3 scenarios and communication and teamwork ratings showed construct validity. Face validity and participant feedback were excellent. Copyright © 2012 Elsevier Inc. All rights reserved.

Validation of the Resilience Scale for Adolescents in Norwegian adolescents 13-18 years.

PubMed

Moksnes, Unni K; Haugan, Gørill

2018-03-01

Resilience is seen as a vital resource for coping and mental health in adolescents. However, there is no universally accepted theory or definition of resilience, leading to considerable challenges regarding how to operationalise and measure this construct. The study aimed at providing further knowledge of the psychometric properties (dimensionality, construct validity and internal consistency) of the 28-item version of the Resilience Scale for Adolescents (READ) in N = 1183 Norwegian adolescents, 13-18 years old. Dimensionality of READ was tested using confirmatory factor analysis (CFA). Convergent validity and reliability were tested using Pearson's correlation analysis, Cronbach's alpha and composite reliability. The CFA supported a modified, 20-item, five-factor structure with high reliability, supporting the dimensionality and internal consistency of the instrument. Convergent validity was confirmed where all factors correlated in expected directions with measures of sense of coherence, self-esteem, stress and depression. The psychometric properties of the READ need to be further evaluated in adolescents; however, the results indicate that a modified 20-item version of READ is adequate for assessing resilience in the present sample of Norwegian adolescents. © 2017 Nordic College of Caring Science.

Farsi version of social skills rating system-secondary student form: cultural adaptation, reliability and construct validity.

PubMed

Eslami, Ahmad Ali; Amidi Mazaheri, Maryam; Mostafavi, Firoozeh; Abbasi, Mohamad Hadi; Noroozi, Ensieh

2014-01-01

Assessment of social skills is a necessary requirement to develop and evaluate the effectiveness of cognitive and behavioral interventions. This paper reports the cultural adaptation and psychometric properties of the Farsi version of the social skills rating system-secondary students form (SSRS-SS) questionnaire (Gresham and Elliot, 1990), in a normative sample of secondary school students. A two-phase design was used that phase 1 consisted of the linguistic adaptation and in phase 2, using cross-sectional sample survey data, the construct validity and reliability of the Farsi version of the SSRS-SS were examined in a sample of 724 adolescents aged from 13 to 19 years. Content validity index was excellent, and the floor/ceiling effects were low. After deleting five of the original SSRS-SS items, the findings gave support for the item convergent and divergent validity. Factor analysis revealed four subscales. RESULTS showed good internal consistency (0.89) and temporal stability (0.91) for the total scale score. Findings demonstrated support for the use of the 27-item Farsi version in the school setting. Directions for future research regarding the applicability of the scale in other settings and populations of adolescents are discussed.

Construct Validation of a Multidimensional Computerized Adaptive Test for Fatigue in Rheumatoid Arthritis

PubMed Central

Nikolaus, Stephanie; Bode, Christina; Taal, Erik; Vonkeman, Harald E.; Glas, Cees A. W.; van de Laar, Mart A. F. J.

2015-01-01

Objective Multidimensional computerized adaptive testing enables precise measurements of patient-reported outcomes at an individual level across different dimensions. This study examined the construct validity of a multidimensional computerized adaptive test (CAT) for fatigue in rheumatoid arthritis (RA). Methods The ‘CAT Fatigue RA’ was constructed based on a previously calibrated item bank. It contains 196 items and three dimensions: ‘severity’, ‘impact’ and ‘variability’ of fatigue. The CAT was administered to 166 patients with RA. They also completed a traditional, multidimensional fatigue questionnaire (BRAF-MDQ) and the SF-36 in order to examine the CAT’s construct validity. A priori criterion for construct validity was that 75% of the correlations between the CAT dimensions and the subscales of the other questionnaires were as expected. Furthermore, comprehensive use of the item bank, measurement precision and score distribution were investigated. Results The a priori criterion for construct validity was supported for two of the three CAT dimensions (severity and impact but not for variability). For severity and impact, 87% of the correlations with the subscales of the well-established questionnaires were as expected but for variability, 53% of the hypothesised relations were found. Eighty-nine percent of the items were selected between one and 137 times for CAT administrations. Measurement precision was excellent for the severity and impact dimensions, with more than 90% of the CAT administrations reaching a standard error below 0.32. The variability dimension showed good measurement precision with 90% of the CAT administrations reaching a standard error below 0.44. No floor- or ceiling-effects were found for the three dimensions. Conclusion The CAT Fatigue RA showed good construct validity and excellent measurement precision on the dimensions severity and impact. The dimension variability had less ideal measurement characteristics, pointing to the need to recalibrate the CAT item bank with a two-dimensional model, solely consisting of severity and impact. PMID:26710104

Validation of psychosocial scales for physical activity in university students

PubMed Central

Tassitano, Rafael Miranda; de Farias, José Cazuza; Rech, Cassiano Ricardo; Tenório, Maria Cecília Marinho; Cabral, Poliana Coelho; da Silva, Giselia Alves Pontes

2015-01-01

OBJECTIVE Translate the Patient-centered Assessment and Counseling for Exercise questionnaire, adapt it cross-culturally and identify the psychometric properties of the psychosocial scales for physical activity in young university students. METHODS The Patient-centered Assessment and Counseling for Exercise questionnaire is made up of 39 items divided into constructs based on the social cognitive theory and the transtheoretical model. The analyzed constructs were, as follows: behavior change strategy (15 items), decision-making process (10), self-efficacy (6), support from family (4), and support from friends (4). The validation procedures were conceptual, semantic, operational, and functional equivalences, in addition to the equivalence of the items and of measurements. The conceptual, of items and semantic equivalences were performed by a specialized committee. During measurement equivalence, the instrument was applied to 717 university students. Exploratory factor analysis was used to verify the loading of each item, explained variance and internal consistency of the constructs. Reproducibility was measured by means of intraclass correlation coefficient. RESULTS The two translations were equivalent and back-translation was similar to the original version, with few adaptations. The layout, presentation order of the constructs and items from the original version were kept in the same form as the original instrument. The sample size was adequate and was evaluated by the Kaiser-Meyer-Olkin test, with values between 0.72 and 0.91. The correlation matrix of the items presented r < 0.8 (p < 0.05). The factor loadings of the items from all the constructs were satisfactory (> 0.40), varying between 0.43 and 0.80, which explained between 45.4% and 59.0% of the variance. Internal consistency was satisfactory (α ≥ 0.70), with support from friends being 0.70 and 0.92 for self-efficacy. Most items (74.3%) presented values above 0.70 for the reproducibility test. CONCLUSIONS The validation process steps were considered satisfactory and adequate for applying to the population. PMID:26270013

Validation of psychosocial scales for physical activity in university students.

PubMed

Tassitano, Rafael Miranda; de Farias Júnior, José Cazuza; Rech, Cassiano Ricardo; Tenório, Maria Cecília Marinho; Cabral, Poliana Coelho; da Silva, Giselia Alves Pontes

2015-01-01

OBJECTIVE Translate the Patient-centered Assessment and Counseling for Exercise questionnaire, adapt it cross-culturally and identify the psychometric properties of the psychosocial scales for physical activity in young university students. METHODS The Patient-centered Assessment and Counseling for Exercise questionnaire is made up of 39 items divided into constructs based on the social cognitive theory and the transtheoretical model. The analyzed constructs were, as follows: behavior change strategy (15 items), decision-making process (10), self-efficacy (6), support from family (4), and support from friends (4). The validation procedures were conceptual, semantic, operational, and functional equivalences, in addition to the equivalence of the items and of measurements. The conceptual, of items and semantic equivalences were performed by a specialized committee. During measurement equivalence, the instrument was applied to 717 university students. Exploratory factor analysis was used to verify the loading of each item, explained variance and internal consistency of the constructs. Reproducibility was measured by means of intraclass correlation coefficient. RESULTS The two translations were equivalent and back-translation was similar to the original version, with few adaptations. The layout, presentation order of the constructs and items from the original version were kept in the same form as the original instrument. The sample size was adequate and was evaluated by the Kaiser-Meyer-Olkin test, with values between 0.72 and 0.91. The correlation matrix of the items presented r < 0.8 (p < 0.05). The factor loadings of the items from all the constructs were satisfactory (> 0.40), varying between 0.43 and 0.80, which explained between 45.4% and 59.0% of the variance. Internal consistency was satisfactory (α ≥ 0.70), with support from friends being 0.70 and 0.92 for self-efficacy. Most items (74.3%) presented values above 0.70 for the reproducibility test. CONCLUSIONS The validation process steps were considered satisfactory and adequate for applying to the population.

Using the Rasch Measurement Model in Psychometric Analysis of the Family Effectiveness Measure

PubMed Central

McCreary, Linda L.; Conrad, Karen M.; Conrad, Kendon J.; Scott, Christy K; Funk, Rodney R.; Dennis, Michael L.

2013-01-01

Background Valid assessment of family functioning can play a vital role in optimizing client outcomes. Because family functioning is influenced by family structure, socioeconomic context, and culture, existing measures of family functioning--primarily developed with nuclear, middle class European American families--may not be valid assessments of families in diverse populations. The Family Effectiveness Measure was developed to address this limitation. Objectives To test the Family Effectiveness Measure with data from a primarily low-income African American convenience sample, using the Rasch measurement model. Method A sample of 607 adult women completed the measure. Rasch analysis was used to assess unidimensionality, response category functioning, item fit, person reliability, differential item functioning by race and parental status, and item hierarchy. Criterion-related validity was tested using correlations with five other variables related to family functioning. Results The Family Effectiveness Measure measures two separate constructs: The effective family functioning construct was a psychometrically sound measure of the target construct that was more efficient due to the deletion of 22 items. The ineffective family functioning construct consisted of 16 of those deleted items but was not as strong psychometrically. Items in both constructs evidenced no differential item functioning by race. Criterion-related validity was supported for both. Discussion In contrast to the prevailing conceptualization that family functioning is a single construct, assessed by positively and negatively worded items, use of the Rasch analysis suggested the existence of two constructs. While the effective family functioning is a strong and efficient measure of family functioning, the ineffective family functioning will require additional item development and psychometric testing. PMID:23636342

Simulation-based training for prostate surgery.

PubMed

Khan, Raheej; Aydin, Abdullatif; Khan, Muhammad Shamim; Dasgupta, Prokar; Ahmed, Kamran

2015-10-01

To identify and review the currently available simulators for prostate surgery and to explore the evidence supporting their validity for training purposes. A review of the literature between 1999 and 2014 was performed. The search terms included a combination of urology, prostate surgery, robotic prostatectomy, laparoscopic prostatectomy, transurethral resection of the prostate (TURP), simulation, virtual reality, animal model, human cadavers, training, assessment, technical skills, validation and learning curves. Furthermore, relevant abstracts from the American Urological Association, European Association of Urology, British Association of Urological Surgeons and World Congress of Endourology meetings, between 1999 and 2013, were included. Only studies related to prostate surgery simulators were included; studies regarding other urological simulators were excluded. A total of 22 studies that carried out a validation study were identified. Five validated models and/or simulators were identified for TURP, one for photoselective vaporisation of the prostate, two for holmium enucleation of the prostate, three for laparoscopic radical prostatectomy (LRP) and four for robot-assisted surgery. Of the TURP simulators, all five have demonstrated content validity, three face validity and four construct validity. The GreenLight laser simulator has demonstrated face, content and construct validities. The Kansai HoLEP Simulator has demonstrated face and content validity whilst the UroSim HoLEP Simulator has demonstrated face, content and construct validity. All three animal models for LRP have been shown to have construct validity whilst the chicken skin model was also content valid. Only two robotic simulators were identified with relevance to robot-assisted laparoscopic prostatectomy, both of which demonstrated construct validity. A wide range of different simulators are available for prostate surgery, including synthetic bench models, virtual-reality platforms, animal models, human cadavers, distributed simulation and advanced training programmes and modules. The currently validated simulators can be used by healthcare organisations to provide supplementary training sessions for trainee surgeons. Further research should be conducted to validate simulated environments, to determine which simulators have greater efficacy than others and to assess the cost-effectiveness of the simulators and the transferability of skills learnt. With surgeons investigating new possibilities for easily reproducible and valid methods of training, simulation offers great scope for implementation alongside traditional methods of training. © 2014 The Authors BJU International © 2014 BJU International Published by John Wiley & Sons Ltd.

Validation of the French version of the yale food addiction scale: an examination of its factor structure, reliability, and construct validity in a nonclinical sample.

PubMed

Brunault, Paul; Ballon, Nicolas; Gaillard, Philippe; Réveillère, Christian; Courtois, Robert

2014-05-01

The concept of food addiction has recently been proposed by applying the Diagnostic and Statistical Manual of Mental Disorders, Fourth Edition, Text Revision, criteria for substance dependence to eating behaviour. Food addiction has received increased attention given that it may play a role in binge eating, eating disorders, and the recent increase in obesity prevalence. Currently, there is no psychometrically sound tool for assessing food addiction in French. Our study aimed to test the psychometric properties of a French version of the Yale Food Addiction Scale (YFAS) by establishing its factor structure and construct validity in a nonclinical population. A total of 553 participants were assessed for food addiction (French version of the YFAS) and binge eating behaviour (Bulimic Investigatory Test Edinburgh and Binge Eating Scale). We tested the scale's factor structure (factor analysis for dichotomous data based on tetrachoric correlation coefficients), internal consistency, and construct validity with measures of binge eating. Our results supported a 1-factor structure, which accounted for 54.1% of the variance. This tool had adequate reliability and high construct validity with measures of binge eating in this population, both in its diagnosis and symptom count version. A 2-factor structure explained an additional 9.1% of the variance, and could differentiate between patients with high, compared with low, levels of insight regarding addiction symptoms. In our study, we validated a psychometrically sound French version of the YFAS, both in its symptom count and diagnostic version. Future studies should validate this tool in clinical samples.

Psychometric Validation of the Academic Motivation Scale in a Dental Student Sample.

PubMed

Orsini, Cesar; Binnie, Vivian; Evans, Phillip; Ledezma, Priscilla; Fuentes, Fernando; Villegas, Maria J

2015-08-01

The Academic Motivation Scale is one of the most frequently used instruments to assess academic motivation. It relies on the self-determination theory of human motivation. However, motivation has been understudied in dental education. Therefore, to address the lack of valid instruments to assess academic motivation in dental education and contribute to future research in the field, the aim of this study was to analyze the psychometric properties of this instrument in a sample of dental students. Participants were 989 Chilean undergraduate dental students (86% response rate) who completed a survey containing a Chilean face-valid version of the Spanish Academic Motivation Scale and three other motivation-related instruments to assess the survey's construct and criterion validity. Later, 76 of the students (out of 100 invited) took the survey again to assess its test-retest stability. The instrument's construct validity was supported by the superior goodness of fit of the seven-subscale Academic Motivation Scale over competing models through confirmatory factor analysis and by the expected correlations among its subscales. The concurrent criterion validity was supported by the confirmation of correlations between its subscales and external criteria. Adequate internal consistency and test-retest correlations were also found. The evidence from this study suggests that the Academic Motivation Scale is a preliminarily valid and reliable instrument to assess motivation in the predoctoral dental context. Future research in this area is needed to confirm or refute these results.

Validation of the theoretical domains framework for use in behaviour change and implementation research.

PubMed

Cane, James; O'Connor, Denise; Michie, Susan

2012-04-24

An integrative theoretical framework, developed for cross-disciplinary implementation and other behaviour change research, has been applied across a wide range of clinical situations. This study tests the validity of this framework. Validity was investigated by behavioural experts sorting 112 unique theoretical constructs using closed and open sort tasks. The extent of replication was tested by Discriminant Content Validation and Fuzzy Cluster Analysis. There was good support for a refinement of the framework comprising 14 domains of theoretical constructs (average silhouette value 0.29): 'Knowledge', 'Skills', 'Social/Professional Role and Identity', 'Beliefs about Capabilities', 'Optimism', 'Beliefs about Consequences', 'Reinforcement', 'Intentions', 'Goals', 'Memory, Attention and Decision Processes', 'Environmental Context and Resources', 'Social Influences', 'Emotions', and 'Behavioural Regulation'. The refined Theoretical Domains Framework has a strengthened empirical base and provides a method for theoretically assessing implementation problems, as well as professional and other health-related behaviours as a basis for intervention development.

A New Tool for Nutrition App Quality Evaluation (AQEL): Development, Validation, and Reliability Testing.

PubMed

DiFilippo, Kristen Nicole; Huang, Wenhao; Chapman-Novakofski, Karen M

2017-10-27

The extensive availability and increasing use of mobile apps for nutrition-based health interventions makes evaluation of the quality of these apps crucial for integration of apps into nutritional counseling. The goal of this research was the development, validation, and reliability testing of the app quality evaluation (AQEL) tool, an instrument for evaluating apps' educational quality and technical functionality. Items for evaluating app quality were adapted from website evaluations, with additional items added to evaluate the specific characteristics of apps, resulting in 79 initial items. Expert panels of nutrition and technology professionals and app users reviewed items for face and content validation. After recommended revisions, nutrition experts completed a second AQEL review to ensure clarity. On the basis of 150 sets of responses using the revised AQEL, principal component analysis was completed, reducing AQEL into 5 factors that underwent reliability testing, including internal consistency, split-half reliability, test-retest reliability, and interrater reliability (IRR). Two additional modifiable constructs for evaluating apps based on the age and needs of the target audience as selected by the evaluator were also tested for construct reliability. IRR testing using intraclass correlations (ICC) with all 7 constructs was conducted, with 15 dietitians evaluating one app. Development and validation resulted in the 51-item AQEL. These were reduced to 25 items in 5 factors after principal component analysis, plus 9 modifiable items in two constructs that were not included in principal component analysis. Internal consistency and split-half reliability of the following constructs derived from principal components analysis was good (Cronbach alpha >.80, Spearman-Brown coefficient >.80): behavior change potential, support of knowledge acquisition, app function, and skill development. App purpose split half-reliability was .65. Test-retest reliability showed no significant change over time (P>.05) for all but skill development (P=.001). Construct reliability was good for items assessing age appropriateness of apps for children, teens, and a general audience. In addition, construct reliability was acceptable for assessing app appropriateness for various target audiences (Cronbach alpha >.70). For the 5 main factors, ICC (1,k) was >.80, with a P value of <.05. When 15 nutrition professionals evaluated one app, ICC (2,15) was .98, with a P value of <.001 for all 7 constructs when the modifiable items were specified for adults seeking weight loss support. Our preliminary effort shows that AQEL is a valid, reliable instrument for evaluating nutrition apps' qualities for clinical interventions by nutrition clinicians, educators, and researchers. Further efforts in validating AQEL in various contexts are needed. ©Kristen Nicole DiFilippo, Wenhao Huang, Karen M. Chapman-Novakofski. Originally published in JMIR Mhealth and Uhealth (http://mhealth.jmir.org), 27.10.2017.

Testing the Construct Validity of a Virtual Reality Hip Arthroscopy Simulator.

PubMed

Khanduja, Vikas; Lawrence, John E; Audenaert, Emmanuel

2017-03-01

To test the construct validity of the hip diagnostics module of a virtual reality hip arthroscopy simulator. Nineteen orthopaedic surgeons performed a simulated arthroscopic examination of a healthy hip joint using a 70° arthroscope in the supine position. Surgeons were categorized as either expert (those who had performed 250 hip arthroscopies or more) or novice (those who had performed fewer than this). Twenty-one specific targets were visualized within the central and peripheral compartments; 9 via the anterior portal, 9 via the anterolateral portal, and 3 via the posterolateral portal. This was immediately followed by a task testing basic probe examination of the joint in which a series of 8 targets were probed via the anterolateral portal. During the tasks, the surgeon's performance was evaluated by the simulator using a set of predefined metrics including task duration, number of soft tissue and bone collisions, and distance travelled by instruments. No repeat attempts at the tasks were permitted. Construct validity was then evaluated by comparing novice and expert group performance metrics over the 2 tasks using the Mann-Whitney test, with a P value of less than .05 considered significant. On the visualization task, the expert group outperformed the novice group on time taken (P = .0003), number of collisions with soft tissue (P = .001), number of collisions with bone (P = .002), and distance travelled by the arthroscope (P = .02). On the probe examination, the 2 groups differed only in the time taken to complete the task (P = .025) with no significant difference in other metrics. Increased experience in hip arthroscopy was reflected by significantly better performance on the virtual reality simulator across 2 tasks, supporting its construct validity. This study validates a virtual reality hip arthroscopy simulator and supports its potential for developing basic arthroscopic skills. Level III. Copyright © 2016 Arthroscopy Association of North America. All rights reserved.

Examining construct validity of a new naturalistic observational assessment of hand skills for preschool- and school-age children.

PubMed

Chien, Chi-Wen; Brown, Ted; McDonald, Rachael

2012-04-01

The Assessment of Children's Hand Skills is a new assessment that utilises a naturalistic observational method to capture children's real-life hand skill performance when engaged at various types of daily activities in everyday living contexts. The Assessment of Children's Hand Skills is designed for use with 2- to 12-year-old children with a range of disabilities or health conditions. The study aimed to investigate construct validity of the Assessment of Children's Hand Skills in Australian children. Rasch analysis was used to examine internal construct validity of the Assessment of Children's Hand Skills in a mixed sample of 53 children with disabilities (including autism spectrum disorder, developmental/genetic disorders and physical disabilities) and 85 typically developing children. External construct validity was examined by correlating with three questionnaires evaluating daily living skills and hand skills. Rasch goodness-of-fit analysis suggested that all 22 activity items and 19 of 20 hand skill items in the Assessment of Children's Hand Skills measured a single construct. The Assessment of Children's Hand Skills items were placed in a clinically meaningful hierarchy from easy to hard, and the difficulty range of the items also matched the majority of children with disabilities and typically developing preschool-aged children. Moderate to high correlations (0.59 ≤ Spearman's ρ coefficients ≤ 0.89, P < 0.01) were found with the assessments of daily living and fine motor skills. This study provided preliminary evidence supporting the construct validity of the Assessment of Children's Hand Skills for its clinical application in assessing children's real-life hand skill performance in Australian contexts. © 2012 The Authors Australian Occupational Therapy Journal © 2012 Occupational Therapy Australia.

Psychometric properties concerning four instruments measuring job satisfaction, strain, and stress of conscience in a residential care context.

PubMed

Orrung Wallin, Anneli; Edberg, Anna-Karin; Beck, Ingela; Jakobsson, Ulf

2013-01-01

There are many instruments assessing the wellbeing of staff, but far from all have been psychometrically investigated. When evaluating supportive interventions directed toward nurse assistants in residential care, valid and reliable instruments are needed in order to detect possible changes. The aim of the study was to investigate validity in terms of data quality, construct validity, convergent and divergent validity and reliability in terms of the internal consistency and stability of the Job Satisfaction Questionnaire, the Psychosocial Aspects of Job Satisfaction, the Strain in Dementia Care Scale (SDCS), and the Stress of Conscience Questionnaire (SCQ) in a residential care context. The psychometric properties of the instruments were investigated in terms of data quality, construct validity, convergent and divergent validity and reliability, including test-retest reliability, in a residential care context with a sample consisting of nurse assistants (n=114). The four instruments responded with different psychometric-related problems such as internal missing data, floor and ceiling effects, problems with construct validity and low test-retest reliability, especially when assessed on the item level. These problems were however reduced or disappeared completely when assessed for total and factor scores. From a psychometric perspective, the SDCS seemed to stand out as the best instrument. However, it should be modified in order to reduce floor effects on item level and thereby gain sensitivity. The Job Satisfaction Questionnaire seemed to have problems both with the construct validity and test-retest reliability. The final choice of instrument must, however, be made dependent on what one intends to measure. Copyright © 2013 Elsevier Ireland Ltd. All rights reserved.

Unforgiveness: Refining theory and measurement of an understudied construct.

PubMed

Stackhouse, Madelynn R D; Jones Ross, Rachel W; Boon, Susan D

2018-01-01

This research presents a multidimensional conceptualization of unforgiveness and the development and validation of the unforgiveness measure (UFM). The scale was developed based on a qualitative study of people's experiences of unforgiven interpersonal offences (Study 1). Three dimensions of unforgiveness emerged (Study 2): emotional-ruminative unforgiveness, cognitive-evaluative unforgiveness, and offender reconstrual. We supported the scale's factor structure, reliability, and validity (Study 3). We also established the convergent and discriminant validity of the UFM with measures of negative affect, rumination, forgiveness, cognitive reappraisal, and emotional suppression (Study 4). Together, our results suggest that the UFM can capture variability in victims' unforgiving experiences in the aftermath of interpersonal transgressions. Implications for understanding the construct of unforgiveness and directions for future research are discussed. © 2017 The British Psychological Society.

Psychometric properties of the Chinese version of the Life Attitude Schedule (LAS-C) in a sample of Taiwanese adolescents.

PubMed

Chang, Hsiu-Ju; Wu, Chiung-Jane; Chen, Tzen Wen; Cheng, Andrew Tai Ann; Lin, Kuan-Chia; Rong, Jiin-Ru; Lee, Hsin-Chien

2011-05-01

Although prior research has proposed that several risk factors are conceptually and positively related to suicidal behavior, researchers have also suggested that suicide may be multifaceted. The Life Attitude Schedule (LAS) measures a broad range of suicide-related behaviors, including life-enhancing and life-threatening behaviors. This study aimed to translate the LAS into Chinese and evaluate the psychometric properties of the new version (LAS-C). A cross-sectional and descriptive design was used. Data were collected from high schools in the city of Taipei in northern Taiwan. A convenience sample of 1492 high school students was recruited from five high schools in Taipei. We used the Multi-Health Systems (MHS) translation policy to guide the translation process. Reliability was evaluated by internal consistency (represented by Cronbach's α coefficients) and test-retest (represented by intraclass correlation). Validity was demonstrated by content, convergent, divergent, concurrent, and contrast group comparison. Confirmatory factor analysis was further used to examine the theoretical model and to support construct validity. The Cronbach's α coefficient for the whole scale of the LAS-C and its subscales ranged from 0.70 to 0.91. The Intraclass Correlation Coefficient (ICC) ranged from 0.76 to 0.89 on the whole scale and its subscales, and were all statistically significant, at least at the p<0.05 level, indicating good stability over a three-week period. Validity was supported by a Content Validity Index (CVI) of 0.99, convergent, divergent, current, and contrast group comparison validity. Confirmatory factor analysis supported the theoretical model, further providing solid evidence of construct validity. The LAS-C has proper psychometric properties. Future studies must be conducted to shorten the items to form a briefer version. Copyright © 2010 Elsevier Ltd. All rights reserved.

Study of the validity of a job-exposure matrix for the job strain model factors: an update and a study of changes over time.

PubMed

Niedhammer, Isabelle; Milner, Allison; LaMontagne, Anthony D; Chastang, Jean-François

2018-03-08

The objectives of the study were to construct a job-exposure matrix (JEM) for psychosocial work factors of the job strain model, to evaluate its validity, and to compare the results over time. The study was based on national representative data of the French working population with samples of 46,962 employees (2010 SUMER survey) and 24,486 employees (2003 SUMER survey). Psychosocial work factors included the job strain model factors (Job Content Questionnaire): psychological demands, decision latitude, social support, job strain and iso-strain. Job title was defined by three variables: occupation and economic activity coded using standard classifications, and company size. A JEM was constructed using a segmentation method (Classification and Regression Tree-CART) and cross-validation. The best quality JEM was found using occupation and company size for social support. For decision latitude and psychological demands, there was not much difference using occupation and company size with or without economic activity. The validity of the JEM estimates was higher for decision latitude, job strain and iso-strain, and lower for social support and psychological demands. Differential changes over time were observed for psychosocial work factors according to occupation, economic activity and company size. This study demonstrated that company size in addition to occupation may improve the validity of JEMs for psychosocial work factors. These matrices may be time-dependent and may need to be updated over time. More research is needed to assess the validity of JEMs given that these matrices may be able to provide exposure assessments to study a range of health outcomes.

Development and psychometric testing of the rural pregnancy experience scale (RPES).

PubMed

Kornelsen, Jude; Stoll, Kathrin; Grzybowski, Stefan

2011-01-01

Rural pregnant woman who lack local access to maternity care due to their remote living circumstances may experience stress and anxiety related to pregnancy and parturition. The Rural Pregnancy Experience Scale (RPES) was designed to assess the unique worry and concerns reflective of the stress and anxiety of rural pregnant women related to pregnancy and parturition. The items of the scale were designed based on the results of a qualitative study of the experiences of pregnant rural women, thereby building a priori content validity into the measure. The relevancy content validity index (CVI) for this instrument was 1.0 and the clarity CVI was .91, as rated by maternity care specialists. A field test of the RPES with 187 pregnant rural women from British Columbia indicated that it had two factors: financial worries and worries/concerns about maternity care services, which were consistent with the conceptual base of the tool. Cronbach's alpha for the total RPES was .91; for the financial worries subscale and the worries/concerns about maternity care services subscale, alpha were .89 and .88, respectively. Construct validity was supported by significant correlations between the total scores of the RPES and the Depression Anxiety Stress Scales (DASS [r =.39, p < .01]), and subscale scores on the RPES were significantly correlated and converged with the depression, anxiety, and stress subscales of the DASS supporting convergent validity (correlations ranged between .20; p < .05 and .43; p < .01). Construct validity was also supported by findings that the level of access and availability of maternity care services were significantly associated with RPES scores. It was concluded that the RPES is a reliable and valid measure of worries and concerns reflective of rural pregnant women's stress and anxiety related to pregnancy and parturition.

Measuring social science concepts in pharmacy education research: From definition to item analysis of self-report instruments.

PubMed

Cor, M Ken

Interpreting results from quantitative research can be difficult when measures of concepts are constructed poorly, something that can limit measurement validity. Social science steps for defining concepts, guidelines for limiting construct-irrelevant variance when writing self-report questions, and techniques for conducting basic item analysis are reviewed to inform the design of instruments to measure social science concepts in pharmacy education research. Based on a review of the literature, four main recommendations emerge: These include: (1) employ a systematic process of conceptualization to derive nominal definitions; (2) write exact and detailed operational definitions for each concept, (3) when creating self-report questionnaires, write statements and select scales to avoid introducing construct-irrelevant variance (CIV); and (4) use basic item analysis results to inform instrument revision. Employing recommendations that emerge from this review will strengthen arguments to support measurement validity which in turn will support the defensibility of study finding interpretations. An example from pharmacy education research is used to contextualize the concepts introduced. Copyright © 2017 Elsevier Inc. All rights reserved.

Middle School Students' Learning about Genetic Inheritance through On-Line Scaffolding Supports

ERIC Educational Resources Information Center

Manokore, Viola

2010-01-01

The main goal of school science is to enable learners to become scientifically literate through their participation in scientific discourses (McNeill & Krajcik, 2009). One of the key elements of scientific discourses is the ability to construct scientific explanations that consist of valid claims supported by appropriate evidence (e.g., McNeill &…

Toward a Multidimensional Assessment of Work Spillover into Family Life.

ERIC Educational Resources Information Center

Small, Stephen A.; Riley, Dave

1990-01-01

Findings from 130 male executives and their spouses provided strong support for construct validity and internal consistency of global measure of work spillover. Data did not support hypothesis that work stress spills over into some role contexts more than others. Identified at least 3 distinct processes by which work can spill over and affect…

Applying modern psychometric techniques to melodic discrimination testing: Item response theory, computerised adaptive testing, and automatic item generation.

PubMed

Harrison, Peter M C; Collins, Tom; Müllensiefen, Daniel

2017-06-15

Modern psychometric theory provides many useful tools for ability testing, such as item response theory, computerised adaptive testing, and automatic item generation. However, these techniques have yet to be integrated into mainstream psychological practice. This is unfortunate, because modern psychometric techniques can bring many benefits, including sophisticated reliability measures, improved construct validity, avoidance of exposure effects, and improved efficiency. In the present research we therefore use these techniques to develop a new test of a well-studied psychological capacity: melodic discrimination, the ability to detect differences between melodies. We calibrate and validate this test in a series of studies. Studies 1 and 2 respectively calibrate and validate an initial test version, while Studies 3 and 4 calibrate and validate an updated test version incorporating additional easy items. The results support the new test's viability, with evidence for strong reliability and construct validity. We discuss how these modern psychometric techniques may also be profitably applied to other areas of music psychology and psychological science in general.

Anger Assessment in Clinical and Nonclinical Populations: Further Validation of the State-Trait Anger Expression Inventory-2.

PubMed

Lievaart, Marien; Franken, Ingmar H A; Hovens, Johannes E

2016-03-01

The most commonly used instrument for measuring anger is the State-Trait Anger Expression Inventory-2 (STAXI-2; Spielberger, 1999). This study further examines the validity of the STAXI-2 and compares anger scores between several clinical and nonclinical samples. Reliability, concurrent, and construct validity were investigated in Dutch undergraduate students (N = 764), a general population sample (N = 1211), and psychiatric outpatients (N = 226). The results support the reliability and validity of the STAXI-2. Concurrent validity was strong, with meaningful correlations between the STAXI-2 scales and anger-related constructs in both clinical and nonclinical samples. Importantly, patients showed higher experience and expression of anger than the general population sample. Additionally, forensic outpatients with addiction problems reported higher Anger Expression-Out than general psychiatric outpatients. Our conclusion is that the STAXI-2 is a suitable instrument to measure both the experience and the expression of anger in both general and clinical populations. © 2016 Wiley Periodicals, Inc.

Mindful attention and awareness: relationships with psychopathology and emotion regulation.

PubMed

Gregório, Sónia; Pinto-Gouveia, José

2013-01-01

The growing interest in mindfulness from the scientific community has originated several self-report measures of this psychological construct. The Mindful Attention and Awareness Scale (MAAS) is a self-report measure of mindfulness at a trait-level. This paper aims at exploring MAAS psychometric characteristics and validating it for the Portuguese population. The first two studies replicate some of the original author's statistical procedures in two different samples from the Portuguese general community population, in particular confirmatory factor analyses. Results from both analyses confirmed the scale single-factor structure and indicated a very good reliability. Moreover, cross-validation statistics showed that this single-factor structure is valid for different respondents from the general community population. In the third study the Portuguese version of the MAAS was found to have good convergent and discriminant validities. Overall the findings support the psychometric validity of the Portuguese version of MAAS and suggest this is a reliable self-report measure of trait-mindfulness, a central construct in Clinical Psychology research and intervention fields.

A Chimpanzee (Pan troglodytes) Model of Triarchic Psychopathy Constructs: Development and Initial Validation

PubMed Central

Latzman, Robert D.; Drislane, Laura E.; Hecht, Lisa K.; Brislin, Sarah J.; Patrick, Christopher J.; Lilienfeld, Scott O.; Freeman, Hani J.; Schapiro, Steven J.; Hopkins, William D.

2015-01-01

The current work sought to operationalize constructs of the triarchic model of psychopathy in chimpanzees (Pan troglodytes), a species well-suited for investigations of basic biobehavioral dispositions relevant to psychopathology. Across three studies, we generated validity evidence for scale measures of the triarchic model constructs in a large sample (N=238) of socially-housed chimpanzees. Using a consensus-based rating approach, we first identified candidate items for the chimpanzee triarchic (CHMP-Tri) scales from an existing primate personality instrument and refined these into scales. In Study 2, we collected data for these scales from human informants (N=301), and examined their convergent and divergent relations with scales from another triarchic inventory developed for human use. In Study 3, we undertook validation work examining associations between CHMP-Tri scales and task measures of approach-avoidance behavior (N=73) and ability to delay gratification (N=55). Current findings provide support for a chimpanzee model of core dispositions relevant to psychopathy and other forms of psychopathology. PMID:26779396

Further Validation of the Psychosocial Costs of Racism to Whites Scale on a Sample of University Students in the Southeastern United States

ERIC Educational Resources Information Center

Sifford, Amy; Ng, Kok-Mun; Wang, Chuang

2009-01-01

We examined the factor structure of the Psychosocial Costs of Racism to Whites Scale (PCRW; Spanierman & Heppner, 2004) on 766 White American university students from the southeastern United States. Results from confirmatory factor analyses supported the 3-factor model proposed by Spanierman and Heppner (2004). The construct validity of the…

Validation study of a Chinese version of Partners in Health in Hong Kong (C-PIH HK).

PubMed

Chiu, Teresa Mei Lee; Tam, Katharine Tai Wo; Siu, Choi Fong; Chau, Phyllis Wai Ping; Battersby, Malcolm

2017-01-01

The Partners in Health (PIH) scale is a measure designed to assess the generic knowledge, attitudes, behaviors, and impacts of self-management. A cross-cultural adaptation of the PIH for use in Hong Kong was evaluated in this study. This paper reports the validity and reliability of the Chinese version of PIH (C-PIH[HK]). A 12-item PIH was translated using forward-backward translation technique and reviewed by individuals with chronic diseases and health professionals. A total of 209 individuals with chronic diseases completed the scale. The construct validity, internal consistency, and test-retest reliability were evaluated in two waves. The findings in Wave 1 (n = 73) provided acceptable psychometric properties of the C-PIH(HK) but supported the adaptation of question 5 to improve the cultural relevance, validity, and reliability of the scale. An adapted version of C-PIH(HK) was evaluated in Wave 2. The findings in Wave 2 (n = 136) demonstrated good construct validity and internal consistency of C-PIH(HK). A principal component analysis with Oblimin rotation yielded a 3-factor solution, and the Cronbach's alphas of the subscales ranged from 0.773 to 0.845. Participants were asked whether they perceived the self-management workshops they attended and education provided by health professionals as useful or not. The results showed that the C-PIH(HK) was able to discriminate those who agreed and those who disagreed related to the usefulness of individual health education (p < 0.0001 in all subscales) and workshops (p < 0.001 in the knowledge subscale) as hypothesized. The test-retest reliability was high (ICC = 0.818). A culturally adapted version of PIH for use in Hong Kong was evaluated. The study supported good construct validity, discriminate validity, internal consistency, and test-retest reliability of the C-PIH(HK).

Instrument translation and initial psychometric evaluation of the Danish Body Image Quality of Life Inventory.

PubMed

Rasmussen, Trine Bernholdt; Berg, Selina Kikkenborg; Dixon, Jane; Moons, Philip; Konradsen, Hanne

2016-12-01

Negative body perception has been reported in a number of patient populations. No instrument in Danish for measuring body image-related concerns has been available. Without such an instrument, understanding of the phenomenon in Danish-speaking populations is limited. The purpose of the study was thus to translate and validate a Danish version of the Body Image Quality of Life Inventory (BIQLI), in order to obtain a valid instrument applicable for healthcare research. The study consisted of two phases: (i) instrument adaptation, including forward and back translation, expert committee comparisons and cognitive interviewing, and (ii) empirical testing of the Danish version (BIQLI-DA) with subsequent psychometric evaluation. Hypothesised correlations to other measures, including body mass index (BMI), Medical Outcome Short Form-8 (SF-8), Patient Health Questionnaire-9 (PHQ-9), General Anxiety Disorder-7 and Symptom Check List-90-Revised (SCL-90-R ® ) were tested. In addition, exploratory factor structure analysis (EFA) and internal consistency on item and scale level were performed. The adapted instrument was found to be semantically sound, yet concerns about face validity did arise through cognitive interviews. Danish college students (n = 189, 65 men, M age = 21.1 years) participated in the piloting of the BIQLI-DA. Convergent construct validity was demonstrated through associations to related constructs. Exploratory factor analysis revealed a potential subscale structure. Finally, results showed a high internal consistency (Cronbach's alpha = 0.92). Support for the validity of the BIQLI-DA might have been strengthened by repeating cognitive interviews after layout alterations, by piloting the instrument on a larger sample. This study demonstrated tentative support for the validity of the Danish Body Image Quality of Life (BIQLI-DA) and found the measure to be reliable in terms of internal consistency. Further exploration of response processes and construct validity is needed. © 2016 Nordic College of Caring Science.

Longitudinal Stability of Person Characteristics: Intelligence and Creativity.

ERIC Educational Resources Information Center

Magnusson, D.; Backteman, G.

1979-01-01

A longitudinal study of approximately 1,000 students aged 10-16 showed high stability of intelligence and creativity. Stability coefficients for intelligence were higher than those for creativity. Results supported the construct validity of creativity. (MH)

Development and Initial Validation of the Pain Resilience Scale.

PubMed

Slepian, P Maxwell; Ankawi, Brett; Himawan, Lina K; France, Christopher R

2016-04-01

Over the past decade, the role of positive psychology in pain experience has gained increasing attention. One such positive factor, identified as resilience, has been defined as the ability to maintain positive emotional and physical functioning despite physical or psychological adversity. Although cross-situational measures of resilience have been shown to be related to pain, it was hypothesized that a pain-specific resilience measure would serve as a stronger predictor of acute pain experience. To test this hypothesis, we conducted a series of studies to develop and validate the Pain Resilience Scale. Study 1 described exploratory and confirmatory factor analyses that support a scale with 2 distinct factors, Cognitive/Affective Positivity and Behavioral Perseverance. Study 2 showed test-retest reliability and construct validity of this new scale, including moderate positive relationships with measures of positive psychological functioning and small to moderate negative relationships with vulnerability measures such as pain catastrophizing. Finally, consistent with our initial hypothesis, study 3 showed that the Pain Resilience Scale is more strongly related to ischemic pain responses than existing measures of general resilience. Together, these studies support the predictive utility of this new pain-specific measure of resilience in the context of acute experimental pain. The Pain Resilience Scale represents a novel measure of Cognitive/Affective Positivity and Behavioral Perseverance during exposure to noxious stimuli. Construct validity is supported by expected relationships with existing pain-coping measures, and predictive validity is shown by individual differences in response to acute experimental pain. Copyright © 2016 American Pain Society. Published by Elsevier Inc. All rights reserved.

Low back related leg pain: an investigation of construct validity of a new classification system.

PubMed

Schäfer, Axel G M; Hall, Toby M; Rolke, Roman; Treede, Rolf-Detlef; Lüdtke, Kerstin; Mallwitz, Joachim; Briffa, Kathryn N

2014-01-01

Leg pain is associated with back pain in 25-65% of all cases and classified as somatic referred pain or radicular pain. However, distinction between the two may be difficult as different pathomechanisms may cause similar patterns of pain. Therefore a pathomechanism based classification system was proposed, with four distinct hierarchical and mutually exclusive categories: Neuropathic Sensitization (NS) comprising major features of neuropathic pain with sensory sensitization; Denervation (D) arising from significant axonal compromise; Peripheral Nerve Sensitization (PNS) with marked nerve trunk mechanosensitivity; and Musculoskeletal (M) with pain referred from musculoskeletal structures. To investigate construct validity of the classification system. Construct validity was investigated by determining the relationship of nerve functioning with subgroups of patients and asymptomatic controls. Thus somatosensory profiles of subgroups of patients with low back related leg pain (LBRLP) and healthy controls were determined by a comprehensive quantitative sensory test (QST) protocol. It was hypothesized that subgroups of patients and healthy controls would show differences in QST profiles relating to underlying pathomechanisms. 77 subjects with LBRLP were recruited and classified in one of the four groups. Additionally, 18 age and gender matched asymptomatic controls were measured. QST revealed signs of pain hypersensitivity in group NS and sensory deficits in group D whereas Groups PNS and M showed no significant differences when compared to the asymptomatic group. These findings support construct validity for two of the categories of the new classification system, however further research is warranted to achieve construct validation of the classification system as a whole.

The behavioral regulation in sport questionnaire (BRSQ): instrument development and initial validity evidence.

PubMed

Lonsdale, Chris; Hodge, Ken; Rose, Elaine A

2008-06-01

The purpose of the four studies described in this article was to develop and test a new measure of competitive sport participants' intrinsic motivation, extrinsic motivation, and amotivation (self-determination theory; Deci & Ryan, 1985). The items for the new measure, named the Behavioral Regulation in Sport Questionnaire (BRSQ), were constructed using interviews, expert review, and pilot testing. Analyses supported the internal consistency, test-retest reliability, and factorial validity of the BRSQ scores. Nomological validity evidence was also supportive, as BRSQ subscale scores were correlated in the expected pattern with scores derived from measures of motivational consequences. When directly compared with scores derived from the Sport Motivation Scale (SMS; Pelletier, Fortier, Vallerand, Tuson, & Blais, 1995) and a revised version of that questionnaire (SMS-6; Mallett, Kawabata, Newcombe, Otero-Forero, & Jackson, 2007), BRSQ scores demonstrated equal or superior reliability and factorial validity as well as better nomological validity.

Psychometric properties of the Late-Life Function and Disability Instrument: a systematic review

PubMed Central

2014-01-01

Background The choice of measure for use as a primary outcome in geriatric research is contingent upon the construct of interest and evidence for its psychometric properties. The Late-Life Function and Disability Instrument (LLFDI) has been widely used to assess functional limitations and disability in studies with older adults. The primary aim of this systematic review was to evaluate the current available evidence for the psychometric properties of the LLFDI. Methods Published studies of any design reporting results based on administration of the original version of the LLFDI in community-dwelling older adults were identified after searches of 9 electronic databases. Data related to construct validity (convergent/divergent and known-groups validity), test-retest reliability and sensitivity to change were extracted. Effect sizes were calculated for within-group changes and summarized graphically. Results Seventy-one studies including 17,301 older adults met inclusion criteria. Data supporting the convergent/divergent and known-groups validity for both the Function and Disability components were extracted from 30 and 18 studies, respectively. High test-retest reliability was found for the Function component, while results for the Disability component were more variable. Sensitivity to change of the LLFDI was confirmed based on findings from 25 studies. The basic lower extremity subscale and overall summary score of the Function component and limitation dimension of the Disability component were associated with the strongest relative effect sizes. Conclusions There is extensive evidence to support the construct validity and sensitivity to change of the LLFDI among various clinical populations of community-dwelling older adults. Further work is needed on predictive validity and values for clinically important change. Findings from this review can be used to guide the selection of the most appropriate LLFDI subscale for use an outcome measure in geriatric research and practice. PMID:24476510

Predictors of parental discretionary choice provision using the health action process approach framework: Development and validation of a self-reported questionnaire for parents of 4-7-year-olds.

PubMed

Johnson, Brittany J; Zarnowiecki, Dorota; Hendrie, Gilly A; Golley, Rebecca K

2018-02-21

Children's intake of discretionary choices is excessive. This study aimed to develop a questionnaire measuring parents' attitudes and beliefs towards limiting provision of discretionary choices, using the Health Action Process Approach model. The questionnaire items were informed by the Health Action Process Approach model, which extends the Theory of Planned Behaviour to include both motivational (intention) and volitional (post-intention) factors that influence behaviour change. The questionnaire was piloted for content and face validity (expert panel, n = 5; parents, n = 4). Construct and predictive validity were examined in a sample of 178 parents of 4-7-year-old children who completed the questionnaire online. Statistical analyses included exploratory factor analyses, Cronbach's alpha and multiple linear regression. Pilot testing supported content and face validity. Principal component analyses identified constructs that aligned with the eight constructs of the Health Action Process Approach model. Internal consistencies were high for all subscales, in both the motivational (Cronbach's alpha 0.77-0.88) and volitional phase (Cronbach's alpha 0.85-0.92). Initial results from validation tests support the development of a new questionnaire for measuring parent attitudes and beliefs regarding provision of discretionary choices to their 4-7-year-old children within the home. This new questionnaire can be used to gain greater insight into parents' attitudes and beliefs that influence ability to limit discretionary choices provision to children. Further research to expand understanding of the questionnaires' psychometric properties would be valuable, including confirmatory factor analysis and reproducibility. © 2018 Dietitians Association of Australia.

Predictors of the risk factors for suicide identified by the interpersonal-psychological theory of suicidal behaviour.

PubMed

Christensen, Helen; Batterham, Philip James; Mackinnon, Andrew J; Donker, Tara; Soubelet, Andrea

2014-10-30

The Interpersonal-Psychological Theory of Suicide (IPTS) has been supported by recent research. However, the nature of the models׳ three major constructs--perceived burdensomeness, thwarted belongingness and acquired capability - requires further investigation. In this paper, we test a number of hypotheses about the predictors and correlates of the IPTS constructs. Participants aged 32-38 from an Australian population-based longitudinal cohort study (n=1167) were assessed. IPTS constructs were measured by items from the Interpersonal Needs Questionnaire (INQ) and Acquired Capability for Suicide Scale (ACSS), alongside demographic and additional measures, measured concurrently or approximately 8 years earlier. Cross-sectional analyses evaluating the IPTS supported earlier work. Mental health was significantly related to all three IPTS constructs, but depression and anxiety caseness were associated only with perceived burdensomeness. Various social support measures were differentially associated with the three constructs. Stressful events and lifetime traumas had robust independent associations with acquired capability for suicide only. The IPTS model provides a useful framework for conceptualising suicide risk. The findings highlight the importance of perceived social support in suicide risk, identify the importance of personality and other factors as new avenues of research, and provide some validation for the independence of the constructs. Copyright © 2014 Elsevier Ireland Ltd. All rights reserved.

Psychometric Properties of Korean Version of the Second Victim Experience and Support Tool (K-SVEST).

PubMed

Kim, Eun-Mi; Kim, Sun-Aee; Lee, Ju-Ry; Burlison, Jonathan D; Oh, Eui Geum

2018-02-13

"Second victims" are defined as healthcare professionals whose wellness is influenced by adverse clinical events. The Second Victim Experience and Support Tool (SVEST) was used to measure the second-victim experience and quality of support resources. Although the reliability and validity of the original SVEST have been validated, those for the Korean tool have not been validated. The aim of the study was to evaluate the psychometric properties of the Korean version of the SVEST. The study included 305 clinical nurses as participants. The SVEST was translated into Korean via back translation. Content validity was assessed by seven experts, and test-retest reliability was evaluated by 30 clinicians. Internal consistency and construct validity were assessed via confirmatory factor analysis. The analyses were performed using SPSS 23.0 and STATA 13.0 software. The content validity index value demonstrated validity; item- and scale-level content validity index values were both 0.95. Test-retest reliability and internal consistency reliability were satisfactory: the intraclass consistent coefficient was 0.71, and Cronbach α values ranged from 0.59 to 0.87. The CFA showed a significantly good fit for an eight-factor structure (χ = 578.21, df = 303, comparative fit index = 0.92, Tucker-Lewis index = 0.90, root mean square error of approximation = 0.05). The K-SVEST demonstrated good psychometric properties and adequate validity and reliability. The results showed that the Korean version of SVEST demonstrated the extent of second victimhood and support resources in Korean healthcare workers and could aid in the development of support programs and evaluation of their effectiveness.

Measurement properties of patient-reported outcome measures (PROMs) used in adult patients with chronic kidney disease: A systematic review

PubMed Central

Kyte, Derek; Cockwell, Paul; Marshall, Tom; Gheorghe, Adrian; Keeley, Thomas; Slade, Anita; Calvert, Melanie

2017-01-01

Background Patient-reported outcome measures (PROMs) can provide valuable information which may assist with the care of patients with chronic kidney disease (CKD). However, given the large number of measures available, it is unclear which PROMs are suitable for use in research or clinical practice. To address this we comprehensively evaluated studies that assessed the measurement properties of PROMs in adults with CKD. Methods Four databases were searched; reference list and citation searching of included studies was also conducted. The COnsensus-based Standards for the selection of health Measurement INstruments (COSMIN) checklist was used to appraise the methodological quality of the included studies and to inform a best evidence synthesis for each PROM. Results The search strategy retrieved 3,702 titles/abstracts. After 288 duplicates were removed, 3,414 abstracts were screened and 71 full-text articles were retrieved for further review. Of these, 24 full-text articles were excluded as they did not meet the eligibility criteria. Following reference list and citation searching, 19 articles were retrieved bringing the total number of papers included in the final analysis to 66. There was strong evidence supporting internal consistency and moderate evidence supporting construct validity for the Kidney Disease Quality of Life-36 (KDQOL-36) in pre-dialysis patients. In the dialysis population, the KDQOL-Short Form (KDQOL-SF) had strong evidence for internal consistency and structural validity and moderate evidence for test-retest reliability and construct validity while the KDQOL-36 had moderate evidence of internal consistency, test-retest reliability and construct validity. The End Stage Renal Disease-Symptom Checklist Transplantation Module (ESRD-SCLTM) demonstrated strong evidence for internal consistency and moderate evidence for test-retest reliability, structural and construct validity in renal transplant recipients. Conclusions We suggest considering the KDQOL-36 for use in pre-dialysis patients; the KDQOL-SF or KDQOL-36 for dialysis patients and the ESRD-SCLTM for use in transplant recipients. However, further research is required to evaluate the measurement error, structural validity, responsiveness and patient acceptability of PROMs used in CKD. PMID:28636678

Validation of a Spanish version of the Spine Functional Index.

PubMed

Cuesta-Vargas, Antonio I; Gabel, Charles P

2014-06-27

The Spine Functional Index (SFI) is a recently published, robust and clinimetrically valid patient reported outcome measure. The purpose of this study was the adaptation and validation of a Spanish-version (SFI-Sp) with cultural and linguistic equivalence. A two stage observational study was conducted. The SFI was cross-culturally adapted to Spanish through double forward and backward translation then validated for its psychometric characteristics. Participants (n = 226) with various spine conditions of >12 weeks duration completed the SFI-Sp and a region specific measure: for the back, the Roland Morris Questionnaire (RMQ) and Backache Index (BADIX); for the neck, the Neck Disability Index (NDI); for general health the EQ-5D and SF-12. The full sample was employed to determine internal consistency, concurrent criterion validity by region and health, construct validity and factor structure. A subgroup (n = 51) was used to determine reliability at seven days. The SFI-Sp demonstrated high internal consistency (α = 0.85) and reliability (r = 0.96). The factor structure was one-dimensional and supported construct validity. Criterion specific validity for function was high with the RMQ (r = 0.79), moderate with the BADIX (r = 0.59) and low with the NDI (r = 0.46). For general health it was low with the EQ-5D and inversely correlated (r = -0.42) and fair with the Physical and Mental Components of the SF-12 and inversely correlated (r = -0.56 and r = -0.48), respectively. The study limitations included the lack of longitudinal data regarding other psychometric properties, specifically responsiveness. The SFI-Sp was demonstrated as a valid and reliable spine-regional outcome measure. The psychometric properties were comparable to and supported those of the English-version, however further longitudinal investigations are required.

Psychometric Evaluation of Two Appetite Questionnaires in Patients With Heart Failure.

PubMed

Andreae, Christina; Strömberg, Anna; Sawatzky, Richard; Årestedt, Kristofer

2015-12-01

Decreased appetite in heart failure (HF) may lead to undernutrition which could negatively influence prognosis. Appetite is a complex clinical issue that is often best measured with the use of self-report instruments. However, there is a lack of self-rated appetite instruments. The Council on Nutrition Appetite Questionnaire (CNAQ) and the Simplified Nutritional Appetite Questionnaire (SNAQ) are validated instruments developed primarily for elderly people. Yet, the psychometric properties have not been evaluated in HF populations. The aim of the present study was to evaluate the psychometric properties of CNAQ and SNAQ in patients with HF. A total of 186 outpatients with reduced ejection fraction and New York Heart Association (NYHA) functional classifications II-IV were included (median age 72 y; 70% men). Data were collected with the use of a questionnaire that included the CNAQ and SNAQ. The psychometric evaluation included data quality, factor structure, construct validity, known-group validity, and internal consistency. Unidimensionality was supported by means of parallel analysis and confirmatory factor analyses (CFAs). The CFA results indicated sufficient model fit. Both construct validity and known-group validity were supported. Internal consistency reliability was acceptable, with ordinal coefficient alpha estimates of 0.82 for CNAQ and 0.77 for SNAQ. CNAQ and SNAQ demonstrated sound psychometric properties and can be used to measure appetite in patients with HF. Copyright © 2015 Elsevier Inc. All rights reserved.

Validity of the Thai EQ-5D in an occupational population in Thailand.

PubMed

Kimman, Merel; Vathesatogkit, Prin; Woodward, Mark; Tai, E-Shyong; Thumboo, Julian; Yamwong, Sukit; Ratanachaiwong, Wipa; Wee, Hwee-Lin; Sritara, Piyamitr

2013-08-01

To assess the construct validity of the Thai EuroQoL (EQ-5D) among an occupational population in Thailand. Data were derived from a large cohort study among employees of the Electricity Generating Authority of Thailand. In 2008 and 2009, 4,850 participants completed the Thai EQ-5D and Short-Form 36 version 2 (SF-36v2). Thai preferences weights were used to convert EQ-5D health states into EQ-5D index scores. Construct validity of the Thai EQ-5D was examined by specifying and testing hypotheses about the relationships between the EQ-5D, SF-36v2, and participants' demographic and medical characteristics. Construct validity of the Thai EQ-5D was supported by expected relationships with SF-36v2 scale and summary scores. For example, SF-36v2 scores on the mental health scale were much lower for participants who reported having problems on the EQ-5D anxiety/depression dimension compared to those reporting no problems (mean norm-based SF-36v2 scores: 52.9 vs. 41.8, p < 0.001). Additionally, reporting a problem in a given EQ-5D dimension was generally associated with lower SF-36v2 summary scores. The EQ-5D index score distinguished between groups of participants in the expected manner, on the basis of sex, age, education and self-reported health, thus providing evidence of known-groups validity. The study demonstrated good construct validity of the Thai EQ-5D in a large occupational population in Thailand.

Internal consistency and validity of a new physical workload questionnaire

PubMed Central

Bot, S; Terwee, C; van der Windt, D A W M; Feleus, A; Bierma-Zeinstra, S; Knol, D; Bouter, L; Dekker, J

2004-01-01

Aims: To examine the dimensionality, internal consistency, and construct validity of a new physical workload questionnaire in employees with musculoskeletal complaints. Methods: Factor analysis was applied to the responses in three study populations with musculoskeletal disorders (n = 406, 300, and 557) on 26 items related to physical workload. The internal consistency of the resulting subscales was examined. It was hypothesised that physical workload would vary among different occupational groups. The occupations of all subjects were classified into four groups on the basis of expected workload (heavy physical load; long lasting postures and repetitive movements; both; no physical load). Construct validity of the subscales created was tested by comparing the subscale scores among these occupational groups. Results: The pattern of the factor loadings of items was almost identical for the three study populations. Two interpretable factors were found: items related to heavy physical workload loaded highly on the first factor, and items related to static postures or repetitive work loaded highly on the second factor. The first constructed subscale "heavy physical work" had a Cronbach's α of 0.92 to 0.93 and the second subscale "long lasting postures and repetitive movements", of 0.86 to 0.87. Six of eight hypotheses regarding the construct validity of the subscales were confirmed. Conclusions: The results support the internal structure, internal consistency, and validity of the new physical workload questionnaire. Testing this questionnaire in non-symptomatic employees and comparing its performance with objective assessments of physical workload are important next steps in the validation process. PMID:15550603

Psychometric properties and validation of Nepali version of the Depression Anxiety Stress Scales (DASS-21).

PubMed

Tonsing, Kareen N

2014-04-01

This study investigated the reliability of the Nepali version of the 21-item Depression Anxiety Stress Scale (DASS-21) among non-clinical sample. The purpose of this paper is to report the dimensionality and internal consistency of the DASS-21in a sample of non-clinical adults. This study was conducted in Hong Kong among 212 Nepali adults, aged 18-60 years. Life satisfaction was assessed with the Life Satisfaction Scale. The dimensionality of the DASS-21 scale was investigated using exploratory factor analysis. Construct validity was evaluated using the life satisfaction scale. The intercorrelation among depression, anxiety and stress subscales indicates that symptoms of psychological distress as measured by the DASS-21-N can distinguished between the three constructs in adult community sample. The results also showed inverse correlation among DASS-21-N and life satisfaction scale, supporting the assumption that the higher the life satisfaction, the lower the psychological distress. The results of this study indicate that the Nepali version of the DASS-21 demonstrate adequate psychometric properties in relation to internal consistency and validity, lending support to prior studies and suggest that the DASS-21 can be utilized among diverse groups with confidence. It supports the reliability of the 3-factorial dimensionality of the DASS-21, and highlight that it is a valid and useful tool that can distinguish between depression and anxiety. Copyright © 2013 Elsevier B.V. All rights reserved.

Preliminary Validity of the Eyberg Child Behavior Inventory With Filipino Immigrant Parents

PubMed Central

Coffey, Dean M.; Javier, Joyce R.; Schrager, Sheree M.

2016-01-01

Filipinos are an understudied minority affected by significant behavioral health disparities. We evaluate evidence for the reliability, construct validity, and convergent validity of the Eyberg Child Behavior Inventory (ECBI) in 6- to 12- year old Filipino children (N = 23). ECBI scores demonstrated high internal consistency, supporting a single-factor model (pre-intervention α =.91; post-intervention α =.95). Results document convergent validity with the Child Behavior Checklist Externalizing scale at pretest (r = .54, p < .01) and posttest (r = .71, p < .001). We conclude that the ECBI is a promising tool to measure behavior problems in Filipino children. PMID:27087739

Preliminary Validity of the Eyberg Child Behavior Inventory With Filipino Immigrant Parents.

PubMed

Coffey, Dean M; Javier, Joyce R; Schrager, Sheree M

Filipinos are an understudied minority affected by significant behavioral health disparities. We evaluate evidence for the reliability, construct validity, and convergent validity of the Eyberg Child Behavior Inventory (ECBI) in 6- to 12- year old Filipino children ( N = 23). ECBI scores demonstrated high internal consistency, supporting a single-factor model (pre-intervention α =.91; post-intervention α =.95). Results document convergent validity with the Child Behavior Checklist Externalizing scale at pretest ( r = .54, p < .01) and posttest ( r = .71, p < .001). We conclude that the ECBI is a promising tool to measure behavior problems in Filipino children.

Validation of the French Version of the Yale Food Addiction Scale: An Examination of Its Factor Structure, Reliability, and Construct Validity in a Nonclinical Sample

PubMed Central

Brunault, Paul; Ballon, Nicolas; Gaillard, Philippe; Réveillère, Christian; Courtois, Robert

2014-01-01

Objective: The concept of food addiction has recently been proposed by applying the Diagnostic and Statistical Manual of Mental Disorders, Fourth Edition, Text Revision, criteria for substance dependence to eating behaviour. Food addiction has received increased attention given that it may play a role in binge eating, eating disorders, and the recent increase in obesity prevalence. Currently, there is no psychometrically sound tool for assessing food addiction in French. Our study aimed to test the psychometric properties of a French version of the Yale Food Addiction Scale (YFAS) by establishing its factor structure and construct validity in a nonclinical population. Method: A total of 553 participants were assessed for food addiction (French version of the YFAS) and binge eating behaviour (Bulimic Investigatory Test Edinburgh and Binge Eating Scale). We tested the scale’s factor structure (factor analysis for dichotomous data based on tetrachoric correlation coefficients), internal consistency, and construct validity with measures of binge eating. Results: Our results supported a 1-factor structure, which accounted for 54.1% of the variance. This tool had adequate reliability and high construct validity with measures of binge eating in this population, both in its diagnosis and symptom count version. A 2-factor structure explained an additional 9.1% of the variance, and could differentiate between patients with high, compared with low, levels of insight regarding addiction symptoms. Conclusions: In our study, we validated a psychometrically sound French version of the YFAS, both in its symptom count and diagnostic version. Future studies should validate this tool in clinical samples. PMID:25007281

Validation of the Narrowing Beam Walking Test in Lower Limb Prosthesis Users.

PubMed

Sawers, Andrew; Hafner, Brian

2018-04-11

To evaluate the content, construct, and discriminant validity of the Narrowing Beam Walking Test (NBWT), a performance-based balance test for lower limb prosthesis users. Cross-sectional study. Research laboratory and prosthetics clinic. Unilateral transtibial and transfemoral prosthesis users (N=40). Not applicable. Content validity was examined by quantifying the percentage of participants receiving maximum or minimum scores (ie, ceiling and floor effects). Convergent construct validity was examined using correlations between participants' NBWT scores and scores or times on existing clinical balance tests regularly administered to lower limb prosthesis users. Known-groups construct validity was examined by comparing NBWT scores between groups of participants with different fall histories, amputation levels, amputation etiologies, and functional levels. Discriminant validity was evaluated by analyzing the area under each test's receiver operating characteristic (ROC) curve. No minimum or maximum scores were recorded on the NBWT. NBWT scores demonstrated strong correlations (ρ=.70‒.85) with scores/times on performance-based balance tests (timed Up and Go test, Four Square Step Test, and Berg Balance Scale) and a moderate correlation (ρ=.49) with the self-report Activities-specific Balance Confidence scale. NBWT performance was significantly lower among participants with a history of falls (P=.003), transfemoral amputation (P=.011), and a lower mobility level (P<.001). The NBWT also had the largest area under the ROC curve (.81) and was the only test to exhibit an area that was statistically significantly >.50 (ie, chance). The results provide strong evidence of content, construct, and discriminant validity for the NBWT as a performance-based test of balance ability. The evidence supports its use to assess balance impairments and fall risk in unilateral transtibial and transfemoral prosthesis users. Copyright © 2018 American Congress of Rehabilitation Medicine. Published by Elsevier Inc. All rights reserved.

Validity and reliability of the persian version of templer death anxiety scale in family caregivers of cancer patients.

PubMed

Soleimani, Mohammad Ali; Bahrami, Nasim; Yaghoobzadeh, Ameneh; Banihashemi, Hedieh; Nia, Hamid Sharif; Haghdoost, Ali Akbar

2016-01-01

Due to increasing recognition of the importance of death anxiety for understanding human nature, it is important that researchers who investigate death anxiety have reliable and valid methodology to measure. The purpose of this study was to evaluate the validity and reliability of the Persian version of Templer Death Anxiety Scale (TDAS) in family caregivers of cancer patients. A sample of 326 caregivers of cancer patients completed a 15-item questionnaire. Principal components analysis (PCA) followed by a varimax rotation was used to assess factor structure of the DAS. The construct validity of the scale was assessed using exploratory and confirmatory factor analyses. Convergent and discriminant validity were also examined. Reliability was assessed with Cronbach's alpha coefficients and construction reliability. Based on the results of the PCA and consideration of the meaning of our items, a three-factor solution, explaining 60.38% of the variance, was identified. A confirmatory factor analysis (CFA) then supported the adequacy of the three-domain structure of the DAS. Goodness-of-fit indices showed an acceptable fit overall with the full model {χ(2)(df) = 262.32 (61), χ(2)/df = 2.04 [adjusted goodness of fit index (AGFI) = 0.922, parsimonious comparative fit index (PCFI) = 0.703, normed fit Index (NFI) = 0.912, CMIN/DF = 2.048, root mean square error of approximation (RMSEA) = 0.055]}. Convergent and discriminant validity were shown with construct fulfilled. The Cronbach's alpha and construct reliability were greater than 0.70. The findings show that the Persian version of the TDAS has a three-factor structure and acceptable validity and reliability.

Measuring Cognitive and Affective Constructs in the Context of an Acute Health Event

PubMed Central

Boudreaux, Edwin D.; Moon, Simon; Tappe, Karyn A.; Bock, Beth; Baumann, Brigitte; Chapman, Gretchen B.

2013-01-01

The latest recommendations for building dynamic health behavior theories emphasize that cognitions, emotions, and behaviors – and the nature of their inter-relationships -- can change over time. This paper describes the development and psychometric validation of four scales created to measure smoking-related causal attributions, perceived illness severity, event-related emotions, and intention to quit smoking among patients experiencing acute cardiac symptoms. After completing qualitative work with a sample of 50 cardiac patients, we administered the scales to 300 patients presenting to the emergency department for cardiac-related symptoms. Factor analyses, alpha coefficients, ANOVAS, and Pearson correlation coefficients were used to establish the scales' reliability and validity. Factor analyses revealed a stable factor structures for each of the four constructs. The scales were internally consistent, with the majority having an alpha of >0.80 (range: 0.57 to 0.89). Mean differences in ratings of the perceived illness severity and event-related emotions were noted across the three time anchors. Significant increases in intention to quit at the time of enrollment, compared to retrospective ratings of intention to quit before the event, provide preliminary support for the sensitivity of this measure to the motivating impact of the event. Finally, smoking-related causal attributions, perceived illness severity, and event-related emotions correlated in the expected directions with intention to quit smoking, providing preliminary support for construct validity. PMID:22970703

Clinical Functional Capacity Testing in Patients With Facioscapulohumeral Muscular Dystrophy: Construct Validity and Interrater Reliability of Antigravity Tests.

PubMed

Rijken, Noortje H; van Engelen, Baziel G; Weerdesteyn, Vivian; Geurts, Alexander C

2015-12-01

To evaluate the construct validity and interrater reliability of 4 simple antigravity tests in a small group of patients with facioscapulohumeral muscular dystrophy (FSHD). Case-control study. University medical center. Patients with various severity levels of FSHD (n=9) and healthy control subjects (n=10) were included (N=19). Not applicable. A 4-point ordinal scale was designed to grade performance on the following 4 antigravity tests: sit to stance, stance to sit, step up, and step down. In addition, the 6-minute walk test, 10-m walking test, Berg Balance Scale, and timed Up and Go test were administered as conventional tests. Construct validity was determined by linear regression analysis using the Clinical Severity Score (CSS) as the dependent variable. Interrater agreement was tested using a κ analysis. Patients with FSHD performed worse on all 4 antigravity tests compared with the controls. Stronger correlations were found within than between test categories (antigravity vs conventional). The antigravity tests revealed the highest explained variance with regard to the CSS (R(2)=.86, P=.014). Interrater agreement was generally good. The results of this exploratory study support the construct validity and interrater reliability of the proposed antigravity tests for the assessment of functional capacity in patients with FSHD taking into account the use of compensatory strategies. Future research should further validate these results in a larger sample of patients with FSHD. Copyright © 2015 American Congress of Rehabilitation Medicine. Published by Elsevier Inc. All rights reserved.

The FACIT-Sp spiritual well-being scale: an investigation of the dimensionality, reliability and construct validity in a cognitively intact nursing home population.

PubMed

Haugan, Gørill

2015-03-01

Spiritual well-being has been found to be a strong individual predictor of overall nursing home satisfaction and a fundamental dimension of global as well as health-related quality-in-life among nursing home patients. Therefore, access to a valid and reliable measure of spiritual well-being among nursing home patients is highly warranted. The aim of this study was to investigate the dimensionality, reliability and construct validity of the Functional Assessment of Chronic Illness Therapy Spiritual Wellbeing scale in a cognitively intact nursing home population. A cross-sectional design was applied, selecting two counties in central Norway from which 20 municipalities representing 44 different nursing homes took part in this study. Long-term care was defined as 24-hour care with duration of 6 months or longer. Participants were 202 cognitively intact long-term nursing home patients fulfilling the inclusion criteria. Approval by all regulatory institutions dealing with research issues in Norway and the Management Unit at the 44 nursing homes was obtained. Explorative and confirmative factor analyses as well as correlation with selected construct were used. Though three items loaded very low (λ = 0.22, 0.26, 0.32) indicating low reliability, the three-factor model for the FACIT-Sp spiritual well-being scale provided an acceptable fit (χ(2) = 101.15 (df = 50), p-value <0.001, RMSEA = 0.075 p = 0.030, NFI = 0.90, GFI = 0.91, AGFI = 0.85) for older nursing home patients, demonstrating acceptable measurement reliability. Construct validity was supported by significant correlations in the hypothesised direction with the selected constructs. The three-factor model is an improvement over the original two-factor construct, based on these nursing home data. The measure yielded significantly factor loadings, good composite reliability and construct validity. © 2014 Nordic College of Caring Science.

Validation of the Social Provisions Scale in people with multiple sclerosis.

PubMed

Chiu, Chung-Yi; Motl, Robert W; Ditchman, Nicole

2016-08-01

This study examined the factorial and construct validity of the Social Provisions Scale (SPS) in a sample of people with multiple sclerosis (MS). Participants included 292 individuals with MS (83.9% women) recruited from the Greater Illinois, Gateway, and Indiana chapters of the National Multiple Sclerosis Society. Participants completed the SPS and pain, fatigue, depression, anxiety, MS self-efficacy, quality of life, and satisfaction with life measures. Factorial validity was tested using confirmatory factor analysis (CFA), and construct validity was examined based on the strength of bivariate correlations with scores on related measures. Findings from the CFA indicated that a first-order, 6-factor measurement model provided a good fit for the 24 items of the SPS (CFI = .94, TLI = .93, RMSEA = 0.07) and that the 6 factors could be described by a single, second-order factor of the overall social provisions (CFI = .93, TLI = .92, RMSEA = 0.08). Cronbach's alpha was .89 for the global score and between .66 and .81 for the 6 subscales. The SPS global and subscale scores correlated significantly with satisfaction with life, depression, anxiety, MS self-efficacy, and quality of life measures. Findings from this study support the factorial validity, construct validity, and reliability of the SPS as a measure of social provisions for use with people with MS. (PsycINFO Database Record (c) 2016 APA, all rights reserved).

Children's Autonomy and Perceived Control in Learning: A Model of Motivation and Achievement in Taiwan.

ERIC Educational Resources Information Center

d'Ailly, Hsiao

2003-01-01

Tests a model of motivation and achievement with data from 50 teachers and 806 Grade 4-6 students in Taiwan. Autonomy as a construct was shown to have ecological validity in Chinese children. The proposed model fit the data well, showing that maternal involvement and autonomy support, as well as teachers' autonomy support, are important for…

Assessing Online Textual Feedback to Support Student Intrinsic Motivation Using a Collaborative Text-Based Dialogue System: A Qualitative Study

ERIC Educational Resources Information Center

Shroff, Ronnie H.; Deneen, Christopher

2011-01-01

This paper assesses textual feedback to support student intrinsic motivation using a collaborative text-based dialogue system. A research model is presented based on research into intrinsic motivation, and the specific construct of feedback provides a framework for the model. A qualitative research methodology is used to validate the model.…

Rasch Calibration of Physical Activity Self-Efficacy and Social Support Scale for Persons with Intellectual Disabilities

ERIC Educational Resources Information Center

Lee, Miyoung; Peterson, Jana J.; Dixon, Alicia

2010-01-01

The purpose of this study was to investigate the construct validity of the Self-Efficacy/Social Support for Activity for persons with Intellectual Disability (SE/SS-AID) scales developed by Peterson, Peterson, Lowe, & Nothwehr (2009). A total of 146 participants with intellectual disabilities completed 6 self-efficacy (SE) items and 18 social…

Trauma Coping Self-Efficacy: A Context Specific Self-Efficacy Measure for Traumatic Stress

PubMed Central

Benight, Charles C.; Shoji, Kotaro; James, Lori E.; Waldrep, Edward E.; Delahanty, Douglas L.; Cieslak, Roman

2015-01-01

The psychometric properties of a Trauma Coping Self-Efficacy (CSE-T) scale that assesses general trauma-related coping self-efficacy perceptions were assessed. Measurement equivalence was assessed using several different samples: hospitalized trauma patients (n1 = 74, n2 = 69, n3 = 60), three samples of disaster survivors (n1 = 273, n2 = 227, n3 = 138), and trauma exposed college students (N = 242). This is the first multi-sample evaluation of the psychometric properties for a general trauma-related CSE measure. Results showed that a brief and parsimonious 9-item version of the CSE performed well across the samples with a robust factor structure; factor structure and factor loadings were similar across study samples. The 9-item scale CSE-T demonstrated measurement equivalence across samples indicating that the underlying concept of general post-traumatic CSE is organized in a similar manner in the different trauma-exposed groups. These results offer strong support for cross-event construct validity of the CSE-T scale. Associations of the CSE-T with important expected covariates showed significant evidence for convergent validity. Finally, discriminant validity was also supported. Replication of the factor structure, internal reliability, and other evidence for construct validity is a critical next step for future research. PMID:26524542

Psychometrics of the scale of attitudes toward physician-pharmacist collaboration: a study with medical students.

PubMed

Hojat, Mohammadreza; Spandorfer, John; Isenberg, Gerald A; Vergare, Michael J; Fassihi, Reza; Gonnella, Joseph S

2012-01-01

Despite the emphasis placed on interdisciplinary education and interprofessional collaboration between physicians and pharmacologists, no psychometrically sound instrument is available to measure attitudes toward collaborative relationships. This study was designed to examine psychometrics of an instrument for measuring attitudes toward physician-pharmacist collaborative relationships for administration to students in medical and pharmacy schools and to physicians and pharmacists. The Scale of Attitudes Toward Physician-Pharmacist Collaboration was completed by 210 students at Jefferson Medical College. Factor analysis and correlational methods were used to examine psychometrics of the instrument. Consistent with the conceptual framework of interprofessional collaboration, three underlying constructs, namely "responsibility and accountability;" "shared authority;" and "interdisciplinary education" emerged from the factor analysis of the instrument providing support for its construct validity. The reliability coefficient alpha for the instrument was 0.90. The instrument's criterion-related validity coefficient with scores of a validated instrument (Jefferson Scale of Attitudes Toward Physician-Nurse Collaboration) was 0.70. Findings provide support for the validity and reliability of the instrument for medical students. The instrument has the potential to be used for the evaluation of interdisciplinary education in medical and pharmacy schools, and for the evaluation of patient outcomes resulting from collaborative physician-pharmacist relationships.

Validity evidence for the adaptation of the State Mindfulness Scale for Physical Activity (SMS-PA) in Spanish youth.

PubMed

Ullrich-French, Sarah; González Hernández, Juan; Hidalgo Montesinos, María D

2017-02-01

Mindfulness is an increasingly popular construct with promise in enhancing multiple positive health outcomes. Physical activity is an important behavior for enhancing overall health, but no Spanish language scale exists to test how mindfulness during physical activity may facilitate physical activity motivation or behavior. This study examined the validity of a Spanish adaption of a new scale, the State Mindfulness Scale for Physical Activity, to assess mindfulness during a specific experience of physical activity. Spanish youths (N = 502) completed a cross-sectional survey of state mindfulness during physical activity and physical activity motivation regulations based on Self-Determination Theory. A high-order model fit the data well and supports the use of one general state mindfulness factor or the use of separate subscales of mindfulness of mental (e.g., thoughts, emotions) and body (physical movement, muscles) aspects of the experience. Internal consistency reliability was good for the general scale and both sub-scales. The pattern of correlations with motivation regulations provides further support for construct validity with significant and positive correlations with self-determined forms of motivation and significant and negative correlations with external regulation and amotivation. Initial validity evidence is promising for the use of the adapted measure.

The Environmental Reward Observation Scale (EROS): development, validity, and reliability.

PubMed

Armento, Maria E A; Hopko, Derek R

2007-06-01

Researchers acknowledge a strong association between the frequency and duration of environmental reward and affective mood states, particularly in relation to the etiology, assessment, and treatment of depression. Given behavioral theories that outline environmental reward as a strong mediator of affect and the unavailability of an efficient, reliable, and valid self-report measure of environmental reward, we developed the Environmental Reward Observation Scale (EROS) and examined its psychometric properties. In Experiment 1, exploratory factor analysis supported a unidimensional 10-item measure with strong internal consistency and test-retest reliability. When administered to a replication sample, confirmatory factor analysis suggested an excellent fit to the 1-factor model and convergent/discriminant validity data supported the construct validity of the EROS. In Experiment 2, further support for the convergent validity of the EROS was obtained via moderate correlations with the Pleasant Events Schedule (PES; MacPhillamy & Lewinsohn, 1976). In Experiment 3, hierarchical regression supported the ecological validity of the EROS toward predicting daily diary reports of time spent in highly rewarding behaviors and activities. Above and beyond variance accounted for by depressive symptoms (BDI), the EROS was associated with significant incremental variance in accounting for time spent in both low and high reward behaviors. The EROS may represent a brief, reliable and valid measure of environmental reward that may improve the psychological assessment of negative mood states such as clinical depression.

Support Vector Data Description Model to Map Specific Land Cover with Optimal Parameters Determined from a Window-Based Validation Set.

PubMed

Zhang, Jinshui; Yuan, Zhoumiqi; Shuai, Guanyuan; Pan, Yaozhong; Zhu, Xiufang

2017-04-26

This paper developed an approach, the window-based validation set for support vector data description (WVS-SVDD), to determine optimal parameters for support vector data description (SVDD) model to map specific land cover by integrating training and window-based validation sets. Compared to the conventional approach where the validation set included target and outlier pixels selected visually and randomly, the validation set derived from WVS-SVDD constructed a tightened hypersphere because of the compact constraint by the outlier pixels which were located neighboring to the target class in the spectral feature space. The overall accuracies for wheat and bare land achieved were as high as 89.25% and 83.65%, respectively. However, target class was underestimated because the validation set covers only a small fraction of the heterogeneous spectra of the target class. The different window sizes were then tested to acquire more wheat pixels for validation set. The results showed that classification accuracy increased with the increasing window size and the overall accuracies were higher than 88% at all window size scales. Moreover, WVS-SVDD showed much less sensitivity to the untrained classes than the multi-class support vector machine (SVM) method. Therefore, the developed method showed its merits using the optimal parameters, tradeoff coefficient ( C ) and kernel width ( s ), in mapping homogeneous specific land cover.

[Reliability and validity studies of Turkish translation of Eysenck Personality Questionnaire Revised-Abbreviated].

PubMed

Karanci, A Nuray; Dirik, Gülay; Yorulmaz, Orçun

2007-01-01

The aim of the present study was to examine the reliability and the validity of the Turkish translation of the Eysneck Personality Questionnaire Revised-abbreviated Form (EPQR-A) (Francis et al., 1992), which consists of 24 items that assess neuroticism, extraversion, psychoticism, and lying. The questionnaire was first translated into Turkish and then back translated. Subsequently, it was administered to 756 students from 4 different universities. The Fear Survey Inventory-III (FSI-III), Rosenberg Self-Esteem Scales (RSES), and Egna Minnen Betraffande Uppfostran (EMBU-C) were also administered in order to assess the questionnaire's validity. The internal consistency, test-retest reliability, and validity were subsequently evaluated. Factor analysis, similar to the original scale, yielded 4 factors; the neuroticism, extraversion, psychoticism, and lie scales. Kuder-Richardson alpha coefficients for the extraversion, neuroticism, psychoticism, and lie scales were 0.78, 0.65, 0.42, and 0.64, respectively, and the test-retest reliability of the scales was 0.84, 0.82, 0.69, and 0.69, respectively. The relationships between EPQR-A-48, FSI-III, EMBU-C, and RSES were examined in order to evaluate the construct validity of the scale. Our findings support the construct validity of the questionnaire. To investigate gender differences in scores on the subscales, MANOVA was conducted. The results indicated that there was a gender difference only in the lie scale scores. Our findings largely supported the reliability and validity of the questionnaire in a Turkish student sample. The psychometric characteristics of the Turkish version of the EPQR-A were discussed in light of the relevant literature.

A measure of smoking abstinence-related motivational engagement: Development and initial validation

PubMed Central

Heckman, Bryan W.; Ditre, Joseph W.; Brandon, Thomas H.

2010-01-01

Introduction: Although a great deal of research has focused on measuring motivation and readiness to quit smoking, little research has assessed gross motivational changes after a smoker has made an attempt to quit smoking. Unlike previous single-item global measures of motivation to remain abstinent, we developed the abstinence-related motivational engagement (ARME) scale to evaluate the degree to which abstinence motivation is reflected by an ex-smoker’s daily experience in areas that include cognitive effort, priority, vigilance, and excitement. The aim of this study was to collect reliability and initial construct validity data on this new measure. Methods: Participants were 199 ex-smokers recruited from the community and smoking cessation Web sites. Participants completed online measures including a global motivation measure, the ARME scale, demographic questionnaire, and a measure of cessation self-efficacy. Results: The 16-item ARME questionnaire demonstrated high internal consistency reliability (α = .89). Analyses provided support for convergent, discriminant, and construct validity of the scale. ARME demonstrated the predicted correlation with a traditional measure of global cessation motivation, yet, also as predicted, only the ARME was negatively associated with length of abstinence. Moreover, as hypothesized, ex-smokers engaged in the quitting process via ongoing smoking Web site participation showed higher ARME scores than a comparison community sample. A five-item short form demonstrated similar psychometric properties. Discussion: This study provided initial support for the ARME construct and offers two versions of a reliable instrument for assessing this construct. Future research will examine the ARME as a predictor of cessation outcome and a potential target for relapse prevention. PMID:20190004

A measure of smoking abstinence-related motivational engagement: development and initial validation.

PubMed

Simmons, Vani N; Heckman, Bryan W; Ditre, Joseph W; Brandon, Thomas H

2010-04-01

Although a great deal of research has focused on measuring motivation and readiness to quit smoking, little research has assessed gross motivational changes after a smoker has made an attempt to quit smoking. Unlike previous single-item global measures of motivation to remain abstinent, we developed the abstinence-related motivational engagement (ARME) scale to evaluate the degree to which abstinence motivation is reflected by an ex-smoker's daily experience in areas that include cognitive effort, priority, vigilance, and excitement. The aim of this study was to collect reliability and initial construct validity data on this new measure. Participants were 199 ex-smokers recruited from the community and smoking cessation Web sites. Participants completed online measures including a global motivation measure, the ARME scale, demographic questionnaire, and a measure of cessation self-efficacy. The 16-item ARME questionnaire demonstrated high internal consistency reliability (alpha = .89). Analyses provided support for convergent, discriminant, and construct validity of the scale. ARME demonstrated the predicted correlation with a traditional measure of global cessation motivation, yet, also as predicted, only the ARME was negatively associated with length of abstinence. Moreover, as hypothesized, ex-smokers engaged in the quitting process via ongoing smoking Web site participation showed higher ARME scores than a comparison community sample. A five-item short form demonstrated similar psychometric properties. This study provided initial support for the ARME construct and offers two versions of a reliable instrument for assessing this construct. Future research will examine the ARME as a predictor of cessation outcome and a potential target for relapse prevention.

Development and psychometric properties of a self-regulation scale about leisure time physical activity in Iranian male adolescents.

PubMed

Abasi, Mohammad Hadi; Eslami, Ahmad Ali; Rakhshani, Fatemeh; Shiri, Mansoor

2016-01-01

Self-regulation is one of the current psychological concepts that have been known as a determinant of leisure time physical activity. Due to cultural and social diversity in different societies and age groups, application of specific questionnaires is essential to perform investigations about physical activities. The aim of this study is development and evaluation of psychometric properties of a self-regulation questionnaire about leisure time physical activity in Iranian male adolescents. This cross-sectional study was conducted in 2013, and data of 603 male students from 12 high schools in Isfahan were collected. A comprehensive literature review and similar questionnaire review were conducted and 25 items were selected or developed to measure self-regulation. Comprehensibility of items was evaluated in a pilot study and an expert panel evaluated face and content validity. Exploratory factors analysis (EFA) was used for evaluation of construct validity and extraction of sub-constructs of self-regulation. Leisure time physical activity was assessed using International Physical Activity Questionnaire (IPAQ). The mean age of the participants was 16.3 years (SD =1.0) and the range was 15-19 years. Cronbach's α coefficient of the questionnaire in the pilot and main study was 0.84 and 0.90, respectively. EFA resulted in four sub-constructs including "enlistment of social support", "goal setting", "self-construction", and "self-monitoring", which explained 63.6% of the variance of self-regulation. Results of this investigation provide some support to the validity and reliability of the 16-item questionnaire of self-regulation abut leisure time physical activity in the target group.

Standardization of the Hare Psychopathy Checklist-Revised in a Spanish prison sample.

PubMed

Moltó, J; Poy, R; Torrubia, R

2000-01-01

This investigation examined the reliability, validity, and factor structure of the Hare Psychopathy Checklist-Revised (PCL-R) in male adult Spanish prison populations (n = 117). The interrater reliability and internal consistency coefficients were high, and similar to those obtained in other countries. This data provides support for the homogeneity and unidimensionality of the psychopathy construct in Spanish male prison samples. The analysis of factor structure also replicated the two factor solution of previous studies. The two factors showed different patterns of intercorrelations with several self-report measures of personality, demographic, and criminal history variables, which confirmed the construct validity of PCL-R. The results confirm the psychometric properties of the PCL-R as a measure of psychopathy in Spanish male inmates, and suggest that psychopathy is a construct also observed in Southern European countries.

Adapting the Facilitating Conditions Questionnaire (FCQ) for Bilingual Filipino Adolescents: Validating English and Filipino Versions.

PubMed

Ganotice, Fraide A; Bernardo, Allan B I; King, Ronnel B

2013-06-01

This study examined the applicability of the English and Filipino versions of the Facilitating Conditions Questionnaire (FCQ) among Filipino high school students. The FCQ measures the external forces in students' social environments that can influence their motivation for school. It is composed of 11 factors: university intention, school valuing, parent support, teacher support, peer help, leave school, pride from others, negative parent influence, affect to school, negative peer influence, and positive peer influence. It was translated into conversational Filipino. Seven hundred sixty-five high school students answered one of the two language versions. Both within-network and between-network approaches to construct validation were used. Confirmatory factor analyses (CFA) of the two versions showed good fit. Results of the multigroup CFA indicated that there was invariance in terms of factor loadings for the two versions. Results of the between-network test also showed that the factors in the FCQ correlated systematically with theoretically relevant constructs. Taken together, this study supports the applicability of the FCQ for use with Filipino bilingual adolescents.

Utilization of the supports intensity scale with psychiatric populations: psychometric properties and utility for service delivery planning.

PubMed

Jenaro, Cristina; Cruz, Maribel; Perez, María Del Carmen; Flores, Noelia E; Vega, Vanessa

2011-10-01

In agreement with the new paradigm of supports, this study examines the adequacy and psychometric properties of the Supports Intensity Scale (SIS) in a sample of 182 participants with severe mental illness (mean Global Assessment of Functioning [GAF] score = 60.2). The measure focuses on identifying the profile and intensities of support needs and on the planning and service delivery rather than on weaknesses and limitations. Internal consistency indexes ranged from .83 to .97; interrater reliability indexes ranged from .67 to .98. Intercorrelations among SIS subscales supported its construct validity. SIS scores correlated to GAF scores and length of disease. Discriminant analysis correctly classified 60.9% of participants. Therefore, the SIS demonstrated adequate reliability and validity, and it can be used by nursing professionals to plan for required supports in this population. Copyright © 2011 Elsevier Inc. All rights reserved.

Validation of the Mobile Information Software Evaluation Tool (MISET) With Nursing Students.

PubMed

Secco, M Loretta; Furlong, Karen E; Doyle, Glynda; Bailey, Judy

2016-07-01

This study evaluated the Mobile Information Software Evaluation Tool (MISET) with a sample of Canadian undergraduate nursing students (N = 240). Psychometric analyses determined how well the MISET assessed the extent that nursing students find mobile device-based information resources useful and supportive of learning in the clinical and classroom settings. The MISET has a valid three-factor structure with high explained variance (74.7%). Internal consistency reliabilities were high for the MISET total (.90) and three subscales: Usefulness/Helpfulness, Information Literacy Support, and Use of Evidence-Based Sources (.87 to .94). Construct validity evidence included significantly higher mean total MISET, Helpfulness/Usefulness, and Information Literacy Support scores for senior students and those with higher computer competence. The MISET is a promising tool to evaluate mobile information technologies and information literacy support; however, longitudinal assessment of changes in scores over time would determine scale sensitivity and responsiveness. [J Nurs Educ. 2016;55(7):385-390.]. Copyright 2016, SLACK Incorporated.

Social support network typologies and health outcomes of older people in low and middle income countries--a 10/66 Dementia Research Group population-based study.

PubMed

Thiyagarajan, Jotheeswaran A; Prince, Martin; Webber, Martin

2014-08-01

This study aims to assess the construct validity of the Wenger social support network typology in low and middle income countries. We hypothesize that, in comparison with the integrated network type, the non-integrated network type is associated with loneliness, depression, poor quality of life (less happiness), poor self-reported health, increased disability and higher care needs. Cross-sectional one-phase surveys were conducted of all residents aged 65 and over in catchment areas in eight low and middle income countries (India, China, Cuba, Dominican Republic, Venezuela, Mexico, Peru and Puerto Rico). Wenger's Practitioner Assessment of Network Type (PANT) was used to measure social network type. Family dependent, local self-contained, wider community-focused and private restricted network types were considered non-integrated, in comparison to the locally integrated network type. Overall, 17,031 participants were interviewed. Family dependent and locally integrated network types were the most prevalent. Adjusted pooled estimates across sites showed that loneliness, depression, less happiness, poor health, disability, and need for care were significantly associated with non-integrated network type. The findings of this study support the construct validity of Wenger's network typology in low and middle income countries. However, further research is required to test the criterion validity of Wenger typology using longitudinal data. Identifying older people who are vulnerable could inform the development of social care interventions to support older people and their families in the context of deteriorating health.

Psychometric properties of the Itch Numeric Rating Scale in patients with moderate-to-severe plaque psoriasis.

PubMed

Kimball, A B; Naegeli, A N; Edson-Heredia, E; Lin, C-Y; Gaich, C; Nikaï, E; Wyrwich, K; Yosipovitch, G

2016-07-01

Itching is a profoundly distressing symptom for many patients with psoriasis, but it has not been rigorously studied using validated tools for this condition. This study investigated the psychometric properties of the Itch Numeric Rating Scale (Itch NRS), a single-item patient-reported outcome (PRO) measuring the worst itching severity due to psoriasis in the past 24 h. Using disease-specific clinician-rated and PRO data from one phase II and three phase III randomized clinical studies of subjects with moderate-to-severe plaque psoriasis, the Itch NRS was evaluated for test-retest reliability, construct validity and responsiveness. A responder definition was explored using anchor- and distribution-based methods. Test-retest reliability analyses supported the reproducibility of the measure (intraclass correlation coefficient range 0·71-0·74). To support the construct validity of the Itch NRS, large cross-sectional correlations with the Dermatology Life Quality Index (DLQI) Symptoms and Feelings domain (r ≥ 0·60 at baseline and r ≥ 0·80 at week 12) supported a priori hypotheses, while large correlations (r ≥ 0·71) between changes in Itch NRS scores and changes in DLQI Symptoms and Feelings domain scores from baseline to week 12 established responsiveness. A 4-point change was optimal for demonstrating a level of clinically meaningful improvement in itch severity after 12 weeks of treatment, which corresponds with marked clinical improvements in plaque psoriasis. The Itch NRS demonstrated sufficient reliability, validity and responsiveness, and appropriate interpretation standards for evaluating change over time in itch severity among patients with moderate-to-severe plaque psoriasis when validated using clinical trial data for this condition. © 2016 The Authors. British Journal of Dermatology published by John Wiley & Sons Ltd on behalf of British Association of Dermatologists.

Development and evaluation of the Expressions of Moral Injury Scale-Military Version.

PubMed

Currier, Joseph M; Farnsworth, Jacob K; Drescher, Kent D; McDermott, Ryon C; Sims, Brook M; Albright, David L

2018-05-01

There is consensus that military personnel can encounter a far more diverse set of challenges than researchers and clinicians have historically appreciated. Moral injury (MI) represents an emerging construct to capture behavioural, social, and spiritual suffering that may transcend and overlap with mental health diagnoses (e.g., post-traumatic stress disorder and major depressive disorder). The Expressions of Moral Injury Scale-Military Version (EMIS-M) was developed to provide a reliable and valid means for assessing the warning signs of a MI in military populations. Drawing on independent samples of veterans who had served in a war-zone environment, factor analytic results revealed 2 distinct factors related to MI expressions directed at both self (9 items) and others (8 items). These subscales generated excellent internal consistency and temporal stability over a 6-month period. When compared to measures of post-traumatic stress disorder, major depressive disorder, and other theoretically relevant constructs (e.g., forgiveness, social support, moral emotions, and combat exposure), EMIS-M scores demonstrated strong convergent, divergent, and incremental validity. In addition, although structural equation modelling findings supported a possible general MI factor in Study 2, the patterns of associations for self- and other-directed expressions yielded evidence for differential validity with varying forms of forgiveness and combat exposure. As such, the EMIS-M provides a face valid, psychometrically validated tool for assessing expressions of apparent MI subtypes in research and clinical settings. Looking ahead, the EMIS-M will hopefully advance the scientific understanding of MI while supporting innovation for clinicians to tailor evidence-based treatments and/or develop novel approaches for addressing MI in their work. Copyright © 2017 John Wiley & Sons, Ltd.

Ultrasound is a reproducible and valid tool for measuring scar height in children with burn scars: A cross-sectional study of the psychometric properties and utility of the ultrasound and 3D camera.

PubMed

Simons, M; Kee, E Gee; Kimble, R; Tyack, Z

2017-08-01

The aim of this study was to investigate the reproducibility and validity of measuring scar height in children using ultrasound and 3D camera. Using a cross-sectional design, children with discrete burn scars were included. Reproducibility was tested using Intraclass Correlation Coefficient (ICC) for reliability, and percentage agreement within 1mm between test and re-test, standard error of measurement (SEM), smallest detectable change (SDC) and Bland Altman limits of agreement for agreement. Concurrent validity was tested using Spearman's rho for support of pre-specified hypotheses. Forty-nine participants (55 scars) were included. For ultrasound, test-retest and inter-rater reproducibility of scar thickness was acceptable for scarred skin (ICC=0.95, SDC=0.06cm and ICC=0.82, SDC=0.14cm). The ultrasound picked up changes of <1mm. Inter-rater reproducibility of maximal scar height using the 3D camera was acceptable (ICC=0.73, SDC=0.55cm). Construct validity of the ultrasound was supported with a strong correlation between the measure of scar thickness and observer ratings of thickness using the POSAS (ρ=0.61). Construct validity of the 3D camera was also supported with a moderate correlation (ρ=0.37) with the same measure using maximal scar height. The ultrasound is capable of detecting smaller changes or differences in scar thickness than the 3D camera, in children with burn scars. However agreement as part of reproducibility was lower than expected between raters for the ultrasound. Improving the accuracy of scar relocation may go some way to address agreement. Crown Copyright © 2017. Published by Elsevier Ltd. All rights reserved.

Supportive care needs of Mexican adult cancer patients: validation of the Mexican version of the Short-Form Supportive Care Needs Questionnaire (SCNS-SFM).

PubMed

Doubova, Svetlana V; Aguirre-Hernandez, Rebeca; Gutiérrez-de la Barrera, Marcos; Infante-Castañeda, Claudia; Pérez-Cuevas, Ricardo

2015-09-01

The purpose of this study is to validate the Mexican version of the Short-Form Supportive Care Needs survey (SCNS-SFM). A cross-sectional survey was conducted from June to December 2013 at the Oncology Hospital of the Mexican Institute of Social Security in Mexico City. The study included 825 subsequent cancer patients >20 years of age with all forms of solid cancer. Patients had prior surgical removal of histologically confirmed cancer and attended outpatient consultations. Validation of SCNS-SFM included the following: (1) content validity through a group of experts; (2) construct validity through an exploratory factor analysis based on the polychoric correlation matrix; (3) internal consistency using Cronbach's alpha; (4) convergent validity between SCNS-SFM and quality of life, anxiety, and depression scales by calculating Pearson's correlation coefficient; (5) discriminative validity through analysis of MANOVAs; and (6) test-retest reliability using intraclass correlation coefficient calculations. SCNS-SFM has 33 items with five factors accounting for 59 % of total variance. Cronbach's alpha values ranged from 0.78 to 0.90 among factors. SCNS-SFM has good convergent validity compared with quality of life and depression and anxiety scales and good discriminative validity, revealing great information, psychological support, and physical daily living needs for women, patients <60 years, and high physical daily living needs for those with <1 year since cancer diagnosis, with advanced disease stages and current chemo- or radiotherapy. Intraclass correlation coefficient between SCNS-SFM measurements was 0.9. SCNS-SFM has acceptable psychometric properties and is suitable to evaluate supportive care needs of cancer patients.

Psychometric properties of the medical outcomes study: social support survey among methadone maintenance patients in Ho Chi Minh City, Vietnam: a validation study.

PubMed

Khuong, Long Quynh; Vu, Tuong-Vi Thi; Huynh, Van-Anh Ngoc; Thai, Truc Thanh

2018-02-14

Social support plays a crucial role in the treatment and recovery process of patients engaging in methadone maintenance treatment (MMT). However, there is a paucity of research about social support among MMT patients, possibly due to a lack of appropriate measuring tools. This study aimed to evaluate the psychometric properties of the Vietnamese version of the Medical Outcomes Study: Social Support Survey (MOS-SSS) among MMT patients. A cross-sectional survey of 300 patients was conducted in a methadone clinic in Ho Chi Minh City, Vietnam. MMT patients who agreed to participate in the study completed a face-to-face interview in a private room. The MOS-SSS was translated into Vietnamese using standard forward-backward process. Internal consistency was measured by Cronbach's alpha. The intra-class correlation coefficient was used to determine the test-retest reliability of the MOS-SSS in 75 participants two weeks after the first survey. Concurrent validity of the MOS-SSS was evaluated by correlations with the Multidimensional Scale of Perceived Social Support (MSPSS) and the Perceived Stigma of Addiction Scale (PSAS). Construct validity was investigated by confirmatory factor analysis. The MOS-SSS had good internal consistency with Cronbach's alpha from 0.95 to 0.97 for the four subscales and 0.97 for the overall scale. The two-week test-retest reliability was at moderate level with intra-class correlation coefficients of 0.61-0.73 for the four subscales and 0.76 for the overall scale. Strong significant correlations between the MOS-SSS and the MSPSS (r = 0.77; p < 0.001) and the PSAS (r = - 0.76; p < 0.001) indicated good concurrent validity. Construct validity of the MOS-SSS was established since a final four-factor model fitted the data well with Comparative Fit Index (0.97), Tucker-Lewis Index (0.97), Standardized Root Mean Square Residual (0.03) and Root Mean Square Error of Approximation (0.068; 90% CI = 0.059-0.077). The MOS-SSS is a reliable and valid tool for measuring social support in Vietnamese MMT patients. Further studies among methadone patients at different stages of their treatment and among those from different areas of Vietnam are needed.

Develop nondestructive rapid pavement quality assurance/quality control evaluation test methods and supporting technology : project summary.

DOT National Transportation Integrated Search

2017-01-01

The findings from the proof of concept with mechanics-based models for flexible base suggest additional validation work should be performed, draft construction specification frameworks should be developed, and work extending the technology to stabili...

Develop nondestructive rapid pavement quality Assurance/quality control evaluation test methods and supporting technology : project summary.

DOT National Transportation Integrated Search

2017-01-01

The findings from the proof of concept with mechanics-based models for flexible base suggest additional validation work should be performed, draft construction specification frameworks should be developed, and work extending the technology to stabili...

Validity of the AUDIT-C screen for at-risk drinking among students utilizing university primary care.

PubMed

Campbell, Clare E; Maisto, Stephen A

2018-03-22

Research is needed to establish the psychometric properties of brief screens in university primary care settings. This study aimed to assess the construct validity of one such screen, the Alcohol Use Disorders Identification Test-Consumption (AUDIT-C), for detecting at-risk drinking among students who have utilized on-campus primary care. 389 students recently seen in university primary care completed a confidential online survey in December 2014. Bivariate correlations between the AUDIT-C and measures of alcohol consumption and negative drinking consequences provided concurrent evidence for construct validity. Receiver Operating Characteristic curve analyses determined optimal cut-off scores for at-risk drinking. The AUDIT-C significantly correlated with measures of alcohol consumption and negative drinking consequences (p < .001). Analyses support optimal AUDIT-C cut-off scores of 5 for females and 7 for males. The AUDIT-C is a valid screen for at-risk drinking among students who utilize university primary care.

Validation of the AVM Blast Computational Modeling and Simulation Tool Set

DTIC Science & Technology

2015-08-04

by-construction" methodology is powerful and would not be possible without high -level design languages to support validation and verification. [1,4...to enable the making of informed design decisions.  Enable rapid exploration of the design trade-space for high -fidelity requirements tradeoffs...live-fire tests, the jump height of the target structure is recorded by using either high speed cameras or a string pot. A simple projectile motion

Reliability and Validity of the Korean Version of the Cancer Stigma Scale.

PubMed

So, Hyang Sook; Chae, Myeong Jeong; Kim, Hye Young

2017-02-01

In this study the reliability and validity of the Korean version of the Cancer Stigma Scale (KCSS) was evaluated. The KCSS was formed through translation and modification of Cataldo Lung Cancer Stigma Scale. The KCSS, Psychological Symptom Inventory (PSI), and European Organization for Research and Treatment of Cancer Quality of Life Questionnaire - Core 30 (EORTC QLQ-C30) were administered to 247 men and women diagnosed with one of the five major cancers. Construct validity, item convergent and discriminant validity, concurrent validity, known-group validity, and internal consistency reliability of the KCSS were evaluated. Exploratory factor analysis supported the construct validity with a six-factor solution; that explained 65.7% of the total variance. The six-factor model was validated by confirmatory factor analysis (Q (χ²/df)= 2.28, GFI=.84, AGFI=.81, NFI=.80, TLI=.86, RMR=.03, and RMSEA=.07). Concurrent validity was demonstrated with the QLQ-C30 (global: r=-.44; functional: r=-.19; symptom: r=.42). The KCSS had known-group validity. Cronbach's alpha coefficient for the 24 items was .89. The results of this study suggest that the 24-item KCSS has relatively acceptable reliability and validity and can be used in clinical research to assess cancer stigma and its impacts on health-related quality of life in Korean cancer patients. © 2017 Korean Society of Nursing Science

Evaluating the Inter-Respondent (Consumer vs. Staff) Reliability and Construct Validity (SIS vs. Vineland) of the Supports Intensity Scale on a Dutch Sample

ERIC Educational Resources Information Center

Claes, C.; Van Hove, G.; van Loon, J.; Vandevelde, S.; Schalock, R. L.

2009-01-01

Background: Despite various reliability studies on the Supports Intensity Scale (SIS), to date there has not been an evaluation of the reliability of client vs. staff judgments. Such determination is important, given the increasing consumer-driven approach to services. Additionally, there has not been an evaluation of the instrument's construct…

Factor analysis methods and validity evidence: A systematic review of instrument development across the continuum of medical education

NASA Astrophysics Data System (ADS)

Wetzel, Angela Payne

Previous systematic reviews indicate a lack of reporting of reliability and validity evidence in subsets of the medical education literature. Psychology and general education reviews of factor analysis also indicate gaps between current and best practices; yet, a comprehensive review of exploratory factor analysis in instrument development across the continuum of medical education had not been previously identified. Therefore, the purpose for this study was critical review of instrument development articles employing exploratory factor or principal component analysis published in medical education (2006--2010) to describe and assess the reporting of methods and validity evidence based on the Standards for Educational and Psychological Testing and factor analysis best practices. Data extraction of 64 articles measuring a variety of constructs that have been published throughout the peer-reviewed medical education literature indicate significant errors in the translation of exploratory factor analysis best practices to current practice. Further, techniques for establishing validity evidence tend to derive from a limited scope of methods including reliability statistics to support internal structure and support for test content. Instruments reviewed for this study lacked supporting evidence based on relationships with other variables and response process, and evidence based on consequences of testing was not evident. Findings suggest a need for further professional development within the medical education researcher community related to (1) appropriate factor analysis methodology and reporting and (2) the importance of pursuing multiple sources of reliability and validity evidence to construct a well-supported argument for the inferences made from the instrument. Medical education researchers and educators should be cautious in adopting instruments from the literature and carefully review available evidence. Finally, editors and reviewers are encouraged to recognize this gap in best practices and subsequently to promote instrument development research that is more consistent through the peer-review process.

Rural Parents’ Perceived Stigma of Seeking Mental Health Services for their Children: Development and Evaluation of a New Instrument

PubMed Central

Williams, Stacey L.; Polaha, Jodi

2014-01-01

The purpose of this paper was to examine the validity of score interpretations of an instrument developed to measure parents’ perceptions of stigma about seeking mental health services for their children. The validity of the score interpretations of the instrument was tested in two studies. Study 1 examined confirmatory factor analysis (CFA) employing a split half approach, and construct and criterion validity using the entire sample of parents in rural Appalachia whose children were experiencing psychosocial concerns (N=347), while Study 2 further examined CFA, construct and criterion validity, as well as predictive validity of the scores on the new scale using a general sample of parents in rural Appalachia (N=184). Results of exploratory and confirmatory factor analyses revealed support for a two factor model of parents’ perceived stigma, which represented both self and public forms of stigma associated with seeking mental health services for their children, and correlated with existing measures of stigma and other psychosocial variables. Further, the new self and public stigma scale significantly predicted parents’ willingness to seek services for children. PMID:24749752

Observed Parenting Behavior with Teens: Measurement Invariance and Predictive Validity Across Race

PubMed Central

Skinner, Martie L.; MacKenzie, Elizabeth P.; Haggerty, Kevin P.; Hill, Karl G.; Roberson, Kendra C.

2011-01-01

Previous reports supporting measurement equality between European American and African American families have often focused on self-reported risk factors or observed parent behavior with young children. This study examines equality of measurement of observer ratings of parenting behavior with adolescents during structured tasks; mean levels of observed parenting; and predictive validity of teen self-reports of antisocial behaviors and beliefs using a sample of 163 African American and 168 European American families. Multiple-group confirmatory factor analyses supported measurement invariance across ethnic groups for 4 measures of observed parenting behavior: prosocial rewards, psychological costs, antisocial rewards, and problem solving. Some mean-level differences were found: African American parents exhibited lower levels of prosocial rewards, higher levels of psychological costs, and lower problem solving when compared to European Americans. No significant mean difference was found in rewards for antisocial behavior. Multigroup structural equation models suggested comparable relationships across race (predictive validity) between parenting constructs and youth antisocial constructs (i.e., drug initiation, positive drug attitudes, antisocial attitudes, problem behaviors) in all but one of the tested relationships. This study adds to existing evidence that family-based interventions targeting parenting behaviors can be generalized to African American families. PMID:21787057

Development and validation of the intuitive exercise scale.

PubMed

Reel, Justine J; Galli, Nick; Miyairi, Maya; Voelker, Dana; Greenleaf, Christy

2016-08-01

Up to 80% of individuals with eating disorders engage in dysfunctional exercise, which is characterized by exercising in excessive quantities often past the point of pain as well as compulsive feelings and negative affect when exercise is disrupted (Cook, Hausenblas, Crosby, Cao, & Wonderlich, 2015). Intuitive exercise involves an awareness of the senses while moving and attending to one's bodily cues for when to start and stop exercise, rather than feeling compelled to adhere to a rigid program (Reel, 2015). The purpose of this study was to design a measurement tool to evaluate the construct of intuitive exercise in research, treatment, and prevention settings. The 14-item Intuitive Exercise Scale (IEXS) was developed and validated in the current study with completed surveys from 518 female and male adult participants. Exploratory factor analysis was used to identify four latent constructs, including emotional exercise, exercise rigidity, body trust, and mindful exercise, which were supported via confirmatory factor analysis (CFI=0.96; SRMR=0.06). The IEXS demonstrated configural, metric, and scalar invariance across women and men. Correlations with measures of intuitive eating, exercise dependence, and exercise motivation supported convergent and discriminant validity. Published by Elsevier Ltd.

The Fear of Positive Evaluation Scale: assessing a proposed cognitive component of social anxiety.

PubMed

Weeks, Justin W; Heimberg, Richard G; Rodebaugh, Thomas L

2008-01-01

Cognitive-behavioral models propose that fear of negative evaluation is the core feature of social anxiety disorder. However, it may be that fear of evaluation in general is important in social anxiety, including fears of positive as well as negative evaluation. To test this hypothesis, we developed the Fear of Positive Evaluation Scale (FPES) and conducted analyses to examine the psychometric properties of the FPES, as well as test hypotheses regarding the construct of fear of positive evaluation (FPE). Responses from a large (n = 1711) undergraduate sample were utilized. The reliability, construct validity, and factorial validity of the FPES were examined; the distinction of FPE from fear of negative evaluation was evaluated utilizing confirmatory factor analysis; and the ability of FPE to predict social interaction anxiety above and beyond fear of negative evaluation was assessed. Results provide preliminary support for the psychometric properties of the FPES and the validity of the construct of FPE. The implications of FPE with respect to the study and treatment of social anxiety disorder are discussed.

Psychometrics of the Laffrey Health Conception Scale for adolescents.

PubMed

Yarcheski, Adela; Mahon, Noreen E; Yarcheski, Thomas J

2005-01-01

The purposes of this methodological study were to factor analyze the Laffrey Health Conception Scale (LHCS) and to assess construct validity of the instrument with early adolescents. The final sample consisted of 230 early adolescents, aged 12 to 14, who responded to instrument packets in classrooms in an urban middle school. Data obtained on the LHCS were subjected to principal components factor analysis with oblique rotation. A two-factor solution was accepted, which is consistent with early adolescents' conceptions of health. Factor I was labeled Wellness and Factor II was labeled Clinical Health. A higher order factor analysis yielded one factor with 26 items, labeled the LHCS for Early Adolescents. The 26-item LHCS had a coefficient alpha of .95. Construct validity was assessed by testing three theoretical propositions, which significantly linked health conception to social support, self-esteem, and positive health practices. The findings indicate that the LHCS is a reliable and valid measure of health conceptions in early adolescents. Results also offer flexibility to researchers interested in testing theory involving the constructs of the definition of health, wellness, and clinical health in early adolescents.

Motivators and barriers of a Healthy Lifestyle Scale: development and psychometric characteristics.

PubMed

Downes, Loureen

2008-01-01

Black individuals suffer disproportionately from diseases that are preventable by lifestyle choices. The purpose of this study was to test the internal consistency and construct validity of the newly devised instrument, Motivators and Barriers of a Healthy Lifestyle Scale (MABS). The MABS was administered to 109 community-dwelling, adult Blacks. Content validity was supported through review of the literature and the judgment of three content experts. Exploratory factor analysis supported the two dimensions, that is, motivators and barriers. The Cronbach's alphas for the motivators and barriers dimensions were .88 and .90, respectively. Results provide initial evidence that the MABS is a valid, internally consistent measure of factors that motivate or inhibit healthy lifestyle behaviors. Screening with the MABS could encourage more focused health promotion discussions between patients and practitioners.

Development and Validation of a Measure of Maladaptive Social-Evaluative Beliefs Characteristic of Social Anxiety Disorder in Youth: The Report of Youth Social Cognitions (RYSC).

PubMed

Wong, Quincy J J; Certoma, Sarah P; McLellan, Lauren F; Halldorsson, Brynjar; Reyes, Natasha; Boulton, Kelsie; Hudson, Jennifer L; Rapee, Ronald M

2017-12-28

Recent research has started to examine the applicability of influential adult models of the maintenance of social anxiety disorder (SAD) to youth. This research is limited by the lack of psychometrically validated measures of underlying constructs that are developmentally appropriate for youth. One key construct in adult models of SAD is maladaptive social-evaluative beliefs. The current study aimed to develop and validate a measure of these beliefs in youth, known as the Report of Youth Social Cognitions (RYSC). The RYSC was developed with a clinical sample of youth with anxiety disorders (N = 180) and cross-validated in a community sample of youth (N = 305). In the clinical sample, the RYSC exhibited a 3-factor structure (negative evaluation, revealing self, and positive impression factors), good internal consistency, and construct validity. In the community sample, the 3-factor structure and the internal consistency of the RYSC were replicated, but the test of construct validity showed that the RYSC had similarly strong associations with social anxiety and depressed affect. The RYSC had good test-retest reliability overall, although the revealing self subscale showed lower temporal stability which improved when only older participants were considered (age ≥9 years). The RYSC in general was also shown to discriminate between youth with and without SAD although the revealing self subscale again performed suboptimally but improved when only older participants were considered. These findings provide psychometric support for the RYSC and justifies its use with youth in research and clinical settings requiring the assessment of maladaptive social-evaluative beliefs. (PsycINFO Database Record (c) 2017 APA, all rights reserved).

Development and validation of the sociocultural attitudes towards appearance questionnaire-4-revised (SATAQ-4R).

PubMed

Schaefer, Lauren M; Harriger, Jennifer A; Heinberg, Leslie J; Soderberg, Taylor; Kevin Thompson, J

2017-02-01

The Sociocultural Attitudes Toward Appearance Questionnaire-4 (SATAQ-4) is a measure of internalization of appearance ideals (i.e., personal acceptance of societal ideals) and appearance pressures (i.e., pressures to achieve the societal ideal). The current study sought to address limitations of the scale in order to increase precision in the measurement of muscular ideal internalization, include an assessment of one's desire for attractiveness, and broaden the measurement of appearance-related pressures. The factor structure, reliability and construct validity of the SATAQ-4-Revised were examined among college women (N = 1,114) in Study 1, adolescent girls (N = 275) in Study 2, and college men (N = 290) in Study 3. Factor analysis among college women indicated a 7-factor 31-item scale, labeled the SATAQ-4R-Female: (1) Internalization: Thin/Low Body Fat, (2) Internalization: Muscular, (3) Internalization: General Attractiveness, (4) Pressures: Family, (5) Pressures: Media, (6) Pressures: Peers, and (7) Pressures: Significant Others. SATAQ-4R-Female subscales demonstrated good reliability and construct validity among college women. Examination of the SATAQ-4R-Female among adolescent girls suggested a six-factor scale in which peer and significant others items comprised a single subscale. The scale demonstrated good reliability and construct validity in adolescent girls. Examination of the SATAQ-4R among men produced a 28-item scale with seven factors paralleling the factors identified among college women. This scale, labeled the SATAQ-4R-Male, demonstrated good reliability and construct validity. Results support the reliability and validity of SATAQ-4R-Female in college women and adolescent girls, and the SATAQ-4R-Male in college men. © 2016 Wiley Periodicals, Inc.(Int J Eat Disord 2017; 50:104-117). © 2016 Wiley Periodicals, Inc.

I-CAN: the classification and prediction of support needs.

PubMed

Arnold, Samuel R C; Riches, Vivienne C; Stancliffe, Roger J

2014-03-01

Since 1992, the diagnosis and classification of intellectual disability has been dependent upon three constructs: intelligence, adaptive behaviour and support needs (Luckasson et al. 1992. Mental Retardation: Definition, Classification and Systems of Support. American Association on Intellectual and Developmental Disability, Washington, DC). While the methods and instruments to measure intelligence and adaptive behaviour are well established and generally accepted, the measurement and classification of support needs is still in its infancy. This article explores the measurement and classification of support needs. A study is presented comparing scores on the ICF (WHO, 2001) based I-CAN v4.2 support needs assessment and planning tool with expert clinical judgment using a proposed classification of support needs. A logical classification algorithm was developed and validated on a separate sample. Good internal consistency (range 0.73-0.91, N = 186) and criterion validity (κ = 0.94, n = 49) were found. Further advances in our understanding and measurement of support needs could change the way we assess, describe and classify disability. © 2013 John Wiley & Sons Ltd.

Psychometric evaluations of the efficacy expectations and Outcome Expectations for Exercise Scales in African American women.

PubMed

Murrock, Carolyn J; Gary, Faye

2014-01-01

This secondary analysis tested the reliability and validity of the Self-Efficacy for Exercise (SEE) and the Outcome Expectations for Exercise (OEE) scales in 126 community dwelling, middle aged African American women. Social Cognitive Theory postulates self-efficacy is behavior age, gender and culture specific. Therefore, it is important to determine ifself-efficacy scales developed and tested in older Caucasian female adults are reliable and valid in middle aged, minority women. Cronbach's alpha and construct validity using hypothesis testing and confirmatory factor analysis supported the reliability and validity of the SEE and OEE scales in community dwelling, middle aged African American women.

Emotional and tangible social support in a German population-based sample: Development and validation of the Brief Social Support Scale (BS6).

PubMed

Beutel, Manfred E; Brähler, Elmar; Wiltink, Jörg; Michal, Matthias; Klein, Eva M; Jünger, Claus; Wild, Philipp S; Münzel, Thomas; Blettner, Maria; Lackner, Karl; Nickels, Stefan; Tibubos, Ana N

2017-01-01

Aim of the study was the development and validation of the psychometric properties of a six-item bi-factorial instrument for the assessment of social support (emotional and tangible support) with a population-based sample. A cross-sectional data set of N = 15,010 participants enrolled in the Gutenberg Health Study (GHS) in 2007-2012 was divided in two sub-samples. The GHS is a population-based, prospective, observational single-center cohort study in the Rhein-Main-Region in western Mid-Germany. The first sub-sample was used for scale development by performing an exploratory factor analysis. In order to test construct validity, confirmatory factor analyses were run to compare the extracted bi-factorial model with the one-factor solution. Reliability of the scales was indicated by calculating internal consistency. External validity was tested by investigating demographic characteristics health behavior, and distress using analysis of variance, Spearman and Pearson correlation analysis, and logistic regression analysis. Based on an exploratory factor analysis, a set of six items was extracted representing two independent factors. The two-factor structure of the Brief Social Support Scale (BS6) was confirmed by the results of the confirmatory factor analyses. Fit indices of the bi-factorial model were good and better compared to the one-factor solution. External validity was demonstrated for the BS6. The BS6 is a reliable and valid short scale that can be applied in social surveys due to its brevity to assess emotional and practical dimensions of social support.

Psychometric properties of a four-component Norwegian Organizational Justice Scale.

PubMed

Olsen, Olav Kjellevold; Myrseth, Helga; Eidhamar, Are; Hystad, Sigurd W

2012-04-01

Organizational justice has attracted attention as a predictor of employees' mental and physical health as well as commitment and work outcomes. The lack of a Norwegian translation of an organizational justice scale has precluded its use in Norway. Four dimensions of the organizational justice construct were examined in a Norwegian military context, including facet measures of distributional, interpersonal, and informational justice developed by Colquitt in 2001, in addition to procedural justice developed by Moorman in 1991. Confirmatory factor analyses supported a four-dimensional structure with good internal consistency. Follow-up analyses have suggested that the four dimensions were nested beneath a general, latent organizational justice factor. A positive relationship between organizational justice and self-sacrificial behavior was found, indicating satisfactory construct validity. The results demonstrate that the Norwegian Organizational Justice Scale is a reliable and construct-valid measure of organizational justice in a Norwegian setting.

Scale indicators of social exchange relationships: a comparison of relative content validity.

PubMed

Colquitt, Jason A; Baer, Michael D; Long, David M; Halvorsen-Ganepola, Marie D K

2014-07-01

Although social exchange theory has become one of the most oft-evoked theories in industrial and organizational psychology, there remains no consensus about how to measure its key mechanism: social exchange relationships (Blau, 1964). Drawing on Cropanzano and Byrne's (2000) review of contemporary social exchange theorizing, we examined the content validity of perceived support, exchange quality, affective commitment, trust, and psychological contract fulfillment as indicators of social exchange relationships. We used Hinkin and Tracey's (1999) quantitative approach to content validation, which asks participants to rate the correspondence between scale items and definitions of intended (and unintended) constructs. Our results revealed that some of the most frequently utilized indicators of social exchange relationships--perceived support and exchange quality--were significantly less content valid than rarely used options like affect-based trust. Our results also revealed that 2 direct measures--Bernerth, Armenakis, Feild, Giles, and Walker's (2007) scale and a scale created for this study--were content valid. We discuss the implications of these results for future applications of social exchange theory.

Psychometric properties of the Social Cognitive Theory questionnaire for physical activity in a sample of Iranian adolescent girl students.

PubMed

Ardestani, M S; Niknami, S; Hidarnia, A; Hajizadeh, E

2016-08-18

This research examined the validity and reliability of a researcher-developed questionnaire based on Social Cognitive Theory (SCT) to assess the physical activity behaviour of Iranian adolescent girls (SCT-PAIAGS). Psychometric properties of the SCT-PAIAGS were assessed by determining its face validity, content and construct validity as well as its reliability. In order to evaluate factor structure, cross-sectional research was conducted on 400 high-school girls in Tehran. Content validity index, content validity ratio and impact score for the SCT-PAIAGS varied between 0.97-1, 0.91-1 and 4.6-4.9 respectively. Confirmatory factor analysis approved a six-factor structure comprising self-efficacy, self-regulation, family support, friend support, outcome expectancy and self-efficacy to overcoming impediments. Factor loadings, t-values and fit indices showed that the SCT model was fitted to the data. Cronbach's α-coefficient ranged from 0.78 to 0.85 and intraclass correlation coefficient from 0.73 to 0.90.

Longitudinal evaluation of Patient Reported Outcomes Measurement Information Systems (PROMIS) measures in pediatric chronic pain

PubMed Central

Kashikar-Zuck, Susmita; Carle, Adam; Barnett, Kimberly; Goldschneider, Kenneth R.; Sherry, David D.; Mara, Constance A.; Cunningham, Natoshia; Farrell, Jennifer; Tress, Jenna; DeWitt, Esi Morgan

2015-01-01

The Patient Reported Outcomes Measurement Information System (PROMIS) initiative is a comprehensive strategy by the National Institutes of Health to support the development and validation of precise instruments to assess self-reported health domains across healthy and disease-specific populations. Much progress has been made in instrument development but there remains a gap in the validation of PROMIS measures for pediatric chronic pain. The purpose of this study was to investigate the construct validity and responsiveness to change of seven PROMIS domains for the assessment of children (ages 8-18) with chronic pain – Pain Interference, Fatigue, Anxiety, Depression, Mobility, Upper Extremity Function and Peer Relationships. PROMIS measures were administered at the initial visit and two follow-up visits at an outpatient chronic pain clinic (CPC; N=82) and at an intensive amplified pain day-treatment program (AMP; N= 63). Aim 1 examined construct validity of PROMIS measures by comparing them with corresponding “legacy” measures administered as part of usual care in the CPC sample. Aim 2 examined sensitivity to change in both CPC and AMP samples. Longitudinal growth models showed that PROMIS Pain Interference, Anxiety, Depression, Mobility, Upper Extremity and Peer Relationship measures and legacy instruments generally performed similarly with slightly steeper slopes of improvement in legacy measures. All seven PROMIS domains showed responsiveness to change. Results offered initial support for the validity of PROMIS measures in pediatric chronic pain. Further validation with larger and more diverse pediatric pain samples and additional legacy measures would broaden the scope of use of PROMIS in clinical research. PMID:26447704

Validity of the Modified Child Psychopathy Scale for Juvenile Justice Center Residents.

PubMed

Verschuere, Bruno; Candel, Ingrid; Van Reenen, Lique; Korebrits, Andries

2012-06-01

Adult psychopathy has proven to be an important clinical and forensic construct, but much less is known about juvenile psychopathy. In the present study, we examined the construct validity of the self report modified Child Psychopathy Scale mCPS; Lynam (Psychological Bulletin 120:(2), 209-234, 1997) in a sample of 57 adolescents residing in a Dutch juvenile justice center, aged between 13 and 22 years. The mCPS total score was reliably related to high externalizing problems, low empathy, high anger and aggression, high impulsivity, high (violent) delinquency, and high alcohol/drug use. Unique relations were found for the antisocial-impulsive (mCPS Factor 2), but not the callous-unemotional facet of psychopathy (mCPS Factor 1). Our findings support the validity of the mCPS in that it encompasses the antisocial-impulsive facet of psychopathy, but it is less clear whether the mCPS sufficiently captures the affective-interpersonal facet of psychopathy.

Reliability and validity of the Modified Erikson Psychosocial Stage Inventory in diverse samples.

PubMed

Leidy, N K; Darling-Fisher, C S

1995-04-01

The Modified Erikson Psychosocial Stage Inventory (MEPSI) is a relatively simple survey measure designed to assess the strength of psychosocial attributes that arise from progression through Erikson's eight stages of development. The purpose of this study was to employ secondary analysis to evaluate the internal-consistency reliability and construct validity of the MEPSI across four diverse samples: healthy young adults, hemophilic men, healthy older adults, and older adults with chronic obstructive pulmonary disease. Special attention was given to the performance of the measure across gender, with exploratory analyses examining possible age cohort and health status effects. Internal-consistency estimates for the aggregate measure were high, whereas subscale reliability levels varied across age groups. Construct validity was supported across samples. Gender, cohort, and health effects offered interesting psychometric and theoretical insights and direction for further research. Findings indicated that the MEPSI might be a useful instrument for operationalizing and testing Eriksonian developmental theory in adults.

Patient's Communication Perceived Self-efficacy Scale (PCSS): construction and validation of a new measure in a socio-cognitive perspective.

PubMed

Capone, Vincenza; Petrillo, Giovanna

2014-06-01

In two studies we constructed and validated the Patient's Communication Perceived Self-efficacy Scale (PCSS) designed to assess patients' beliefs about their capability to successfully manage problematic situations related to communication with doctor. The 20-item scale was administered to 179 outpatients (study 1). An Exploratory Factor Analysis revealed a three-factor solution. In study 2, the 16-item scale was administered to 890 outpatients. Exploratory and Confirmatory Factor Analyses supported the 3-factor solution (Provide and Collect information, Express concerns and doubts, Verify information) that showed good psychometric properties and was invariant for gender. PCSS is an easily administered, reliable, and valid test of patients' communication self-efficacy beliefs. It can be applied optimally in the empirical study of factors influencing doctor-patient communication and used in training aimed at strengthening patients' communication skills. Copyright © 2014 Elsevier Ireland Ltd. All rights reserved.

Construct validity of the Iowa Gambling Task.

PubMed

Buelow, Melissa T; Suhr, Julie A

2009-03-01

The Iowa Gambling Task (IGT) was created to assess real-world decision making in a laboratory setting and has been applied to various clinical populations (i.e., substance abuse, schizophrenia, pathological gamblers) outside those with orbitofrontal cortex damage, for whom it was originally developed. The current review provides a critical examination of lesion, functional neuroimaging, developmental, and clinical studies in order to examine the construct validity of the IGT. The preponderance of evidence provides support for the use of the IGT to detect decision making deficits in clinical populations, in the context of a more comprehensive evaluation. The review includes a discussion of three critical issues affecting the validity of the IGT, as it has recently become available as a clinical instrument: the lack of a concise definition as to what aspect of decision making the IGT measures, the lack of data regarding reliability of the IGT, and the influence of personality and state mood on IGT performance.

Validation of the Japanese version of the job crafting scale.

PubMed

Eguchi, Hisashi; Shimazu, Akihito; Bakker, Arnold B; Tims, Maria; Kamiyama, Kimika; Hara, Yujiro; Namba, Katsuyuki; Inoue, Akiomi; Ono, Masakatsu; Kawakami, Norito

2016-06-16

The aim of this study was to validate the Japanese version of the job crafting scale (JCS-J). JCS measures four independent job crafting dimensions, namely increasing structural job resources, decreasing hindering job demands, increasing social job resources, and increasing challenging job demands. The translated and back-translated JCS-J questionnaires were administered online to 972 employees of a Japanese manufacturing company. The data were then divided into independent explorative and confirmative samples. Exploratory and confirmatory factor analyses were performed to evaluate the factorial validity of JCS-J. The relationship with potential consequences of job crafting (e.g., job demands, job resources, and psychological well-being) was investigated to evaluate construct validity. Internal consistency was examined to evaluate the reliability of the four JCSs. An exploratory factor analysis extracted a five-factor solution. Decreasing hindering job demands was further split into two separate dimensions supporting a five- rather than four-factor structure. A series of confirmatory factor analyses revealed that the modified five-factor model that allows covariance between items fits the data best. Construct validity was generally supported by the expected correlations of each job crafting dimension with each corresponding job resource (+), job demand (+), and psychological well-being (+). Cronbach's α coefficient was sufficient for each of the four dimensions of job crafting (α ranged between 0.76 and 0.90). This study confirmed that JCS-J is an adequate measure of job crafting that can be used in the Japanese context.

Construct validity of the Korean Women's Abuse Intolerance Scale.

PubMed

Choi, Myunghan; Phillips, Linda R; Figueredo, Aurelio José; Insel, Katheleen; Min, Sung-Kil

2008-01-01

Domestic violence against married women has persisted throughout Korean history. However, very little empirical research has been conducted in Korea about domestic violence, its causes, or women's responses. To develop and test psychometrically the Korean Women's Abuse Intolerance Scale (KWAIS) to measure women's propensity or desire to leave abusive husbands in Korea. The first phase of the investigation involved qualitative research to explore the themes of women's responses to domestic violence and the development of the instrument. The second phase was a preliminary study conducted to examine women's responses to domestic violence. In the third phase, construct validity of the scale was established, using a sample of 184 married women living in Korea. The KWAIS adequately supported the underlying theory of women's responses to domestic violence, demonstrating strong content validity, high internal consistency (Cronbach's alpha of .98), and criterion-related validity evidenced by significant correlations that supported hypotheses among abuse intolerance and abuse (r = .69), traditional family ideology (r = -.78), marital satisfaction (r = -.85), attitude toward power ascription (r = .63), and collectivism (r = -.88). Factor analysis yielded a four-factor structure, explaining 78.4% of the common variance. Factor loadings ranged from .65 to .93. The findings for the psychometric properties of the KWAIS established its potential as a research instrument in measuring Korean women's propensity or desire to leave abusive husbands. Future studies need to focus on determining the predictive validity of the KWAIS and evaluating cross-cultural differences in women's propensity or desire to leave abusive husbands.

Validation of the Japanese version of the job crafting scale

PubMed Central

Eguchi, Hisashi; Shimazu, Akihito; Bakker, Arnold B.; Tims, Maria; Kamiyama, Kimika; Hara, Yujiro; Namba, Katsuyuki; Inoue, Akiomi; Ono, Masakatsu; Kawakami, Norito

2016-01-01

Objectives: The aim of this study was to validate the Japanese version of the job crafting scale (JCS-J). JCS measures four independent job crafting dimensions, namely increasing structural job resources, decreasing hindering job demands, increasing social job resources, and increasing challenging job demands. Methods: The translated and back-translated JCS-J questionnaires were administered online to 972 employees of a Japanese manufacturing company. The data were then divided into independent explorative and confirmative samples. Exploratory and confirmatory factor analyses were performed to evaluate the factorial validity of JCS-J. The relationship with potential consequences of job crafting (e.g., job demands, job resources, and psychological well-being) was investigated to evaluate construct validity. Internal consistency was examined to evaluate the reliability of the four JCSs. Results: An exploratory factor analysis extracted a five-factor solution. Decreasing hindering job demands was further split into two separate dimensions supporting a five- rather than four-factor structure. A series of confirmatory factor analyses revealed that the modified five-factor model that allows covariance between items fits the data best. Construct validity was generally supported by the expected correlations of each job crafting dimension with each corresponding job resource (+), job demand (+), and psychological well-being (+). Cronbach's α coefficient was sufficient for each of the four dimensions of job crafting (α ranged between 0.76 and 0.90). Conclusions: This study confirmed that JCS-J is an adequate measure of job crafting that can be used in the Japanese context. PMID:27108643

What to Do With "Moderate" Reliability and Validity Coefficients?

PubMed

Post, Marcel W

2016-07-01

Clinimetric studies may use criteria for test-retest reliability and convergent validity such that correlation coefficients as low as .40 are supportive of reliability and validity. It can be argued that moderate (.40-.60) correlations should not be interpreted in this way and that reliability coefficients <.70 should be considered as indicative of unreliability. Convergent validity coefficients in the .40 to .60 or .40 to .70 range should be considered as indications of validity problems, or as inconclusive at best. Studies on reliability and convergent should be designed in such a way that it is realistic to expect high reliability and validity coefficients. Multitrait multimethod approaches are preferred to study construct (convergent-divergent) validity. Copyright © 2016 American Congress of Rehabilitation Medicine. Published by Elsevier Inc. All rights reserved.

Validation of a Theory of Planned Behavior-Based Questionnaire to Examine Factors Associated With Milk Expression.

PubMed

Bai, Yeon K; Dinour, Lauren M

2017-11-01

A proper assessment of multidimensional needs for breastfeeding mothers in various settings is crucial to facilitate and support breastfeeding and its exclusivity. The theory of planned behavior (TPB) has been used frequently to measure factors associated with breastfeeding. Full utility of the TPB requires accurate measurement of theory constructs. Research aim: This study aimed to develop and confirm the psychometric properties of an instrument, Milk Expression on Campus, based on the TPB and to establish the reliability and validity of the instrument. In spring 2015, 218 breastfeeding (current or in the recent past) employees and students at one university campus in northern New Jersey completed the online questionnaire containing demography and theory-based items. Internal consistency (α) and split-half reliability ( r) tests and factor analyses established and confirmed the reliability and construct validity of this instrument. Milk Expression on Campus showed strong and significant reliabilities as a full scale (α = .78, r = .74, p < .001) and theory construct subscales. Validity was confirmed as psychometric properties corresponded to the factors extracted from the scale. Four factors extracted from the direct construct subscales accounted for 79.49% of the total variability. Four distinct factors from the indirect construct subscales accounted for 73.68% of the total variability. Milk Expression on Campus can serve as a model TPB-based instrument to examine factors associated with women's milk expression behavior. The utility of this instrument extends to designing effective promotion programs to foster breastfeeding and milk expression behaviors in diverse settings.

Confirmatory factor analysis of burnout dimensions : correlations with job stressors and aspects of social support and job satisfaction.

DOT National Transportation Integrated Search

1992-02-01

This study examined the dimensionality and construct validity of Golembiewski, Munzenrider, and Stevenson (1986) revision of the Maslach and Jackson (1981) Maslach Burnout Inventory (MBI). Results of confirmatory factor analyses conducted on data col...

Validity and reliability of the Delta Healthy Eating Attitudes Scale

USDA-ARS?s Scientific Manuscript database

The objective of this study was to evaluate psychometric properties of an instrument developed to measure psychosocial factors related to the Dietary Guidelines for Americans for a nutrition intervention in the Lower Mississippi Delta (LMD). Social Cognitive Theory constructs social support (SS), s...

[Validation of food security and social support scales in an Afro-Colombian community: application on a prevalence study of nutritional status in children aged 6 to 18 months].

PubMed

Alvarado, Beatriz Eugenia; Zunzunegui, María Victoria; Delisle, Helene

2005-01-01

We conducted a cross-sectional study on 193 mothers of children 6 to 18 months of age in an African-Colombian community, with the objectives: (1) to adapt and validate the Community Childhood Hunger Identification Project scale, the DUKE-UNC-11 social support scale, and the Quebec Longitudinal Study of Child Development (QLSCD) partner support scale, and (2) to identify any existent relationship between nutritional status in infancy and both food insecurity and social support. We determined construct validity using factor analysis and theoretical models-based non-parametric correlations. Length-for-age and weight-for-length Z-results were calculated. Factor analyses reduced the hunger scale to one factor, the DUKE-UNC-11 scale to two factors, and the QLSCD scale to one factor. The Cronbach's alpha test ranged between 0.70 and 0.90. Both food insecurity and social support scales were correlated with mother's social conditions, and social support was positively associated with social networks and mother's self-perceived health status. Food insecurity, emotional-social support, and partner's negative support were associated with lower height-to-age and therefore a higher ratio of chronic malnutrition. The study supports the appropriateness of the instruments to measure the expressed concepts.

Construct Validity: Advances in Theory and Methodology

PubMed Central

Strauss, Milton E.; Smith, Gregory T.

2008-01-01

Measures of psychological constructs are validated by testing whether they relate to measures of other constructs as specified by theory. Each test of relations between measures reflects on the validity of both the measures and the theory driving the test. Construct validation concerns the simultaneous process of measure and theory validation. In this chapter, we review the recent history of validation efforts in clinical psychological science that has led to this perspective, and we review five recent advances in validation theory and methodology of importance for clinical researchers. These are: the emergence of nonjustificationist philosophy of science; an increasing appreciation for theory and the need for informative tests of construct validity; valid construct representation in experimental psychopathology; the need to avoid representing multidimensional constructs with a single score; and the emergence of effective new statistical tools for the evaluation of convergent and discriminant validity. PMID:19086835

The validity and reliability of the Finnish Family Empowerment Scale (FES): a survey of parents with small children.

PubMed

Vuorenmaa, M; Halme, N; Åstedt-Kurki, P; Kaunonen, M; Perälä, M-L

2014-07-01

The Family Empowerment Scale (FES) is a widely used instrument which measures the parents' own sense of their empowerment at the level of the family, service system and community. It was originally developed for parents of children with emotional disabilities. The aims of this study were to evaluate the validity and reliability of the Finnish FES and to examine its responsiveness in measuring the empowerment of parents with small children. The English FES was translated into Finnish using back translation and modified so as to be generic and convenient for all families. The construct, convergent, discriminant and concurrent validities, reliability and responsiveness of the Finnish FES were examined. Participants (n = 955) were the parents of children aged 0-9 years who had been selected using stratified random sampling. Confirmatory factor analysis proved that the Finnish FES had three subscales based on the original FES. Convergent and discriminant validities confirmed and supported the same construct. The relationship between parents' participation and empowerment was tested for concurrent validity. As in previous FES studies, the participating parents were more empowered, which supported the concurrent validity. The reliability of the Finnish FES proved acceptable for both parents. The Finnish FES could also discriminate the responses of the parents. Participation in the activities organized by the family service system influenced parents' perceptions of empowerment more than did their background characteristics. The Finnish FES is a valid and reliable instrument and it is suitable for measuring the empowerment of parents. However, it is necessary to consider how the FES would identify in the best way the parents who perhaps need some help. © 2013 John Wiley & Sons Ltd.

Validating Self-Report Measures of Pain and Function in Patients Undergoing Hip or Knee Arthroplasty

PubMed Central

Dogra, Moneet; Woodhouse, Linda; Kennedy, Deborah M.; Spadoni, Greg F.

2009-01-01

ABSTRACT Purpose: To investigate the factorial and construct validity of a four-item pain intensity scale, the P4, in patients awaiting primary total hip or knee arthroplasty secondary to osteoarthritis. Method: A construct validation design was applied to a sample of convenience of 117 patients (mean age 65.6 [SD = 11.2] years) at their preoperative visit. All patients completed the P4 and the Western Ontario and McMaster Universities Osteoarthritis Index (WOMAC). Exploratory and confirmatory factor analyses were used to examine the factorial structure of the P4 and WOMAC. To evaluate construct validity, we examined the correlation between the P4 and WOMAC pain sub-scales and the ability of the P4 to differentiate between patients awaiting hip and knee replacement. Results: Two distinct factors consistent with the themes of pain and function were identified with P4 and WOMAC physical function items, but not with the WOMAC pain and physical function items. The P4 correlates more with the WOMAC pain scores (r = 0.67) than with the WOMAC physical function scores (r = 0.60). Conclusion: The P4's validity was supported in this patient group. The use of the P4 with the WOMAC physical function sub-scale provides a more distinct assessment of pain and function than the WOMAC pain and physical function scales. PMID:20808479

Development and validation of the brief esophageal dysphagia questionnaire.

PubMed

Taft, T H; Riehl, M; Sodikoff, J B; Kahrilas, P J; Keefer, L; Doerfler, B; Pandolfino, J E

2016-12-01

Esophageal dysphagia is common in gastroenterology practice and has multiple etiologies. A complication for some patients with dysphagia is food impaction. A valid and reliable questionnaire to rapidly evaluate esophageal dysphagia and impaction symptoms can aid the gastroenterologist in gathering information to inform treatment approach and further evaluation, including endoscopy. 1638 patients participated over two study phases. 744 participants completed the Brief Esophageal Dysphagia Questionnaire (BEDQ) for phase 1; 869 completed the BEDQ, Visceral Sensitivity Index, Gastroesophageal Reflux Disease Questionnaire, and Hospital Anxiety and Depression Scale for phase 2. Demographic and clinical data were obtained via the electronic medical record. The BEDQ was evaluated for internal consistency, split-half reliability, ceiling and floor effects, and construct validity. The BEDQ demonstrated excellent internal consistency, reliability, and construct validity. The symptom frequency and severity scales scored above the standard acceptable cutoffs for reliability while the impaction subscale yielded poor internal consistency and split-half reliability; thus the impaction items were deemed qualifiers only and removed from the total score. No significant ceiling or floor effects were found with the exception of 1 item, and inter-item correlations fell within accepted ranges. Construct validity was supported by moderate yet significant correlations with other measures. The predictive ability of the BEDQ was small but significant. The BEDQ represents a rapid, reliable, and valid assessment tool for esophageal dysphagia with food impaction for clinical practice that differentiates between patients with major motor dysfunction and mechanical obstruction. © 2016 John Wiley & Sons Ltd.

Development and Validation of the Brief Esophageal Dysphagia Questionnaire

PubMed Central

Taft, Tiffany H.; Riehl, Megan; Sodikoff, Jamie B.; Kahrilas, Peter J.; Keefer, Laurie; Doerfler, Bethany; Pandolfino, John E.

2017-01-01

Background Esophageal dysphagia is common in gastroenterology practice and has multiple etiologies. A complication for some patients with dysphagia is food impaction. A valid and reliable questionnaire to rapidly evaluate esophageal dysphagia and impaction symptoms can aid the gastroenterologist in gathering information to inform treatment approach and further evaluation, including endoscopy. Methods 1,638 patients participated over two study phases. 744 participants completed the Brief Esophageal Dysphagia Questionnaire (BEDQ) for phase 1; 869 completed the BEDQ, Visceral Sensitivity Index, Gastroesophageal Reflux Disease Questionnaire, and Hospital Anxiety and Depression Scale for phase 2. Demographic and clinical data were obtained via the electronic medical record. The BEDQ was evaluated for internal consistency, split-half reliability, ceiling and floor effects, and construct validity. Key Results The BEDQ demonstrated excellent internal consistency, reliability, and construct validity. The symptom frequency and severity scales scored above the standard acceptable cutoffs for reliability while the impaction subscale yielded poor internal consistency and split-half reliability; thus the impaction items were deemed qualifiers only and removed from the total score. No significant ceiling or floor effects were found with the exception of 1 item, and inter-item correlations fell within accepted ranges. Construct validity was supported by moderate yet significant correlations with other measures. The predictive ability of the BEDQ was small but significant. Conclusions & Inferences The BEDQ represents a rapid, reliable and valid assessment tool for esophageal dysphagia with food impaction for clinical practice that differentiates between patients with major motor dysfunction and mechanical obstruction. PMID:27380834

Reliability and Validity of the Alcohol Short Index of Problems and a Newly Constructed Drug Short Index of Problems*

PubMed Central

Alterman, Arthur I.; Cacciola, John S.; Ivey, Megan A.; Lynch, Kevin G.

2009-01-01

Objective: This study evaluated the psychometric properties of the 15-item alcohol Short Index of Problems (SIP) instrument and those of a newly constructed 15-item drug Short Index of Problems (SIP-D) instrument in 277 newly entered substance-abuse patients. Method: The SIP is derived from the longer, 50-item Drinker Inventory of Consequences (DrInC), which was designed to assess adverse consequences of alcohol use. The SIP-D was constructed by substituting the term “drug use” for the term “drinking” in each SIP item. A 3-month recall interval was employed. Results: Factor analyses of each of the instruments revealed similar solutions, with only one main factor accounting for the majority of variance. Nonparametric item response theory methods produced the same finding. Internal consistency reliability estimates for the SIP and SIP-D total scores were .98 and .97, respectively. Concurrent validity was demonstrated by examining the correlations of the total scores for each of the instruments with the recent summary indexes of the newly revised Addiction Severity Index (ASI-Version 6): alcohol, drug, medical, economic, legal, family/social, and psychiatric problems. Conclusions: This study is the first to confirm the psychometric validity of the SIP when used as an independent instrument unembedded within the DrInC. The study also supports the use of the SIP-D as a brief measure of adverse consequences of drug use. The findings strongly support the unidimensional structure of both measures. PMID:19261243

Reliability and validity of the alcohol short index of problems and a newly constructed drug short index of problems.

PubMed

Alterman, Arthur I; Cacciola, John S; Ivey, Megan A; Habing, Brian; Lynch, Kevin G

2009-03-01

This study evaluated the psychometric properties of the 15-item alcohol Short Index of Problems (SIP) instrument and those of a newly constructed 15-item drug Short Index of Problems (SIP-D) instrument in 277 newly entered substance-abuse patients. The SIP is derived from the longer, 50-item Drinker Inventory of Consequences (DrInC), which was designed to assess adverse consequences of alcohol use. The SIP-D was constructed by substituting the term "drug use" for the term "drinking" in each SIP item. A 3-month recall interval was employed. Factor analyses of each of the instruments revealed similar solutions, with only one main factor accounting for the majority of variance. Nonparametric item response theory methods produced the same finding. Internal consistency reliability estimates for the SIP and SIP-D total scores were .98 and .97, respectively. Concurrent validity was demonstrated by examining the correlations of the total scores for each of the instruments with the recent summary indexes of the newly revised Addiction Severity Index (ASI-Version 6): alcohol, drug, medical, economic, legal, family/social, and psychiatric problems. This study is the first to confirm the psychometric validity of the SIP when used as an independent instrument unembedded within the DrInC. The study also supports the use of the SIP-D as a brief measure of adverse consequences of drug use. The findings strongly support the unidimensional structure of both measures.

Examining the Construct Validity of the MMPI-2-RF Interpersonal Functioning Scales Using the Computerized Adaptive Test of Personality Disorder as a Comparative Framework.

PubMed

Franz, Annabel O; Harrop, Tiffany M; McCord, David M

2017-01-01

This study aimed to examine the construct validity of the Minnesota Multiphasic Personality Inventory-2 Restructured Form (MMPI-2-RF) interpersonal functioning scales (Ben-Porath & Tellegen, 2008/2011 ) using as a criterion measure the Computerized Adaptive Test of Personality Disorder-Static Form (CAT-PD-SF; Simms et al., 2011 ). Participants were college students (n = 98) recruited through the university subject pool. A series of a priori hypotheses were developed for each of the 6 interpersonal functioning scales of the MMPI-2-RF, expressed as predicted correlations with construct-relevant CAT-PD-SF scales. Of the 27 specific predictions, 21 were supported by substantial (≥ |.30|) correlations. The MMPI-2-RF Family Problems scale (FML) demonstrated the strongest correlations with CAT-PD-SF scales Anhedonia and Mistrust; Cynicism (RC3) was most highly correlated with Mistrust and Norm Violation; Interpersonal Passivity (IPP) was most highly correlated with Domineering and Rudeness; Social Avoidance (SAV) was most highly correlated with Social Withdrawal and Anhedonia; Shyness (SHY) was most highly correlated with Social Withdrawal and Anxioiusness; and Disaffiliativeness (DSF) was most highly correlated with Emotional Detachment and Mistrust. Results are largely consistent with hypotheses suggesting support for both models of constructs relevant to interpersonal functioning. Future research designed to more precisely differentiate Social Avoidance (SAV) and Shyness (SHY) is suggested.

The Social Interaction Phobia Scale: Continued support for the psychometric validity of the SIPS using clinical and non-clinical samples.

PubMed

Menatti, Alison R; Weeks, Justin W; Carleton, R Nicholas; Morrison, Amanda S; Heimberg, Richard G; Hope, Debra A; Blanco, Carlos; Schneier, Franklin R; Liebowitz, Michael R

2015-05-01

The present study sought to extend findings supporting the psychometric validity of a promising measure of social anxiety (SA) symptoms, the Social Interaction Phobia Scale (SIPS; Carleton et al., 2009). Analyses were conducted using three samples: social anxiety disorder (SAD) patients, generalized anxiety disorder (GAD) patients, and healthy controls. SIPS scores of SAD patients demonstrated internal consistency and construct validity, and the previously demonstrated three-factor structure of the SIPS was replicated. Further, the SIPS total score uniquely predicted SA symptoms, and SIPS scores were significantly higher for SAD patients than GAD patients or controls. Two cut-off scores that discriminated SAD patients from GAD patients and from healthy controls were identified. The current study is the first to replicate the SIPS three-factor model in a large, treatment-seeking sample of SAD patients and establish a cut-off score discriminating SAD from GAD patients. Findings support the SIPS as a valid, SAD-specific assessment instrument. Copyright © 2015 Elsevier Ltd. All rights reserved.

A Psychometric Analysis of the Italian Version of the eHealth Literacy Scale Using Item Response and Classical Test Theory Methods

PubMed Central

Dima, Alexandra Lelia; Schulz, Peter Johannes

2017-01-01

Background The eHealth Literacy Scale (eHEALS) is a tool to assess consumers’ comfort and skills in using information technologies for health. Although evidence exists of reliability and construct validity of the scale, less agreement exists on structural validity. Objective The aim of this study was to validate the Italian version of the eHealth Literacy Scale (I-eHEALS) in a community sample with a focus on its structural validity, by applying psychometric techniques that account for item difficulty. Methods Two Web-based surveys were conducted among a total of 296 people living in the Italian-speaking region of Switzerland (Ticino). After examining the latent variables underlying the observed variables of the Italian scale via principal component analysis (PCA), fit indices for two alternative models were calculated using confirmatory factor analysis (CFA). The scale structure was examined via parametric and nonparametric item response theory (IRT) analyses accounting for differences between items regarding the proportion of answers indicating high ability. Convergent validity was assessed by correlations with theoretically related constructs. Results CFA showed a suboptimal model fit for both models. IRT analyses confirmed all items measure a single dimension as intended. Reliability and construct validity of the final scale were also confirmed. The contrasting results of factor analysis (FA) and IRT analyses highlight the importance of considering differences in item difficulty when examining health literacy scales. Conclusions The findings support the reliability and validity of the translated scale and its use for assessing Italian-speaking consumers’ eHealth literacy. PMID:28400356

Further validation of the Health Promoting Activities Scale with mothers of typically developing children.

PubMed

Bourke-Taylor, Helen; Lalor, Aislinn; Farnworth, Louise; Pallant, Julie F

2014-10-01

The Health Promoting Activities Scale (HPAS) measures the frequency that mothers participate in self-selected leisure activities that promote health and wellbeing. The scale was originally validated on mothers of school-aged children with disabilities, and the current article extends this research using a comparative sample of mothers of typically developing school-aged children. Australian mothers (N = 263) completed a questionnaire containing the HPAS, a measure of depression, anxiety and stress (DASS-21) and questions concerning their weight, height, sleep quality and demographics. Statistical analysis assessed the underlying structure, internal consistency and construct validity of the HPAS. Inferential statistics were utilised to investigate the construct validity. Exploratory factor analysis supported the unidimensionality of the HPAS. It showed good internal consistency (Cronbach's alpha = 0.78). Significantly lower HPAS scores were recorded for women who were obese; had elevated levels of depression, anxiety and stress; had poor quality sleep or had heavy caring commitments. The mean HPAS score in this sample (M = 32.2) was significantly higher than was previously reported for women of children with a disability (M = 21.6: P < 0.001). Further psychometric evaluation of the HPAS continues to support the HPAS as a sound instrument that measures the frequency that women participate in meaningful occupation that is associated with differences in mental health and wellbeing and other health indicators. © 2014 Occupational Therapy Australia.

Construct Validity of the MMPI-2-RF Triarchic Psychopathy Scales in Correctional and Collegiate Samples.

PubMed

Kutchen, Taylor J; Wygant, Dustin B; Tylicki, Jessica L; Dieter, Amy M; Veltri, Carlo O C; Sellbom, Martin

2017-01-01

This study examined the MMPI-2-RF (Ben-Porath & Tellegen, 2008/2011) Triarchic Psychopathy scales recently developed by Sellbom et al. ( 2016 ) in 3 separate groups of male correctional inmates and 2 college samples. Participants were administered a diverse battery of psychopathy specific measures (e.g., Psychopathy Checklist-Revised [Hare, 2003 ], Psychopathic Personality Inventory-Revised [Lilienfeld & Widows, 2005 ], Triarchic Psychopathy Measure [Patrick, 2010 ]), omnibus personality and psychopathology measures such as the Personality Assessment Inventory (Morey, 2007 ) and Personality Inventory for DSM-5 (Krueger, Derringer, Markon, Watson, & Skodol, 2012 ), and narrow-band measures that capture conceptually relevant constructs. Our results generally evidenced strong support for the convergent and discriminant validity for the MMPI-2-RF Triarchic scales. Boldness was largely associated with measures of fearless dominance, social potency, and stress immunity. Meanness showed strong relationships with measures of callousness, aggression, externalizing tendencies, and poor interpersonal functioning. Disinhibition exhibited strong associations with poor impulse control, stimulus seeking, and general externalizing proclivities. Our results provide additional construct validation to both the triarchic model and MMPI-2-RF Triarchic scales. Given the widespread use of the MMPI-2-RF in correctional and forensic settings, our results have important implications for clinical assessment in these 2 areas, where psychopathy is a highly relevant construct.

A model of scientific attitudes assessment by observation in physics learning based scientific approach: case study of dynamic fluid topic in high school

NASA Astrophysics Data System (ADS)

Yusliana Ekawati, Elvin

2017-01-01

This study aimed to produce a model of scientific attitude assessment in terms of the observations for physics learning based scientific approach (case study of dynamic fluid topic in high school). Development of instruments in this study adaptation of the Plomp model, the procedure includes the initial investigation, design, construction, testing, evaluation and revision. The test is done in Surakarta, so that the data obtained are analyzed using Aiken formula to determine the validity of the content of the instrument, Cronbach’s alpha to determine the reliability of the instrument, and construct validity using confirmatory factor analysis with LISREL 8.50 program. The results of this research were conceptual models, instruments and guidelines on scientific attitudes assessment by observation. The construct assessment instruments include components of curiosity, objectivity, suspended judgment, open-mindedness, honesty and perseverance. The construct validity of instruments has been qualified (rated load factor > 0.3). The reliability of the model is quite good with the Alpha value 0.899 (> 0.7). The test showed that the model fits the theoretical models are supported by empirical data, namely p-value 0.315 (≥ 0.05), RMSEA 0.027 (≤ 0.08)

Cross-cultural adaptation of the Disability of Arm, Shoulder, and Hand questionnaire: Spanish for Puerto Rico Version

PubMed Central

Mulero-Portela, Ana L.; Colón-Santaella, Carmen L.; Cruz-Gomez, Cynthia

2010-01-01

The purpose of this study was to perform a cross-cultural adaptation of the Disability of Arm, Shoulder, and Hand (DASH) questionnaire to Spanish for Puerto Rico. Five steps were followed for the cross-cultural adaptation: forward translations into Spanish for Puerto Rico, synthesis of the translations, back translations into English, revision by an expert committee, and field test of the prefinal version. Psychometric characteristics of reliability and construct validity were evaluated for the final version. Internal consistency of the final version was high (Cronbach's α = 0.97) and item-to-total correlations were moderate (range from 0.44 to 0.85). Construct validity was evaluated by correlating the DASH with the scales of the Functional Assessment of Cancer Therapy - Breast. Fair to moderate correlations found in this study between the DASH and most scales of the Functional Assessment of Cancer Therapy - Breast support the construct validity of the Puerto Rico-Spanish DASH. The final version of the questionnaire was revised and approved by the Institute for Work and Health of Canada. Revisions to the original DASH English version are recommended. This version of the DASH is valid and reliable, and it can be used to evaluate outcomes in both clinical and research settings. PMID:19901616

A process-oriented measure of habit strength for moderate-to-vigorous physical activity

PubMed Central

Grove, J. Robert; Zillich, Irja; Medic, Nikola

2014-01-01

Purpose: Habitual action is an important aspect of health behaviour, but the relevance of various habit strength indicators continues to be debated. This study focused specifically on moderate-to-vigorous physical activity (MVPA) and evaluated the construct validity of a framework emphasizing patterned action, stimulus-response bonding, automaticity, and negative consequences for nonperformance as indicators of habit strength for this form of exercise. Methods: Upper-level undergraduates (N = 124) provided demographic information and responded to questionnaire items assessing historical MVPA involvement, current MVPA involvement, and the four proposed habit strength dimensions. Factor analyses were used to examine the latent structure of the habit strength indicators, and the model's construct validity was evaluated via an examination of relationships with repetition history and current behaviour. Results: At a measurement level, findings indicated that the proposed four-component model possessed psychometric integrity as a coherent set of factors. Criterion-related validity was also demonstrated via significant changes in three of the four factors as a function of past involvement in MVPA and significant correlations with the frequency, duration, and intensity of current MVPA. Conclusions: These findings support the construct validity of this exercise habit strength model and suggest that it could provide a template for future research on how MVPA habits are developed and maintained. PMID:25750789

Prevalence and construct validity of compulsive buying disorder in shopping mall visitors.

PubMed

Maraz, Aniko; van den Brink, Wim; Demetrovics, Zsolt

2015-08-30

Compulsive buying is a relatively new psychopathological concept and very few data are currently available regarding the prevalence and validity of compulsive buying disorder. In this cross-sectional study, we establish the prevalence of compulsive buying disorder in shopping mall visitors and explore the construct validity of the concept using the revised version of the Edwards Compulsive Buying Scale in 1441 shopping mall visitors looking at shopping habits, current substance use (smoking, alcohol and illicit drug) and various psychological characteristics. Overall, 8.7% (95% CI: 7.3-10.3) of our sample was classified as having a compulsive buying disorder. Compulsive buyers were younger, less educated and more likely to be female than non-compulsive buyers. They were also more likely to have used licit and illicit substances. Compulsive buyers also reported higher levels of impulsivity and obsessive-compulsive symptoms, lower levels of well-being and self-esteem and more psychological distress. Finally, compulsive buyers were five times more likely to meet criteria for borderline personality disorder than non-compulsive buyers. Compulsive buying is a frequent disorder in shopping mall visitors and is associated with important and robust indicators of psychopathology thus supporting the validity of the construct. Copyright © 2015 Elsevier Ireland Ltd. All rights reserved.

A process-oriented measure of habit strength for moderate-to-vigorous physical activity.

PubMed

Grove, J Robert; Zillich, Irja; Medic, Nikola

2014-01-01

Purpose : Habitual action is an important aspect of health behaviour, but the relevance of various habit strength indicators continues to be debated. This study focused specifically on moderate-to-vigorous physical activity (MVPA) and evaluated the construct validity of a framework emphasizing patterned action, stimulus-response bonding, automaticity, and negative consequences for nonperformance as indicators of habit strength for this form of exercise. Methods : Upper-level undergraduates ( N  = 124) provided demographic information and responded to questionnaire items assessing historical MVPA involvement, current MVPA involvement, and the four proposed habit strength dimensions. Factor analyses were used to examine the latent structure of the habit strength indicators, and the model's construct validity was evaluated via an examination of relationships with repetition history and current behaviour. Results : At a measurement level, findings indicated that the proposed four-component model possessed psychometric integrity as a coherent set of factors. Criterion-related validity was also demonstrated via significant changes in three of the four factors as a function of past involvement in MVPA and significant correlations with the frequency, duration, and intensity of current MVPA. Conclusions : These findings support the construct validity of this exercise habit strength model and suggest that it could provide a template for future research on how MVPA habits are developed and maintained.

IFMIF: overview of the validation activities

NASA Astrophysics Data System (ADS)

Knaster, J.; Arbeiter, F.; Cara, P.; Favuzza, P.; Furukawa, T.; Groeschel, F.; Heidinger, R.; Ibarra, A.; Matsumoto, H.; Mosnier, A.; Serizawa, H.; Sugimoto, M.; Suzuki, H.; Wakai, E.

2013-11-01

The Engineering Validation and Engineering Design Activities (EVEDA) for the International Fusion Materials Irradiation Facility (IFMIF), an international collaboration under the Broader Approach Agreement between Japan Government and EURATOM, aims at allowing a rapid construction phase of IFMIF in due time with an understanding of the cost involved. The three main facilities of IFMIF (1) the Accelerator Facility, (2) the Target Facility and (3) the Test Facility are the subject of validation activities that include the construction of either full scale prototypes or smartly devised scaled down facilities that will allow a straightforward extrapolation to IFMIF needs. By July 2013, the engineering design activities of IFMIF matured with the delivery of an Intermediate IFMIF Engineering Design Report (IIEDR) supported by experimental results. The installation of a Linac of 1.125 MW (125 mA and 9 MeV) of deuterons started in March 2013 in Rokkasho (Japan). The world's largest liquid Li test loop is running in Oarai (Japan) with an ambitious experimental programme for the years ahead. A full scale high flux test module that will house ∼1000 small specimens developed jointly in Europe and Japan for the Fusion programme has been constructed by KIT (Karlsruhe) together with its He gas cooling loop. A full scale medium flux test module to carry out on-line creep measurement has been validated by CRPP (Villigen).

Validation of alternative indicators of social support in perinatal outcomes research using quality of the partner relationship.

PubMed

Kruse, Julie A; Low, Lisa Kane; Seng, Julia S

2013-07-01

To test alternatives to the current research and clinical practice of assuming that married or partnered status is a proxy for positive social support. Having a partner is assumed to relate to better health status via the intermediary process of social support. However, women's health research indicates that having a partner is not always associated with positive social support. An exploratory post hoc analysis focused on posttraumatic stress and childbearing was conducted using a large perinatal database from 2005-2009. To operationalize partner relationship, four variables were analysed: partner ('yes' or 'no'), intimate partner violence ('yes' or 'no'), the combination of those two factors, and the woman's appraisal of the quality of her partner relationship via a single item. Construct validity of these four alternative variables was assessed in relation to appraisal of the partner's social support in labour and the postpartum using linear regression standardized betas and adjusted R-squares. Predictive validity was assessed using unadjusted and adjusted linear regression modelling. Four groups were compared. Married, abused women differed most from married, not abused women in relation to the social support, and depression outcomes used for validity checks. The variable representing the women's appraisals of their partner relationships accounts for the most variance in predicting depression scores. Our results support the validity of operationalizing the impact of the partner relationship on outcomes using a combination of partnered status and abuse status or using a subjective rating of quality of the partner relationship. © 2012 Blackwell Publishing Ltd.

Development of Measurability and Importance Scales for the NATA Athletic Training Educational Competencies.

ERIC Educational Resources Information Center

Wolfe, Edward W.; Nogle, Sally

2002-01-01

Developed and validated an instrument designed to measure the perceived measurability and importance of the National Athletic Trainers' Association Athletic Training Educational Competencies. Data from 931 athletic trainers and sport medicine physicians support 6 constructs, each of which demonstrates high reliability. (SLD)

Inhibitor-based validation of a homology model of the active-site of tripeptidyl peptidase II.

PubMed

De Winter, Hans; Breslin, Henry; Miskowski, Tamara; Kavash, Robert; Somers, Marijke

2005-04-01

A homology model of the active site region of tripeptidyl peptidase II (TPP II) was constructed based on the crystal structures of four subtilisin-like templates. The resulting model was subsequently validated by judging expectations of the model versus observed activities for a broad set of prepared TPP II inhibitors. The structure-activity relationships observed for the prepared TPP II inhibitors correlated nicely with the structural details of the TPP II active site model, supporting the validity of this model and its usefulness for structure-based drug design and pharmacophore searching experiments.

The hospital anxiety and depression scale--dimensionality, reliability and construct validity among cognitively intact nursing home patients.

PubMed

Haugan, Gørill; Drageset, Jorunn

2014-08-01

Depression and anxiety are particularly common among individuals living in long-term care facilities. Therefore, access to a valid and reliable measure of anxiety and depression among nursing home patients is highly warranted. To investigate the dimensionality, reliability and construct validity of the Hospital Anxiety and Depression scale (HADS) in a cognitively intact nursing home population. Cross-sectional data were collected from two samples; 429 cognitively intact nursing home patients participated, representing 74 different Norwegian nursing homes. Confirmative factor analyses and correlations with selected constructs were used. The two-factor model provided a good fit in Sample1, revealing a poorer fit in Sample2. Good-acceptable measurement reliability was demonstrated, and construct validity was supported. Using listwise deletion the sample sizes were 227 and 187, for Sample1 and Sample2, respectively. Greater sample sizes would have strengthen the statistical power in the tests. The researchers visited the participants to help fill in the questionnaires; this might have introduced some bias into the respondents׳ reporting. The 14 HADS items were part of greater questionnaires. Thus, frail, older NH patients might have tired during the interview causing a possible bias. Low reliability for depression was disclosed, mainly resulting from three items appearing to be inappropriate indicators for depression in this population. Further research is needed exploring which items might perform as more reliably indicators for depression among nursing home patients. Copyright © 2014 Elsevier B.V. All rights reserved.

Pathological video-gaming among Singaporean youth.

PubMed

Choo, Hyekyung; Gentile, Douglas A; Sim, Timothy; Li, Dongdong; Khoo, Angeline; Liau, Albert K

2010-11-01

Increase in internet use and video-gaming contributes to public concern on pathological or obsessive play of video games among children and adolescents worldwide. Nevertheless, little is known about the prevalence of pathological symptoms in video-gaming among Singaporean youth and the psychometric properties of instruments measuring pathological symptoms in video-gaming. A total of 2998 children and adolescents from 6 primary and 6 secondary schools in Singapore responded to a comprehensive survey questionnaire on sociodemographic characteristics, video-gaming habits, school performance, somatic symptoms, various psychological traits, social functioning and pathological symptoms of video-gaming. After weighting, the survey data were analysed to determine the prevalence of pathological video-gaming among Singaporean youth and gender differences in the prevalence. The construct validity of instrument used to measure pathological symptoms of video-gaming was tested. Of all the study participants, 8.7% were classified as pathological players with more boys reporting more pathological symptoms than girls. All variables, including impulse control problem, social competence, hostility, academic performance, and damages to social functioning, tested for construct validity, were significantly associated with pathological status, providing good evidence for the construct validity of the instrument used. The prevalence rate of pathological video-gaming among Singaporean youth is comparable with that from other countries studied thus far, and gender differences are also consistent with the findings of prior research. The positive evidence of construct validity supports the potential use of the instrument for future research and clinical screening on Singapore children and adolescents' pathological video-gaming.

Identifying gender specific risk/need areas for male and female juvenile offenders: Factor analyses with the Structured Assessment of Violence Risk in Youth (SAVRY).

PubMed

Hilterman, Ed L B; Bongers, Ilja; Nicholls, Tonia L; van Nieuwenhuizen, Chijs

2016-02-01

By constructing risk assessment tools in which the individual items are organized in the same way for male and female juvenile offenders it is assumed that these items and subscales have similar relevance across males and females. The identification of criminogenic needs that vary in relevance for 1 of the genders, could contribute to more meaningful risk assessments, especially for female juvenile offenders. In this study, exploratory factor analyses (EFA) on a construction sample of male (n = 3,130) and female (n = 466) juvenile offenders were used to aggregate the 30 items of the Structured Assessment of Violence Risk in Youth (SAVRY) into empirically based risk/need factors and explore differences between genders. The factor models were cross-validated through confirmatory factor analyses (CFA) on a validation sample of male (n = 2,076) and female (n = 357) juvenile offenders. In both the construction sample and the validation sample, 5 factors were identified: (a) Antisocial behavior; (b) Family functioning; (c) Personality traits; (d) Social support; and (e) Treatability. The male and female models were significantly different and the internal consistency of the factors was good, both in the construction sample and the validation sample. Clustering risk/need items for male and female juvenile offenders into meaningful factors may guide clinicians in the identification of gender-specific treatment interventions. PsycINFO Database Record (c) 2016 APA, all rights reserved.

Cultural competence in mental health nursing: validity and internal consistency of the Portuguese version of the multicultural mental health awareness scale-MMHAS.

PubMed

de Almeida Vieira Monteiro, Ana Paula Teixeira; Fernandes, Alexandre Bastos

2016-05-17

Cultural competence is an essential component in rendering effective and culturally responsive services to culturally and ethnically diverse clients. Still, great difficulty exists in assessing the cultural competence of mental health nurses. There are no Portuguese validated measurement instruments to assess cultural competence in mental health nurses. This paper reports a study testing the reliability and validity of the Portuguese version of the Multicultural Mental Health Awareness Scale-MMHAS in a sample of Portuguese nurses. Following a standard forward/backward translation into Portuguese, the adapted version of MMHAS, along with a sociodemographic questionnaire, were applied to a sample of 306 Portuguese nurses (299 males, 77 females; ages 21-68 years, M = 35.43, SD = 9.85 years). A psychometric research design was used with content and construct validity and reliability. Reliability was assessed using internal consistency and item-total correlations. Construct validity was determined using factor analysis. The factor analysis confirmed that the Portuguese version of MMHAS has a three-factor structure of multicultural competencies (Awareness, Knowledge, and Skills) explaining 59.51% of the total variance. Strong content validity and reliability correlations were demonstrated. The Portuguese version of MMHAS has a strong internal consistency, with a Cronbach's alpha of 0.958 for the total scale. The results supported the construct validity and reliability of the Portuguese version of MMHAS, proving that is a reliable and valid measure of multicultural counselling competencies in mental health nursing. The MMHAS Portuguese version can be used to evaluate the effectiveness of multicultural competency training programs in Portuguese-speaking mental health nurses. The scale can also be a useful in future studies of multicultural competencies in Portuguese-speaking nurses.

Validation of a proposal for evaluating hospital infection control programs.

PubMed

Silva, Cristiane Pavanello Rodrigues; Lacerda, Rúbia Aparecida

2011-02-01

To validate the construct and discriminant properties of a hospital infection prevention and control program. The program consisted of four indicators: technical-operational structure; operational prevention and control guidelines; epidemiological surveillance system; and prevention and control activities. These indicators, with previously validated content, were applied to 50 healthcare institutions in the city of São Paulo, Southeastern Brazil, in 2009. Descriptive statistics were used to characterize the hospitals and indicator scores, and Cronbach's α coefficient was used to evaluate the internal consistency. The discriminant validity was analyzed by comparing indicator scores between groups of hospitals: with versus without quality certification. The construct validity analysis was based on exploratory factor analysis with a tetrachoric correlation matrix. The indicators for the technical-operational structure and epidemiological surveillance presented almost 100% conformity in the whole sample. The indicators for the operational prevention and control guidelines and the prevention and control activities presented internal consistency ranging from 0.67 to 0.80. The discriminant validity of these indicators indicated higher and statistically significant mean conformity scores among the group of institutions with healthcare certification or accreditation processes. In the construct validation, two dimensions were identified for the operational prevention and control guidelines: recommendations for preventing hospital infection and recommendations for standardizing prophylaxis procedures, with good correlation between the analysis units that formed the guidelines. The same was found for the prevention and control activities: interfaces with treatment units and support units were identified. Validation of the measurement properties of the hospital infection prevention and control program indicators made it possible to develop a tool for evaluating these programs in an ethical and scientific manner in order to obtain a quality diagnosis in this field.

The Social Provisions Scale: psychometric properties of the SPS-10 among participants in nature-based services.

PubMed

Steigen, Anne Mari; Bergh, Daniel

2018-02-05

This article analyses the psychometric properties of the Social Provisions Scale 10-items version. The Social Provisions Scale was analysed by means of the polytomous Rasch model, applied to data on 93 young adults (16-30 years) out of school or work, participating in different nature-based services, due to mental or drug-related problems. The psychometric analysis concludes that the original scale has difficulties related to targeting and construct validity. In order to improve the psychometric properties, the scale was modified to include eight items measuring functional support. The modification was based on theoretical and statistical considerations. After modifications the scale showed not only satisfying psychometric properties, but it also clarified uncertainties regarding construct validity of the measure. However, further analysis on larger samples are required. Implications for Rehabilitation Social support is important for a variety of rehabilitation outcomes and for different patient groups in the rehabilitation context, including people with mental health or drug-related problems. Social Provisions Scale may be used as a screening tool to assess social support of participants in rehabilitation, and the scale may also be an important instrument in rehabilitation research. There might be issues measuring structural support using a 10-items version of the Social Provisions Scale but it seemed to work well as an 8-item scale measuring functional support.

Assessment study of insight ARTHRO VR (®) arthroscopy virtual training simulator: face, content, and construct validities.

PubMed

Bayona, Sofía; Fernández-Arroyo, José Manuel; Martín, Isaac; Bayona, Pilar

2008-09-01

The aims of this study were to test the face, content, and construct validities of a virtual-reality haptic arthroscopy simulator and to validate four assessment hypothesis. The participants in our study were 94 arthroscopists attending an international conference on arthroscopy. The interviewed surgeons had been performing arthroscopies for a mean of 8.71 years (σ = 6.94 years). We explained the operation, functionality, instructions for use, and the exercises provided by the simulator. They performed a trial exercise and then an exercise in which performance was recorded. After having using it, the arthroscopists answered a questionnaire. The simulator was classified as one of the best training methods (over phantoms), and obtained a mark of 7.10 out of 10 as an evaluation tool. The simulator was considered more useful for inexperienced surgeons than for surgeons with experience (mean difference 1.88 out of 10, P value < 0.001). The participants valued the simulator at 8.24 as a tool for learning skills, its fidelity at 7.41, the quality of the platform at 7.54, and the content of the exercises at 7.09. It obtained a global score of 7.82. Of the subjects, 30.8% said they would practise with the simulator more than 6 h per week. Of the surgeons, 89.4% affirmed that they would recommend the simulator to their colleagues. The data gathered support the first three hypotheses, as well as face and content validities. Results show statistically significant differences between experts and novices, thus supporting the construct validity, but studies with a larger sample must be carried out to verify this. We propose concrete solutions and an equation to calculate economy of movement. Analogously, we analyze competence measurements and propose an equation to provide a single measurement that contains them all and that, according to the surgeons' criteria, is as reliable as the judgment of experts observing the performance of an apprentice.

The six-minute walk test as a measure of postoperative recovery after colorectal resection: further examination of its measurement properties.

PubMed

Pecorelli, Nicolò; Fiore, Julio F; Gillis, Chelsia; Awasthi, Rashami; Mappin-Kasirer, Benjamin; Niculiseanu, Petru; Fried, Gerald M; Carli, Francesco; Feldman, Liane S

2016-06-01

Patients, clinicians and researchers seek an easy, reproducible and valid measure of postoperative recovery. The six-minute walk test (6MWT) is a low-cost measure of physical function, which is a relevant dimension of recovery. The aim of the present study was to contribute further evidence for the validity of the 6MWT as a measure of postoperative recovery after colorectal surgery. This study involved a sample of 174 patients enrolled in three previous randomized controlled trials. Construct validity was assessed by testing the hypotheses that the distance walked in 6 min (6MWD) at 4 weeks after surgery is greater (1) in younger versus older patients, (2) in patients with higher preoperative physical status versus lower, (3) after laparoscopic versus open surgery, (4) in patients without postoperative complications versus with postoperative complications; and that 6MWD (5) correlates cross-sectionally with self-reported physical activity as measured with a questionnaire (CHAMPS). Statistical analysis was performed using linear regression and Spearman's correlation. The COnsensus-based Standards for the selection of health Measurement INstruments (COSMIN) checklist was used to guide the formulation of hypotheses and reporting of results. One hundred and fifty-one patients who completed the 6MWT at 4 weeks after surgery were included in the analysis. All hypotheses tested for construct validity were supported by the data. Older age, poorer physical status, open surgery and occurrence of postoperative complications were associated with clinically relevant reduction in 6MWD (>19 m). There was a moderate positive correlation between 6MWD and patient-reported physical activity (r = 0.46). This study contributes further evidence for the construct validity of the 6MWT as a measure of postoperative recovery after colorectal surgery. Results from this study support the use of the 6MWT as an outcome measure in studies evaluating interventions aimed to improve postoperative recovery.

Valid and Reliable Science Content Assessments for Science Teachers

NASA Astrophysics Data System (ADS)

Tretter, Thomas R.; Brown, Sherri L.; Bush, William S.; Saderholm, Jon C.; Holmes, Vicki-Lynn

2013-03-01

Science teachers' content knowledge is an important influence on student learning, highlighting an ongoing need for programs, and assessments of those programs, designed to support teacher learning of science. Valid and reliable assessments of teacher science knowledge are needed for direct measurement of this crucial variable. This paper describes multiple sources of validity and reliability (Cronbach's alpha greater than 0.8) evidence for physical, life, and earth/space science assessments—part of the Diagnostic Teacher Assessments of Mathematics and Science (DTAMS) project. Validity was strengthened by systematic synthesis of relevant documents, extensive use of external reviewers, and field tests with 900 teachers during assessment development process. Subsequent results from 4,400 teachers, analyzed with Rasch IRT modeling techniques, offer construct and concurrent validity evidence.

Psychometric evaluation of the Spanish version of the MPI-SCI.

PubMed

Soler, M D; Cruz-Almeida, Y; Saurí, J; Widerström-Noga, E G

2013-07-01

Postal surveys. To confirm the factor structure of the Spanish version of the MPI-SCI (MPI-SCI-S, Multidimensional Pain Inventory in the SCI population) and to test its internal consistency and construct validity in a Spanish population. Guttmann Institute, Barcelona, Spain. The MPI-SCI-S along with Spanish measures of pain intensity (Numerical Rating Scale), pain interference (Brief Pain Inventory), functional independence (Functional Independence Measure), depression (Beck Depression Inventory), locus of control (Multidimensional health Locus of Control), support (Functional Social Support Questionnaire (Duke-UNC)), psychological well-being (Psychological Global Well-Being Index) and demographic/injury characteristics were assessed in persons with spinal cord injury (SCI) and chronic pain (n=126). Confirmatory factor analysis suggested an adequate factor structure for the MPI-SCI-S. The internal consistency of the MPI-SCI-S subscales ranged from acceptable (r=0.66, Life Control) to excellent (r=0.94, Life Interference). All MPI-SCI-S subscales showed adequate construct validity, with the exception of the Negative and Solicitous Responses subscales. The Spanish version of the MPI-SCI is adequate for evaluating chronic pain impact following SCI in a Spanish-speaking population. Future studies should include additional measures of pain-related support in the Spanish-speaking SCI population.

The construct and criterion validity of the multi-source feedback process to assess physician performance: a meta-analysis

PubMed Central

Al Ansari, Ahmed; Donnon, Tyrone; Al Khalifa, Khalid; Darwish, Abdulla; Violato, Claudio

2014-01-01

Background The purpose of this study was to conduct a meta-analysis on the construct and criterion validity of multi-source feedback (MSF) to assess physicians and surgeons in practice. Methods In this study, we followed the guidelines for the reporting of observational studies included in a meta-analysis. In addition to PubMed and MEDLINE databases, the CINAHL, EMBASE, and PsycINFO databases were searched from January 1975 to November 2012. All articles listed in the references of the MSF studies were reviewed to ensure that all relevant publications were identified. All 35 articles were independently coded by two authors (AA, TD), and any discrepancies (eg, effect size calculations) were reviewed by the other authors (KA, AD, CV). Results Physician/surgeon performance measures from 35 studies were identified. A random-effects model of weighted mean effect size differences (d) resulted in: construct validity coefficients for the MSF system on physician/surgeon performance across different levels in practice ranged from d=0.14 (95% confidence interval [CI] 0.40–0.69) to d=1.78 (95% CI 1.20–2.30); construct validity coefficients for the MSF on physician/surgeon performance on two different occasions ranged from d=0.23 (95% CI 0.13–0.33) to d=0.90 (95% CI 0.74–1.10); concurrent validity coefficients for the MSF based on differences in assessor group ratings ranged from d=0.50 (95% CI 0.47–0.52) to d=0.57 (95% CI 0.55–0.60); and predictive validity coefficients for the MSF on physician/surgeon performance across different standardized measures ranged from d=1.28 (95% CI 1.16–1.41) to d=1.43 (95% CI 0.87–2.00). Conclusion The construct and criterion validity of the MSF system is supported by small to large effect size differences based on the MSF process and physician/surgeon performance across different clinical and nonclinical domain measures. PMID:24600300

Construct Validity of the Nepalese School Leaving English Reading Test

ERIC Educational Resources Information Center

Dawadi, Saraswati; Shrestha, Prithvi N.

2018-01-01

There has been a steady interest in investigating the validity of language tests in the last decades. Despite numerous studies on construct validity in language testing, there are not many studies examining the construct validity of a reading test. This paper reports on a study that explored the construct validity of the English reading test in…

Assessing Knowledge Structures.

ERIC Educational Resources Information Center

Yacci, Michael

This paper presents two general approaches to the assessment of knowledge structures, the first of which entails the building of empirical evidence to support cognitive theory. This type of assessment is concerned with attempting to prove the existence of various knowledge structures; that is, evidence that leads to the construct validity of these…

Construction and Validation of the Lesbian, Gay, Bisexual, and Transgendered Climate Inventory

ERIC Educational Resources Information Center

Liddle, Becky J.; Luzzo, Darrell Anthony; Hauenstein, Anita L.; Schuck, Kelly

2004-01-01

Workplace climate refers to formal and informal organizational characteristics contributing to employee welfare. Workplace climates for lesbian, gay, bisexual, and transgendered (LGBT) employees range from actively supportive to openly hostile. An instrument measuring LGBT workplace climate will enable research on vocational adjustment of LGBT…

Merlino-Perkins Father-Daughter Relationship Inventory (MP-FDI): Construction, Reliability, Validity, and Implications for Counseling and Research

ERIC Educational Resources Information Center

Merlino Perkins, Rose J.

2008-01-01

The Merlino-Perkins Father-Daughter Relationship Inventory, a self-report instrument, assesses women's childhood interactions with supportive, doting, distant, controlling, tyrannical, physically abusive, absent, and seductive fathers. Item and scale development, psychometric findings drawn from factor analyses, reliability assessments, and…

A topological hierarchy for functions on triangulated surfaces.

PubMed

Bremer, Peer-Timo; Edelsbrunner, Herbert; Hamann, Bernd; Pascucci, Valerio

2004-01-01

We combine topological and geometric methods to construct a multiresolution representation for a function over a two-dimensional domain. In a preprocessing stage, we create the Morse-Smale complex of the function and progressively simplify its topology by cancelling pairs of critical points. Based on a simple notion of dependency among these cancellations, we construct a hierarchical data structure supporting traversal and reconstruction operations similarly to traditional geometry-based representations. We use this data structure to extract topologically valid approximations that satisfy error bounds provided at runtime.

Geomagnetism-Aided Indoor Wi-Fi Radio-Map Construction via Smartphone Crowdsourcing.

PubMed

Li, Wen; Wei, Dongyan; Lai, Qifeng; Li, Xianghong; Yuan, Hong

2018-05-08

Wi-Fi radio-map construction is an important phase in indoor fingerprint localization systems. Traditional methods for Wi-Fi radio-map construction have the problems of being time-consuming and labor-intensive. In this paper, an indoor Wi-Fi radio-map construction method is proposed which utilizes crowdsourcing data contributed by smartphone users. We draw indoor pathway map and construct Wi-Fi radio-map without requiring manual site survey, exact floor layout and extra infrastructure support. The key novelty is that it recognizes road segments from crowdsourcing traces by a cluster based on magnetism sequence similarity and constructs an indoor pathway map with Wi-Fi signal strengths annotated on. Through experiments in real world indoor areas, the method is proved to have good performance on magnetism similarity calculation, road segment clustering and pathway map construction. The Wi-Fi radio maps constructed by crowdsourcing data are validated to provide competitive indoor localization accuracy.

Geomagnetism-Aided Indoor Wi-Fi Radio-Map Construction via Smartphone Crowdsourcing

PubMed Central

Li, Wen; Wei, Dongyan; Lai, Qifeng; Li, Xianghong; Yuan, Hong

2018-01-01

Wi-Fi radio-map construction is an important phase in indoor fingerprint localization systems. Traditional methods for Wi-Fi radio-map construction have the problems of being time-consuming and labor-intensive. In this paper, an indoor Wi-Fi radio-map construction method is proposed which utilizes crowdsourcing data contributed by smartphone users. We draw indoor pathway map and construct Wi-Fi radio-map without requiring manual site survey, exact floor layout and extra infrastructure support. The key novelty is that it recognizes road segments from crowdsourcing traces by a cluster based on magnetism sequence similarity and constructs an indoor pathway map with Wi-Fi signal strengths annotated on. Through experiments in real world indoor areas, the method is proved to have good performance on magnetism similarity calculation, road segment clustering and pathway map construction. The Wi-Fi radio maps constructed by crowdsourcing data are validated to provide competitive indoor localization accuracy. PMID:29738454

The revised scale for caregiving self-efficacy: reliability and validity studies.

PubMed

Steffen, Ann M; McKibbin, Christine; Zeiss, Antonette M; Gallagher-Thompson, Dolores; Bandura, Albert

2002-01-01

Two samples of family caregivers (Study 1: N = 169; Study 2: N = 145) of cognitively impaired older adults were used to revise, extend, and evaluate a measure of perceived self-efficacy for caregiving tasks. The Revised Scale for Caregiving Self-Efficacy measures 3 domains of caregiving self-efficacy: Obtaining Respite, Responding to Disruptive Patient Behaviors, and Controlling Upsetting Thoughts. The 3 subscales show strong internal consistency and adequate test-retest reliability. Construct validity is supported by relationships between these 3 facets of perceived caregiving efficacy and depression, anxiety, anger, perceived social support, and criticism expressed in speech samples. The Revised Scale for Caregiving Self-Efficacy has potential uses for both research and clinical purposes.

Fundamental Movement Skills Are More than Run, Throw and Catch: The Role of Stability Skills.

PubMed

Rudd, James R; Barnett, Lisa M; Butson, Michael L; Farrow, Damian; Berry, Jason; Polman, Remco C J

2015-01-01

In motor development literature fundamental movement skills are divided into three constructs: locomotive, object control and stability skills. Most fundamental movement skills research has focused on children's competency in locomotor and object control skills. The first aim of this study was to validate a test battery to assess the construct of stability skills, in children aged 6 to 10 (M age = 8.2, SD = 1.2). Secondly we assessed how the stability skills construct fitted into a model of fundamental movement skill. The Delphi method was used to select the stability skill battery. Confirmatory factor analysis (CFA) was used to assess if the skills loaded onto the same construct and a new model of FMS was developed using structural equation modelling. Three postural control tasks were selected (the log roll, rock and back support) because they had good face and content validity. These skills also demonstrated good predictive validity with gymnasts scoring significantly better than children without gymnastic training and children from a high SES school performing better than those from a mid and low SES schools and the mid SES children scored better than the low SES children (all p < .05). Inter rater reliability tests were excellent for all three skills (ICC = 0.81, 0.87, 0.87) as was test re-test reliability (ICC 0.87-0.95). CFA provided good construct validity, and structural equation modelling revealed stability skills to be an independent factor in an overall FMS model which included locomotor (r = .88), object control (r = .76) and stability skills (r = .81). This study provides a rationale for the inclusion of stability skills in FMS assessment. The stability skills could be used alongside other FMS assessment tools to provide a holistic assessment of children's fundamental movement skills.

Measuring primary care organizational capacity for diabetes care coordination: the Diabetes Care Coordination Readiness Assessment.

PubMed

Weeks, Douglas L; Polello, Jennifer M; Hansen, Daniel T; Keeney, Benjamin J; Conrad, Douglas A

2014-01-01

Not all primary care clinics are prepared to implement care coordination services for chronic conditions, such as diabetes. Understanding true capacity to coordinate care is an important first-step toward establishing effective and efficient care coordination. Yet, we could identify no diabetes-specific instruments to systematically assess readiness and/or status of primary care clinics to engage in diabetes care coordination. This report describes the development and initial validation of the Diabetes Care Coordination Readiness Assessment (DCCRA), which is intended to measure primary care clinic readiness to coordinate care for adult patients with diabetes. The instrument was developed through iterative item generation within a framework of five domains of care coordination: Organizational Capacity, Care Coordination, Clinical Management, Quality Improvement, and Technical Infrastructure. Validation data was collected on 39 primary care clinics. Content validity, inter-rater reliability, internal consistency, and construct validity of the 49-item instrument were assessed. Inter-rater agreement indices per item ranged from 0.50 to 1.0. Cronbach's alpha of the entire instrument was 0.964, and for the five domain scales ranged from 0.688 to 0.961. Clinics with existing care coordinators were rated as more ready to support care coordination than clinics without care coordinators for the entire DCCRA and for each domain, supporting construct validity. As providers increasingly attempt to adopt patient-centered approaches, introduction of the DCCRA is timely and appropriate for assisting clinics with identifying gaps in provision of care coordination services. The DCCRA's strengths include promising psychometric properties. A valid measure of diabetes care coordination readiness should be useful in diabetes program evaluation, assistance with quality improvement initiatives, and measurement of patient-centered care in research.

Using Hospital Anxiety and Depression Scale (HADS) on patients with epilepsy: Confirmatory factor analysis and Rasch models.

PubMed

Lin, Chung-Ying; Pakpour, Amir H

2017-02-01

The problems of mood disorders are critical in people with epilepsy. Therefore, there is a need to validate a useful tool for the population. The Hospital Anxiety and Depression Scale (HADS) has been used on the population, and showed that it is a satisfactory screening tool. However, more evidence on its construct validity is needed. A total of 1041 people with epilepsy were recruited in this study, and each completed the HADS. Confirmatory factor analysis (CFA) and Rasch analysis were used to understand the construct validity of the HADS. In addition, internal consistency was tested using Cronbachs' α, person separation reliability, and item separation reliability. Ordering of the response descriptors and the differential item functioning (DIF) were examined using the Rasch models. The HADS showed that 55.3% of our participants had anxiety; 56.0% had depression based on its cutoffs. CFA and Rasch analyses both showed the satisfactory construct validity of the HADS; the internal consistency was also acceptable (α=0.82 in anxiety and 0.79 in depression; person separation reliability=0.82 in anxiety and 0.73 in depression; item separation reliability=0.98 in anxiety and 0.91 in depression). The difficulties of the four-point Likert scale used in the HADS were monotonically increased, which indicates no disordering response categories. No DIF items across male and female patients and across types of epilepsy were displayed in the HADS. The HADS has promising psychometric properties on construct validity in people with epilepsy. Moreover, the additive item score is supported for calculating the cutoff. Copyright © 2016 British Epilepsy Association. Published by Elsevier Ltd. All rights reserved.

FG7142, yohimbine, and βCCE produce anxiogenic-like effects in the elevated plus-maze but do not affect brainstem activated hippocampal theta.

PubMed

Yeung, Michelle; Lu, Lily; Hughes, Adam M; Treit, Dallas; Dickson, Clayton T

2013-12-01

The neurobiological underpinnings of anxiety are of paramount importance to selective and efficacious pharmaceutical intervention. Hippocampal theta frequency in urethane anaesthetized rats is suppressed by all known (and some previously unknown) anti-anxiety (anxiolytic) drugs. Although these findings support the predictive validity of this assay, its construct validity (i.e., whether theta frequency actually indexes anxiety per se) has not been a subject of systematic investigation. We reasoned that if anxiolytic drugs suppress hippocampal theta frequency, then drugs that increase anxiety (i.e., anxiogenic agents) should increase theta frequency, thus providing evidence of construct validity. We used three proven anxiogenic drugs--two benzodiazepine receptor inverse agonists, N-methyl-β-carboline-3-carboxamide (FG7142) and β-carboline-3-carboxylate ethyl ester (βCCE), and one α2 noradrenergic receptor antagonist, 17α-hydroxy-yohimban-16α-carboxylic acid methyl ester (yohimbine) as pharmacological probes to assess the construct validity of the theta model. Although all three anxiogenic drugs significantly increased behavioural measures of anxiety in the elevated plus-maze, none of the three increased the frequency of hippocampal theta oscillations in the neurophysiological model. As a positive control, we demonstrated that diazepam, a proven anxiolytic drug, decreased the frequency of hippocampal theta, as in all other studies using this model. Given this discrepancy between the significant effects of anxiogenic drugs in the behavioural model and the null effects of these drugs in the neurophysiological model, we conclude that the construct validity of the hippocampal theta model of anxiety is questionable. Copyright © 2013 Elsevier Ltd. All rights reserved.

[Reproducibility, internal consistency, and construct validity of KIDSCREEN-27 in Brazilian adolescents].

PubMed

Farias, José Cazuza de; Loch, Mathias Roberto; Lima, Antônio José de; Sales, Joana Marcela; Ferreira, Flávia Emília Leite de Lima

2017-09-28

: The objective of this two-part study was to estimate the reproducibility, internal consistency, and construct validity of KIDSCREEN-27, a questionnaire to measure health-related quality of life, in Brazilian adolescents. One study component estimated reproducibility (176 adolescents, 59.7% females, 64.7% 10 to 12 years of age), and another estimated internal consistency and validity (1,321 adolescents, 53.7% females, 56.9% 10 to 12 years of age). The studies were conducted with adolescents of both sexes in public schools in the municipality of João Pessoa, Paraíba State, Brazil. KIDSCREEN-27 consists of 27 items distributed across five domains (physical well-being, 5 items; psychological well-being, 7 items; parents and social support, 7 items; autonomy and relationship with parents, 4 items; school environment, 4 items). Reproducibility was estimated by intra-class correlation coefficient (ICC). Confirmatory factor analysis was used to assess construct validity, and composite reliability index (CRI) was used to verify the questionnaire's internal consistency. ICCs were greater than or equal to 0.70 (0.70 to 0.96). Factor loads were greater than 0.40, except for five items (0.28 to 0.39). The model's goodness-of-fit indices were adequate (χ2/df = 2.79; RMR = 0.035; RMSEA = 0.037; GFI = 0.951; AGFI = 0.941; CFI = 0.908; TLI = 0.901). CRI varied from 0.65 to 0.70 in the domains and was 0.90 for the questionnaire. KIDSCREEN-27 reached satisfactory levels of reproducibility, internal consistency, and construct validity and can be used to assess health-related quality of life in Brazilian adolescents 10 to 15 years of age.

Psychosocial Adjustment to Illness Scale: Factor structure, reliability, and validity assessment in a sample of Greek breast cancer patients.

PubMed

Kolokotroni, Philippa; Anagnostopoulos, Fotios; Missitzis, Ioannis

2017-07-01

The study and measurement of psychosocial adjustment is important for evaluating patients' well-being, and assessing the illness's course, treatment's success, and patients' recovery. In this study, internal consistency reliability and construct validity of the Greek version of the Psychosocial Adjustment to Illness Scale-Self-Report (PAIS-SR) were examined. Demographic and psychosocial data were collected from a sample of 243 women with breast cancer, recruited from September 2011 to December 2012. With some exceptions in specific items, the original conceptually-derived PAIS-SR subscales emerged in a seven-factor solution. Social Environment, Job and Household Duties, and Psychological Distress accounted for more of the total variance than other subscales. PAIS-SR showed good internal consistency reliability, with Cronbach's alpha coefficients >0.62. Correlations of PAIS-SR domains with measures of quality of life and posttraumatic stress symptoms supported the convergent validity of the PAIS-SR and its significance for cancer research. The Greek version of the PAIS-SR has acceptable internal consistency reliability and construct validity, as well as satisfactory convergent validity. Results provide some suggestions for the development of programs to evaluate adjustment status and implement psychosocial interventions among breast cancer survivors.

Validity of the Mexican version of the combined Foot Care Confidence / Foot-Care Behavior scale for diabetes.

PubMed

García-Inzunza, Jaime A; Valles-Medina, Ana M; Muñoz, Fátima A; Delgadillo-Ramos, Guadalupe; Compean-Ortiz, Lidia G

2015-07-01

To 1) translate / transculturally adapt the original (English-language) combined Foot Care Confidence Scale / Foot-Care Behavior instrument (FCCS-FCB) to produce a Mexican-Spanish version and 2) determine its validity and reliability in a population with diabetes in Tijuana, Mexico. The original FCCS-FCB was translated (and back-translated), the content validated (by a group of health professional experts), and the instrument applied to 304 patients 23-78 years old in diabetes support groups in Tijuana, Mexico. Internal consistency for the study constructs ("self-efficacy," and risk / preventive foot self-care behaviors) was measured using Cronbach's alpha. The constructs were validated using principal component factor analysis. The Cronbach's alpha values for internal consistency were 0.782 for self-efficacy and 0.505 for behaviors. Based on the analysis, two factors explained 49.1% of the total variance for self-efficacy, and six factors explained 57.7% of the total variance for behaviors. The results were consistent with those for the original (English) version of the FCCS-FCB. The Mexican version of the FCCS-FCB is a reliable and valid instrument recommended for use with Mexican-Spanish-speaking patients with diabetes.

Rural parents' perceived stigma of seeking mental health services for their children: development and evaluation of a new instrument.

PubMed

Williams, Stacey L; Polaha, Jodi

2014-09-01

The purpose of our research was to examine the validity of score interpretations of an instrument developed to measure parents' perceptions of stigma about seeking mental health services for their children. The validity of the score interpretations of the instrument was tested in 2 studies. Study 1 employed confirmatory factor analysis (CFA), using a split half approach, and construct and criterion validity on data from the entire sample of parents in rural Appalachia whose children were experiencing psychosocial concerns (N = 347), while Study 2 employed CFA, construct and criterion validity, and predictive validity of the scores on data from a general sample of parents in rural Appalachia (N = 184). Results of exploratory and confirmatory factor analyses revealed support for a 2-factor model of parents' perceived stigma, which represented both self and public forms of stigma associated with seeking mental health services for their children, and correlated with existing measures of stigma and other psychosocial variables. Further, the new self and public stigma scale significantly predicted parents' willingness to seek services for children. PsycINFO Database Record (c) 2014 APA, all rights reserved.

Measuring attitudes towards suicide: Preliminary evaluation of an attitude towards suicide scale.

PubMed

Cwik, Jan Christopher; Till, Benedikt; Bieda, Angela; Blackwell, Simon E; Walter, Carolin; Teismann, Tobias

2017-01-01

Our study aimed to validate a previously published scale assessing attitudes towards suicide. Factor structure, convergent and discriminant validity, and predictive validity were investigated. Adult German participants (N=503; mean age=24.74years; age range=18-67years) anonymously completed a set of questionnaires. An exploratory factor analysis was conducted, and incongruous items were deleted. Subsequently, scale properties of the reduced scale and its construct validity were analyzed. A confirmatory factor analysis was then conducted in an independent sample (N=266; mean age=28.77years; age range=18-88years) to further confirm the factor structure of the questionnaire. Parallel analysis indicated a three-factor solution, which was also supported by confirmatory factor analysis: right to commit suicide, interpersonal gesture and resilience. The subscales demonstrated acceptable construct and discriminant validity. Cronbach's α for the subscales ranged from 0.67 to 0.83, explaining 49.70% of the total variance. Positive attitudes towards suicide proved to be predictive of suicide risk status, providing preliminary evidence for the utility of the scale. Future studies aiming to reproduce the factor structure in a more heterogeneous sample are warranted. Copyright © 2016 Elsevier Inc. All rights reserved.

Opportunity integrated assessment facilitating critical thinking and science process skills measurement on acid base matter

NASA Astrophysics Data System (ADS)

Sari, Anggi Ristiyana Puspita; Suyanta, LFX, Endang Widjajanti; Rohaeti, Eli

2017-05-01

Recognizing the importance of the development of critical thinking and science process skills, the instrument should give attention to the characteristics of chemistry. Therefore, constructing an accurate instrument for measuring those skills is important. However, the integrated instrument assessment is limited in number. The purpose of this study is to validate an integrated assessment instrument for measuring students' critical thinking and science process skills on acid base matter. The development model of the test instrument adapted McIntire model. The sample consisted of 392 second grade high school students in the academic year of 2015/2016 in Yogyakarta. Exploratory Factor Analysis (EFA) was conducted to explore construct validity, whereas content validity was substantiated by Aiken's formula. The result shows that the KMO test is 0.714 which indicates sufficient items for each factor and the Bartlett test is significant (a significance value of less than 0.05). Furthermore, content validity coefficient which is based on 8 experts is obtained at 0.85. The findings support the integrated assessment instrument to measure critical thinking and science process skills on acid base matter.

Toward the development of a children's science curiosity measure

NASA Astrophysics Data System (ADS)

Harty, Harold; Beall, Dwight

Based on the need for, suggestions about the construction, and existing measures serving as models found in the literature both inside and outside of science education, the Children's Science Curiosity Scale has undergone six versions using four different samples of fifth graders. Respectable internal consistency (alpha) and test-retest reliabilities have been calculated. Concurrent validity has been demonstrated by significant positive correlations with another recognized curiosity measure, and by way of significant differences between students who were interested in science and students uncertain about interest in science. Somewhat weak predictive validity has been decided by way of significant positive correlations with students' semester science grades. Construct validity has been described and established by eight judges using six criteria, and supported through the use of factor analysis where four underlying factors were hypothesized as characteristics of science curiosity. Sex differences were also explored where significant differences were not found between the genders. Suggestions have been made concerning future attempts at instrument refinement, establishing conceptual validity, future research involving other variables, and classroom use in a variety of contexts.

[Diagnostic validity of attention deficit/hyperactivity disorder: from phenomenology to neurobiology (I)].

PubMed

Trujillo-Orrego, N; Pineda, D A; Uribe, L H

2012-03-01

The diagnostic criteria for the attentional deficit hyperactivity disorder (ADHD), were defined by the American Psychiatric Association in the Diagnostic and Statistical Manual of Mental Disorders fourth version (DSM-IV) and World Health Organization in the ICD-10. The American Psychiatric Association used an internal validity analysis to select specific behavioral symptoms associated with the disorder and to build five cross-cultural criteria for its use in the categorical diagnosis. The DSM has been utilized for clinicians and researchers as a valid and stable approach since 1968. We did a systematic review of scientific literature in Spanish and English, aimed to identify the historical origin that supports ADHD as a psychiatric construct. This comprehensive review started exploring the concept of minimal brain dysfunction, hyper-activity, inattention, impulsivity since 1932 to 2011. This paper summarize all the DSM versions that include the definition of ADHD or its equivalent, and it point out the statistical and methodological approach implemented for defining ADHD as a valid epidemiological and psychometric construct. Finally the paper discusses some considerations and suggestions for the new versions of the manual.

Validation of the theoretical domains framework for use in behaviour change and implementation research

PubMed Central

2012-01-01

Background An integrative theoretical framework, developed for cross-disciplinary implementation and other behaviour change research, has been applied across a wide range of clinical situations. This study tests the validity of this framework. Methods Validity was investigated by behavioural experts sorting 112 unique theoretical constructs using closed and open sort tasks. The extent of replication was tested by Discriminant Content Validation and Fuzzy Cluster Analysis. Results There was good support for a refinement of the framework comprising 14 domains of theoretical constructs (average silhouette value 0.29): ‘Knowledge’, ‘Skills’, ‘Social/Professional Role and Identity’, ‘Beliefs about Capabilities’, ‘Optimism’, ‘Beliefs about Consequences’, ‘Reinforcement’, ‘Intentions’, ‘Goals’, ‘Memory, Attention and Decision Processes’, ‘Environmental Context and Resources’, ‘Social Influences’, ‘Emotions’, and ‘Behavioural Regulation’. Conclusions The refined Theoretical Domains Framework has a strengthened empirical base and provides a method for theoretically assessing implementation problems, as well as professional and other health-related behaviours as a basis for intervention development. PMID:22530986

Hierarchical and Multidimensional Academic Self-Concept of Commercial Students.

PubMed

Yeung; Chui; Lau

1999-10-01

Adapting the Marsh (1990) Academic Self-Description Questionnaire (ASDQ), this study examined the academic self-concept of students in a school of commerce in Hong Kong (N = 212). Confirmatory factor analysis found that students clearly distinguished among self-concept constructs in English, Chinese, Math and Statistics, Economics, and Principles of Accounting, and each of these constructs was highly associated with a global Academic self-concept construct, reflecting the validity of each construct in measuring an academic component of self-concept. Domain-specific self-concepts were more highly related with students' intention of course selection in corresponding areas than in nonmatching areas, further supporting the multidimensionality of the students' academic self-concept. Students' self-concepts in the five curriculum domains can be represented by the global Academic self-concept, supporting the hierarchical structure of students' academic self-concept in an educational institution with a specific focus, such as commercial studies. The academic self-concepts of the commercial students are both multidimensional and hierarchical. Copyright 1999 Academic Press.

Social anxiety questionnaire (SAQ): Development and preliminary validation.

PubMed

Łakuta, Patryk

2018-05-30

The Social Anxiety Questionnaire (SAQ) was designed to assess five dimensions of social anxiety as posited by the Clark and Wells' (1995; Clark, 2001) cognitive model. The development of the SAQ involved generation of an item pool, followed by a verification of content validity and the theorized factor structure (Study 1). The final version of the SAQ was then assessed for reliability, temporal stability (test re-test reliability), and construct, criterion-related, and contrasted-group validity (Study 2, 3, and 4). Following a systematic process, the results provide support for the SAQ as reliable, and both theoretically and empirically valid measure. A five-factor structure of the SAQ verified and replicated through confirmatory factor analyses reflect five dimensions of social anxiety: negative self-processing; self-focused attention and self-monitoring; safety behaviours; somatic and cognitive symptoms; and anticipatory and post-event rumination. Results suggest that the SAQ possesses good psychometric properties, while recognizing that additional validation is a required future research direction. It is important to replicate these findings in diverse populations, including a large clinical sample. The SAQ is a promising measure that supports social anxiety as a multidimensional construct, and the foundational role of self-focused cognitive processes in generation and maintenance of social anxiety symptoms. The findings make a significant contribution to the literature, moreover, the SAQ is a first instrument that offers to assess all, proposed by the Clark-Wells model, specific cognitive-affective, physiological, attitudinal, and attention processes related to social anxiety. Copyright © 2018 Elsevier B.V. All rights reserved.

Psychometric properties of the Treatment-Emergent Activation and Suicidality Assessment Profile (TEASAP) in youth with OCD.

PubMed

Bussing, Regina; Murphy, Tanya K; Storch, Eric A; McNamara, Joseph P H; Reid, Adam M; Garvan, Cynthia W; Goodman, Wayne K

2013-02-28

This study evaluated the psychometric properties of the treatment-emergent activation and suicidality assessment profile (TEASAP) in a clinical sample of 56 youth aged 7-17 with obsessive-compulsive disorder (OCD) who participated in a double-blind randomized controlled trial. The 38-item TEASAP demonstrated good internal consistency for its total score (α=0.93) and adequate to good performance for its five subscale scores (α=0.65-0.92). One-week test-retest stability (N=18) was adequate (Intraclass correlation coefficient [ICC]=0.68-0.80) except for Self-Injury (ICC=0.46). Construct validity was supported by total and subscale TEASAP score relationships with related constructs, including irritability, hyperactivity, externalizing behaviors, manic symptoms, and suicidal ideation, and the absence of relationships with unrelated constructs. Predictive validity was established for the Disinhibition subscale through significant associations with subsequent activation events. Furthermore, TEASAP sensitivity to change in activation scores over time was supported by longitudinal associations of TEASAP scores with clinician ratings of activation over the course of treatment. Findings indicate that the TEASAP has acceptable psychometric properties in a clinical sample of youth with OCD and merits further study in larger samples for additional refinement of its measurement approaches. Copyright © 2012 Elsevier Ireland Ltd. All rights reserved.

Reliable and valid assessment of point-of-care ultrasonography.

PubMed

Todsen, Tobias; Tolsgaard, Martin Grønnebæk; Olsen, Beth Härstedt; Henriksen, Birthe Merete; Hillingsø, Jens Georg; Konge, Lars; Jensen, Morten Lind; Ringsted, Charlotte

2015-02-01

To explore the reliability and validity of the Objective Structured Assessment of Ultrasound Skills (OSAUS) scale for point-of-care ultrasonography (POC US) performance. POC US is increasingly used by clinicians and is an essential part of the management of acute surgical conditions. However, the quality of performance is highly operator-dependent. Therefore, reliable and valid assessment of trainees' ultrasonography competence is needed to ensure patient safety. Twenty-four physicians, representing novices, intermediates, and experts in POC US, scanned 4 different surgical patient cases in a controlled set-up. All ultrasound examinations were video-recorded and assessed by 2 blinded radiologists using OSAUS. Reliability was examined using generalizability theory. Construct validity was examined by comparing performance scores between the groups and by correlating physicians' OSAUS scores with diagnostic accuracy. The generalizability coefficient was high (0.81) and a D-study demonstrated that 1 assessor and 5 cases would result in similar reliability. The construct validity of the OSAUS scale was supported by a significant difference in the mean scores between the novice group (17.0; SD 8.4) and the intermediate group (30.0; SD 10.1), P = 0.007, as well as between the intermediate group and the expert group (72.9; SD 4.4), P = 0.04, and by a high correlation between OSAUS scores and diagnostic accuracy (Spearman ρ correlation coefficient = 0.76; P < 0.001). This study demonstrates high reliability as well as evidence of construct validity of the OSAUS scale for assessment of POC US competence. Hence, the OSAUS scale may be suitable for both in-training as well as end-of-training assessment.

Construct validity of the Nutrition and Activity Knowledge Scale in a French sample of adolescents with mild to moderate intellectual disability.

PubMed

Maïano, Christophe; Bégarie, Jérôme; Morin, Alexandre J S; Garbarino, Jean-Marie; Ninot, Grégory

2010-01-01

The purpose of this study was to test the reliability (i.e. internal consistency and test-retest reliability) and construct validity (i.e. content validity, factor validity, measurement invariance, and latent mean invariance) of the Nutrition and Activity Knowledge Scale (NAKS) in a sample of French adolescents with mild to moderate Intellectual Disability (ID). A total sample of 260 adolescents (144 boys and 116 girls), aged between 12 and 18 years old, with mild to moderate ID was involved in two studies. In the first study, analysis of items' content reveals that many words from the original version were not understood or induced confusion. These items were reworded and simplified while retaining their original meaning. In the second study, results provided support for: (i) the factor validity and reliability of a 15-item French version of the NAKS; (ii) the measurement invariance of the resulting NAKS across genders and ID levels; (iii) the partial measurement invariance of the resulting NAKS across age groups and type of school placement. In addition, the latent means of the 15-item French version of the NAKS proved to be invariant across gender, age categories, and ID levels, but to vary across type of school placement (with adolescents schooled in self-contained classes from regular schools presenting higher levels of NAK than adolescents placed in specialized establishments). The present results thus provide preliminary evidence regarding the construct validity of a 15-item French version of the NAKS in a sample of adolescents with ID.

ICD-11 complex PTSD among Israeli male perpetrators of intimate partner violence: Construct validity and risk factors.

PubMed

Gilbar, Ohad; Hyland, Philip; Cloitre, Marylene; Dekel, Rachel

2018-03-01

The International Classification of Diseases 11th Version (ICD-11) will include Complex Posttraumatic Stress Disorder (CPTSD) as a unique diagnostic entity comprising core PTSD and DSO (disturbances in self-organization) symptoms. The current study had three aims: (1) assessing the validity of CPTSD in a unique population of male perpetrators of intimate partner violence; (2) examining whether exposure to different types of traumatic events would be associated with the two proposed CPTSD factors, namely PTSD or DSO; and (3) assessing the differential association of various sociodemographic and symptom characteristics with each factor. Participants were 234 males drawn randomly from a sample of 2600 men receiving treatment at 66 domestic violence centers in Israel. Data were collected using the International Trauma Questionnaire (ITQ) - Hebrew version. Confirmatory factor analysis supported the factorial validity of ICD-11 CPTSD. Cumulative lifetime trauma and physical childhood neglect were associated with PTSD and DSO, while cumulative childhood violence exposure was associated only with DSO. Anxiety was associated only with DSO; depression more strongly with DSO than PTSD. Religious level contributed only to PTSD; compulsory military service only to DSO. The study supports the distinction between PTSD and DSO in the CPTSD construct and introduces the role of cultural variables. Copyright © 2018 Elsevier Ltd. All rights reserved.

Standardization of Brief Inventory of Social Support Exchange Network (BISSEN) in Japan.

PubMed

Aiba, Miyuki; Tachikawa, Hirokazu; Fukuoka, Yoshiharu; Lebowitz, Adam; Shiratori, Yuki; Doi, Nagafumi; Matsui, Yutaka

2017-07-01

This study describes the Brief Inventory of Social Support Exchange Network (BISSEN) as a standardized brief inventory measuring various aspects of social support. We confirmed the reliability and validity for function and direction of support and standardized the BISSEN. For Sample 1, a stratified random sampling method was used to select 5200 residents in Japan. We conducted mail surveys and responses were retrieved from 2274 participants (collection rate 43.7%). Participants completed a questionnaire packet that included BISSEN, suicidal ideation, depression, support seeking, and Multidimensional Scale of Perceived Social Support (MSPSS). Sample 2 surveys for test-retest reliability were conducted on 23 residents at approximately two-week intervals. Participants were asked about gender, age, and BISSEN. First, we assessed the internal consistency, test-retest reliability, construct, convergent, and concurrent validity. McDonald's omega (.73-.92) and test-retest correlations (.78-.85) demonstrated adequate internal consistency and test-retest reliability. Depression, support seeking, and MSPSS were significantly correlated with all scores of BISSEN. The non-suicidal ideation group had significantly more support compared to the suicidal ideation group. Therefore, function and direction of support in BISSEN had sufficient reliability and validity. Next, we standardized BISSEN using Z-scores and percentile rank with respect to each 12 norm groups by age and gender. Copyright © 2017 Elsevier Ireland Ltd. All rights reserved.

The reliability and validity of the Maryland Assessment of Recovery in Serious Mental Illness Scale.

PubMed

Drapalski, Amy L; Medoff, Deborah; Dixon, Lisa; Bellack, Alan

2016-05-30

The current study aims to further evaluate the psychometric properties of the Maryland Assessment of Recovery in Serious Mental Illness (MARS), a relatively new instrument designed to assess personal recovery status in individuals with serious mental illness. Two hundred and fifty individuals with serious mental illness receiving outpatient mental health treatment completed a baseline assessment which included the MARS and measures to assess recovery-related constructs, clinical outcomes, and social and community functioning. The MARS demonstrated excellent internal consistency and test-retest reliability. Good construct validity was evidenced by strong positive relationships between the MARS and recovery-related constructs (e.g. hope, empowerment, self-efficacy, and personal agency) and a strong negative relationship with self-stigma. Divergent validity was demonstrated by weaker relationships with cognitive and social functioning. The confirmatory factor analysis did not confirm the unitary factor structure found in previous research. Given the equivocal result of the CFA, additional exploratory work is needed to determine if a more complex factor structure is present. This study provides addition support for the psychometric soundness of the MARS and subsequently, its potential use as a measure of personal recovery status in people with serious mental illness. Published by Elsevier Ireland Ltd.

Psychological Literacy Weakly Differentiates Students by Discipline and Year of Enrolment.

PubMed

Heritage, Brody; Roberts, Lynne D; Gasson, Natalie

2016-01-01

Psychological literacy, a construct developed to reflect the types of skills graduates of a psychology degree should possess and be capable of demonstrating, has recently been scrutinized in terms of its measurement adequacy. The recent development of a multi-item measure encompassing the facets of psychological literacy has provided the potential for improved validity in measuring the construct. We investigated the known-groups validity of this multi-item measure of psychological literacy to examine whether psychological literacy could predict (a) students' course of enrolment and (b) students' year of enrolment. Five hundred and fifteen undergraduate psychology students, 87 psychology/human resource management students, and 83 speech pathology students provided data. In the first year cohort, the reflective processes (RPs) factor significantly predicted psychology and psychology/human resource management course enrolment, although no facets significantly differentiated between psychology and speech pathology enrolment. Within the second year cohort, generic graduate attributes (GGAs) and RPs differentiated psychology and speech pathology course enrolment. GGAs differentiated first-year and second-year psychology students, with second-year students more likely to have higher scores on this factor. Due to weak support for known-groups validity, further measurement refinements are recommended to improve the construct's utility.

Dimensionality and construct validity of an instrument designed to measure the metacognitive orientation of science classroom learning environments.

PubMed

Thomas, Gregory P

2004-01-01

The purpose of this study was to establish the factorial construct validity and dimensionality of the Metacognitive Orientation Learning Environment Scale-Science (MOLES-S) which was designed to measure the metacognitive orientation of science classroom learning environments. The metacognitive orientation of a science classroom learning environment is the extent to which psychosocial conditions that are known to enhance students' metacognition are evident within that classroom. The development of items comprising this scale was based on a theoretical understanding of metacognition, learning environments and the development of previous learning environments instruments. Four possible hypothesized structure models, each consistent with the literature, were reviewed and their merits were compared on the basis of empirical data drawn from two populations of 1026 and 1223 Hong Kong secondary school students using confirmatory factor analysis procedures. The scale was calibrated using the Rasch rating scale model using data from the 1223 student sample. The results suggest that there is strong evidence to support the factorial construct validity of the MOLES-S but that, on the basis of the Rasch analysis, there are still suggestions for further refinement and improvement of the MOLES-S.

Discriminant content validity: a quantitative methodology for assessing content of theory-based measures, with illustrative applications.

PubMed

Johnston, Marie; Dixon, Diane; Hart, Jo; Glidewell, Liz; Schröder, Carin; Pollard, Beth

2014-05-01

In studies involving theoretical constructs, it is important that measures have good content validity and that there is not contamination of measures by content from other constructs. While reliability and construct validity are routinely reported, to date, there has not been a satisfactory, transparent, and systematic method of assessing and reporting content validity. In this paper, we describe a methodology of discriminant content validity (DCV) and illustrate its application in three studies. Discriminant content validity involves six steps: construct definition, item selection, judge identification, judgement format, single-sample test of content validity, and assessment of discriminant items. In three studies, these steps were applied to a measure of illness perceptions (IPQ-R) and control cognitions. The IPQ-R performed well with most items being purely related to their target construct, although timeline and consequences had small problems. By contrast, the study of control cognitions identified problems in measuring constructs independently. In the final study, direct estimation response formats for theory of planned behaviour constructs were found to have as good DCV as Likert format. The DCV method allowed quantitative assessment of each item and can therefore inform the content validity of the measures assessed. The methods can be applied to assess content validity before or after collecting data to select the appropriate items to measure theoretical constructs. Further, the data reported for each item in Appendix S1 can be used in item or measure selection. Statement of contribution What is already known on this subject? There are agreed methods of assessing and reporting construct validity of measures of theoretical constructs, but not their content validity. Content validity is rarely reported in a systematic and transparent manner. What does this study add? The paper proposes discriminant content validity (DCV), a systematic and transparent method of assessing and reporting whether items assess the intended theoretical construct and only that construct. In three studies, DCV was applied to measures of illness perceptions, control cognitions, and theory of planned behaviour response formats. Appendix S1 gives content validity indices for each item of each questionnaire investigated. Discriminant content validity is ideally applied while the measure is being developed, before using to measure the construct(s), but can also be applied after using a measure. © 2014 The British Psychological Society.

Cross-Cultural Adaptation and Validation of the SWAL-QoL Questionnaire in Greek.

PubMed

Georgopoulos, Voula C; Perdikogianni, Myrto; Mouskenteri, Myrto; Psychogiou, Loukia; Oikonomou, Maria; Malandraki, Georgia A

2018-02-01

The purpose of this study was to translate and adapt the 44-item SWAL-QoL into Greek and examine its internal consistency, test-retest reliability, external construct validity, and discriminant validity in order to provide a validated dysphagia-specific QoL instrument in the Greek language. The instrument was translated into Greek using the back translation to ensure linguistic validity and was culturally adapted resulting in the SWAL-QoL-GR. Two groups of participants were included: a patient group of 86 adults (48 males; age range: 18-87 years) diagnosed with oropharyngeal dysphagia, and an age-matched healthy control group (39 adults; 19 males; age range: 18-84 years). The Greek 30-item version of the WHOQOL-BREF was used for assessment of construct validity. Overall, the questionnaire achieved good to excellent psychometric values. Internal consistency of all 10 subscales and the physical symptoms scale of the SWAL-QoL-GR assessed by Cronbach's α was good to excellent (0.811 < α < 0.940). Test-retest validity was found to be good to excellent as well. In addition, moderate to strong correlations were found between seven of the ten subscales of the SWAL-QoL-GR with limited items of the WHOQΟL-BREF (0.401 < ρ < 0.65), supporting good construct validity of the SWAL-QoL-GR. The SWAL-QoL-GR also correctly differentiated between patients with dysphagia and age-matched healthy controls (p < 0.001) on all 11 scales, further indicating excellent discriminant validity. Finally, no significant differences were found between the two sexes. This cultural adaptation and validation allows the use of this tool in Greece, further enhancing our clinical and scientific efforts to increase the evidence-based practice resources for dysphagia rehabilitation in Greece.

Development and validation of Dutch version of Lasater Clinical Judgment Rubric in hospital practice: An instrument design study.

PubMed

Vreugdenhil, Jettie; Spek, Bea

2018-03-01

Clinical reasoning in patient care is a skill that cannot be observed directly. So far, no reliable, valid instrument exists for the assessment of nursing students' clinical reasoning skills in hospital practice. Lasater's clinical judgment rubric (LCJR), based on Tanner's model "Thinking like a nurse" has been tested, mainly in academic simulation settings. The aim is to develop a Dutch version of the LCJR (D-LCJR) and to test its psychometric properties when used in a hospital traineeship context. A mixed-model approach was used to develop and to validate the instrument. Ten dedicated educational units in a university hospital. A well-mixed group of 52 nursing students, nurse coaches and nurse educators. A Delphi panel developed the D-LCJR. Students' clinical reasoning skills were assessed "live" by nurse coaches, nurse educators and students who rated themselves. The psychometric properties tested during the assessment process are reliability, reproducibility, content validity and construct validity by testing two hypothesis: 1) a positive correlation between assessed and self-reported sum scores (convergent validity) and 2) a linear relation between experience and sum score (clinical validity). The obtained D-LCJR was found to be internally consistent, Cronbach's alpha 0.93. The rubric is also reproducible with intraclass correlations between 0.69 and 0.78. Experts judged it to be content valid. The two hypothesis were both tested significant, supporting evidence for construct validity. The translated and modified LCJR, is a promising tool for the evaluation of nursing students' development in clinical reasoning in hospital traineeships, by students, nurse coaches and nurse educators. More evidence on construct validity is necessary, in particular for students at the end of their hospital traineeship. Based on our research, the D-LCJR applied in hospital traineeships is a usable and reliable tool. Copyright © 2017 Elsevier Ltd. All rights reserved.

Reliability and Validity of an Internet-based Questionnaire Measuring Lifetime Physical Activity

PubMed Central

De Vera, Mary A.; Ratzlaff, Charles; Doerfling, Paul; Kopec, Jacek

2010-01-01

Lifetime exposure to physical activity is an important construct for evaluating associations between physical activity and disease outcomes, given the long induction periods in many chronic diseases. The authors' objective in this study was to evaluate the measurement properties of the Lifetime Physical Activity Questionnaire (L-PAQ), a novel Internet-based, self-administered instrument measuring lifetime physical activity, among Canadian men and women in 2005–2006. Reliability was examined using a test-retest study. Validity was examined in a 2-part study consisting of 1) comparisons with previously validated instruments measuring similar constructs, the Lifetime Total Physical Activity Questionnaire (LT-PAQ) and the Chasan-Taber Physical Activity Questionnaire (CT-PAQ), and 2) a priori hypothesis tests of constructs measured by the L-PAQ. The L-PAQ demonstrated good reliability, with intraclass correlation coefficients ranging from 0.67 (household activity) to 0.89 (sports/recreation). Comparison between the L-PAQ and the LT-PAQ resulted in Spearman correlation coefficients ranging from 0.41 (total activity) to 0.71 (household activity); comparison between the L-PAQ and the CT-PAQ yielded coefficients of 0.58 (sports/recreation), 0.56 (household activity), and 0.50 (total activity). L-PAQ validity was further supported by observed relations between the L-PAQ and sociodemographic variables, consistent with a priori hypotheses. Overall, the L-PAQ is a useful instrument for assessing multiple domains of lifetime physical activity with acceptable reliability and validity. PMID:20876666

Measuring Acceptance of Sleep Difficulties: The Development of the Sleep Problem Acceptance Questionnaire.

PubMed

Bothelius, Kristoffer; Jernelöv, Susanna; Fredrikson, Mats; McCracken, Lance M; Kaldo, Viktor

2015-11-01

Acceptance may be an important therapeutic process in sleep medicine, but valid psychometric instruments measuring acceptance related to sleep difficulties are lacking. The purpose of this study was to develop a measure of acceptance in insomnia, and to examine its factor structure as well as construct validity. In a cross-sectional design, a principal component analysis for item reduction was conducted on a first sample (A) and a confirmatory factor analysis on a second sample (B). Construct validity was tested on a combined sample (C). Questionnaire items were derived from a measure of acceptance in chronic pain, and data were gathered through screening or available from pretreatment assessments in four insomnia treatment trials, administered online, via bibliotherapy and in primary care. Adults with insomnia: 372 in sample A and 215 in sample B. Sample C (n = 820) included sample A and B with another 233 participants added. Construct validity was assessed through relations with established acceptance and sleep scales. The principal component analysis presented a two-factor solution with eight items, explaining 65.9% of the total variance. The confirmatory factor analysis supported the solution. Acceptance of sleep problems was more closely related to subjective symptoms and consequences of insomnia than to diary description of sleep, or to acceptance of general private events. The Sleep Problem Acceptance Questionnaire (SPAQ), containing the subscales "Activity Engagement" and "Willingness", is a valid tool to assess acceptance of insomnia. © 2015 Associated Professional Sleep Societies, LLC.

Reliability and validity of an internet-based questionnaire measuring lifetime physical activity.

PubMed

De Vera, Mary A; Ratzlaff, Charles; Doerfling, Paul; Kopec, Jacek

2010-11-15

Lifetime exposure to physical activity is an important construct for evaluating associations between physical activity and disease outcomes, given the long induction periods in many chronic diseases. The authors' objective in this study was to evaluate the measurement properties of the Lifetime Physical Activity Questionnaire (L-PAQ), a novel Internet-based, self-administered instrument measuring lifetime physical activity, among Canadian men and women in 2005-2006. Reliability was examined using a test-retest study. Validity was examined in a 2-part study consisting of 1) comparisons with previously validated instruments measuring similar constructs, the Lifetime Total Physical Activity Questionnaire (LT-PAQ) and the Chasan-Taber Physical Activity Questionnaire (CT-PAQ), and 2) a priori hypothesis tests of constructs measured by the L-PAQ. The L-PAQ demonstrated good reliability, with intraclass correlation coefficients ranging from 0.67 (household activity) to 0.89 (sports/recreation). Comparison between the L-PAQ and the LT-PAQ resulted in Spearman correlation coefficients ranging from 0.41 (total activity) to 0.71 (household activity); comparison between the L-PAQ and the CT-PAQ yielded coefficients of 0.58 (sports/recreation), 0.56 (household activity), and 0.50 (total activity). L-PAQ validity was further supported by observed relations between the L-PAQ and sociodemographic variables, consistent with a priori hypotheses. Overall, the L-PAQ is a useful instrument for assessing multiple domains of lifetime physical activity with acceptable reliability and validity.

Inappropriate and Excessive Guilt: Instrument Validation and Developmental Differences in Relation to Depression

PubMed Central

Tilghman-Osborne, Carlos; Felton, Julia W.

2014-01-01

Inappropriate or excessive guilt is listed as a symptom of depression by the American Psychiatric Association (1994). Although many measures of guilt have been developed, definitional and operational problems exist, especially in the application of such measures in childhood and adolescence. To address these problems, the current study introduces the Inappropriate and Excessive Guilt Scale (IEGS), assesses its validity for use with children and adolescents, and tests its relation to depression across development. From a sample of 370 children between 7 and 16 years old, results provided (1) evidence that items designed to assess inappropriate and excessive guilt converged onto a single underlying factor, (2) support for the convergent, discriminant, and construct validity of the IEGS in a general youth population, and (3) evidence of incremental validity of the IEGS over-and-above other measures of guilt. Results also supported the hypothesis that inappropriate and excessive guilt as well as negative cognitive errors become less normative and more depressotypic with age. PMID:22086497

Dependence and physical exercise: Spanish validation of the Exercise Dependence Scale-Revised (EDS-R).

PubMed

Sicilia, Alvaro; González-Cutre, David

2011-05-01

The purpose of this study was to validate the Spanish version of the Exercise Dependence Scale-Revised (EDS-R). To achieve this goal, a sample of 531 sport center users was used and the psychometric properties of the EDS-R were examined through different analyses. The results supported both the first-order seven-factor model and the higher-order model (seven first-order factors and one second-order factor). The structure of both models was invariant across age. Correlations among the subscales indicated a related factor model, supporting construct validity of the scale. Alpha values over .70 (except for Reduction in Other Activities) and suitable levels of temporal stability were obtained. Users practicing more than three days per week had higher scores in all subscales than the group practicing with a frequency of three days or fewer. The findings of this study provided reliability and validity for the EDS-R in a Spanish context.

A Psychometric Analysis of the Italian Version of the eHealth Literacy Scale Using Item Response and Classical Test Theory Methods.

PubMed

Diviani, Nicola; Dima, Alexandra Lelia; Schulz, Peter Johannes

2017-04-11

The eHealth Literacy Scale (eHEALS) is a tool to assess consumers' comfort and skills in using information technologies for health. Although evidence exists of reliability and construct validity of the scale, less agreement exists on structural validity. The aim of this study was to validate the Italian version of the eHealth Literacy Scale (I-eHEALS) in a community sample with a focus on its structural validity, by applying psychometric techniques that account for item difficulty. Two Web-based surveys were conducted among a total of 296 people living in the Italian-speaking region of Switzerland (Ticino). After examining the latent variables underlying the observed variables of the Italian scale via principal component analysis (PCA), fit indices for two alternative models were calculated using confirmatory factor analysis (CFA). The scale structure was examined via parametric and nonparametric item response theory (IRT) analyses accounting for differences between items regarding the proportion of answers indicating high ability. Convergent validity was assessed by correlations with theoretically related constructs. CFA showed a suboptimal model fit for both models. IRT analyses confirmed all items measure a single dimension as intended. Reliability and construct validity of the final scale were also confirmed. The contrasting results of factor analysis (FA) and IRT analyses highlight the importance of considering differences in item difficulty when examining health literacy scales. The findings support the reliability and validity of the translated scale and its use for assessing Italian-speaking consumers' eHealth literacy. ©Nicola Diviani, Alexandra Lelia Dima, Peter Johannes Schulz. Originally published in the Journal of Medical Internet Research (http://www.jmir.org), 11.04.2017.

Calibration and Validation of the Dutch-Flemish PROMIS Pain Interference Item Bank in Patients with Chronic Pain

PubMed Central

Crins, Martine H. P.; Roorda, Leo D.; Smits, Niels; de Vet, Henrica C. W.; Westhovens, Rene; Cella, David; Cook, Karon F.; Revicki, Dennis; van Leeuwen, Jaap; Boers, Maarten; Dekker, Joost; Terwee, Caroline B.

2015-01-01

The Dutch-Flemish PROMIS Group translated the adult PROMIS Pain Interference item bank into Dutch-Flemish. The aims of the current study were to calibrate the parameters of these items using an item response theory (IRT) model, to evaluate the cross-cultural validity of the Dutch-Flemish translations compared to the original English items, and to evaluate their reliability and construct validity. The 40 items in the bank were completed by 1085 Dutch chronic pain patients. Before calibrating the items, IRT model assumptions were evaluated using confirmatory factor analysis (CFA). Items were calibrated using the graded response model (GRM), an IRT model appropriate for items with more than two response options. To evaluate cross-cultural validity, differential item functioning (DIF) for language (Dutch vs. English) was examined. Reliability was evaluated based on standard errors and Cronbach’s alpha. To evaluate construct validity correlations with scores on legacy instruments (e.g., the Disabilities of the Arm, Shoulder and Hand Questionnaire) were calculated. Unidimensionality of the Dutch-Flemish PROMIS Pain Interference item bank was supported by CFA tests of model fit (CFI = 0.986, TLI = 0.986). Furthermore, the data fit the GRM and showed good coverage across the pain interference continuum (threshold-parameters range: -3.04 to 3.44). The Dutch-Flemish PROMIS Pain Interference item bank has good cross-cultural validity (only two out of 40 items showing DIF), good reliability (Cronbach’s alpha = 0.98), and good construct validity (Pearson correlations between 0.62 and 0.75). A computer adaptive test (CAT) and Dutch-Flemish PROMIS short forms of the Dutch-Flemish PROMIS Pain Interference item bank can now be developed. PMID:26214178

Calibration and Validation of the Dutch-Flemish PROMIS Pain Interference Item Bank in Patients with Chronic Pain.

PubMed

Crins, Martine H P; Roorda, Leo D; Smits, Niels; de Vet, Henrica C W; Westhovens, Rene; Cella, David; Cook, Karon F; Revicki, Dennis; van Leeuwen, Jaap; Boers, Maarten; Dekker, Joost; Terwee, Caroline B

2015-01-01

The Dutch-Flemish PROMIS Group translated the adult PROMIS Pain Interference item bank into Dutch-Flemish. The aims of the current study were to calibrate the parameters of these items using an item response theory (IRT) model, to evaluate the cross-cultural validity of the Dutch-Flemish translations compared to the original English items, and to evaluate their reliability and construct validity. The 40 items in the bank were completed by 1085 Dutch chronic pain patients. Before calibrating the items, IRT model assumptions were evaluated using confirmatory factor analysis (CFA). Items were calibrated using the graded response model (GRM), an IRT model appropriate for items with more than two response options. To evaluate cross-cultural validity, differential item functioning (DIF) for language (Dutch vs. English) was examined. Reliability was evaluated based on standard errors and Cronbach's alpha. To evaluate construct validity correlations with scores on legacy instruments (e.g., the Disabilities of the Arm, Shoulder and Hand Questionnaire) were calculated. Unidimensionality of the Dutch-Flemish PROMIS Pain Interference item bank was supported by CFA tests of model fit (CFI = 0.986, TLI = 0.986). Furthermore, the data fit the GRM and showed good coverage across the pain interference continuum (threshold-parameters range: -3.04 to 3.44). The Dutch-Flemish PROMIS Pain Interference item bank has good cross-cultural validity (only two out of 40 items showing DIF), good reliability (Cronbach's alpha = 0.98), and good construct validity (Pearson correlations between 0.62 and 0.75). A computer adaptive test (CAT) and Dutch-Flemish PROMIS short forms of the Dutch-Flemish PROMIS Pain Interference item bank can now be developed.

The validity of the 4-Skills Scan: A double validation study.

PubMed

van Kernebeek, W G; de Kroon, M L A; Savelsbergh, G J P; Toussaint, H M

2018-06-01

Adequate gross motor skills are an essential aspect of a child's healthy development. Where physical education (PE) is part of the primary school curriculum, a strong curriculum-based emphasis on evaluation and support of motor skill development in PE is apparent. Monitoring motor development is then a task for the PE teacher. In order to fulfil this task, teachers need adequate tools. The 4-Skills Scan is a quick and easily manageable gross motor skill instrument; however, its validity has never been assessed. Therefore, the purpose of this study is to assess the construct and concurrent validity of both 4-Skills Scans (version 2007 and version 2015). A total of 212 primary school children (6 - 12 years old), was requested to participate in both versions of the 4-Skills Scan. For assessing construct validity, children covered an obstacle course with video recordings for observation by an expert panel. For concurrent validity, a comparison was made with the MABC-2, by calculating Pearson correlations. Multivariable linear regression analyses were performed to determine the contribution of each subscale to the construct of gross motor skills, according to the MABC-2 and the expert panel. Correlations between the 4-Skills Scans and expert valuations were moderate, with coefficients of .47 (version 2007) and .46 (version 2015). Correlations between the 4-Skills Scans and the MABC-2 (gross) were moderate (.56) for version 2007 and high (.64) for version 2015. It is concluded that both versions of the 4-Skills Scans are satisfactory valid instruments for assessing gross motor skills during PE lessons. This article is protected by copyright. All rights reserved. This article is protected by copyright. All rights reserved.

Development and validation of a scale to measure perceived control of internal states.

PubMed

Pallant, J F

2000-10-01

One of the key developments in the psychological literature on control has been the growing recognition of the multidimensional nature of the control construct. Recent research suggests that perceived control of internal states may be just as important as perceived control of external events. The Perceived Control of Internal States Scale was developed to provide a measure of the degree to which people feel they have control of their internal states (emotions, thoughts, physical reactions). I report the results of 2 studies (N= 689), supporting the reliability, construct, and incremental validity of the scale. The buffering effects of perceived control for people facing major life events was also explored, with higher levels of perceived control being associated with less physical and psychological symptoms of strain.

Validation and clinical utility of the executive function performance test in persons with traumatic brain injury.

PubMed

Baum, C M; Wolf, T J; Wong, A W K; Chen, C H; Walker, K; Young, A C; Carlozzi, N E; Tulsky, D S; Heaton, R K; Heinemann, A W

2017-07-01

This study examined the relationships between the Executive Function Performance Test (EFPT), the NIH Toolbox Cognitive Function tests, and neuropsychological executive function measures in 182 persons with traumatic brain injury (TBI) and 46 controls to evaluate construct, discriminant, and predictive validity. Construct validity: There were moderate correlations between the EFPT and the NIH Toolbox Crystallized (r = -.479), Fluid Tests (r = -.420), and Total Composite Scores (r = -.496). Discriminant validity: Significant differences were found in the EFPT total and sequence scores across control, complicated mild/moderate, and severe TBI groups. We found differences in the organisation score between control and severe, and between mild and severe TBI groups. Both TBI groups had significantly lower scores in safety and judgement than controls. Compared to the controls, the severe TBI group demonstrated significantly lower performance on all instrumental activities of daily living (IADL) tasks. Compared to the mild TBI group, the controls performed better on the medication task, the severe TBI group performed worse in the cooking and telephone tasks. Predictive validity: The EFPT predicted the self-perception of independence measured by the TBI-QOL (beta = -0.49, p < .001) for the severe TBI group. Overall, these data support the validity of the EFPT for use in individuals with TBI.

Evaluation of the Irritable Bowel Syndrome Quality of Life (IBS-QOL) questionnaire in diarrheal-predominant irritable bowel syndrome patients

PubMed Central

2013-01-01

Background Diarrhea-predominant irritable bowel syndrome (IBS-d) significantly diminishes the health-related quality of life (HRQOL) of patients. Psychological and social impacts are common with many IBS-d patients reporting comorbid depression, anxiety, decreased intimacy, and lost working days. The Irritable Bowel Syndrome Quality of Life (IBS-QOL) questionnaire is a 34-item instrument developed and validated for measurement of HRQOL in non-subtyped IBS patients. The current paper assesses this previously-validated instrument employing data collected from 754 patients who participated in a randomized clinical trial of a novel treatment, eluxadoline, for IBS-d. Methods Psychometric methods common to HRQOL research were employed to evaluate the IBS-QOL. Many of the historical analyses of the IBS-QOL validations were used. Other techniques that extended the original methods were applied where more appropriate for the current dataset. In IBS-d patients, we analyzed the items and substructure of the IBS-QOL via item reduction, factor structure, internal consistency, reproducibility, construct validity, and ability to detect change. Results This study supports the IBS-QOL as a psychometrically valid measure. Factor analyses suggested that IBS-specific QOL as measured by the IBS-QOL is a unidimensional construct. Construct validity was further buttressed by significant correlations between IBS-QOL total scores and related measures of IBS-d severity including the historically-relevant Irritable Bowel Syndrome Adequate Relief (IBS-AR) item and the FDA’s Clinical Responder definition. The IBS-QOL also showed a significant ability to detect change as evidenced by analysis of treatment effects. A minority of the items, unrelated to the IBS-d, performed less well by the standards set by the original authors. Conclusions We established that the IBS-QOL total score is a psychometrically valid measure of HRQOL in IBS-d patients enrolled in this study. Our analyses suggest that the IBS-QOL items demonstrate very good construct validity and ability to detect changes due to treatment effects. Furthermore, our analyses suggest that the IBS-QOL items measure a univariate construct and we believe further modeling of the IBS-QOL from an item response theory (IRT) approach under both non-treatment and treatment conditions would greatly further our understanding as item-based methods could be used to develop a short form. PMID:24330412

Validation of a German Version of the Ethical Leadership at Work Questionnaire by Kalshoven et al. (2011)

PubMed Central

Steinmann, Barbara; Nübold, Annika; Maier, Günter W.

2016-01-01

The present study evaluates the psychometric properties of a German version of the Ethical Leadership at Work questionnaire (ELW-D), and further embeds the construct of ethical leadership within its nomological network. Confirmatory factor analyses (CFAs) based on the total sample of N = 363 employees support the assumed seven-factor structure of the German translation. Within a sub-sample of N = 133, the ELW-D shows positive correlations with related leadership behaviors (transformational leadership, contingent reward, and servant leadership), and negative correlations with destructive ones (passive leadership, autocratic leadership, and abusive supervision), approving convergent validity of the scale. Comparisons of correlated correlation coefficients reveal restrictions of its discriminant validity. In support of the criterion-related validity (N = 100), the ELW-D relates to work-related attitudes (e.g., job satisfaction, satisfaction with the leader, trust in the leader) and follower behaviors (e.g., extra effort, organizational citizenship behavior) in the way expected. Besides, ELW-D-dimensions show incremental validity over and above the Ethical Leadership Scale, emphasizing the added value of this questionnaire. PMID:27065916

Validation of a German Version of the Ethical Leadership at Work Questionnaire by Kalshoven et al. (2011).

PubMed

Steinmann, Barbara; Nübold, Annika; Maier, Günter W

2016-01-01

The present study evaluates the psychometric properties of a German version of the Ethical Leadership at Work questionnaire (ELW-D), and further embeds the construct of ethical leadership within its nomological network. Confirmatory factor analyses (CFAs) based on the total sample of N = 363 employees support the assumed seven-factor structure of the German translation. Within a sub-sample of N = 133, the ELW-D shows positive correlations with related leadership behaviors (transformational leadership, contingent reward, and servant leadership), and negative correlations with destructive ones (passive leadership, autocratic leadership, and abusive supervision), approving convergent validity of the scale. Comparisons of correlated correlation coefficients reveal restrictions of its discriminant validity. In support of the criterion-related validity (N = 100), the ELW-D relates to work-related attitudes (e.g., job satisfaction, satisfaction with the leader, trust in the leader) and follower behaviors (e.g., extra effort, organizational citizenship behavior) in the way expected. Besides, ELW-D-dimensions show incremental validity over and above the Ethical Leadership Scale, emphasizing the added value of this questionnaire.

[Support of the nursing process through electronic nursing documentation systems (UEPD) – Initial validation of an instrument].

PubMed

Hediger, Hannele; Müller-Staub, Maria; Petry, Heidi

2016-01-01

Electronic nursing documentation systems, with standardized nursing terminology, are IT-based systems for recording the nursing processes. These systems have the potential to improve the documentation of the nursing process and to support nurses in care delivery. This article describes the development and initial validation of an instrument (known by its German acronym UEPD) to measure the subjectively-perceived benefits of an electronic nursing documentation system in care delivery. The validity of the UEPD was examined by means of an evaluation study carried out in an acute care hospital (n = 94 nurses) in German-speaking Switzerland. Construct validity was analyzed by principal components analysis. Initial references of validity of the UEPD could be verified. The analysis showed a stable four factor model (FS = 0.89) scoring in 25 items. All factors loaded ≥ 0.50 and the scales demonstrated high internal consistency (Cronbach's α = 0.73 – 0.90). Principal component analysis revealed four dimensions of support: establishing nursing diagnosis and goals; recording a case history/an assessment and documenting the nursing process; implementation and evaluation as well as information exchange. Further testing with larger control samples and with different electronic documentation systems are needed. Another potential direction would be to employ the UEPD in a comparison of various electronic documentation systems.

The Validity and Responsiveness of Isometric Lower Body Multi-Joint Tests of Muscular Strength: a Systematic Review.

PubMed

Drake, David; Kennedy, Rodney; Wallace, Eric

2017-12-01

Researchers and practitioners working in sports medicine and science require valid tests to determine the effectiveness of interventions and enhance understanding of mechanisms underpinning adaptation. Such decision making is influenced by the supportive evidence describing the validity of tests within current research. The objective of this study is to review the validity of lower body isometric multi-joint tests ability to assess muscular strength and determine the current level of supporting evidence. Preferred Reporting Items for Systematic Reviews and Meta-Analysis (PRISMA) guidelines were followed in a systematic fashion to search, assess and synthesize existing literature on this topic. Electronic databases such as Web of Science, CINAHL and PubMed were searched up to 18 March 2015. Potential inclusions were screened against eligibility criteria relating to types of test, measurement instrument, properties of validity assessed and population group and were required to be published in English. The Consensus-based Standards for the Selection of health Measurement Instruments (COSMIN) checklist was used to assess methodological quality and measurement property rating of included studies. Studies rated as fair or better in methodological quality were included in the best evidence synthesis. Fifty-nine studies met the eligibility criteria for quality appraisal. The ten studies that rated fair or better in methodological quality were included in the best evidence synthesis. The most frequently investigated lower body isometric multi-joint tests for validity were the isometric mid-thigh pull and isometric squat. The validity of each of these tests was strong in terms of reliability and construct validity. The evidence for responsiveness of tests was found to be moderate for the isometric squat test and unknown for the isometric mid-thigh pull. No tests using the isometric leg press met the criteria for inclusion in the best evidence synthesis. Researchers and practitioners can use the isometric squat and isometric mid-thigh pull with confidence in terms of reliability and construct validity. Further work to investigate other validity components such as criterion validity, smallest detectable change and responsiveness to resistance exercise interventions may be beneficial to the current level of evidence.

Stereotype Threat and College Academic Performance: A Latent Variables Approach*

PubMed Central

Owens, Jayanti; Massey, Douglas S.

2013-01-01

Stereotype threat theory has gained experimental and survey-based support in helping explain the academic underperformance of minority students at selective colleges and universities. Stereotype threat theory states that minority students underperform because of pressures created by negative stereotypes about their racial group. Past survey-based studies, however, are characterized by methodological inefficiencies and potential biases: key theoretical constructs have only been measured using summed indicators and predicted relationships modeled using ordinary least squares. Using the National Longitudinal Survey of Freshman, this study overcomes previous methodological shortcomings by developing a latent construct model of stereotype threat. Theoretical constructs and equations are estimated simultaneously from multiple indicators, yielding a more reliable, valid, and parsimonious test of key propositions. Findings additionally support the view that social stigma can indeed have strong negative effects on the academic performance of pejoratively stereotyped racial-minority group members, not only in laboratory settings, but also in the real world. PMID:23950616

The assessment of commitment: advantages of a unidimensional, target-free approach.

PubMed

Klein, Howard J; Cooper, Joseph T; Molloy, Janice C; Swanson, Jacqueline A

2014-03-01

This study presents a new approach to assessing commitment reflecting the Klein, Molloy, and Brinsfield (2012) reconceptualization. Klein et al. recast the construct to address issues hindering commitment scholarship, but their claims cannot be tested with existing measures. This paper presents a 4-item measure consistent with the Klein et al. conceptual definition, a measure intended to be unidimensional and applicable across all workplace targets. Our purpose is to present the development of and provide initial validity evidence for this new commitment measure and to compare it to existing alternative measures. Hypotheses around these objectives were tested with data gathered across 5 samples yielding 2,487 participants representing a wide range of jobs, organizations, and industries. Each sample examined a unique set of variables and targets that together provide a comprehensive test of this new measure relative to 8 different targets, several constructs within the nomological network, and 4 prior commitment measures. Results support our hypotheses regarding (a) the measure's properties and structure, (b) convergence and divergence with prior measures of commitment and other constructs in the nomological network, and (c) advantages over prior measures. These findings support the validity of this new approach to assessing commitment, laying the foundation for future research to address critiques of the commitment construct; better examine the multiple commitments individuals simultaneously hold; and bring consistency, synergy, and integration to commitment scholarship across workplace targets. The conceptual, methodological, and practical benefits of the measure are discussed, along with study limitations and future research opportunities.

Hangover in Post-College-Aged Drinkers: Psychometric Properties of the Hangover Symptom Scale (HSS) and the Hangover Symptom Scale-Short Form (HSS-5).

PubMed

Chavarria, Jesus; Rueger, Sandra Y; King, Andrea C

2018-04-16

Alcohol hangovers have been found to be a common and costly consequence of alcohol misuse. However, there is only limited psychometric support for instruments to accurately measure hangovers beyond the college-age years. This study investigated the psychometric properties of the Hangover Symptom Scale (HSS) and the Hangover Symptom Scale-Short Form (HSS-5) including the internal consistency, convergent and discriminant validity, construct validity, and the measurement invariance of these scales between light and heavy drinkers, individuals with a positive and negative family history of alcohol use disorder (AUD), and men and women in a post-college-aged sample. The association of the HSS and HSS-5 with alcohol use problems was also tested. Participants were 294 nonalcoholic light and heavy social drinkers (age range 21 to 35 years; 57.8% male) enrolled in the Chicago Social Drinking Project. They completed the HSS as part of a take-home packet completed outside of the laboratory. The psychometric properties of the HSS and HSS-5 were tested. Stronger psychometric support was found for the HSS-5 relative to the full HSS. While both measures demonstrated strong internal consistency reliability, convergent and discriminant validity, and an association with alcohol use problems, only the HSS-5 showed construct validity as determined by confirmatory factor analysis. Further, only the HSS-5 showed measurement invariance between men and women, light and heavy drinkers, and individuals with a positive and negative family history of AUD. This was the first study to examine the psychometric properties of the HSS and HSS-5 in a post-college-aged sample and the first to investigate the measurement invariance of these measures as a function of sex, drinking history, and family history of AUD. This study supports the use of the HSS-5 as a reliable and valid brief measure of frequency of hangover symptoms. Copyright © 2018 by the Research Society on Alcoholism.

Psychometric Assessment of the Chinese Version of the Abbreviated Expanded Prostate Cancer Index Composite (EPIC-26) and the Clinical Practice Version (EPIC-CP) in Chinese Men With Prostate Cancer.

PubMed

Lam, Wendy W T; Tse, Michael A; Ng, Chris N L; Chung, Edward K M; Fielding, Richard

2017-06-01

The Expanded Prostate Cancer Index Composite (EPIC) instrument was designed to assess a range of health-related quality-of-life issues specifically relevant to patients with prostate cancer. This study examined the validity and reliability of Chinese versions of the 26-item EPIC and of the 16-item EPIC for Clinical Practice (EPIC-CP) in Chinese patients with prostate cancer. A Chinese version of the 26-item EPIC and the 16-item EPIC-CP were self-completed by 252 Chinese patients with prostate cancer who were recruited from three community-based cancer service centers. Confirmatory factors analysis assessed the factor structures of the EPIC and the EPIC-CP. Internal consistency and construct and clinical validities of the factor structures were assessed. Confirmatory factor analysis revealed that the original factor structure of both EPIC-26 and EPIC-CP showed good fit to this sample. A correlated model was superior to a hierarchical model in both EPIC-26 and EPIC-CP supporting the utility of the domain scores over the total scores. Cronbach α ranged from 0.55 to 0.91 for EPIC-26 and 0.44 to 0.67 for EPIC-CP. Construct validity was supported by correlations between EPIC-26/EPIC-CP and psychological distress measures. Clinical validity was supported by differentiation between patients with and without prostatectomy. These Chinese versions of the five-factor EPIC-26 and the EPIC-CP are valid and practical measures for assessing a range of health-related quality-of-life issues related to the diagnosis and treatment of prostate cancer, highlighting their utility in assessing health-related quality of life for patients diagnosed with prostate cancer. Copyright © 2017 American Academy of Hospice and Palliative Medicine. Published by Elsevier Inc. All rights reserved.

Validation of the Rational and Experiential Multimodal Inventory in the Italian Context.

PubMed

Monacis, Lucia; de Palo, Valeria; Di Nuovo, Santo; Sinatra, Maria

2016-08-01

The unfavorable relations of the Rational and Experiential Inventory Experiential scale with objective criterion measures and its limited content validity led Norris and Epstein to propose a more content-valid measure of the experiential thinking style, the Rational and Experiential Multimodal Inventory (REIm), in order to assess the several facets of a broader experiential system consisting of interrelated components. This study aimed to provide the Italian validation of the inventory by examining its psychometric features, its factor structure (Study 1, N = 545), and its convergent and discriminant validity (Study 2, N = 257). Study 1 supported the 2- and 4-factor solutions, and multi-group analyses confirmed the invariance measurement across age and gender for both models. Study 2 provided evidence for both the convergent validity by supporting the theoretical associations among Rational and Experiential Multimodal Inventory scores and similar and related measures, and the discriminant validity by showing associations between the two thinking styles and a different but conceptually related construct, i.e., identity formation. No associations between Rational and Experiential Multimodal Inventory scores and social desirability were found. The Italian version of the Rational and Experiential Multimodal Inventory showed satisfactory psychometric properties, thus confirming its validity. © The Author(s) 2016.

CHAT: development and validation of a computer-delivered, self-report, substance use assessment for adolescents.

PubMed

Lord, Sarah E; Trudeau, Kimberlee J; Black, Ryan A; Lorin, Lucy; Cooney, Elizabeth; Villapiano, Albert; Butler, Stephen F

2011-01-01

The current study was conducted to construct and validate a computer-delivered, multimedia, substance use self-assessment for adolescents. Reliability and validity of six problem dimensions were evaluated in two studies, conducted from 2003 to 2008. Study 1 included 192 adolescents from five treatment settings throughout the United States (N = 142) and two high schools from Greater Boston, Massachusetts (N = 50). Study 2 included 356 adolescents (treatment: N = 260; school: N = 94). The final version of Comprehensive Health Assessment for Teens (CHAT) demonstrated relatively strong psychometric properties. The limitations and implications of this study are noted. This study was supported by an SBIR grant.

Concurrent Validity of the International Family Quality of Life Survey.

PubMed

Samuel, Preethy S; Pociask, Fredrick D; DiZazzo-Miller, Rosanne; Carrellas, Ann; LeRoy, Barbara W

2016-01-01

The measurement of the social construct of Family Quality of Life (FQOL) is a parsimonious alternative to the current approach of measuring familial outcomes using a battery of tools related to individual-level outcomes. The purpose of this study was to examine the internal consistency and concurrent validity of the International FQOL Survey (FQOLS-2006), using cross-sectional data collected from 65 family caregivers of children with developmental disabilities. It shows a moderate correlation between the total FQOL scores of the FQOLS-2006 and the Beach Center's FQOL scale. The validity of five FQOLS-2006 domains was supported by the correlations between conceptually related domains.

New measure for fathers of children with developmental challenges.

PubMed

Ly, A R; Goldberg, W A

2014-05-01

There is a relative lack of measures tailored to the study of fathers of children with developmental challenges (DCs). The goal of the current study was to create and validate a brief measure designed to capture the perceptions and experiences of these fathers. The Fathers of Children with Developmental Challenges (FCDC) questionnaire was designed to assess fathers' perceptions of the supports for, and challenges to, their efforts to be involved in the rearing of their children. Participants were 101 fathers of children with DCs who completed an online survey. Scale validation included tests to determine reliability, validity and factor structure. Used to establish validity were measures of parenting stress, parenting commitment, parent personality and child social-communicative skills. Analyses indicated that the FCDC is reliable (α = 0.89), demonstrates content validity, construct validity and acts in theoretically expected ways. Factor analysis on the 20-item measure yielded two sub-scales: (1) impact on parenting, and (2) involvement with child intervention. The FCDC fills a gap in the literature by offering an easy-to-administer self-report measure of fathers' perceptions of supports for, and barriers to, their involvement with their children with DCs. The FCDC could assist professionals in delivering support services specifically for fathers of children with DCs. © 2013 The Authors. Journal of Intellectual Disability Research © 2013 John Wiley & Sons Ltd, MENCAP & IASSIDD.

An Approach to Comprehensive and Sustainable Solar Wind Model Validation

NASA Astrophysics Data System (ADS)

Rastaetter, L.; MacNeice, P. J.; Mays, M. L.; Boblitt, J. M.; Wiegand, C.

2017-12-01

The number of models of the corona and inner heliosphere and of their updates and upgrades grows steadily, as does the number and character of the model inputs. Maintaining up to date validation of these models, in the face of this constant model evolution, is a necessary but very labor intensive activity. In the last year alone, both NASA's LWS program and the CCMC's ongoing support of model forecasting activities at NOAA SWPC have sought model validation reports on the quality of all aspects of the community's coronal and heliospheric models, including both ambient and CME related wind solutions at L1. In this presentation I will give a brief review of the community's previous model validation results of L1 wind representation. I will discuss the semi-automated web based system we are constructing at the CCMC to present comparative visualizations of all interesting aspects of the solutions from competing models.This system is designed to be easily queried to provide the essential comprehensive inputs to repeat andupdate previous validation studies and support extensions to them. I will illustrate this by demonstrating how the system is being used to support the CCMC/LWS Model Assessment Forum teams focused on the ambient and time dependent corona and solar wind, including CME arrival time and IMF Bz.I will also discuss plans to extend the system to include results from the Forum teams addressing SEP model validation.

Consumers' convenience orientation towards meal preparation: conceptualization and measurement.

PubMed

Candel, M

2001-02-01

Consumer researchers consider convenience orientation towards meal preparation to be a relevant construct for understanding consumer behavior towards foods. This study set out to conceptualize this construct and to develop a scale that measures it. As examined in two different samples of meal preparers, the resulting scale is reliable, satisfies a unifactorial structure and has satisfactory convergent validity. The scale's nomological validity is supported in that it conforms to expectations regarding various psychographic constructs and various food-related behaviors. Convenience orientation was found to be negatively related to cooking enjoyment, involvement with food products and variety seeking, and to be positively related to role overload. The analyses also suggest that the lack of relation between the meal preparer's working status and convenience food consumption, as found in many studies, is due to convenience food not offering enough preparation convenience. Consuming take-away meals and eating in restaurants appear to satisfy the consumer's need for convenience more adequately. Copyright 2001 Academic Press.

The Multidimensional Loss Scale: validating a cross-cultural instrument for measuring loss.

PubMed

Vromans, Lyn; Schweitzer, Robert D; Brough, Mark

2012-04-01

The Multidimensional Loss Scale (MLS) represents the first instrument designed specifically to index Experience of Loss Events and Loss Distress across multiple domains (cultural, social, material, and intrapersonal) relevant to refugee settlement. Recently settled Burmese adult refugees (N = 70) completed a questionnaire battery, including MLS items. Analyses explored MLS internal consistency, convergent and divergent validity, and factor structure. Cronbach alphas indicated satisfactory internal consistency for Experience of Loss Events (0.85) and Loss Distress (0.92), reflecting a unitary construct of multidimensional loss. Loss Distress did not correlate with depression or anxiety symptoms and correlated moderately with interpersonal grief and trauma symptoms, supporting divergent and convergent validity. Factor analysis provided preliminary support for a five-factor model: Loss of Symbolic Self, Loss of Interdependence, Loss of Home, Interpersonal Loss, and Loss of Intrapersonal Integrity. Received well by participants, the new scale shows promise for application in future research and practice.

The Bereavement Guilt Scale.

PubMed

Li, Jie; Stroebe, Magaret; Chan, Cecilia L W; Chow, Amy Y M

2017-06-01

The rationale, development, and validation of the Bereavement Guilt Scale (BGS) are described in this article. The BGS was based on a theoretically developed, multidimensional conceptualization of guilt. Part 1 describes the generation of the item pool, derived from in-depth interviews, and review of the scientific literature. Part 2 details statistical analyses for further item selection (Sample 1, N = 273). Part 3 covers the psychometric properties of the emergent-BGS (Sample 2, N = 600, and Sample 3, N = 479). Confirmatory factor analysis indicated that a five-factor model fit the data best. Correlations of BGS scores with depression, anxiety, self-esteem, self-forgiveness, and mode of death were consistent with theoretical predictions, supporting the construct validity of the measure. The internal consistency and test-retest reliability were also supported. Thus, initial testing or examination suggests that the BGS is a valid tool to assess multiple components of bereavement guilt. Further psychometric testing across cultures is recommended.

Development and Psychometric Validation of the Dementia Attitudes Scale

PubMed Central

O'Connor, Melissa L.; McFadden, Susan H.

2010-01-01

This study employed qualitative construct mapping and factor analysis to construct a scale to measure attitudes toward dementia. Five family caregivers, five professionals, and five college students participated in structured interviews. Qualitative analysis of the interviews led to a 46-item scale, which was reduced to 20 items following principal axis factoring with two different samples: college students (N = 302) and certified nursing assistant students (N = 145). Confirmatory factor analysis was then conducted with another sample of college students (N = 157). The final scale, titled the Dementia Attitudes Scale (DAS), essentially had a two-factor structure; the factors were labeled “dementia knowledge” and “social comfort.” Total-scale Cronbach's alphas ranged 0.83–0.85. Evidence for convergent validity was promising, as the DAS correlated significantly with scales that measured ageism and attitudes toward disabilities (range of correlations = 0.44–0.55; mean correlation = 0.50). These findings demonstrate the reliability and validity of the DAS, supporting its use as a research tool.

Diagnosis of borderline personality disorder in China: current status and future directions.

PubMed

Zhong, Jie; Leung, Freedom

2009-02-01

This paper reviews the current status and future directions of borderline personality disorder (BPD) research in China. Although the committee of the third version of the Chinese Classification of Mental Disorders (CCMD-3) rejected BPD as a valid diagnostic category and instead adopted the term impulsive personality disorder (IPD), our literature review on personality disorders from 1979 to 2008 in China indicated that BPD was the most popular research topic among researchers and clinicians. Available empiric evidence on BPD in China provided preliminary support for the construct validity and clinical utility of BPD in clinical and nonclinical Chinese samples. Future studies in the following areas are suggested: 1) developing reliable assessment instruments for measuring BPD pathology in China, 2) comparing the construct validity and phenomenology of CCMD IPD and DSM BPD among Chinese patients, 3) examining potential cultural differences in symptom expression of BPD pathology among the Chinese, and 4) exploring indigenous and imported methods for treating BPD patients in China.

Hypersensitivity to sound in tinnitus patients: an analysis of a construct based on questionnaire and audiological data.

PubMed

Bläsing, Lena; Goebel, Gerhard; Flötzinger, Uta; Berthold, Anke; Kröner-Herwig, Birgit

2010-07-01

The purpose of this study was to analyse the Questionnaire on Hypersensitivity to Sound (GUF; Nelting & Finlayson, 2004 ) and to improve its validity based on the analysis of intercorrelations (single item level) with other methods of assessing hyperacusis (uncomfortable loudness level, individual loudness function, self-rated severity of hyperacusis). Subjects consisted of 91 inpatients with tinnitus and hyperacusis. The GUF showed a good reliability (alpha = .92). The factorial structure of the questionnaire reported by Nelting et al (2002) was not completely supported by the evidence in this study. The total score and the single items showed small to moderate correlations with the other modes of measuring hyperacusis. Evidence for convergent and discriminant validity were found, but overall the results corroborate the conceptual heterogeneity of the construct hyperacusis and its dependency on the assessment method. Four items of the GUF with particularly low correlations were excluded from the questionnaire. The revised GUF total score showed slightly but not statistically significant higher convergent and discriminant validity.

Development and validation of a Malawian version of the primary care assessment tool.

PubMed

Dullie, Luckson; Meland, Eivind; Hetlevik, Øystein; Mildestvedt, Thomas; Gjesdal, Sturla

2018-05-16

Malawi does not have validated tools for assessing primary care performance from patients' experience. The aim of this study was to develop a Malawian version of Primary Care Assessment Tool (PCAT-Mw) and to evaluate its reliability and validity in the assessment of the core primary care dimensions from adult patients' perspective in Malawi. A team of experts assessed the South African version of the primary care assessment tool (ZA-PCAT) for face and content validity. The adapted questionnaire underwent forward and backward translation and a pilot study. The tool was then used in an interviewer administered cross-sectional survey in Neno district, Malawi, to test validity and reliability. Exploratory factor analysis was performed on a random half of the sample to evaluate internal consistency, reliability and construct validity of items and scales. The identified constructs were then tested with confirmatory factor analysis. Likert scale assumption testing and descriptive statistics were done on the final factor structure. The PCAT-Mw was further tested for intra-rater and inter-rater reliability. From the responses of 631 patients, a 29-item PCAT-Mw was constructed comprising seven multi-item scales, representing five primary care dimensions (first contact, continuity, comprehensiveness, coordination and community orientation). All the seven scales achieved good internal consistency, item-total correlations and construct validity. Cronbach's alpha coefficient ranged from 0.66 to 0.91. A satisfactory goodness of fit model was achieved (GFI = 0.90, CFI = 0.91, RMSEA = 0.05, PCLOSE = 0.65). The full range of possible scores was observed for all scales. Scaling assumptions tests were achieved for all except the two comprehensiveness scales. Intra-class correlation coefficient (ICC) was 0.90 (n = 44, 95% CI 0.81-0.94, p < 0.001) for intra-rater reliability and 0.84 (n = 42, 95% CI 0.71-0.96, p < 0.001) for inter-rater reliability. Comprehensive metric analyses supported the reliability and validity of PCAT-Mw in assessing the core concepts of primary care from adult patients' experience. This tool could be used for health service research in primary care in Malawi.

Development, test-retest reliability, and construct validity of the resistance training skills battery.

PubMed

Lubans, David R; Smith, Jordan J; Harries, Simon K; Barnett, Lisa M; Faigenbaum, Avery D

2014-05-01

The aim of this study was to describe the development and assess test-retest reliability and construct validity of the Resistance Training Skills Battery (RTSB) for adolescents. The RTSB provides an assessment of resistance training skill competency and includes 6 exercises (i.e., body weight squat, push-up, lunge, suspended row, standing overhead press, and front support with chest touches). Scoring for each skill is based on the number of performance criteria successfully demonstrated. An overall resistance training skill quotient (RTSQ) is created by adding participants' scores for the 6 skills. Participants (44 boys and 19 girls, mean age = 14.5 ± 1.2 years) completed the RTSB on 2 occasions separated by 7 days. Participants also completed the following fitness tests, which were used to create a muscular fitness score (MFS): handgrip strength, timed push-up, and standing long jump tests. Intraclass correlation (ICC), paired samples t-tests, and typical error were used to assess test-retest reliability. To assess construct validity, gender and RTSQ were entered into a regression model predicting MFS. The rank order repeatability of the RTSQ was high (ICC = 0.88). The model explained 39% of the variance in MFS (p ≤ 0.001) and RTSQ (r = 0.40, p ≤ 0.001) was a significant predictor. This study has demonstrated the construct validity and test-retest reliability of the RTSB in a sample of adolescents. The RTSB can reliably rank participants in regards to their resistance training competency and has the necessary sensitivity to detect small changes in resistance training skill proficiency.

Application of the OMERACT filter to measures of core outcome domains in recent clinical studies of acute gout.

PubMed

Taylor, William J; Redden, David; Dalbeth, Nicola; Schumacher, H Ralph; Edwards, N Lawrence; Simon, Lee S; John, Markus R; Essex, Margaret N; Watson, Douglas J; Evans, Robert; Rome, Keith; Singh, Jasvinder A

2014-03-01

To determine the extent to which instruments that measure core outcome domains in acute gout fulfill the Outcome Measures in Rheumatology (OMERACT) filter requirements of truth, discrimination, and feasibility. Patient-level data from 4 randomized controlled trials of agents designed to treat acute gout and 1 observational study of acute gout were analyzed. For each available measure, construct validity, test-retest reliability, within-group change using effect size, between-group change using the Kruskall-Wallis statistic, and repeated measures generalized estimating equations were assessed. Floor and ceiling effects were also assessed and minimal clinically important difference was estimated. These analyses were presented to participants at OMERACT 11 to help inform voting for possible endorsement. There was evidence for construct validity and discriminative ability for 3 measures of pain [0 to 4 Likert, 0 to 10 numeric rating scale (NRS), 0 to 100 mm visual analog scale (VAS)]. Likewise, there appears to be sufficient evidence for a 4-point Likert scale to possess construct validity and discriminative ability for physician assessment of joint swelling and joint tenderness. There was some evidence for construct validity and within-group discriminative ability for the Health Assessment Questionnaire as a measure of activity limitations, but not for discrimination between groups allocated to different treatment. There is sufficient evidence to support measures of pain (using Likert, NRS, or VAS), joint tenderness, and swelling (using Likert scale) as fulfilling the requirements of the OMERACT filter. Further research on a measure of activity limitations in acute gout clinical trials is required.

Application of the OMERACT filter to measures of core outcome domains in recent clinical studies of acute gout

PubMed Central

Taylor, William J; Redden, David; Dalbeth, Nicola; Schumacher, H Ralph; Edwards, N Lawrence; Simon, Lee S; John, Markus R; Essex, Margaret N; Watson, Douglas J; Evans, Robert; Rome, Keith; Singh, Jasvinder A

2014-01-01

Objective To determine the extent to which instruments that measure core outcome domains in acute gout fulfil the OMERACT filter requirements of truth, discrimination and feasibility. Methods Patient-level data from four randomised controlled trials of agents designed to treat acute gout and one observational study of acute gout were analysed. For each available measure construct validity, test-retest reliability, within-group change using effect size, between-group change using the Kruskall-Wallis statistic and repeated measures generalised estimating equations were assessed. Floor and ceiling effects were also assessed and MCID was estimated. These analyses were presented to participants at OMERACT 11 to help inform voting for possible endorsement. Results There was evidence for construct validity and discriminative ability for 3 measures of pain (0 to 4 Likert, 0 to 10 numeric rating scale, 0 to 100 mm visual analogue scale). Likewise, there appears to be sufficient evidence for a 4-point Likert scale to possess construct validity and discriminative ability for physician assessment of joint swelling and joint tenderness. There was some evidence for construct validity and within-group discriminative ability for the Health Assessment Questionnaire as a measure of activity limitations, but not for discrimination between groups allocated to different treatment. Conclusions There is sufficient evidence to support measures of pain (using Likert, numeric rating scale or visual analogue scales), joint tenderness and swelling (using Likert scale) as fulfilling the requirements of the OMERACT filter. Further research on a measure of activity limitations in acute gout clinical trials is required. PMID:24429178

Modelling Question Difficulty in an A Level Physics Examination

ERIC Educational Resources Information Center

Crisp, Victoria; Grayson, Rebecca

2013-01-01

"Item difficulty modelling" is a technique used for a number of purposes such as to support future item development, to explore validity in relation to the constructs that influence difficulty and to predict the difficulty of items. This research attempted to explore the factors influencing question difficulty in a general qualification…

A Psychometric Investigation of the Academic Motivation Scale Using a United States Sample.

ERIC Educational Resources Information Center

Cokley, Kevin O.; Bernard, Naijean; Cunningham, Dana; Motoike, Janice

2001-01-01

Examines the factor structure of the Academic Motivation Scale with a United States student population. There was some support for a 7-factor structure. Evidence of construct validity examining the relationship with academic self concept and academic achievement is mixed. Discusses ethnic and gender differences in motivation. (Contains 37…

Child and Adolescent Behaviorally Based Disorders: A Critical Review of Reliability and Validity

ERIC Educational Resources Information Center

Mallett, Christopher A.

2014-01-01

Objectives: The purpose of this study was to investigate the historical construction and empirical support of two child and adolescent behaviorally based mental health disorders: oppositional defiant and conduct disorders. Method: The study utilized a historiography methodology to review, from 1880 to 2012, these disorders' inclusion in…

Assessing Measurement Invariance for Spanish Sentence Repetition and Morphology Elicitation Tasks

ERIC Educational Resources Information Center

Kapantzoglou, Maria; Thompson, Marilyn S.; Gray, Shelley; Restrepo, M. Adelaida

2016-01-01

Purpose: The purpose of this study was to evaluate evidence supporting the construct validity of two grammatical tasks (sentence repetition, morphology elicitation) included in the Spanish Screener for Language Impairment in Children (Restrepo, Gorin, & Gray, 2013). We evaluated if the tasks measured the targeted grammatical skills in the same…

Validation of Automated Scoring for a Formative Assessment That Employs Scientific Argumentation

ERIC Educational Resources Information Center

Mao, Liyang; Liu, Ou Lydia; Roohr, Katrina; Belur, Vinetha; Mulholland, Matthew; Lee, Hee-Sun; Pallant, Amy

2018-01-01

Scientific argumentation is one of the core practices for teachers to implement in science classrooms. We developed a computer-based formative assessment to support students' construction and revision of scientific arguments. The assessment is built upon automated scoring of students' arguments and provides feedback to students and teachers.…

Indigenous Chinese Personality Constructs: Is the Five-Factor Model Complete?

ERIC Educational Resources Information Center

Cheung, Fanny M.; Leung, Kwok; Zhang, Jian-Xin; Sun, Hai-Fa; Gan, Yi-Qun; Song, Wei-Zhen; Xie, Dong

2001-01-01

Three studies involving Chinese respondents from China and Hong Kong and diverse respondents from Hawaii compared the Chinese Personality Assessment Inventory factor structure with the Revised NEO Personality Inventory (NEO-PI-R) and NEO-Five Factor Inventory. Results supported the universality of the five-factor model, the validity of NEO-PI-R,…

The Subjective Well-Being Construct: A Test of Its Convergent, Discriminant, and Factorial Validity

ERIC Educational Resources Information Center

Arthaud-day, Marne L.; Rode, Joseph C.; Mooney, Christine H.; Near, Janet P.

2005-01-01

Using structural equation modeling, we found empirical support for the prevailing theory that subjective well-being consists of three domains: (1) cognitive evaluations of one's life (i.e., life satisfaction or happiness); (2) positive affect; and (3) negative affect. Multiple indicators of satisfaction/happiness were shown to have strong…

Life Style Assessment: So What!

ERIC Educational Resources Information Center

Aubry, William E.

The construct life style was used by Alfred Adler to describe the characteristic way in which individuals act and think. Followers of his theories are now collecting evidence to support or validate his contentions. The assessment of client life styles serves: (1) to make the client aware of his misconceptions, (2) as a reference point for therapy,…

Multiple Subtypes among Vocationally Undecided College Students: A Model and Assessment Instrument.

ERIC Educational Resources Information Center

Jones, Lawrence K.; Chenery, Mary Faeth

1980-01-01

A model of vocational decision status was developed, and an instrument was constructed and used to assess its three dimensions. Results demonstrated the utility of the model, supported the reliability and validity of the instrument, and illustrated the value of viewing vocationally undecided students as multiple subtypes. (Author)

Construct Equivalence of a National Certification Examination that Uses Dual Languages and Audio Assistance

ERIC Educational Resources Information Center

Wang, Shudong; Wang, Ning; Hoadley, David

2007-01-01

This study used confirmatory factor analysis (CFA) to examine the comparability of the National Nurse Aide Assessment Program (NNAAP[TM]) test scores across language and administration condition groups for calibration and validation samples that were randomly drawn from the same population. Fit statistics supported both the calibration and…

The Needs-Based Assessment of Parental (Guardian) Support: a test of its validity and reliability.

PubMed

Bolen, Rebecca M; Leah Lamb, J; Gradante, Jennifer

2002-10-01

The purpose of this paper is to present a newly developed measure of guardian support, the Needs-Based Assessment of Parental (Guardian) Support (NAPS), an empirical evaluation of that measure, and its comparison with another measure of guardian support. The theoretical model that underlies this measure applies humanistic theory and Maslow's hierarchy of needs to the understanding of guardian support. The study employed a cross-sectional nonexperimental survey design using 183 nonoffending guardians who accompanied children presenting for a medical/forensic examination for sexual abuse. The NAPS and an existing measure of guardian support were administered during the hospital outpatient visit, and basic information concerning the child and abuse situations were gathered. The NAPS had robust psychometric properties and was culturally sensitive. Tests of specific hypotheses supported the construct validity of the measure and a conceptualization of guardian support as hierarchical, with four stages of support. The brevity and ease of administration of the NAPS for both the clinician and guardian suggest that it is a viable assessment tool. The strong support for the NAPS' underlying theoretical model suggests that the nonoffending guardians' available resources need to be considered when assessing guardian support.

Development of a validated questionnaire to measure the self-perceived competence of primary health professionals in providing nutrition care to patients with chronic disease.

PubMed

Ball, Lauren E; Leveritt, Michael D

2015-12-01

Nutrition is an important aspect of chronic disease prevention and management by primary health professionals, including GPs, dietitians, practice nurses, diabetes educators and exercise professionals. In order to better understand how to improve the delivery of nutrition care, it is important to have valid and reliable tools to measure self-perceived competence. This study aimed to develop a valid, structured, questionnaire that measures the self-perceived competence of primary health professionals to provide nutrition care to patients with chronic disease. The development of the questionnaire was carried out in four stages (1): preparation of scope and structure, through a literature review and consultation with an expert reference group (2); development of questionnaire items, which were refined through feedback from the reference group and 18 primary health professionals (3); investigation of internal consistency and concurrent validity through a pilot study on 118 primary health professionals (4) and investigation of test-retest reliability through a pilot study on 33 primary health professionals who completed the questionnaire twice, 2-3 weeks apart. Stages 1 and 2 resulted in four constructs and 35 questions in the questionnaire. Stage 3 confirmed internal consistency, with Cronbach's α ranging from 0.88 to 0.98 for each construct and 0.98 for all items combined. Dietitians scored significantly higher than speech pathologists (P < 0.05) in each construct, confirming concurrent validity. Stage 4 confirmed test-retest reliability, with correlation coefficients ranging from 0.89 to 0.94 for each construct and 0.95 for all items combined. The NUTrition COMPetence (NUTCOMP) questionnaire is a valid, reliable and suitable tool that can be used to directly inform professional development and identify opportunities to support safe and effective practice. © The Author 2015. Published by Oxford University Press. All rights reserved. For permissions, please e-mail: journals.permissions@oup.com.

A tool to assess sex-gender when selecting health research projects.

PubMed

Tomás, Concepción; Yago, Teresa; Eguiluz, Mercedes; Samitier, M A Luisa; Oliveros, Teresa; Palacios, Gemma

2015-04-01

To validate the questionnaire "Gender Perspective in Health Research" (GPIHR) to assess the inclusion of gender perspective in research projects. Validation study in two stages. Feasibility was analysed in the first, and reliability, internal consistence and validity in the second. Aragón Institute of Health Science, Aragón, Spain. GPIHR was applied to 118 research projects funded in national and international competitive tenders from 2003 to 2012. Analysis of inter- and intra-observer reliability with Kappa index and internal consistency with Cronbach's alpha. Content validity analysed through literature review and construct validity with an exploratory factor analysis. Validated GPIHR has 10 questions: 3 in the introduction, 1 for objectives, 3 for methodology and 3 for research purpose. Average time of application was 13min Inter-observer reliability (Kappa) varied between 0.35 and 0.94 and intra-observer between 0.40 and 0.94. Theoretical construct is supported in the literature. Factor analysis identifies three levels of GP inclusion: "difference by sex", "gender sensitive" and "feminist research" with an internal consistency of 0.64, 0.87 and 0.81, respectively, which explain 74.78% of variance. GPIHR questionnaire is a valid tool to assess GP and useful for those researchers who would like to include GP in their projects. Copyright © 2014 Elsevier España, S.L.U. All rights reserved.

Should essays and other "open-ended"-type questions retain a place in written summative assessment in clinical medicine?

PubMed

Hift, Richard J

2014-11-28

Written assessments fall into two classes: constructed-response or open-ended questions, such as the essay and a number of variants of the short-answer question, and selected-response or closed-ended questions; typically in the form of multiple-choice. It is widely believed that constructed response written questions test higher order cognitive processes in a manner that multiple-choice questions cannot, and consequently have higher validity. An extensive review of the literature suggests that in summative assessment neither premise is evidence-based. Well-structured open-ended and multiple-choice questions appear equivalent in their ability to assess higher cognitive functions, and performance in multiple-choice assessments may correlate more highly than the open-ended format with competence demonstrated in clinical practice following graduation. Studies of construct validity suggest that both formats measure essentially the same dimension, at least in mathematics, the physical sciences, biology and medicine. The persistence of the open-ended format in summative assessment may be due to the intuitive appeal of the belief that synthesising an answer to an open-ended question must be both more cognitively taxing and similar to actual experience than is selecting a correct response. I suggest that cognitive-constructivist learning theory would predict that a well-constructed context-rich multiple-choice item represents a complex problem-solving exercise which activates a sequence of cognitive processes which closely parallel those required in clinical practice, hence explaining the high validity of the multiple-choice format. The evidence does not support the proposition that the open-ended assessment format is superior to the multiple-choice format, at least in exit-level summative assessment, in terms of either its ability to test higher-order cognitive functioning or its validity. This is explicable using a theory of mental models, which might predict that the multiple-choice format will have higher validity, a statement for which some empiric support exists. Given the superior reliability and cost-effectiveness of the multiple-choice format consideration should be given to phasing out open-ended format questions in summative assessment. Whether the same applies to non-exit-level assessment and formative assessment is a question which remains to be answered; particularly in terms of the educational effect of testing, an area which deserves intensive study.

Development and Validation of the Caring Loneliness Scale.

PubMed

Karhe, Liisa; Kaunonen, Marja; Koivisto, Anna-Maija

2016-12-01

The Caring Loneliness Scale (CARLOS) includes 5 categories derived from earlier qualitative research. This article assesses the reliability and construct validity of a scale designed to measure patient experiences of loneliness in a professional caring relationship. Statistical analysis with 4 different sample sizes included Cronbach's alpha and exploratory factor analysis with principal axis factoring extraction. The sample size of 250 gave the most useful and comprehensible structure, but all 4 samples yielded underlying content of loneliness experiences. The initial 5 categories were reduced to 4 factors with 24 items and Cronbach's alpha ranging from .77 to .90. The findings support the reliability and validity of CARLOS for the assessment of Finnish breast cancer and heart surgery patients' experiences but as all instruments, further validation is needed.

The military social health index: a partial multicultural validation.

PubMed

Van Breda, Adrian D

2008-05-01

Routine military deployments place great stress on military families. Before South African soldiers can be deployed, they undergo a comprehensive health assessment, which includes a social work assessment. The assessment focuses on the resilience of the family system to estimate how well the family will cope when exposed to the stress of deployments. This article reports on the development and validation of a new measuring tool, the Military Social Health Index, or MSHI. The MSHI is made up of four scales, each comprising 14 items, viz social support, problem solving, stressor appraisal, and generalized resistance resources. An initial, large-scale, multicultural validation of the MSHI revealed strong levels of reliability (Cronbach a and standard error of measurement) and validity (factorial, construct, convergent, and discriminant).

The Nature of Science Instrument-Elementary (NOSI-E): Using Rasch principles to develop a theoretically grounded scale to measure elementary student understanding of the nature of science

NASA Astrophysics Data System (ADS)

Peoples, Shelagh

The purpose of this study was to determine which of three competing models will provide, reliable, interpretable, and responsive measures of elementary students' understanding of the nature of science (NOS). The Nature of Science Instrument-Elementary (NOSI-E), a 28-item Rasch-based instrument, was used to assess students' NOS understanding. The NOS construct was conceptualized using five construct dimensions (Empirical, Inventive, Theory-laden, Certainty and Socially & Culturally Embedded). The competing models represent three internal models for the NOS construct. One postulate is that the NOS construct is unidimensional where one latent construct explains the relationship between the 28 items of the NOSI-E. Alternatively, the NOS construct is composed of five independent unidimensional constructs (the consecutive approach). Lastly, the NOS construct is multidimensional and composed of five inter-related but separate dimensions. A validity argument was developed that hypothesized that the internal structure of the NOS construct is best represented by the multidimensional Rasch model. Four sets of analyses were performed in which the three representations were compared. These analyses addressed five validity aspects (content, substantive, generalizability, structural and external) of construct validity. The vast body of evidence supported the claim that the NOS construct is composed of five separate but inter-related dimensions that is best represented by the multidimensional Rasch model. The results of the multidimensional analyses indicated that the items of the five subscales were of excellent technical quality, exhibited no differential item functioning (based on gender), had an item hierarchy that conformed to theoretical expectations; and together formed subscales of reasonable reliability (> 0.7 on each subscale) that were responsive to change in the construct. Theory-laden scores from the multidimensional model predicted students' science achievement with scores from all five NOS dimensions significantly predicting students' perceptions of the constructivist nature of their classroom learning environment. The NOSI-E instrument is a theoretically grounded scale that can measure elementary students' NOS understanding and appears suitable for use in science education research.

Validity and reliability of Arabic MOS social support survey.

PubMed

Dafaalla, Mohamed; Farah, Abdulraheem; Bashir, Sheima; Khalil, Ammar; Abdulhamid, Rabab; Mokhtar, Mousab; Mahadi, Mohamed; Omer, Zulfa; Suliman, Asgad; Elkhalifa, Mohammed; Abdelgadir, Hanin; Kheir, Abdelmoneim E M; Abdalrahman, Ihab

2016-01-01

We aimed to generate a valid reliable Arabic version of MOS social support survey (MOS-SSS). We did a cross sectional study in medical students of Faculty of Medicine in Khartoum, Sudan. We did a clustered random sampling in 500 students of which 487 were suitable for analysis. We followed the standard translation process for translating the MOS-SSS. We accomplished factor analysis to assess construct validity, and generated item-scales correlations to evaluate the convergent and discriminant validity. We extracted the Cronbach's α and Spearman Brown coefficient of spit half method to determine internal consistency. We measured stability by correlation between the scores of the MOS survey taken at two different occasions with ten days apart in 252 participants. All items correlated highly (0.788 or greater) with their hypothesized scales. All items in subscales correlated higher by two standard errors with their own scale than with any other scale. Principle component analysis with varimax rotation was conducted on the 19 items and examination of scree plot graphically suggested 4 predominant factors that account for 72 % of variance. It showed high loadings, ranging from 0.720 to 0.84 for items of emotional support, 0.699-0.845 for tangible support, 0.518-0.823 for affectionate support, and 0.740-0.816 for positive social interaction. Cronbach's alpha for overall MOS scale and subscales indicated high internal consistency. The test-retest correlation showed weak correlation between the test and retest (ranges from 0.04 to 0.104). The Arabic MOS-SSS had high validity and internal consistency.

Study of the validity of a job-exposure matrix for psychosocial work factors: results from the national French SUMER survey.

PubMed

Niedhammer, Isabelle; Chastang, Jean-François; Levy, David; David, Simone; Degioanni, Stéphanie; Theorell, Töres

2008-10-01

To construct and evaluate the validity of a job-exposure matrix (JEM) for psychosocial work factors defined by Karasek's model using national representative data of the French working population. National sample of 24,486 men and women who filled in the Job Content Questionnaire (JCQ) by Karasek measuring the scores of psychological demands, decision latitude, and social support (individual scores) in 2003 (response rate 96.5%). Median values of the three scores in the total sample of men and women were used to define high demands, low latitude, and low support (individual binary exposures). Job title was defined by both occupation and economic activity that were coded using detailed national classifications (PCS and NAF/NACE). Two JEM measures were calculated from the individual scores of demands, latitude and support for each job title: JEM scores (mean of the individual score) and JEM binary exposures (JEM score dichotomized at the median). The analysis of the variance of the individual scores of demands, latitude, and support explained by occupations and economic activities, of the correlation and agreement between individual measures and JEM measures, and of the sensitivity and specificity of JEM exposures, as well as the study of the associations with self-reported health showed a low validity of JEM measures for psychological demands and social support, and a relatively higher validity for decision latitude compared with individual measures. Job-exposure matrix measure for decision latitude might be used as a complementary exposure assessment. Further research is needed to evaluate the validity of JEM for psychosocial work factors.

A review of the Child and Adolescent Social Support Scale for Healthy Behaviors.

PubMed

Cullum, Kristiana G H; Mayo, Ann M

2015-01-01

Assessing an instrument's psychometric properties to determine appropriateness for use can be a challenging process. Dissecting the statistical terminology may be even more perplexing. There are several instruments that evaluate adolescents' perceived social support, but a fairly new instrument related to this construct assesses not only the availability of social support but also support for healthy behaviors in this population. The Child and Adolescent Social Support Scale for Healthy Behaviors, first published in 2013, demonstrates adequate initial reliability and validity. The purpose of this article is to review the psychometric properties of the Child and Adolescent Social Support Scale for Healthy Behaviors and potential uses of the instrument.

Development of a short form of the Japanese version of the Interpersonal Relationship Inventory.

PubMed

Sumi, Katsunori

2009-10-01

The Interpersonal Relationship Inventory (Tilden, Nelson, & May, 1990a) is a 39-item self-report measure to assess three aspects (support, reciprocity, and conflict) of perceived social relationships. In this research, short forms of the Japanese version (Sumi, 2003) of the inventory were developed on the basis of data from two sources. For the item selection, data from 340 Japanese college students (148 women, 192 men; M age = 21.6 yr., SD = 1.6) who completed the original full form of the inventory were used to create three internally consistent short forms. The reliability and construct validity of the short forms were examined upon administering them to among 513 college students (226 women, 287 men; M age =19.9 yr., SD = 1.4). All the subscales of the short forms had acceptable internal consistency (alphas = .70-.90) and test-retest reliability (rs = .72-.81). Confirmatory factor analysis of each short form supported the fact that each form had a three-factor structure. Scores on the subscales shared acceptable overlapping variance with the corresponding subscale scores of the original full form, and these scores were weakly but significantly correlated with the scores for satisfaction with social support, loneliness, and perceived stress. All the short forms had acceptable reliability and construct validity.

HSTDEK: Developing a methodology for construction of large-scale, multi-use knowledge bases

NASA Technical Reports Server (NTRS)

Freeman, Michael S.

1987-01-01

The primary research objectives of the Hubble Space Telescope Design/Engineering Knowledgebase (HSTDEK) are to develop a methodology for constructing and maintaining large scale knowledge bases which can be used to support multiple applications. To insure the validity of its results, this research is being persued in the context of a real world system, the Hubble Space Telescope. The HSTDEK objectives are described in detail. The history and motivation of the project are briefly described. The technical challenges faced by the project are outlined.

Perceptions towards disability among social work students in Israel: Development and validation of a new scale.

PubMed

Holler, Roni; Werner, Shirli

2018-05-01

Over the last decades, the disability movement has been advocating for a paradigmatic shift in how disability is perceived and managed: from a medical or individual perspective focusing on the person's body and mind to a social perspective emphasizing the context and barriers of disability. However, we still know little about the perceptions of helping professionals, particularly social workers who work closely with disabled people. Thus, the aim of the current study is to develop and validate a scale-Perceptions Toward Disability Scale (PTDS)-to measure how social workers view disability: as an individual or social category. This paper describes the three phases of the scale's construction. First, scale items were formulated and its content validity was examined. Next, a pilot of 30 social workers completed a questionnaire and an initial exploratory factor analysis was conducted. In the third and main phase, the final draft was completed in 2016 by 565 Israeli social work students to assess its psychometric properties. Both exploratory and confirmatory factorial validity and discriminant validity analyses were conducted. The results of a confirmatory factor analysis revealed two distinct factors: an individual perspective of disability comprised of eight items (α = 0.77) and a social perspective of disability comprised of ten (α = 0.66). Subsequent analyses supported the scale's discriminant validity as indicated by the lack of an association between the Attitude Toward Disabled Persons Scale (ATDP) and the social model subscale (r = .13, p = .19) and by the weak negative relation with the individual model subscale (r = -.25, p = .01). These findings show that the PTDS possesses promising construct validity and provide support for its utility. This easy-to-administer instrument offers several practical benefits and can serve as a framework for further empirical research regarding social work practice with disabled people. © 2018 John Wiley & Sons Ltd.

Assessing young children's intention-reading in authentic communicative contexts: preliminary evidence and clinical utility.

PubMed

Greenslade, Kathryn J; Coggins, Truman E

2014-01-01

Identifying what a communication partner is looking at (referential intention) and why (social intention) is essential to successful social communication, and may be challenging for children with social communication deficits. This study explores a clinical task that assesses these intention-reading abilities within an authentic context. To gather evidence of the task's reliability and validity, and to discuss its clinical utility. The intention-reading task was administered to twenty 4-7-year-olds with typical development (TD) and ten with autism spectrum disorder (ASD). Task items were embedded in an authentic activity, and they targeted the child's ability to identify the examiner's referential and social intentions, which were communicated through joint attention behaviours. Reliability and construct validity evidence were addressed using established psychometric methods. Reliability and validity evidence supported the use of task scores for identifying children whose intention-reading warranted concern. Evidence supported the reliability of task administration and coding, and item-level codes were highly consistent with overall task performance. Supporting task validity, group differences aligned with predictions, with children with ASD exhibiting poorer and more variable task scores than children with TD. Also, as predicted, task scores correlated significantly with verbal mental age and ratings of parental concerns regarding social communication abilities. The evidence provides preliminary support for the reliability and validity of the clinical task's scores in assessing young children's real-time intention-reading abilities, which are essential for successful interactions in school and beyond. © 2014 Royal College of Speech and Language Therapists.

Ready, Set, Change! Development and usability testing of an online readiness for change decision support tool for healthcare organizations.

PubMed

Timmings, Caitlyn; Khan, Sobia; Moore, Julia E; Marquez, Christine; Pyka, Kasha; Straus, Sharon E

2016-02-24

To address challenges related to selecting a valid, reliable, and appropriate readiness assessment measure in practice, we developed an online decision support tool to aid frontline implementers in healthcare settings in this process. The focus of this paper is to describe a multi-step, end-user driven approach to developing this tool for use during the planning stages of implementation. A multi-phase, end-user driven approach was used to develop and test the usability of a readiness decision support tool. First, readiness assessment measures that are valid, reliable, and appropriate for healthcare settings were identified from a systematic review. Second, a mapping exercise was performed to categorize individual items of included measures according to key readiness constructs from an existing framework. Third, a modified Delphi process was used to collect stakeholder ratings of the included measures on domains of feasibility, relevance, and likelihood to recommend. Fourth, two versions of a decision support tool prototype were developed and evaluated for usability. Nine valid and reliable readiness assessment measures were included in the decision support tool. The mapping exercise revealed that of the nine measures, most measures (78 %) focused on assessing readiness for change at the organizational versus the individual level, and that four measures (44 %) represented all constructs of organizational readiness. During the modified Delphi process, stakeholders rated most measures as feasible and relevant for use in practice, and reported that they would be likely to recommend use of most measures. Using data from the mapping exercise and stakeholder panel, an algorithm was developed to link users to a measure based on characteristics of their organizational setting and their readiness for change assessment priorities. Usability testing yielded recommendations that were used to refine the Ready, Set, Change! decision support tool . Ready, Set, Change! decision support tool is an implementation support that is designed to facilitate the routine incorporation of a readiness assessment as an early step in implementation. Use of this tool in practice may offer time and resource-saving implications for implementation.

Evaluating cognition in individuals with Huntington disease: Neuro-QoL cognitive functioning measures.

PubMed

Lai, Jin-Shei; Goodnight, Siera; Downing, Nancy R; Ready, Rebecca E; Paulsen, Jane S; Kratz, Anna L; Stout, Julie C; McCormack, Michael K; Cella, David; Ross, Christopher; Russell, Jenna; Carlozzi, Noelle E

2018-03-01

Cognitive functioning impacts health-related quality of life (HRQOL) for individuals with Huntington disease (HD). The Neuro-QoL includes two patient-reported outcome (PRO) measures of cognition-Executive Function (EF) and General Concerns (GC). These measures have not previously been validated for use in HD. The purpose of this analysis is to evaluate the reliability and validity of the Neuro-QoL Cognitive Function measures for use in HD. Five hundred ten individuals with prodromal or manifest HD completed the Neuro-QoL Cognition measures, two other PRO measures of HRQOL (WHODAS 2.0 and EQ5D), and a depression measure (PROMIS Depression). Measures of functioning The Total Functional Capacity and behavior (Problem Behaviors Assessment) were completed by clinician interview. Objective measures of cognition were obtained using clinician-administered Symbol Digit Modalities Test and the Stroop Test (Word, Color, and Interference). Self-rated, clinician-rated, and objective composite scores were developed. We examined the Neuro-QoL measures for reliability, convergent validity, discriminant validity, and known-groups validity. Excellent reliabilities (Cronbach's alphas ≥ 0.94) were found. Convergent validity was supported, with strong relationships between self-reported measures of cognition. Discriminant validity was supported by less robust correlations between self-reported cognition and other constructs. Prodromal participants reported fewer cognitive problems than manifest groups, and early-stage HD participants reported fewer problems than late-stage HD participants. The Neuro-QoL Cognition measures provide reliable and valid assessments of self-reported cognitive functioning for individuals with HD. Findings support the utility of these measures for assessing self-reported cognition.

Reliability and validity of the adapted Resistance Training Skills Battery for Children.

PubMed

Furzer, Bonnie J; Bebich-Philip, Marc D; Wright, Kemi E; Reid, Siobhan L; Thornton, Ashleigh L

2017-12-29

Resistance training (RT) is emerging as a training modality to improve motor function and facilitate physical activity participation in children across the motor proficiency spectrum. Although RT competency assessments have been established and validated among adolescent cohorts, the extent to which these methods are suitable for assessing children's RT skills is unknown. This project aimed to assess the psychometric properties of the adapted Resistance Training Skills Battery for Children (RTSBc), in children with varying motor proficiency. Repeated measures design with 40 participants (M age=8.2±1.7years) displaying varying levels of motor proficiency. Participants performed the adapted RTSBc on two occasions, receiving a score for their execution of each component, in addition to an overall RT skill quotient child (RTSQc). Cronbach's alpha, intra-class correlation (ICC), Bland-Altman analysis, and typical error were used to assess test-retest reliability. To examine construct validity, exploratory factor analysis was performed alongside computing correlations between participants' muscle strength, motor proficiency, age, lean muscle mass, and RTSQc. The RTSBc displayed an acceptable level of internal consistency (alpha=0.86) and test-retest reliability (ICC range=0.86-0.99). Exploratory factor analysis supported internal test structure, with all six RT skills loading strongly on a single factor (range 0.56-0.89). Analyses of structural validity revealed positive correlations for RTSQc in relation to motor proficiency (r=0.52, p<0.001) and strength scores (r=0.61, p<0.001). Analyses revealed support for the construct validity and test-retest reliability of the RTSBc, providing preliminary evidence that the RTSBc is appropriate for use in the assessment of children's RT competency. Copyright © 2018 Sports Medicine Australia. Published by Elsevier Ltd. All rights reserved.

The Motivational Value Systems Questionnaire (MVSQ): Psychometric Analysis Using a Forced Choice Thurstonian IRT Model

PubMed Central

Merk, Josef; Schlotz, Wolff; Falter, Thomas

2017-01-01

This study presents a new measure of value systems, the Motivational Value Systems Questionnaire (MVSQ), which is based on a theory of value systems by psychologist Clare W. Graves. The purpose of the instrument is to help people identify their personal hierarchies of value systems and thus become more aware of what motivates and demotivates them in work-related contexts. The MVSQ is a forced-choice (FC) measure, making it quicker to complete and more difficult to intentionally distort, but also more difficult to assess its psychometric properties due to ipsativity of FC data compared to rating scales. To overcome limitations of ipsative data, a Thurstonian IRT (TIRT) model was fitted to the questionnaire data, based on a broad sample of N = 1,217 professionals and students. Comparison of normative (IRT) scale scores and ipsative scores suggested that MVSQ IRT scores are largely freed from restrictions due to ipsativity and thus allow interindividual comparison of scale scores. Empirical reliability was estimated using a sample-based simulation approach which showed acceptable and good estimates and, on average, slightly higher test-retest reliabilities. Further, validation studies provided evidence on both construct validity and criterion-related validity. Scale score correlations and associations of scores with both age and gender were largely in line with theoretically- and empirically-based expectations, and results of a multitrait-multimethod analysis supports convergent and discriminant construct validity. Criterion validity was assessed by examining the relation of value system preferences to departmental affiliation which revealed significant relations in line with prior hypothesizing. These findings demonstrate the good psychometric properties of the MVSQ and support its application in the assessment of value systems in work-related contexts. PMID:28979228

The Motivational Value Systems Questionnaire (MVSQ): Psychometric Analysis Using a Forced Choice Thurstonian IRT Model.

PubMed

Merk, Josef; Schlotz, Wolff; Falter, Thomas

2017-01-01

This study presents a new measure of value systems, the Motivational Value Systems Questionnaire (MVSQ), which is based on a theory of value systems by psychologist Clare W. Graves. The purpose of the instrument is to help people identify their personal hierarchies of value systems and thus become more aware of what motivates and demotivates them in work-related contexts. The MVSQ is a forced-choice (FC) measure, making it quicker to complete and more difficult to intentionally distort, but also more difficult to assess its psychometric properties due to ipsativity of FC data compared to rating scales. To overcome limitations of ipsative data, a Thurstonian IRT (TIRT) model was fitted to the questionnaire data, based on a broad sample of N = 1,217 professionals and students. Comparison of normative (IRT) scale scores and ipsative scores suggested that MVSQ IRT scores are largely freed from restrictions due to ipsativity and thus allow interindividual comparison of scale scores. Empirical reliability was estimated using a sample-based simulation approach which showed acceptable and good estimates and, on average, slightly higher test-retest reliabilities. Further, validation studies provided evidence on both construct validity and criterion-related validity. Scale score correlations and associations of scores with both age and gender were largely in line with theoretically- and empirically-based expectations, and results of a multitrait-multimethod analysis supports convergent and discriminant construct validity. Criterion validity was assessed by examining the relation of value system preferences to departmental affiliation which revealed significant relations in line with prior hypothesizing. These findings demonstrate the good psychometric properties of the MVSQ and support its application in the assessment of value systems in work-related contexts.

Validation of the Virtual MET as an assessment tool for executive functions.

PubMed

Rand, Debbie; Basha-Abu Rukan, Soraya; Weiss, Patrice L Tamar; Katz, Noomi

2009-08-01

The purpose of this study was to establish ecological validity and initial construct validity of a Virtual Multiple Errands Test (VMET) as an assessment tool for executive functions. It was implemented within the Virtual Mall (VMall), a novel functional video-capture virtual shopping environment. The main objectives were (1) to examine the relationships between the performance of three groups of participants in the Multiple Errands Test (MET) carried out in a real shopping mall and their performance in the VMET, (2) to assess the relationships between the MET and VMET of the post-stroke participant's level of executive functioning and independence in instrumental activities of daily living, and (3) to compare the performance of post-stroke participants to those of healthy young and older controls in both the MET and VMET. The study population included three groups; post-stroke participants (n = 9), healthy young participants (n = 20), and healthy older participants (n = 20). The VMET was able to differentiate between two age groups of healthy participants and between healthy and post-stroke participants thus demonstrating that it is sensitive to brain injury and ageing and supports construct validity between known groups. In addition, significant correlations were found between the MET and the VMET for both the post-stroke participants and older healthy participants. This provides initial support for the ecological validity of the VMET as an assessment tool of executive functions. However, further psychometric data on temporal stability are needed, namely test-retest reliability and responsiveness, before it is ready for clinical application. Further research using the VMET as an assessment tool within the VMall with larger groups and in additional populations is also recommended.

Validation of decisional balance and self-efficacy measures for HPV vaccination in college women.

PubMed

Lipschitz, Jessica M; Fernandez, Anne C; Larson, H Elsa; Blaney, Cerissa L; Meier, Kathy S; Redding, Colleen A; Prochaska, James O; Paiva, Andrea L

2013-01-01

Women younger than 25 years are at greatest risk for human papillomavirus (HPV) infection, including high-risk strains associated with 70% of cervical cancers. Effective model-based measures that can lead to intervention development to increase HPV vaccination rates are necessary. This study validated Transtheoretical Model measures of Decisional Balance and Self-Efficacy for seeking the HPV vaccine in a sample of female college students. Cross-sectional measurement development. Setting. Online survey of undergraduate college students. A total of 340 female students ages 18 to 26 years. Stage of Change, Decisional Balance, and Self-Efficacy. The sample was randomly split into halves for exploratory principal components analyses (PCAs), followed by confirmatory factor analyses (CFAs) to test measurement models. Multivariate analyses examined relationships between constructs. For Decisional Balance, PCA indicated two 4-item factors (Pros -α = .90; and Cons -α = .66). CFA supported a two-factor correlated model, χ(2)(19) = 39.33; p < .01; comparative fit index (CFI) = .97; and average absolute standardized residual statistic (AASR) = .03; with Pros α = .90 and Cons α = .67. For Self-Efficacy, PCA indicated one 6-item factor (α = .84). CFA supported this structure, χ(2)(9) = 50.87; p < .05; CFI = .94; AASR = .03; and α = .90. Multivariate analyses indicated significant cross-stage differences on Pros, Cons, and Self-Efficacy in expected directions. Findings support the internal and external validity of these measures and their use in Transtheoretical Model-tailored interventions. Stage-construct relationships suggest that reducing the Cons of vaccination may be more important for HPV than for behaviors with a true Maintenance stage.

Measuring Prosocial Tendencies in Germany: Sources of Validity and Reliablity of the Revised Prosocial Tendency Measure

PubMed Central

Rodrigues, Johannes; Ulrich, Natalie; Mussel, Patrick; Carlo, Gustavo; Hewig, Johannes

2017-01-01

The prosocial tendencies measure (PTM; Carlo and Randall, 2002) is a widely used measurement for prosocial tendencies in English speaking participants. This instrument distinguishes between six different types of prosocial tendencies that partly share some common basis, but also can be opposed to each other. To examine these constructs in Germany, a study with 1067 participants was conducted. The study investigated the structure of this German version of the PTM-R via exploratory factor analysis, confirmatory factor analysis, correlations with similar constructs in subsamples as well as via measurement invariance test concerning the original English version. The German translation showed a similar factor structure to the English version in exploratory factor analysis and in confirmatory factor analysis. Measurement invariance was found between the English and German language versions of the PTM and support for the proposed six-factor structure (altruistic, anonymous, compliant, dire, emotional and public prosocial behavior) was also found in confirmatory factor analysis. Furthermore, the expected interrelations of these factors of prosocial behavior tendencies were obtained. Finally, correlations of the prosocial behavior tendencies with validating constructs and behaviors were found. Thus, the findings stress the importance of seeing prosocial behavior not as a single dimension construct, but as a factored construct which now can also be assessed in German speaking participants. PMID:29270144

Modelling job support, job fit, job role and job satisfaction for school of nursing sessional academic staff.

PubMed

Cowin, Leanne S; Moroney, Robyn

2018-01-01

Sessional academic staff are an important part of nursing education. Increases in casualisation of the academic workforce continue and satisfaction with the job role is an important bench mark for quality curricula delivery and influences recruitment and retention. This study examined relations between four job constructs - organisation fit, organisation support, staff role and job satisfaction for Sessional Academic Staff at a School of Nursing by creating two path analysis models. A cross-sectional correlational survey design was utilised. Participants who were currently working as sessional or casual teaching staff members were invited to complete an online anonymous survey. The data represents a convenience sample of Sessional Academic Staff in 2016 at a large school of Nursing and Midwifery in Australia. After psychometric evaluation of each of the job construct measures in this study we utilised Structural Equation Modelling to better understand the relations of the variables. The measures used in this study were found to be both valid and reliable for this sample. Job support and job fit are positively linked to job satisfaction. Although the hypothesised model did not meet model fit standards, a new 'nested' model made substantive sense. This small study explored a new scale for measuring academic job role, and demonstrated how it promotes the constructs of job fit and job supports. All four job constructs are important in providing job satisfaction - an outcome that in turn supports staffing stability, retention, and motivation.

University student depression inventory (USDI): confirmatory factor analysis and review of psychometric properties.

PubMed

Romaniuk, Madeline; Khawaja, Nigar G

2013-09-25

The 30-item USDI is a self-report measure that assesses depressive symptoms among university students. It consists of three correlated three factors: lethargy, cognitive-emotional and academic motivation. The current research used confirmatory factor analysis to asses construct validity and determine whether the original factor structure would be replicated in a different sample. Psychometric properties were also examined. Participants were 1148 students (mean age 22.84 years, SD=6.85) across all faculties from a large Australian metropolitan university. Students completed a questionnaire comprising of the USDI, the depression anxiety stress scale (DASS) and Life Satisfaction Scale (LSS). The three correlated factor model was shown to be an acceptable fit to the data, indicating sound construct validity. Internal consistency of the scale was also demonstrated to be sound, with high Cronbach alpha values. Temporal stability of the scale was also shown to be strong through test-retest analysis. Finally, concurrent and discriminant validity was examined with correlations between the USDI and DASS subscales as well as the LSS, with sound results further supporting the construct validity of the scale. Cut-off points were also developed to aid total score interpretation. Response rates are unclear. In addition, the representativeness of the sample could be improved potentially through targeted recruitment (i.e. reviewing the online sample statistics during data collection, examining the representativeness trends and addressing particular faculties within the university that were underrepresented). The USDI provides a valid and reliable method of assessing depressive symptoms found among university students. © 2013 Elsevier B.V. All rights reserved.

Validation of the Dyadic Coping Inventory with Chinese couples: Factorial structure, measurement invariance, and construct validity.

PubMed

Xu, Feng; Hilpert, Peter; Randall, Ashley K; Li, Qiuping; Bodenmann, Guy

2016-08-01

The Dyadic Coping Inventory (DCI, Bodenmann, 2008) assesses how couples support each other when facing individual (e.g., workload) and common (e.g., parenting) stressors. Specifically, the DCI measures partners' perceptions of their own (Self) and their partners' behaviors (Partner) when facing individual stressors, and partners' common coping behaviors when facing common stressors (Common). To date, the DCI has been validated in 6 different languages from individualistic Western cultures; however, because culture can affect interpersonal interactions, it is unknown whether the DCI is a reliable measure of coping behaviors for couples living in collectivistic Eastern cultures. Based on data from 474 Chinese couples (N = 948 individuals), the current study examined the Chinese version of the DCI's factorial structure, measurement invariance (MI), and construct validity of test scores. Using 3 cultural groups (China, Switzerland, and the United States [U.S.]), confirmatory factor analysis revealed a 5-factor structure regarding Self and Partner and a 2-factor structure regarding Common dyadic coping (DC). Results from analyses of MI indicated that the DCI subscales met the criteria for configural, metric, and full/partial scalar invariance across cultures (Chinese-Swiss and Chinese-U.S.) and genders (Chinese men and women). Results further revealed good construct validity of the DCI test scores. In all, the Chinese version of the DCI can be used for measuring Chinese couples' coping behaviors, and is available for cross-cultural studies examining DC behaviors between Western and Eastern cultures. (PsycINFO Database Record (c) 2016 APA, all rights reserved).

Construct Validity and Scoring Methods of the World Health Organization: Health and Work Performance Questionnaire Among Workers With Arthritis and Rheumatological Conditions.

PubMed

AlHeresh, Rawan; LaValley, Michael P; Coster, Wendy; Keysor, Julie J

2017-06-01

To evaluate construct validity and scoring methods of the world health organization-health and work performance questionnaire (HPQ) for people with arthritis. Construct validity was examined through hypothesis testing using the recommended guidelines of the consensus-based standards for the selection of health measurement instruments (COSMIN). The HPQ using the absolute scoring method showed moderate construct validity as four of the seven hypotheses were met. The HPQ using the relative scoring method had weak construct validity as only one of the seven hypotheses were met. The absolute scoring method for the HPQ is superior in construct validity to the relative scoring method in assessing work performance among people with arthritis and related rheumatic conditions; however, more research is needed to further explore other psychometric properties of the HPQ.

Longitudinal construct validity of the minimum data set health status index.

PubMed

Jones, Aaron; Feeny, David; Costa, Andrew P

2018-05-24

The Minimum Data Set Health Status Index (MDS-HSI) is a generic, preference-based health-related quality of life (HRQOL) measure derived by mapping items from the Resident Assessment Instrument - Minimum Data Set (RAI-MDS) assessment onto the Health Utilities Index Mark 2 classification system. While the validity of the MDS-HSI has been examined in cross-sectional settings, the longitudinal validity has not been explored. The objective of this study was to investigate the longitudinal construct validity of the MDS-HSI in a home care population. This study utilized a retrospective cohort of home care patients in the Hamilton-Niagara-Haldimand-Brant health region of Ontario, Canada with at least two RAI-MDS Home Care assessments between January 2010 and December 2014. Convergent validity was assessed by calculating Spearman rank correlations between the change in MDS-HSI and changes in six validated indices of health domains that can be calculated from the RAI-MDS assessment. Known-groups validity was investigated by fitting multivariable linear regression models to estimate the mean change in MDS-HSI associated with clinically important changes in the six health domain indices and 15 disease symptoms from the RAI-MDS Home Care assessment, controlling for age and sex. The cohort contained 25,182 patients with two RAI-MDS Home Care assessments. Spearman correlations between the MDS-HSI change and changes in the health domain indices were all statistically significant and in the hypothesized small to moderate range [0.1 < ρ < 0.5]. Clinically important changes in all of the health domain indices and 13 of the 15 disease symptoms were significantly associated with clinically important changes in the MDS-HSI. The findings of this study support the longitudinal construct validity of the MDS-HSI in home care populations. In addition to evaluating changes in HRQOL among home care patients in clinical research, economic evaluation, and health technology assessment, the MDS-HSI may be used in system-level applications using routinely collected population-level data.

Further Refinements in the Measurement of Exercise Imagery: The Exercise Imagery Inventory

ERIC Educational Resources Information Center

Giacobbi, Peter R., Jr.; Hausenblas, Heather A.; Penfield, Randall D.

2005-01-01

The factorial and construct validity of the Exercise Imagery Inventory (EII) were assessed with 3 separate samples of participants. In Phase 1, a 41-item measure was administered to 504 undergraduate students. Exploratory factor analysis supported a 4-factor model that explained 65% of the variance. In Phase 2, a 19-item measure was administered…

Factor Analysis of the Kaufman Assessment Battery for Children (K-ABC) for Ages 2 1/2 through 12 1/2 Years.

ERIC Educational Resources Information Center

Kaufman, Alan S.; Kamphaus, Randy W.

1984-01-01

The construct validity of the Sequential Processing, Simultaneous Processing and Achievement scales of the Kaufman Assessment Battery for Children was supported by factor-analytic investigations of a representative national stratified sample of 2,000 children. Correlations provided insight into the relationship of sequential/simultaneous…

Factor Structure, Construct Validity and Reliability of the Seeking of Noetic Goals (SONG) and Purpose in Life (PIL) Tests.

ERIC Educational Resources Information Center

Reker, Gary T.; Cousins, J. B.

1979-01-01

In this study with 240 introductory psychology students, ten interpretable independent dimensions of satisfaction with life were extracted with six factors that loaded on the PIL and four that loaded on the SONG, supporting Crumbaugh's assertion that the SONG is a complementary scale to the PIL. (Author/SJL)

Quantification of construction waste prevented by BIM-based design validation: Case studies in South Korea.

PubMed

Won, Jongsung; Cheng, Jack C P; Lee, Ghang

2016-03-01

Waste generated in construction and demolition processes comprised around 50% of the solid waste in South Korea in 2013. Many cases show that design validation based on building information modeling (BIM) is an effective means to reduce the amount of construction waste since construction waste is mainly generated due to improper design and unexpected changes in the design and construction phases. However, the amount of construction waste that could be avoided by adopting BIM-based design validation has been unknown. This paper aims to estimate the amount of construction waste prevented by a BIM-based design validation process based on the amount of construction waste that might be generated due to design errors. Two project cases in South Korea were studied in this paper, with 381 and 136 design errors detected, respectively during the BIM-based design validation. Each design error was categorized according to its cause and the likelihood of detection before construction. The case studies show that BIM-based design validation could prevent 4.3-15.2% of construction waste that might have been generated without using BIM. Copyright © 2015 Elsevier Ltd. All rights reserved.

Perceived Context of Reception among Recent Hispanic Immigrants: Conceptualization, Instrument Development, and Preliminary Validation

PubMed Central

Schwartz, Seth J.; Unger, Jennifer B.; Lorenzo-Blanco, Elma I.; Des Rosiers, Sabrina E.; Villamar, Juan A.; Soto, Daniel W.; Pattarroyo, Monica; Baezconde-Garbanati, Lourdes; Szapocznik, José

2013-01-01

Context of reception has been discussed widely in the sociological and anthropological literature, but no measures of this construct exist. We designed a measure of perceived context of reception and provide initial support for the factorial validity, internal consistency reliability, and incremental and discriminant validity of scores generated by this measure. A sample of 302 recent-immigrant Hispanic parent-adolescent dyads from Miami and Los Angeles completed the new perceived context of reception measure, as well as measures of perceived discrimination; Hispanic/American cultural practices, values, and identifications; and depressive symptoms. In Phase 1, exploratory and confirmatory factor analyses extracted a factor for negative perceived context of reception. A subscale corresponding to this factor was used in Phase 2; for parents and adolescents, negative perceived context of reception and perceived discrimination were differentially associated with acculturation-related variables – suggesting discriminant validity between perceived discrimination and negative perceived context of reception. For adolescents at both sites and for parents in Los Angeles only, the negative perceived context of reception dimensions were significantly associated with depressive symptoms six months later, over and above the contribution made by perceived discrimination – suggesting incremental validity. Results are discussed in terms of perceived context of reception as a new and emerging construct. PMID:24099485

The Prosocial and Antisocial Behaviour in Sport Scale: further evidence for construct validity and reliability.

PubMed

Kavussanu, Maria; Stanger, Nicholas; Boardley, Ian D

2013-01-01

The purpose of this research was to provide further evidence for the construct validity (i.e., convergent, concurrent, and discriminant validity) of the Prosocial and Antisocial Behaviour in Sport Scale (PABSS), an instrument that has four subscales measuring prosocial and antisocial behaviour toward teammates and opponents. We also investigated test-retest reliability and stability of the PABSS. We conducted three studies using athletes from a variety of team sports. In Study 1, participants (N = 129) completed the PABSS and measures of physical and verbal aggression, hostility, anger, moral identity, and empathy; a sub-sample (n = 111) also completed the PABSS one week later. In Study 2, in addition to the PABSS, participants (N = 89) completed measures of competitive aggressiveness and anger, moral attitudes, moral disengagement, goal orientation, and anxiety. In Study 3, participants (N = 307) completed the PABSS and a measure of social goals. Across the three studies, the four subscales evidenced the hypothesised relationships with a number of variables. Correlations were large between the two antisocial behaviours and small between the two prosocial behaviours. Overall, the findings supported the convergent, concurrent, and discriminant validity of the scale, provided evidence for its test-retest reliability and stability, and suggest that the instrument is a valid and reliable measure of prosocial and antisocial behaviour in sport.

Validation of an instrument to measure older adults' expectations regarding movement (ERM).

PubMed

Dahodwala, Nabila; Karlawish, Jason; Shea, Judy A; Zubritsky, Cynthia; Stern, Matthew; Mandell, David S

2012-01-01

Many individuals with Parkinson's disease are not diagnosed and treated. Attitudes about aging and related help-seeking may affect the timely diagnosis of Parkinson's disease. Our objectives were to develop measures of older adults' expectations regarding movement with aging, specifically related to parkinsonism, and their beliefs about seeking healthcare for the diagnosis and treatment of parkinsonism. We established content and face validity from interviews with experts, review of the literature, and pre-testing with key informants. Two 9-item instruments resulted: Expectations Regarding Movement (ERM) and Healthcare Seeking Beliefs for parkinsonism (HSB). These instruments were administered to 210 older adults at senior centers to investigate internal consistency and construct validity. 192 (91%) of the older adults completed more than 90% of the survey. The mean age was 76; 17 (9%) reported parkinsonism. Both scales demonstrated good internal consistency (α = 0.90). Factor analysis supported construct validity of the ERM and HSB scores. Older age, lower education, worse self-reported health and African American race each were associated with lower ERM scores, but not HSB scores. The ERM, a brief measure of expectations regarding movement with aging, shows reliability and validity. This scale may be useful in identifying older adults at increased risk for under-identification of Parkinson's disease. Further work is needed to measure healthcare seeking for parkinsonism.

Perceived context of reception among recent Hispanic immigrants: conceptualization, instrument development, and preliminary validation.

PubMed

Schwartz, Seth J; Unger, Jennifer B; Lorenzo-Blanco, Elma I; Des Rosiers, Sabrina E; Villamar, Juan A; Soto, Daniel W; Pattarroyo, Monica; Baezconde-Garbanati, Lourdes; Szapocznik, José

2014-01-01

Context of reception has been discussed widely in the sociological and anthropological literature, but no measures of this construct exist. We designed a measure of perceived context of reception and provide initial support for the factorial validity, internal consistency reliability, and incremental and discriminant validity of scores generated by this measure. A sample of 302 recent-immigrant Hispanic parent-adolescent dyads from Miami and Los Angeles completed the new perceived context of reception measure, as well as measures of perceived discrimination; Hispanic/American cultural practices, values, and identifications; and depressive symptoms. In Phase 1, exploratory and confirmatory factor analyses extracted a factor for negative perceived context of reception. A subscale corresponding to this factor was used in Phase 2; for parents and adolescents, negative perceived context of reception and perceived discrimination were differentially associated with acculturation-related variables-suggesting discriminant validity between perceived discrimination and negative perceived context of reception. For adolescents at both sites and for parents in Los Angeles only, the negative perceived context of reception dimensions were significantly associated with depressive symptoms 6 months later, over and above the contribution made by perceived discrimination--suggesting incremental validity. Results are discussed in terms of perceived context of reception as a new and emerging construct.

Spanish translation and validation of the Preschool Activity Card Sort.

PubMed

Stoffel, Ashley; Berg, Christine

2008-05-01

Few standardized assessments exist for children living in the United States who are Hispanic/Latino. This study reports the Spanish translation process for the Preschool Activity Card Sort (PACS), which is a measure of participation in preschool children, and examines content, construct, and concurrent validity. Methods of verifying accuracy of translation included expert review and back translation and supported content validity of the Tarjetas de Actividades Preescolares (TAP). Subsequently, a sample of 37 parents of children between 3 and 6 years of age completed the PACS/TAP by structured interview. Twenty-six parents were Spanish speaking, and 11 were English speaking. A comparison of reported participation by Spanish- and English-speaking children provides initial construct validity of the TAP. Results indicate that the TAP differentiates among children of recent immigrants as compared to preschoolers who were born in the United States on domains of self-care, high and low demand leisure, and educational activities. Results emphasize the importance of considering sociocultural influences when assessing participation. PACS/TAP scores were moderately correlated with Pediatric Evaluation of Disability Inventory scores for the self-care domain, but did not correlate with the mobility or social function domains. The PACS/TAP appears to provide a useful means of understanding preschoolers' participation. Future research is needed to further establish the validity of this assessment.

A Music-Related Quality of Life Measure to Guide Music Rehabilitation for Adult Cochlear Implant Users.

PubMed

Dritsakis, Giorgos; van Besouw, Rachel M; Kitterick, Pádraig; Verschuur, Carl A

2017-09-18

A music-related quality of life (MuRQoL) questionnaire was developed for the evaluation of music rehabilitation for adult cochlear implant (CI) users. The present studies were aimed at refinement and validation. Twenty-four experts reviewed the MuRQoL items for face validity. A refined version was completed by 147 adult CI users, and psychometric techniques were used for item selection, assessment of reliability, and definition of the factor structure. The same participants completed the Short Form Health Survey for construct validation. MuRQoL responses from 68 CI users were compared with those of a matched group of adults with normal hearing. Eighteen items measuring music perception and engagement and 18 items measuring their importance were selected; they grouped together into 2 domains. The final questionnaire has high internal consistency and repeatability. Significant differences between CI users and adults with normal hearing and a correlation between music engagement and quality of life support construct validity. Scores of music perception and engagement and importance for the 18 items can be combined to assess the impact of music on the quality of life. The MuRQoL questionnaire is a reliable and valid measure of self-reported music perception, engagement, and their importance for adult CI users with potential to guide music aural rehabilitation.

Social Support Is a Predictor of Lower Stress and Higher Quality of Life and Resilience in Brazilian Patients With Colorectal Cancer.

PubMed

Costa, Ana Lucia Siqueira; Heitkemper, Margaret M; Alencar, Gizelton Pereira; Damiani, Lucas Petri; Silva, Rodrigo Marques da; Jarrett, Monica E

The well-being of patients undergoing chemotherapy treatment for colorectal cancer (CRC) is affected by psychological effects associated with cancer treatment. However, little is known about the impact of these psychological factors in Brazilian patients with CRC. The aim of this study was to determine whether perceived stress, social support, and resilience are associated with quality of life in urban Brazilian patients receiving chemotherapy treatment for CRC. This was a cross-sectional study conducted with 144 Brazilian CRC patients in an ambulatory oncology clinic. The participants completed 5 questionnaires: Demographics, Perceived Stress Scale 14, Social Support Satisfaction Scale, Resilience Scale, and European Organization for Research and Treatment of Cancer Quality of Life Questionnaires (C30 and CR29). Confirmatory factor analysis modeling and Cronbach's α were used to examine construct validity and internal consistency. We used the MPlus 3.0 to construct and validate the structural model. There was a moderate and positive effect of resilience on the physical, social, and emotional aspects of quality of life. Social support had a strong and positive direct effect on quality of life (ie, social, physical, social, and emotional). Social support had a negative effect on stress perception. Resilience was also negatively related to stress perception. Family support and professional social support are important factors for Brazilian CRC patients. Resilience is an important ally for patients. It is important for nurses to consider this when developing educational and psychological interventional strategies to reduce stress and ultimately improve quality of life in this population. Psychological factors that improve quality of life should be evaluated in patients undergoing treatment for cancer.

A validation study of the Brazilian version of the pornography consumption inventory (PCI) in a sample of female university students.

PubMed

Baltieri, Danilo Antonio; Luísa de Souza Gatti, Ana; Henrique de Oliveira, Vitor; Junqueira Aguiar, Ana Saito; Almeida de Souza Aranha e Silva, Renata

2016-02-01

Although men constitute the widest consumer group of pornography, the Internet has facilitated both the production of and access to pornographic material by women as well. However, few measures are available to examine pornography-use constructs, which can compromise the reliability of statements regarding the harmful use of pornography. Our study aimed to confirm the factorial validity and internal consistency of the Pornography Consumption Inventory (PCI) in a sample of female university students in Brazil. The PCI is a four-factor, 15-item, five-point Likert-type scale. After translation and back-translation of the PCI, it was administered to 105 female medical students. Exploratory and confirmatory factor analyses were conducted to examine the construct validity. The results supported the four-factor model of the PCI. The model showed adequate internal reliability and good fit indices (comparative fit index (CFI) = 0.95, Tucker-Lewis index (TLI) = 0.94, root mean square error of approximation (RMSEA) = 0.07 (95% confidence interval (CI) = 0.04-0.09), and standardized root mean square residual (SRMR) = 0.08). Overall, the findings from this study support the use of the PCI in Portuguese-speaking women. Copyright © 2015 Elsevier Ltd and Faculty of Forensic and Legal Medicine. All rights reserved.

Cooperativeness and competitiveness as two distinct constructs: validating the Cooperative and Competitive Personality Scale in a social dilemma context.

PubMed

Lu, Su; Au, Wing-Tung; Jiang, Feng; Xie, Xiaofei; Yam, Paton

2013-01-01

The present research validated the construct and criterion validities of the Cooperative and Competitive Personality Scale (CCPS) in a social dilemma context. The results from three studies supported the notion that cooperativeness and competitiveness are two independent dimensions, challenging the traditional view that they are two ends of a single continuum. First, confirmatory factor analyses revealed that a two-factor structure fit the data significantly better than a one-factor structure. Moreover, cooperativeness and competitiveness were either not significantly correlated (Studies 1 and 3) or only moderately positively correlated (Study 2). Second, cooperativeness and competitiveness were differentially associated with Schwartz's Personal Values. These results further supported the idea that cooperativeness and competitiveness are two distinct constructs. Specifically, the individuals who were highly cooperative emphasized self-transcendent values (i.e., universalism and benevolence) more, whereas the individuals who were highly competitive emphasized self-enhancement values (i.e., power and achievement) more. Finally, the CCPS, which adheres to the trait perspective of personality, was found to be a useful supplement to more prevalent social motive measures (i.e., social value orientation) in predicting cooperative behaviors. Specifically, in Study 2, when social value orientation was controlled for, the CCPS significantly predicted cooperative behaviors in a public goods dilemma (individuals who score higher on cooperativeness scale contributed more to the public goods). In Study 3, when social value orientation was controlled for, the CCPS significantly predicted cooperative behaviors in commons dilemmas (individuals who score higher on cooperativeness scale requested fewer resources from the common resource pool). The practical implications of the CCPS in conflict resolution, as well as in recruitment and selection settings, are discussed.

Hypochondriasis Y-BOCS: a study of the psychometric properties of a clinician-administered semi-structured interview to assess hypochondriacal thoughts and behaviours.

PubMed

Greeven, Anja; Spinhoven, Philip; van Balkom, Anton J L M

2009-01-01

This study investigated the psychometric properties of the first clinician-administered semi-structured interview for assessing the severity of hypochondriacal symptoms. The Hypochondriasis Yale-Brown Obsessive-Compulsive Scale (H-YBOCS) consisted of three a priori dimensions: hypochondriacal obsessions, compulsions and avoidance. The 16-item interview was conducted with 112 participants with Diagnostic and Statistical Manual of Mental Disorders, Fourth Edition, hypochondriasis. We analysed factor analytic structure, reliability, construct validity and sensitivity to change. Factor analysis supported a three-factor model similar to the a priori dimensions. Internal consistency ranged from satisfactory to good. Inter-rater reliability was excellent. The construct validity was low to moderate. The H-YBOCS was sensitive for measuring changes in symptom severity. The H-YBOCS is a (factorially) valid and coherent interview with a high level of agreement across different raters. The relatively low discriminant validity could be due to co-morbid anxiety and depressive disorders. Overall, the H-YBOCS seems to be a promising contribution to the assessment of hypochondriasis. *The hypochondriasis Y-BOCS is a feasible clinician rated interview to assess the severity of hypochondriacal complaints.

Psychometric properties of the Portuguese version of the Depressive Cognition Scale in Brazilian adults with diabetes mellitus.

PubMed

Sousa, Valmi D; Zanetti, Maria L; Zauszniewski, Jaclene A; Mendes, Isabel A C; Daguano, Michelle O

2008-01-01

Identifying depressive cognitions in Brazilians with diabetes can be important step to prevent the development of clinical depression, which is negatively associated with diabetes self-management. This study focused on the psychometric testing of the Portuguese version of the Depressive Cognition Scale, the Escala Cognitiva de Depressão (ECD), among 82 Brazilian adults with diabetes mellitus. The questionnaire was assessed for internal consistency, homogeneity, and construct validity using factor analysis and convergent validity assessment with the Portuguese version of the Beck Depression Inventory, the Inventário de Depressão Beck (IDB). Cronbach's alpha for the ECD was .88. The homogeneity of the instrument was supported by item-to-total correlations between .30 and .70. Factor extraction generated only one factor with eigenvalues greater than 1, which is consistent with the English version. The ECD's total score had a weak but significant correlation with the IDB's total score (r = .24, p < .05), indicating convergent validity. Evidence for the reliability and construct validity of the ECD was provided by this study. This scale has the potential to become a useful screening tool for depressive cognitions among Brazilians with diabetes.

Development and validation of the Measure of Indigenous Racism Experiences (MIRE)

PubMed Central

Paradies, Yin C; Cunningham, Joan

2008-01-01

Background In recent decades there has been increasing evidence of a relationship between self-reported racism and health. Although a plethora of instruments to measure racism have been developed, very few have been described conceptually or psychometrically Furthermore, this research field has been limited by a dearth of instruments that examine reactions/responses to racism and by a restricted focus on African American populations. Methods In response to these limitations, the 31-item Measure of Indigenous Racism Experiences (MIRE) was developed to assess self-reported racism for Indigenous Australians. This paper describes the development of the MIRE together with an opportunistic examination of its content, construct and convergent validity in a population health study involving 312 Indigenous Australians. Results Focus group research supported the content validity of the MIRE, and inter-item/scale correlations suggested good construct validity. A good fit with a priori conceptual dimensions was demonstrated in factor analysis, and convergence with a separate item on discrimination was satisfactory. Conclusion The MIRE has considerable utility as an instrument that can assess multiple facets of racism together with responses/reactions to racism among indigenous populations and, potentially, among other ethnic/racial groups. PMID:18426602

Validation of a French version of the pure procrastination scale (PPS).

PubMed

Rebetez, Marie My Lien; Rochat, Lucien; Gay, Philippe; Van der Linden, Martial

2014-08-01

Procrastination is a widespread phenomenon that affects everyone's day-to-day life and interferes with the clinical treatment of several psychopathological states. To assess this construct, Steel (2010) developed the Pure Procrastination Scale (PPS), a short scale intended to capture the general notion of dysfunctional delay. The aim of the current study was to present a French version of this questionnaire. To this end, the 12 items of the PPS were translated into French and data were collected from an online survey in a sample of 245 French-speaking individuals from the general population. The results revealed that one item had problematic face validity; it was therefore removed. Exploratory and confirmatory analyses performed on the resulting 11-item version of the French PPS indicated that the scale was composed of two factors ("voluntary delay" and "observed delay") depending on a common, higher-order construct ("general procrastination"). Good internal consistency and test-retest reliability were found. External validity was supported by specific relationships with measures of personality traits, impulsivity, and subjective well-being. The French PPS therefore presents satisfactory psychometric properties and may be considered a reliable and valid instrument for research, teaching and clinical practice. Copyright © 2014 Elsevier Inc. All rights reserved.

Psychometric analysis of two new scales: the evidence-based practice nursing leadership and work environment scales.

PubMed

Pryse, Yvette; McDaniel, Anna; Schafer, John

2014-08-01

Those in nursing have been charged with practicing to the full extent of their education and training by the Institute of Medicine. Therefore, evidence-based practice (EBP) has never been more important to nursing than in the current healthcare environment. Frequently the burden of EBP is the responsibility of the bedside practitioner, but has been found to be a process that requires leadership and organizational support. A key underlying component of a strong EBP environment includes effective communications and collaboration among staff and nursing leadership. Developing measurement tools that examine the milieu and nursing leadership in which the staff nurse practices is an important component of understanding the factors that support or hinder EBP. The aim of this study is to report on the development and analysis of two new scales designed to explore leadership and organizational support for EBP. The EBP Nursing Leadership Scale (10 items) examines the staff nurses perception of support provided by the nurse manager for EBP, and the EBP Work Environment Scale (8 items) examines organizational support for EBP. Staff nurses who worked at least .5 FTE in direct patient care, from two inner city hospitals (n = 422) completed the scales. The scales were evaluated for internal consistency reliability with the Cronbach alpha technique, content validity using a panel of experts, and construct validity by The content validity index computed from expert rankings was .78 to 1.0 with an average of.96. Cronbach's alpha was .96 (n = 422) for the EBP Nursing Leadership Scale and .86 (n = 422) for the EBP Work Environment Scale. Factor analysis confirmed that each scale measured a unidimensional construct (p < .000). The EBP Nursing Leadership Scale and the EBP Work Environment Scale are psychometrically sound instruments to examine organizational influences on EBP. © 2014 Sigma Theta Tau International.

Factors affecting unsafe behavior in construction projects: development and validation of a new questionnaire.

PubMed

Asilian-Mahabadi, Hassan; Khosravi, Yahya; Hassanzadeh-Rangi, Narmin; Hajizadeh, Ebrahim; Behzadan, Amir H

2018-02-05

Occupational safety in general, and construction safety in particular, is a complex phenomenon. This study was designed to develop a new valid measure to evaluate factors affecting unsafe behavior in the construction industry. A new questionnaire was generated from qualitative research according to the principles of grounded theory. Key measurement properties (face validity, content validity, construct validity, reliability and discriminative validity) were examined using qualitative and quantitative approaches. The receiver operating characteristic curve was used to estimate the discriminating power and the optimal cutoff score. Construct validity revealed an interpretable 12-factor structure which explained 61.87% of variance. Good internal consistency (Cronbach's α = 0.94) and stability (intra-class correlation coefficient = 0.93) were found for the new instrument. The area under the curve, sensitivity and specificity were 0.80, 0.80 and 0.75, respectively. The new instrument also discriminated safety performance among the construction sites with different workers' accident histories (F = 6.40, p < 0.05). The new instrument appears to be a valid, reliable and sensitive instrument that will contribute to investigating the root causes of workers' unsafe behaviors, thus promoting safety performance in the construction industry.

A systematic review of a functional assessment Tool: UCSD Performance-based skill assessment (UPSA).

PubMed

Becattini-Oliveira, Ana Claudia; Dutra, Douglas de Farias; Spenciere de Oliveira Campos, Bárbara; de Araujo, Verônica Carvalho; Charchat-Fichman, Helenice

2018-05-18

Performance based assessment instruments have been employed in functional capacity measurement of mental disorders. The aim of this systematic review was to identify the psychometric properties of the UCSD Performance-based Skill Assessment (UPSA). A search was conducted using the PRISMA protocol and 'UPSA' as key word term on electronic databases, with a date range for articles published from 2001-2017. Published studies involving community-dwelling adults were included. Pharmacological and/or clinical interventions involving clinical outcomes and/or institutionalized samples were excluded. Data related to construct validity, test-retest reliability and sensitivity/specificity were extracted, summarized and analyzed according to UPSA versions and psychiatric disorders. Fifty-eight studies including 8782 Community-dwelling adults met selection criteria. Data supporting the construct and known-groups validity were extracted from 41 studies involving Schizophrenia and schizoaffective disorders and 17 studies involving other metal illness. The UPSA was culturally adapted to 8 different languages and employed in 17 countries. Few studies reported sensitivity and specificity and the cut-off points could not be generalized. Moderate to strong evidence of construct validity and test-retest reliability was found. Few studies proposed cut-off points. The UPSA showed good psychometric properties in different versions including those culturally adapted. Copyright © 2018 Elsevier B.V. All rights reserved.

Development and psychometric properties of the Maastricht Personal Autonomy Questionnaire (MPAQ) in older adults with a chronic physical illness.

PubMed

Mars, Godelief M J; van Eijk, Jacques Th M; Post, Marcel W M; Proot, Ireen M; Mesters, Ilse; Kempen, Gertrudis I J M

2014-08-01

To develop and test the Maastricht Personal Autonomy Questionnaire (MPAQ), an instrument measuring personal autonomy of older adults with a chronic physical illness in accordance with their experience of autonomy. Achievement of personal autonomy is conceptualized as correspondence between the way people's lives are actually arranged and the way people want to arrange their lives. A field test was conducted in three waves (n = 412, n = 125 and n = 244) among a random sample of people older than 59 years with either chronic obstructive pulmonary disease or diabetes mellitus. Construct validity, reproducibility and responsiveness were evaluated. The MPAQ entailing 16 items consists of three scales: degree of (personal) autonomy, working on autonomy and dilemmas. Construct validity was largely supported by confirmatory factor analysis and correlations between the MPAQ and other instruments. Intraclass correlation coefficients ranged from 0.61 to 0.80 and SRDsgroup from 0.10 to 0.13. Mean change was larger (0.54) than was SRDgroup (0.11) in patients who had deteriorated, but smaller in patients who had improved (0.07). The MPAQ has good content and construct validity and moderate reproducibility. Responsiveness is weak, although better for deterioration than for improvement.

BioNetCAD: design, simulation and experimental validation of synthetic biochemical networks

PubMed Central

Rialle, Stéphanie; Felicori, Liza; Dias-Lopes, Camila; Pérès, Sabine; El Atia, Sanaâ; Thierry, Alain R.; Amar, Patrick; Molina, Franck

2010-01-01

Motivation: Synthetic biology studies how to design and construct biological systems with functions that do not exist in nature. Biochemical networks, although easier to control, have been used less frequently than genetic networks as a base to build a synthetic system. To date, no clear engineering principles exist to design such cell-free biochemical networks. Results: We describe a methodology for the construction of synthetic biochemical networks based on three main steps: design, simulation and experimental validation. We developed BioNetCAD to help users to go through these steps. BioNetCAD allows designing abstract networks that can be implemented thanks to CompuBioTicDB, a database of parts for synthetic biology. BioNetCAD enables also simulations with the HSim software and the classical Ordinary Differential Equations (ODE). We demonstrate with a case study that BioNetCAD can rationalize and reduce further experimental validation during the construction of a biochemical network. Availability and implementation: BioNetCAD is freely available at http://www.sysdiag.cnrs.fr/BioNetCAD. It is implemented in Java and supported on MS Windows. CompuBioTicDB is freely accessible at http://compubiotic.sysdiag.cnrs.fr/ Contact: stephanie.rialle@sysdiag.cnrs.fr; franck.molina@sysdiag.cnrs.fr Supplementary information: Supplementary data are available at Bioinformatics online. PMID:20628073

The shoulder pain and disability index: the construct validity and responsiveness of a region-specific disability measure.

PubMed

Heald, S L; Riddle, D L; Lamb, R L

1997-10-01

The purposes of this study were (1) to assess the construct validity of the Shoulder Pain and Disability Index (SPADI) and (2) to determine whether the SPADI is more responsive than the Sickness Impact Profile (SIP), a generic health status measure. The sample consisted of 94 patients who were diagnosed with a shoulder problem and referred to six outpatient physical therapy clinics. Clinically meaningful change was determined by use of an ordinal rating scale designed to determine whether the patient's shoulder function was improved, the same, or worse following treatment. Spearman rho correlations were calculated for the initial visit SPADI and SIP scores. The standardized response mean (SRM) was used to measure responsiveness for the patients who were judged to be improved. One-tailed paired t tests (alpha = .01) were used to determine whether differences existed among SRM values. Correlations between the SPADI and SIP scores ranged from r = .01 to r = .57. The SRM value was higher for the SPADI total score (SRM = 1.38) than for the SIP total score (SRM = 0.79). Most correlations between SPADI and SIP scores provided support for the construct validity of the SPADI. The SPADI does not appear to strongly reflect occupational and recreational disability and is more responsive than the SIP.

Validation of a Latent Construct for Dementia in a Population-Wide Dataset from Singapore.

PubMed

Peh, Chao Xu; Abdin, Edimansyah; Vaingankar, Janhavi A; Verma, Swapna; Chua, Boon Yiang; Sagayadevan, Vathsala; Seow, Esmond; Zhang, YunJue; Shahwan, Shazana; Ng, Li Ling; Prince, Martin; Chong, Siow Ann; Subramaniam, Mythily

2017-01-01

The latent variable δ has been proposed as a proxy for dementia. Previous validation studies have been conducted using convenience samples. It is currently unknown how δ performs in population-wide data. To validate δ in Singapore using population-wide epidemiological study data on persons aged 60 and above. δ was constructed using items from the Community Screening Instrument for Dementia (CSI'D) and World Health Organization Disability Assessment Schedule (WHODAS II). Confirmatory factor analysis (CFA) was conducted to examine δ model fit. Convergent validity was examined with the Clinical Dementia Rating scale (CDR) and GMS-AGECAT dementia. Divergent validity was examined with GMS-AGECAT depression. The δ model demonstrated fit to the data, χ2(df) = 249.71(55), p < 0.001, CFI = 0.990, TLI = 0.997, RMSEA = 0.037. Latent variable δ was significantly associated with CDR and GMS-AGECAT dementia (range: β= 0.32 to 0.63), and was not associated with GMS-AGECAT depression. Compared to unadjusted models, δ model fit was poor when adjusted for age, gender, ethnicity, and education. The study found some support for δ as a proxy for dementia in Singapore based on population data. Both convergent and divergent validity were established. In addition, the δ model structure appeared to be influenced by age, gender, ethnicity, and education covariates.

CODEMamb - an observational communication behavior assessment tool for use in ambulatory dementia care.

PubMed

Knebel, Maren; Haberstroh, Julia; Kümmel, Anne; Pantel, Johannes; Schröder, Johannes

2016-12-01

Communication improves well-being and quality of life for both people with dementia and their professional and family caregivers. Individualized communication, as required in informed consent procedures and psychosocial interventions, can improve quality of life, especially in ambulatory settings. However, few valid and reliable instruments exist that enable communication to be assessed and communication and behavioral resources to be identified. We, therefore, extended and adapted the newly developed observational instrument CODEM for use in ambulatory settings (CODEM amb ). Reliability and validity of the new instrument were studied in a total of 171 patients, whereby principal component analysis revealed three important factors: relationship aspects, verbal communication behavior and nonverbal communication behavior. CODEM amb [Formula: see text]s internal consistency, interrater and retest reliability were satisfactory to excellent. Convergent validity indices, as shown by examining correlations with similar but not identical constructs (CERAD-NP verbal subscales), were medium-high, while the divergent validity index (constructional praxis) was relatively low. The relationship to peer-rating remained nonsignificant. Criterion validity was investigated in groups of patients in accordance with their cognitive status. As expected, verbal communication abilities deteriorate faster than the relationship aspects of communication as the disease progresses. In summary, CODEM amb is a reliable and valid instrument that can be used to collect important information with the ultimate aim of supporting communication with people with dementia.

Validation of VARK learning modalities questionnaire using Rasch analysis

NASA Astrophysics Data System (ADS)

Fitkov-Norris, E. D.; Yeghiazarian, A.

2015-02-01

This article discusses the application of Rasch analysis to assess the internal validity of a four sub-scale VARK (Visual, Auditory, Read/Write and Kinaesthetic) learning styles instrument. The results from the analysis show that the Rasch model fits the majority of the VARK questionnaire data and the sample data support the internal validity of the four sub-constructs at 1% level of significance for all but one item. While this suggests that the instrument could potentially be used as a predictor for a person's learning preference orientation, further analysis is necessary to confirm the invariability of the instrument across different user groups across factors such as gender, age, educational and cultural background.

[The psychometric properties of the Turkish version of Myocardial Infarction Dimensional Assessment Scale (MIDAS)].

PubMed

Yılmaz, Emel; Eser, Erhan; Şekuri, Cevad; Kültürsay, Hakan

2011-08-01

The purpose of this study was to describe the psychometric properties of the Myocardial Infarction Dimensional Assessment Scale (MIDAS). This is a methodological cultural adaptation study. The MIDAS consists of 35-items covering seven domains: physical activity, insecurity, emotional reaction, dependency, diet, concerns over medication, and side effects which are rated on a five-point Likert scale from 1: never to 5:always. The highest score of MIDAS is 100.Quality of life (QOL) decreases as the score of scale increases. Overall 185 myocardial infarction (MI) patients were enrolled in this study. Cronbach alpha was used for the reliability analysis. The criterion validity, structural validity, and sensitivity analysis approach was used for validity analysis. New York Heart Association (NYHA) and the Canadian Cardiovascular Society Functional Classifications (CCSFC) for testing the criterion validity; SF-36 for construct validity testing of the Turkish version of the MIDAS were used. The range of Cronbach alpha values is 0.79-0.90 for seven domains of the scale. No problematic items were observed for the entire scale. Medication related domains of the MIDAS showed considerable floor effects (35.7%-22.7%). Confirmatory Factor analysis indicators [Comparative Fit Index (CFI) =0.95 and Root Mean Square Error of Approximation (RMSEA) =0.075] supported the construct validity of MIDAS. Convergent validity of the MIDAS was confirmed with correlation of SF-36 scale where appropriate. Criterion validity results was also satisfactory by comparing different stages of the NYHA and the CCSFC (p<0.05). Overall results revealed that Turkish version of the MIDAS is a reliable and valid instrument.

Development of the Assessment of Belief Conflict in Relationship-14 (ABCR-14).

PubMed

Kyougoku, Makoto; Teraoka, Mutsumi; Masuda, Noriko; Ooura, Mariko; Abe, Yasushi

2015-01-01

Nurses and other healthcare workers frequently experience belief conflict, one of the most important, new stress-related problems in both academic and clinical fields. In this study, using a sample of 1,683 nursing practitioners, we developed The Assessment of Belief Conflict in Relationship-14 (ABCR-14), a new scale that assesses belief conflict in the healthcare field. Standard psychometric procedures were used to develop and test the scale, including a qualitative framework concept and item-pool development, item reduction, and scale development. We analyzed the psychometric properties of ABCR-14 according to entropy, polyserial correlation coefficient, exploratory factor analysis, confirmatory factor analysis, average variance extracted, Cronbach's alpha, Pearson product-moment correlation coefficient, and multidimensional item response theory (MIRT). The results of the analysis supported a three-factor model consisting of 14 items. The validity and reliability of ABCR-14 was suggested by evidence from high construct validity, structural validity, hypothesis testing, internal consistency reliability, and concurrent validity. The result of the MIRT offered strong support for good item response of item slope parameters and difficulty parameters. However, the ABCR-14 Likert scale might need to be explored from the MIRT point of view. Yet, as mentioned above, there is sufficient evidence to support that ABCR-14 has high validity and reliability. The ABCR-14 demonstrates good psychometric properties for nursing belief conflict. Further studies are recommended to confirm its application in clinical practice.

Psychometric support of the school climate measure in a large, diverse sample of adolescents: a replication and extension.

PubMed

Zullig, Keith J; Collins, Rani; Ghani, Nadia; Patton, Jon M; Scott Huebner, E; Ajamie, Jean

2014-02-01

The School Climate Measure (SCM) was developed and validated in 2010 in response to a dearth of psychometrically sound school climate instruments. This study sought to further validate the SCM on a large, diverse sample of Arizona public school adolescents (N = 20,953). Four SCM domains (positive student-teacher relationships, academic support, order and discipline, and physical environment) were available for the analysis. Confirmatory factor analysis and structural equation modeling were established to construct validity, and criterion-related validity was assessed via selected Youth Risk Behavior Survey (YRBS) school safety items and self-reported grade (GPA) point average. Analyses confirmed the 4 SCM school climate domains explained approximately 63% of the variance (factor loading range .45-.92). Structural equation models fit the data well χ(2) = 14,325 (df = 293, p < .001), comparative fit index (CFI) = .951, Tuker-Lewis index (TLI) = .952, root mean square error of approximation (RMSEA) = .05). The goodness-of-fit index was .940. Coefficient alphas ranged from .82 to .93. Analyses of variance with post hoc comparisons suggested the SCM domains related in hypothesized directions with the school safety items and GPA. Additional evidence supports the validity and reliability of the SCM. Measures, such as the SCM, can facilitate data-driven decisions and may be incorporated into evidenced-based processes designed to improve student outcomes. © 2014, American School Health Association.

Comprehensive Calibration and Validation Site for Information Remote Sensing

NASA Astrophysics Data System (ADS)

Li, C. R.; Tang, L. L.; Ma, L. L.; Zhou, Y. S.; Gao, C. X.; Wang, N.; Li, X. H.; Wang, X. H.; Zhu, X. H.

2015-04-01

As a naturally part of information technology, Remote Sensing (RS) is strongly required to provide very precise and accurate information product to serve industry, academy and the public at this information economic era. To meet the needs of high quality RS product, building a fully functional and advanced calibration system, including measuring instruments, measuring approaches and target site become extremely important. Supported by MOST of China via national plan, great progress has been made to construct a comprehensive calibration and validation (Cal&Val) site, which integrates most functions of RS sensor aviation testing, EO satellite on-orbit caration and performance assessment and RS product validation at this site located in Baotou, 600km west of Beijing. The site is equipped with various artificial standard targets, including portable and permanent targets, which supports for long-term calibration and validation. A number of fine-designed ground measuring instruments and airborne standard sensors are developed for realizing high-accuracy stepwise validation, an approach in avoiding or reducing uncertainties caused from nonsynchronized measurement. As part of contribution to worldwide Cal&Val study coordinated by CEOS-WGCV, Baotou site is offering its support to Radiometric Calibration Network of Automated Instruments (RadCalNet), with an aim of providing demonstrated global standard automated radiometric calibration service in cooperation with ESA, NASA, CNES and NPL. Furthermore, several Cal&Val campaigns have been performed during the past years to calibrate and validate the spaceborne/airborne optical and SAR sensors, and the results of some typical demonstration are discussed in this study.

Development and testing of the Survey of Family Environment (SFE): a novel instrument to measure family functioning and needs for family support.

PubMed

Hohashi, Naohiro; Honda, Junko

2012-01-01

Hohashi's Concentric Sphere Family Environment Model (CSFEM; Hohashi & Honda, 2011) is a newly proposed family nursing theory for holistically understanding the family environment that acts on family well-being. The purpose of this article is to develop and psychometrically test the Japanese version of the Survey of Family Environment (SFE-J), grounded in the CSFEM, for measuring family's perceived family functioning and family's perceived needs for family support. The SFE-J is a 30-item self-administered instrument that assesses five domains (suprasystem, macrosystem, microsystem, family internal environment system, and chronosystem) and has been subjected to rigorous reliability and validity investigations among paired partners in child-rearing families (N of family = 1,990). Internal consistency reliability was high as measured by Cronbach's alpha coefficients. Temporal stability over a 2-week interval was supported by high (substantial or perfect) and significant intraclass correlation coefficients. The total score for the SFE-J was significantly correlated with the Japanese version of the Feetham Family Functioning Survey (FFFS-J), indicating an acceptable concurrent validity. Construct validity was supported by a confirmatory factor analysis that evaluated the five-factor structure to measure the concept of CSFEM. Results also demonstrate that the SFE-J family functioning scores show no significant differences between paired partners. The SFE-J is a reliable and valid instrument to assess not only intrafamily functioning but also interfamily functioning and, by identifying items/domains with high requirements for family support, serves to facilitate the providing of appropriate support to families.

Nursing Job Rotation Stress Scale development and psychometric evaluation.

PubMed

Huang, Shan; Lin, Yu-Hua; Kao, Chia-Chan; Yang, Hsing-Yu; Anne, Ya-Li; Wang, Cheng-Hua

2016-01-01

The aim of this study was to develop and assess the reliability and validity of the Nurse Job Rotation Stress Scale (NJRS). A convenience sampling method was utilized to recruit two groups of nurses (n = 150 and 253) from a 2751 bed medical center in southern Taiwan. The NJRS scale was developed and used to evaluate the NJRS. Explorative factor analysis revealed that three factors accounted for 74.11% of the explained variance. Confirmatory factor analysis validity testing supported the three factor structure and the construct validity. Cronbach's alpha for the 10 item model was 0.87 and had high linearity. The NJRS can be considered a reliable and valid scale for the measurement of nurse job rotation stress for nursing management and research purposes. © 2015 Japan Academy of Nursing Science.

Achievement-Relevant Personality: Relations with the Big Five and Validation of an Efficient Instrument

PubMed Central

Briley, Daniel A.; Domiteaux, Matthew; Tucker-Drob, Elliot M.

2014-01-01

Many achievement-relevant personality measures (APMs) have been developed, but the interrelations among APMs or associations with the broader personality landscape are not well-known. In Study 1, 214 participants were measured on 36 APMs and a measure of the Big Five. Factor analytic results supported the convergent and discriminant validity of five latent dimensions: performance, mastery, self-doubt, effort, and intellectual investment. Conscientiousness, neuroticism, and openness to experience had the most consistent associations with APMs. We constructed a more efficient scale– the Multidimensional Achievement-Relevant Personality Scale (MAPS). In Study 2, we replicated the factor structure and external correlates of the MAPS in a sample of 359 individuals. Finally, we validated the MAPS with four indicators of academic performance and demonstrated incremental validity. PMID:24839374

Development of the Parent Responses to School Functioning Questionnaire.

PubMed

Barber Garcia, Brittany N; Gray, Laura S; Simons, Laura E; Logan, Deirdre E

2017-10-01

Parents play an important role in supporting school functioning in youth with chronic pain, but no validated tools exists to assess parental responses to child and adolescent pain behaviors in the school context. Such a tool would be useful in identifying targets of change to reduce pain-related school impairment. The goal of this study was to develop and preliminarily validate the Parent Responses to School Functioning Questionnaire (PRSF), a parent self-report measure of this construct. After initial expert review and pilot testing, the measure was administered to 418 parents of children (ages 6-17 years) seen for initial multidisciplinary chronic pain clinic evaluation. The final 16-item PRSF showed evidence of good internal consistency (α = .82) and 2-week test-retest reliability (intraclass correlation coefficient = .87). Criterion validity was demonstrated by significant correlations with school absence rates and overall school functioning, and construct validity was demonstrated by correlations with general parental responses to pain. Three subscales emerged capturing parents' personal distress, parents' level of distrust of the school, and parents' expectations and behaviors related to their child's management of challenging school situations. These results provide preliminary support for the PRSF as a psychometrically sound tool to assess parents' responses to child pain in the school setting. The 16-item PRSF measures parental responses to their child's chronic pain in the school context. The clinically useful measure can inform interventions aimed reducing functional disability in children with chronic pain by enhancing parents' ability to respond adaptively to child pain behaviors. Copyright © 2017 American Pain Society. Published by Elsevier Inc. All rights reserved.

Assessing the Learning Environment for Medical Students: An Evaluation of a Novel Survey Instrument in Four Medical Schools.

PubMed

Pololi, Linda H; Evans, Arthur T; Nickell, Leslie; Reboli, Annette C; Coplit, Lisa D; Stuber, Margaret L; Vasiliou, Vasilia; Civian, Janet T; Brennan, Robert T

2017-06-01

A practical, reliable, and valid instrument is needed to measure the impact of the learning environment on medical students' well-being and educational experience and to meet medical school accreditation requirements. From 2012 to 2015, medical students were surveyed at the end of their first, second, and third year of studies at four medical schools. The survey assessed students' perceptions of the following nine dimensions of the school culture: vitality, self-efficacy, institutional support, relationships/inclusion, values alignment, ethical/moral distress, work-life integration, gender equity, and ethnic minority equity. The internal reliability of each of the nine dimensions was measured. Construct validity was evaluated by assessing relationships predicted by our conceptual model and prior research. Assessment was made of whether the measurements were sensitive to differences over time and across institutions. Six hundred and eighty-six students completed the survey (49 % women; 9 % underrepresented minorities), with a response rate of 89 % (range over the student cohorts 72-100 %). Internal consistency of each dimension was high (Cronbach's α 0.71-0.86). The instrument was able to detect significant differences in the learning environment across institutions and over time. Construct validity was supported by demonstrating several relationships predicted by our conceptual model. The C-Change Medical Student Survey is a practical, reliable, and valid instrument for assessing the learning environment of medical students. Because it is sensitive to changes over time and differences across institution, results could potentially be used to facilitate and monitor improvements in the learning environment of medical students.

Measuring preschool learning engagement in the laboratory.

PubMed

Halliday, Simone E; Calkins, Susan D; Leerkes, Esther M

2018-03-01

Learning engagement is a critical factor for academic achievement and successful school transitioning. However, current methods of assessing learning engagement in young children are limited to teacher report or classroom observation, which may limit the types of research questions one could assess about this construct. The current study investigated the validity of a novel assessment designed to measure behavioral learning engagement among young children in a standardized laboratory setting and examined how learning engagement in the laboratory relates to future classroom adjustment. Preschool-aged children (N = 278) participated in a learning-based Tangrams task and Story sequencing task and were observed based on seven behavioral indicators of engagement. Confirmatory factor analysis supported the construct validity for a behavioral engagement factor composed of six of the original behavioral indicators: attention to instructions, on-task behavior, enthusiasm/energy, persistence, monitoring progress/strategy use, and negative affect. Concurrent validity for this behavioral engagement factor was established through its associations with parent-reported mastery motivation and pre-academic skills in math and literacy measured in the laboratory, and predictive validity was demonstrated through its associations with teacher-reported classroom learning behaviors and performance in math and reading in kindergarten. These associations were found when behavioral engagement was observed during both the nonverbal task and the verbal story sequencing tasks and persisted even after controlling for child minority status, gender, and maternal education. Learning engagement in preschool appears to be successfully measurable in a laboratory setting. This finding has implications for future research on the mechanisms that support successful academic development. Copyright © 2017 Elsevier Inc. All rights reserved.

Validation of Multilevel Constructs: Validation Methods and Empirical Findings for the EDI

ERIC Educational Resources Information Center

Forer, Barry; Zumbo, Bruno D.

2011-01-01

The purposes of this paper are to highlight the foundations of multilevel construct validation, describe two methodological approaches and associated analytic techniques, and then apply these approaches and techniques to the multilevel construct validation of a widely-used school readiness measure called the Early Development Instrument (EDI;…

Integration of design and inspection

NASA Astrophysics Data System (ADS)

Simmonds, William H.

1990-08-01

Developments in advanced computer integrated manufacturing technology, coupled with the emphasis on Total Quality Management, are exposing needs for new techniques to integrate all functions from design through to support of the delivered product. One critical functional area that must be integrated into design is that embracing the measurement, inspection and test activities necessary for validation of the delivered product. This area is being tackled by a collaborative project supported by the UK Government Department of Trade and Industry. The project is aimed at developing techniques for analysing validation needs and for planning validation methods. Within the project an experimental Computer Aided Validation Expert system (CAVE) is being constructed. This operates with a generalised model of the validation process and helps with all design stages: specification of product requirements; analysis of the assurance provided by a proposed design and method of manufacture; development of the inspection and test strategy; and analysis of feedback data. The kernel of the system is a knowledge base containing knowledge of the manufacturing process capabilities and of the available inspection and test facilities. The CAVE system is being integrated into a real life advanced computer integrated manufacturing facility for demonstration and evaluation.

Psychometric Properties and Validation of the Positive and Negative Suicide Ideation (PANSI) Inventory in an Outpatient Clinical Population in Malaysia.

PubMed

Sinniah, Aishvarya; Oei, Tian P S; Chinna, Karuthan; Shah, Shamsul A; Maniam, T; Subramaniam, Ponnusamy

2015-01-01

The PANSI is a measure designed to assess the risk and protective factors related to suicidal behaviors. The present study evaluated the psychometric properties and factor structure of the Positive and Negative Suicide Ideation (PANSI) Inventory in a sample of clinical outpatients at a major hospital in Malaysia. In this study, 283 psychiatric patients and 200 medical (non-psychiatric) patients participated. All the patients completed the PANSI and seven other self-report instruments. Confirmative factor analysis supported the 2-factor oblique model. The internal consistency of the two subscales of PANSI-Negative and the PANSI-Positive were 0.93 and 0.84, respectively. In testing construct validity, PANSI showed sizable correlation with the other seven scales. Criterion validity was supported by scores on PANSI which differentiated psychiatric patients from medical patients. Logistic regression analyses showed PANSI can be used to classify the patients into suicidal or non-suicidal. The PANSI is a reliable and valid instrument to measure the severity of suicidal ideation among clinical outpatients in Malaysia.

Psychometric Properties and Validation of the Positive and Negative Suicide Ideation (PANSI) Inventory in an Outpatient Clinical Population in Malaysia

PubMed Central

Sinniah, Aishvarya; Oei, Tian P. S.; Chinna, Karuthan; Shah, Shamsul A.; Maniam, T.; Subramaniam, Ponnusamy

2015-01-01

The PANSI is a measure designed to assess the risk and protective factors related to suicidal behaviors. The present study evaluated the psychometric properties and factor structure of the Positive and Negative Suicide Ideation (PANSI) Inventory in a sample of clinical outpatients at a major hospital in Malaysia. In this study, 283 psychiatric patients and 200 medical (non-psychiatric) patients participated. All the patients completed the PANSI and seven other self-report instruments. Confirmative factor analysis supported the 2-factor oblique model. The internal consistency of the two subscales of PANSI-Negative and the PANSI-Positive were 0.93 and 0.84, respectively. In testing construct validity, PANSI showed sizable correlation with the other seven scales. Criterion validity was supported by scores on PANSI which differentiated psychiatric patients from medical patients. Logistic regression analyses showed PANSI can be used to classify the patients into suicidal or non-suicidal. The PANSI is a reliable and valid instrument to measure the severity of suicidal ideation among clinical outpatients in Malaysia. PMID:26733920

Validation of the Readiness for Return-To-Work Scale in Outpatient Occupational Rehabilitation in Canada.

PubMed

Park, Joanne; Roberts, Mary Roduta; Esmail, Shaniff; Rayani, Fahreen; Norris, Colleen M; Gross, Douglas P

2018-06-01

Purpose To examine construct and concurrent validity of the Readiness for Return-To-Work (RRTW) Scale with injured workers participating in an outpatient occupational rehabilitation program. Methods Lost-time claimants (n = 389) with sub-acute or chronic musculoskeletal disorders completed the RRTW Scale on their first day of their occupational rehabilitation program. Statistical analysis included exploratory and confirmatory factor analyses of the readiness items, reliability analyses, and correlation with related scales and questionnaires. Results For claimants in the non-job attached/not working group (n = 165), three factors were found (1) Contemplation (2) Prepared for Action-Self-evaluative and (3) Prepared for Action-Behavioural. The precontemplation stage was not identified within this sample of injured workers. For claimants who were job attached/working group in some capacity (n = 224), two factors were identified (1) Uncertain Maintenance and (2) Proactive Maintenance. Expected relationships and statistically significant differences were found among the identified Return-To-Work (RTW) readiness factors and related constructs of pain, physical and mental health and RTW expectations. Conclusion Construct and concurrent validity of the RRTW Scale were supported in this study. The results of this study indicate the construct of readiness for RTW can vary by disability duration and occupational category. Physical health appears to be a significant barrier to RRTW for the job attached/working group while mental health significantly compromises RRTW with the non-job attached/not working group.

Needs of caregivers of cancer patients: validation of the Mexican version of the Support Person Unmet Needs Survey (SPUNS-SFM).

PubMed

Doubova, Svetlana V; Aguirre-Hernandez, Rebeca; Infante-Castañeda, Claudia; Martinez-Vega, Ingrid; Pérez-Cuevas, Ricardo

2015-10-01

The purpose of this study was to validate the Mexican version of the Support Person Unmet Needs Survey (SPUNS-SFM). A cross-sectional survey that included 826 primary caregivers of cancer patients was conducted from June to December 2013 at the Oncology Hospital of the Mexican Institute of Social Security in Mexico City. The validation procedure comprised (1) content validity through a group of experts; (2) construct validity through an exploratory factor analysis based on the polychoric correlation matrix; (3) internal consistency using Cronbach's alpha; (4) convergent validity between SPUNS-SFM and quality of life, anxiety-and-depression scales by calculating Spearman's rank correlation coefficient;( 5) discriminative validity through the Wilcoxon rank-sum test; and (6) test-retest reliability using intraclass correlation coefficient. SPUNS-SFM has 23 items with six factors accounting for 65 % of the total variance. The domains were concerns about the future, access and continuity of healthcare, information, work and finance, and personal and emotional needs. Cronbach's alpha values ranged from 0.70 to 0.88 among factors. SPUNS-SFM had moderate convergent validity compared with quality of life and depression-and-anxiety scales and good discriminative validity, revealing high needs for younger caregivers and more emotional needs for caregivers of patients with advanced cancer stages. Intraclass correlation coefficient between SPUNS-SFM measurements was 0.78. SPUNS-SFM is a valid and reliable tool to identify needs of caregivers of cancer patients.

Face and construct validity of a computer-based virtual reality simulator for ERCP.

PubMed

Bittner, James G; Mellinger, John D; Imam, Toufic; Schade, Robert R; Macfadyen, Bruce V

2010-02-01

Currently, little evidence supports computer-based simulation for ERCP training. To determine face and construct validity of a computer-based simulator for ERCP and assess its perceived utility as a training tool. Novice and expert endoscopists completed 2 simulated ERCP cases by using the GI Mentor II. Virtual Education and Surgical Simulation Laboratory, Medical College of Georgia. Outcomes included times to complete the procedure, reach the papilla, and use fluoroscopy; attempts to cannulate the papilla, pancreatic duct, and common bile duct; and number of contrast injections and complications. Subjects assessed simulator graphics, procedural accuracy, difficulty, haptics, overall realism, and training potential. Only when performance data from cases A and B were combined did the GI Mentor II differentiate novices and experts based on times to complete the procedure, reach the papilla, and use fluoroscopy. Across skill levels, overall opinions were similar regarding graphics (moderately realistic), accuracy (similar to clinical ERCP), difficulty (similar to clinical ERCP), overall realism (moderately realistic), and haptics. Most participants (92%) claimed that the simulator has definite training potential or should be required for training. Small sample size, single institution. The GI Mentor II demonstrated construct validity for ERCP based on select metrics. Most subjects thought that the simulated graphics, procedural accuracy, and overall realism exhibit face validity. Subjects deemed it a useful training tool. Study repetition involving more participants and cases may help confirm results and establish the simulator's ability to differentiate skill levels based on ERCP-specific metrics.

The validation of the Supervision of Thesis Questionnaire (STQ).

PubMed

Henricson, Maria; Fridlund, Bengt; Mårtensson, Jan; Hedberg, Berith

2018-06-01

The supervision process is characterized by differences between the supervisors' and the students' expectations before the start of writing a bachelor thesis as well as after its completion. A review of the literature did not reveal any scientifically tested questionnaire for evaluating nursing students' expectations of the supervision process when writing a bachelor thesis. The aim of the study was to determine the construct validity and internal consistency reliability of a questionnaire for measuring nursing students' expectations of the bachelor thesis supervision process. The study had a developmental and methodological design carried out in four steps including construct validity and internal consistency reliability statistical procedures: construction of the items, assessment of face validity, data collection and data analysis. This study was conducted at a university in southern Sweden, where students on the "Nursing student thesis, 15 ECTS" course were consecutively selected for participation. Of the 512 questionnaires distributed, 327 were returned, a response rate of 64%. Five factors with a total variance of 74% and good communalities, ≥0.64, were extracted from the 10-item STQ. The internal consistency of the 10 items was 0.68. The five factors were labelled: The nature of the supervision process, The supervisor's role as a coach, The students' progression to self-support, The interaction between students and supervisor and supervisor competence. A didactic, useful and secure questionnaire measuring nursing students' expectations of the bachelor thesis supervision process based on three main forms of supervision was created. Copyright © 2018 Elsevier Ltd. All rights reserved.

MEASURING SPORT-SPECIFIC PHYSICAL ABILITIES IN MALE GYMNASTS: THE MEN'S GYMNASTICS FUNCTIONAL MEASUREMENT TOOL.

PubMed

Sleeper, Mark D; Kenyon, Lisa K; Elliott, James M; Cheng, M Samuel

2016-12-01

Despite the availability of various field-tests for many competitive sports, a reliable and valid test specifically developed for use in men's gymnastics has not yet been developed. The Men's Gymnastics Functional Measurement Tool (MGFMT) was designed to assess sport-specific physical abilities in male competitive gymnasts. The purpose of this study was to develop the MGFMT by establishing a scoring system for individual test items and to initiate the process of establishing test-retest reliability and construct validity. A total of 83 competitive male gymnasts ages 7-18 underwent testing using the MGFMT. Thirty of these subjects underwent re-testing one week later in order to assess test-retest reliability. Construct validity was assessed using a simple regression analysis between total MGFMT scores and the gymnasts' USA-Gymnastics competitive level to calculate the coefficient of determination (r 2 ). Test-retest reliability was analyzed using Model 1 Intraclass correlation coefficients (ICC). Statistical significance was set at the p<0.05 level. The relationship between total MGFMT scores and subjects' current USA-Gymnastics competitive level was found to be good (r 2  = 0.63). Reliability testing of the MGFMT composite test score showed excellent test-retest reliability over a one-week period (ICC = 0.97). Test-retest reliability of the individual component tests ranged from good to excellent (ICC = 0.75-0.97). The results of this study provide initial support for the construct validity and test-retest reliability of the MGFMT. Level 3.

Development and validation of a virtual reality simulator: human factors input to interventional radiology training.

PubMed

Johnson, Sheena Joanne; Guediri, Sara M; Kilkenny, Caroline; Clough, Peter J

2011-12-01

This study developed and validated a virtual reality (VR) simulator for use by interventional radiologists. Research in the area of skill acquisition reports practice as essential to become a task expert. Studies on simulation show skills learned in VR can be successfully transferred to a real-world task. Recently, with improvements in technology, VR simulators have been developed to allow complex medical procedures to be practiced without risking the patient. Three studies are reported. In Study I, 35 consultant interventional radiologists took part in a cognitive task analysis to empirically establish the key competencies of the Seldinger procedure. In Study 2, 62 participants performed one simulated procedure, and their performance was compared by expertise. In Study 3, the transferability of simulator training to a real-world procedure was assessed with 14 trainees. Study I produced 23 key competencies that were implemented as performance measures in the simulator. Study 2 showed the simulator had both face and construct validity, although some issues were identified. Study 3 showed the group that had undergone simulator training received significantly higher mean performance ratings on a subsequent patient procedure. The findings of this study support the centrality of validation in the successful design of simulators and show the utility of simulators as a training device. The studies show the key elements of a validation program for a simulator. In addition to task analysis and face and construct validities, the authors highlight the importance of transfer of training in validation studies.

Simple shoulder test and Oxford Shoulder Score: Persian translation and cross-cultural validation.

PubMed

Naghdi, Soofia; Nakhostin Ansari, Noureddin; Rustaie, Nilufar; Akbari, Mohammad; Ebadi, Safoora; Senobari, Maryam; Hasson, Scott

2015-12-01

To translate, culturally adapt, and validate the simple shoulder test (SST) and Oxford Shoulder Score (OSS) into Persian language using a cross-sectional and prospective cohort design. A standard forward and backward translation was followed to culturally adapt the SST and the OSS into Persian language. Psychometric properties of floor and ceiling effects, construct convergent validity, discriminant validity, internal consistency reliability, test-retest reliability, standard error of the measurement (SEM), smallest detectable change (SDC), and factor structure were determined. One hundred patients with shoulder disorders and 50 healthy subjects participated in the study. The PSST and the POSS showed no missing responses. No floor or ceiling effects were observed. Both the PSST and POSS detected differences between patients and healthy subjects supporting their discriminant validity. Construct convergent validity was confirmed by a very good correlation between the PSST and POSS (r = 0.68). There was high internal consistency for both the PSST (α = 0.73) and the POSS (α = 0.91 and 0.92). Test-retest reliability with 1-week interval was excellent (ICCagreement = 0.94 for PSST and 0.90 for POSS). Factor analyses demonstrated a three-factor solution for the PSST (49.7 % of variance) and a two-factor solution for the POSS (61.6 % of variance). The SEM/SDC was satisfactory for PSST (5.5/15.3) and POSS (6.8/18.8). The PSST and POSS are valid and reliable outcome measures for assessing functional limitations in Persian-speaking patients with shoulder disorders.

Family Self-Efficacy for Diabetes Management: Psychometric Testing.

PubMed

Mcewen, Marylyn M; Pasvogel, Alice; Murdaugh, Carolyn L

2016-01-01

Type 2 diabetes mellitus (T2DM) self-management among Hispanic adults occurs in a family context. Self-efficacy (SE) affects T2DM self-management behaviors; however, no instruments are available to measure family diabetes self-efficacy. The study's purpose was to test the psychometric properties of the Family Self-Efficacy for Diabetes Scale (FSE). Family members (n = 113) of adults with T2DM participated. Psychometric analysis included internal consistency reliability and concurrent and construct validity. Internal consistency reliability was .86. Items loaded on 2 factors, Family SE for Supporting Healthy Behaviors and Family SE for Supporting General Health, accounting for 71% of the variance. FSE correlated significantly with 3 diabetes-related instruments. The FSE is a reliable and valid instrument. Further testing is needed in diverse populations and geographic areas.

Reliability and validity of the Japanese version of the Organizational Justice Questionnaire.

PubMed

Inoue, Akiomi; Kawakami, Norito; Tsutsumi, Akizumi; Shimazu, Akihito; Tsuchiya, Masao; Ishizaki, Masao; Tabata, Masaji; Akiyama, Miki; Kitazume, Akiko; Kuroda, Mitsuyo; Kivimäki, Mika

2009-01-01

Previous European studies reporting low procedural justice and low interactional justice were associated with increased health problems have used a modified version of the Moorman's Organizational Justice Questionnaire (OJQ, Elovainio et al., 2002) to assess organizational justice. We translated the modified OJQ into the Japanese language and examined the internal consistency reliability, and factor-based and construct validity of this measure. A back-translation procedure confirmed that the translation was appropriate, pending a minor revision. A total of 185 men and 58 women at a manufacturing factory in Japan were surveyed using a mailed questionnaire including the OJQ and other job stressors. Cronbach alpha coefficients of the two OJQ subscales were high (0.85-0.94) for both sexes. The hypothesized two factors (i.e., procedural justice and interactional justice) were extracted by the factor analysis for men; for women, procedural justice was further split into two separate dimensions supporting a three- rather than two-factor structure. Convergent validity was supported by expected correlations of the OJQ with job control, supervisor support, effort-reward imbalance, and job future ambiguity in particular among the men. The present study shows that the Japanese version of the OJQ has acceptable levels of reliability and validity at least for male employees.

Development of the Therapist Empathy Scale.

PubMed

Decker, Suzanne E; Nich, Charla; Carroll, Kathleen M; Martino, Steve

2014-05-01

Few measures exist to examine therapist empathy as it occurs in session. A 9-item observer rating scale, called the Therapist Empathy Scale (TES), was developed based on Watson's (1999) work to assess affective, cognitive, attitudinal, and attunement aspects of therapist empathy. The aim of this study was to evaluate the inter-rater reliability, internal consistency, and construct and criterion validity of the TES. Raters evaluated therapist empathy in 315 client sessions conducted by 91 therapists, using data from a multi-site therapist training trial (Martino et al., 2010) in Motivational Interviewing (MI). Inter-rater reliability (ICC = .87 to .91) and internal consistency (Cronbach's alpha = .94) were high. Confirmatory factor analyses indicated some support for single-factor fit. Convergent validity was supported by correlations between TES scores and MI fundamental adherence (r range .50 to .67) and competence scores (r range .56 to .69). Discriminant validity was indicated by negative or nonsignificant correlations between TES and MI-inconsistent behavior (r range .05 to -.33). The TES demonstrates excellent inter-rater reliability and internal consistency. RESULTS indicate some support for a single-factor solution and convergent and discriminant validity. Future studies should examine the use of the TES to evaluate therapist empathy in different psychotherapy approaches and to determine the impact of therapist empathy on client outcome.

Validating the Type D personality construct in Chinese patients with coronary heart disease.

PubMed

Yu, Doris S F; Thompson, David R; Yu, Cheuk Man; Pedersen, Susanne S; Denollet, Johan

2010-08-01

Type D personality predicts poor prognosis in coronary heart disease (CHD) but little is known about Type D in non-Western cultures. We examined the (a) validity of the Type D construct and its assessment with the DS14 scale in the Chinese culture, (b) prevalence of Type D, and (c) gender vs. Type D discrepancies in depression/anxiety, among Chinese patients with CHD. Patients with CHD (N=326) completed the Chinese version of the DS14. The NEO Five Factor Inventory (NEO-FFI), Hospital Anxiety and Depression Scale (HADS), and Stress Symptom Checklist (SSC) were administered to subsamples to establish construct and discriminant validity. Administration of the DS14, HADS, and SSC was repeated at 1 month after hospital discharge in 66 patients, and stability of the DS14 was examined in another subsample of 100 patients. The theoretical structure of the Type D construct in the Chinese culture was supported (chi(2)/df=2.89, root mean square error of approximation=0.08, normal fit index=0.91, non-normal fit index=0.91, comparative fit index=0.93). The Negative Affectivity (NA) and Social Inhibition (SI) subscales of the DS14 in the entire sample were internally consistent (Cronbach's alpha=0.89/0.81), measured stable traits (3-month test-retest ICC=0.76/0.74), and correlated significantly with the neuroticism (NA/neuroticism, r=0.78, P<.001) and extraversion subscales (SI/extraversion, r=-0.64, P<.001) of the NEO-FFI, respectively. The prevalence of Type D personality was 31%. Type D was not related to transient emotional states. However, Chinese patients with a Type D personality were at increased concurrent risk of anxiety (P=.002) and depression (P=.016). Type D personality is a cross-culturally valid construct, is associated with an increased risk of anxiety and depression, and deserves prompt attention in estimating the prognostic risk of Chinese CHD patients. Copyright 2010 Elsevier Inc. All rights reserved.

Fundamental Movement Skills Are More than Run, Throw and Catch: The Role of Stability Skills

PubMed Central

Rudd, James R.; Barnett, Lisa M.; Butson, Michael L.; Farrow, Damian; Berry, Jason; Polman, Remco C. J.

2015-01-01

Introduction In motor development literature fundamental movement skills are divided into three constructs: locomotive, object control and stability skills. Most fundamental movement skills research has focused on children’s competency in locomotor and object control skills. The first aim of this study was to validate a test battery to assess the construct of stability skills, in children aged 6 to 10 (M age = 8.2, SD = 1.2). Secondly we assessed how the stability skills construct fitted into a model of fundamental movement skill. Method The Delphi method was used to select the stability skill battery. Confirmatory factor analysis (CFA) was used to assess if the skills loaded onto the same construct and a new model of FMS was developed using structural equation modelling. Results Three postural control tasks were selected (the log roll, rock and back support) because they had good face and content validity. These skills also demonstrated good predictive validity with gymnasts scoring significantly better than children without gymnastic training and children from a high SES school performing better than those from a mid and low SES schools and the mid SES children scored better than the low SES children (all p < .05). Inter rater reliability tests were excellent for all three skills (ICC = 0.81, 0.87, 0.87) as was test re-test reliability (ICC 0.87–0.95). CFA provided good construct validity, and structural equation modelling revealed stability skills to be an independent factor in an overall FMS model which included locomotor (r = .88), object control (r = .76) and stability skills (r = .81). Discussion This study provides a rationale for the inclusion of stability skills in FMS assessment. The stability skills could be used alongside other FMS assessment tools to provide a holistic assessment of children’s fundamental movement skills. PMID:26468644

Investigation of Item-Pair Presentation and Construct Validity of the Navy Computer Adaptive Personality Scales (NCAPS)

DTIC Science & Technology

2006-10-01

Investigation of Item-Pair Presentation and Construct Validity of the Navy Computer Adaptive Personality Scales ( NCAPS ) Christina M. Underhill, Ph.D...Construct Validity of the Navy Computer Adaptive Personality Scales ( NCAPS ) Christina M. Underhill, Ph.D. Reviewed and Approved by Jacqueline A. Mottern...and Construct Validity of the Navy Computer Adaptive Personality Scales ( NCAPS ) 5b. GRANT NUMBER 5c. PROGRAM ELEMENT NUMBER 0602236N and 0603236N 6

Concurrent validity, discriminatory power and feasibility of the instrument for Identification of Parents At Risk for child Abuse and Neglect (IPARAN)

PubMed Central

Horrevorts, Esther M B; van Grieken, Amy; Mieloo, Cathelijne L; Hafkamp-de Groen, Esther; Bannink, Rienke; Bouwmeester-Landweer, Merian B R; Broeren, Suzanne; Raat, Hein

2017-01-01

Objectives To determine the feasibility, concurrent validity and discriminatory power of the instrument for Identification of Parents At Risk for child Abuse and Neglect (IPARAN) among Dutch parents with a newborn child. Setting Community paediatrics. Participants Data from a controlled trial were used. In total, 2659 Dutch parents with a newborn child were invited to participate. Of the 2659 parents, 759 parents filled in the consent form and participated in the study. Primary and secondary outcome measures Concurrent validity was determined by calculating correlations—using the Pearson’s correlation (r)—between the IPARAN score and related constructs from the following instruments: the Empowerment Questionnaire 2.0, the Family Functioning Questionnaire and the Parenting Stress Questionnaire. Discriminatory power was determined by calculating receiver operating characteristic (ROC) curves between high-risk mothers and low-risk mothers according to their scores on the related constructs. Feasibility was determined by examining the percentage of missing answers. Results In terms of concurrent validity, we found that 3 out of 12 correlations between the IPARAN score and related constructs were strong (ie, r>0.50) and 4 out of 12 were medium (ie, r=0.30–0.49). In terms of discriminatory power, mothers with a score in the borderline/clinical range or lowest 10 percent (P10) range of the related constructs (high-risk mothers) had a higher IPARAN score than mothers with a score in the normal range or highest 90 percent (P90) range of the related constructs (low-risk mothers). Effect sizes varied from d=0.37 to d=1.93, and the area under the ROC curve varied from 0.62 to 0.93. Regarding feasibility, the part of the IPARAN filled in by the mother had on average 0.7% missing answers, whereas the part of the IPARAN filled in by the father had on average 1.7% missing answers. Conclusion The results of this study support the concurrent validity, discriminatory power and feasibility of the IPARAN among a population of Dutch parents with a newborn child. PMID:28838892

The Validity of a New Structured Assessment of Gastrointestinal Symptoms Scale (SAGIS) for Evaluating Symptoms in the Clinical Setting.

PubMed

Koloski, N A; Jones, M; Hammer, J; von Wulffen, M; Shah, A; Hoelz, H; Kutyla, M; Burger, D; Martin, N; Gurusamy, S R; Talley, N J; Holtmann, G

2017-08-01

The clinical assessments of patients with gastrointestinal symptoms can be time-consuming, and the symptoms captured during the consultation may be influenced by a variety of patient and non-patient factors. To facilitate standardized symptom assessment in the routine clinical setting, we developed the Structured Assessment of Gastrointestinal Symptom (SAGIS) instrument to precisely characterize symptoms in a routine clinical setting. We aimed to validate SAGIS including its reliability, construct and discriminant validity, and utility in the clinical setting. Development of the SAGIS consisted of initial interviews with patients referred for the diagnostic work-up of digestive symptoms and relevant complaints identified. The final instrument consisted of 22 items as well as questions on extra intestinal symptoms and was given to 1120 consecutive patients attending a gastroenterology clinic randomly split into derivation (n = 596) and validation datasets (n = 551). Discriminant validity along with test-retest reliability was assessed. The time taken to perform a clinical assessment with and without the SAGIS was recorded along with doctor satisfaction with this tool. Exploratory factor analysis conducted on the derivation sample suggested five symptom constructs labeled as abdominal pain/discomfort (seven items), gastroesophageal reflux disease/regurgitation symptoms (four items), nausea/vomiting (three items), diarrhea/incontinence (five items), and difficult defecation and constipation (2 items). Confirmatory factor analysis conducted on the validation sample supported the initially developed five-factor measurement model ([Formula: see text], p < 0.0001, χ 2 /df = 4.6, CFI = 0.90, TLI = 0.88, RMSEA = 0.08). All symptom groups demonstrated differentiation between disease groups. The SAGIS was shown to be reliable over time and resulted in a 38% reduction of the time required for clinical assessment. The SAGIS instrument has excellent psychometric properties and supports the clinical assessment of and symptom-based categorization of patients with a wide spectrum of gastrointestinal symptoms.

Validating MEDIQUAL Constructs

NASA Astrophysics Data System (ADS)

Lee, Sang-Gun; Min, Jae H.

In this paper, we validate MEDIQUAL constructs through the different media users in help desk service. In previous research, only two end-users' constructs were used: assurance and responsiveness. In this paper, we extend MEDIQUAL constructs to include reliability, empathy, assurance, tangibles, and responsiveness, which are based on the SERVQUAL theory. The results suggest that: 1) five MEDIQUAL constructs are validated through the factor analysis. That is, importance of the constructs have relatively high correlations between measures of the same construct using different methods and low correlations between measures of the constructs that are expected to differ; and 2) five MEDIQUAL constructs are statistically significant on media users' satisfaction in help desk service by regression analysis.

Intrarater Reliability and Other Psychometrics of the Health Promoting Activities Scale (HPAS).

PubMed

Muskett, Rachel; Bourke-Taylor, Helen; Hewitt, Alana

The Health Promoting Activities Scale (HPAS) measures the self-rated frequency with which adults participate in activities that promote health. We evaluated the internal consistency, construct validity, and intrarater reliability of the HPAS with a cohort of mothers (N = 56) of school-age children. We used an online survey that included the HPAS and measures of mental and physical health. Statistical analysis included intraclass correlation coefficients (ICCs), measurement error, error range, limits of agreement, and minimum detectable change (MDC). The HPAS showed good internal consistency (Cronbach's α = .73). Construct validity was supported by a significant difference in HPAS scores among participants grouped by physical activity level; no other differences were significant. Results included a high aggregate ICC of .90 and an MDC of 5 points. Our evaluation of the HPAS revealed good reliability and stability, suggesting suitability for ongoing evaluation as an outcome measure. Copyright © 2017 by the American Occupational Therapy Association, Inc.

[Development of a Japanese version of the TALE scale].

PubMed

Ochiai, Tsutomu; Oguchi, Takashi

2013-12-01

The Thinking About Life Experiences (TALE) Scale (Bluck & Alea, 2011) has three subscales that assess the self, social, and directive functions of autobiographical memory. This study constructs a Japanese version of the TALE Scale and examines its reliability and validity. Fifteen items that assess the three functions of autobiographical memory were translated into Japanese. We conducted an online investigation with 600 men and women between 20-59 years of age. In Study 1, exploratory and confirmatory factor analysis identified that the three-factor structure of the Japanese version of the TALE Scale was the same as the original TALE Scale. Sufficient internal consistency of the scale was found, and the construct validity of the scale was supported by correlation analysis. Study 2 confirmed that the test-retest reliabilities of the three subscales were sufficient. Thus, this Japanese version of the TALE Scale is useful to assess autobiographical memory functions in Japan.

The Factor Structure of Effortful Control and Measurement Invariance Across Ethnicity and Sex in a High-Risk Sample

PubMed Central

Huerta, Snjezana; Zerr, Argero A.; Eisenberg, Nancy; Spinrad, Tracy L.; Valiente, Carlos; Di Giunta, Laura; Pina, Armando A.; Eggum, Natalie D.; Sallquist, Julie; Edwards, Alison; Kupfer, Anne; Lonigan, Christopher J.; Phillips, Beth M.; Wilson, Shauna B.; Clancy-Menchetti, Jeanine; Landry, Susan H.; Swank, Paul R.; Assel, Michael A.; Taylor, Heather B.

2010-01-01

Measurement invariance of a one-factor model of effortful control (EC) was tested for 853 low-income preschoolers (M age = 4.48 years). Using a teacher-report questionnaire and seven behavioral measures, configural invariance (same factor structure across groups), metric invariance (same pattern of factor loadings across groups), and partial scalar invariance (mostly the same intercepts across groups) were established across ethnicity (European Americans, African Americans and Hispanics) and across sex. These results suggest that the latent construct of EC behaved in a similar way across ethnic groups and sex, and that comparisons of mean levels of EC are valid across sex and probably valid across ethnicity, especially when larger numbers of tasks are used. The findings also support the use of diverse behavioral measures as indicators of a single latent EC construct. PMID:20593008

Development and preliminary validation of a behavioral task of negative reinforcement underlying risk taking and its relation to problem alcohol use in college freshmen

PubMed Central

MacPherson, Laura; Calvin, Nicholas T.; Richards, Jessica M.; Guller, Leila; Mayes, Linda C.; Crowley, Michael J.; Daughters, Stacey B.; Lejuez, C.W.

2011-01-01

Background A long line of theoretical and empirical evidence implicates negative reinforcement as a process underlying the etiology and maintenance of risky alcohol use behaviors from adolescence through emerging adulthood. However, the bulk of this literature has relied on self-report measures and there is a notable absence of behavioral modes of assessments of negative reinforcement-based alcohol-related risk-taking. To address this clear gap in the literature, the current study presents the first published data on the reliability and validity of the Maryland Resource for the Behavioral Utilization of the Reinforcement of Negative Stimuli (MRBURNS), which is a modified version of the positive reinforcement-based Balloon Analogue Risk Task (BART). Methods Participants included a convenience sample of 116 college freshmen ever regular drinkers (aged 18–19) who completed both behavioral tasks; self-report measures of negative reinforcement/avoidance constructs and of positive reinforcement/appetitive constructs to examine convergent validity and discriminant validity, respectively; and self-report measures of alcohol use, problems, and motives to examine criterion validity. Results The MRBURNS evidenced sound experimental properties and reliability across task trials. In support of convergent validity, risk taking on the MRBURNS correlated significantly with negative urgency, difficulties in emotion regulation and depressive and anxiety-related symptoms. In support of discriminant validity, performance on the MRBURNS was unrelated to risk taking on the BART, sensation seeking, and trait impulsivity. Finally, pertaining to criterion validity, risk taking on the MRBURNS was related to alcohol-related problems but not heavy episodic alcohol use. Notably, risk taking on the MRBURNS was associated with negative reinforcement-based but not with positive reinforcement-based drinking motives. Conclusions Data from this initial investigation suggest the utility of the MRBURNS as a behavioral measure of negative-reinforcement based risk-taking that can provide a useful compliment to existing self-report measures to improve our understanding of the relationship between avoidant reinforcement processes and risky alcohol use. PMID:22309846