[Development and validity of workplace bullying in nursing-type inventory (WPBN-TI)].

PubMed

Lee, Younju; Lee, Mihyoung

2014-04-01

The purpose of this study was to develop an instrument to assess bullying of nurses, and test the validity and reliability of the instrument. The initial thirty items of WPBN-TI were identified through a review of the literature on types bullying related to nursing and in-depth interviews with 14 nurses who experienced bullying at work. Sixteen items were developed through 2 content validity tests by 9 experts and 10 nurses. The final WPBN-TI instrument was evaluated by 458 nurses from five general hospitals in the Incheon metropolitan area. SPSS 18.0 program was used to assess the instrument based on internal consistency reliability, construct validity, and criterion validity. WPBN-TI consisted of 16 items with three distinct factors (verbal and nonverbal bullying, work-related bullying, and external threats), which explained 60.3% of the total variance. The convergent validity and determinant validity for WPBN-TI were 100.0%, 89.7%, respectively. Known-groups validity of WPBN-TI was proven through the mean difference between subjective perception of bullying. The satisfied criterion validity for WPBN-TI was more than .70. The reliability of WPBN-TI was Cronbach's α of .91. WPBN-TI with high validity and reliability is suitable to determine types of bullying in nursing workplace.

Creation of a computer self-efficacy measure: analysis of internal consistency, psychometric properties, and validity.

PubMed

Howard, Matt C

2014-10-01

Computer self-efficacy is an often studied construct that has been shown to be related to an array of important individual outcomes. Unfortunately, existing measures of computer self-efficacy suffer from several deficiencies, including criterion contamination, outdated wording, and/or inadequate psychometric properties. For this reason, the current article presents the creation of a new computer self-efficacy measure. In Study 1, an over-representative item list is created and subsequently reduced through exploratory factor analysis to create an initial measure, and the discriminant validity of this initial measure is tested. In Study 2, the unidimensional factor structure of the initial measure is supported through confirmatory factor analysis and further reduced into a final, 12-item measure. In Study 3, the convergent and criterion validity of the 12-item measure is tested. Overall, this three study process demonstrates that the new computer self-efficacy measure has superb psychometric properties and internal reliability, and demonstrates excellent evidence for several aspects of validity. It is hoped that the 12-item computer self-efficacy measure will be utilized in future research on computer self-efficacy, which is discussed in the current article.

[Design and validation of a questionnaire for psychosocial nursing diagnosis in Primary Care].

PubMed

Brito-Brito, Pedro Ruymán; Rodríguez-Álvarez, Cristobalina; Sierra-López, Antonio; Rodríguez-Gómez, José Ángel; Aguirre-Jaime, Armando

2012-01-01

To develop a valid, reliable and easy-to-use questionnaire for a psychosocial nursing diagnosis. The study was performed in two phases: first phase, questionnaire design and construction; second phase, validity and reliability tests. A bank of items was constructed using the NANDA classification as a theoretical framework. Each item was assigned a Likert scale or dichotomous response. The combination of responses to the items constituted the diagnostic rules to assign up to 28 labels. A group of experts carried out the validity test for content. Other validated scales were used as reference standards for the criterion validity tests. Forty-five nurses provided the questionnaire to the patients on three separate occasions over a period of three weeks, and the other validated scales only once to 188 randomly selected patients in Primary Care centres in Tenerife (Spain). Validity tests for construct confirmed the six dimensions of the questionnaire with 91% of total variance explained. Validity tests for criterion showed a specificity of 66%-100%, and showed high correlations with the reference scales when the questionnaire was assigning nursing diagnoses. Reliability tests showed agreement of 56%-91% (P<.001), and a 93% internal consistency. The Questionnaire for Psychosocial Nursing Diagnosis was called CdePS, and included 61 items. The CdePS is a valid, reliable and easy-to-use tool in Primary Care centres to improve the assigning of a psychosocial nursing diagnosis. Copyright © 2011 Elsevier España, S.L. All rights reserved.

Item Development and Validity Testing for a Self- and Proxy Report: The Safe Driving Behavior Measure

PubMed Central

Classen, Sherrilene; Winter, Sandra M.; Velozo, Craig A.; Bédard, Michel; Lanford, Desiree N.; Brumback, Babette; Lutz, Barbara J.

2010-01-01

OBJECTIVE We report on item development and validity testing of a self-report older adult safe driving behaviors measure (SDBM). METHOD On the basis of theoretical frameworks (Precede–Proceed Model of Health Promotion, Haddon’s matrix, and Michon’s model), existing driving measures, and previous research and guided by measurement theory, we developed items capturing safe driving behavior. Item development was further informed by focus groups. We established face validity using peer reviewers and content validity using expert raters. RESULTS Peer review indicated acceptable face validity. Initial expert rater review yielded a scale content validity index (CVI) rating of 0.78, with 44 of 60 items rated ≥0.75. Sixteen unacceptable items (≤0.5) required major revision or deletion. The next CVI scale average was 0.84, indicating acceptable content validity. CONCLUSION The SDBM has relevance as a self-report to rate older drivers. Future pilot testing of the SDBM comparing results with on-road testing will define criterion validity. PMID:20437917

Using the Rasch Measurement Model in Psychometric Analysis of the Family Effectiveness Measure

PubMed Central

McCreary, Linda L.; Conrad, Karen M.; Conrad, Kendon J.; Scott, Christy K; Funk, Rodney R.; Dennis, Michael L.

2013-01-01

Background Valid assessment of family functioning can play a vital role in optimizing client outcomes. Because family functioning is influenced by family structure, socioeconomic context, and culture, existing measures of family functioning--primarily developed with nuclear, middle class European American families--may not be valid assessments of families in diverse populations. The Family Effectiveness Measure was developed to address this limitation. Objectives To test the Family Effectiveness Measure with data from a primarily low-income African American convenience sample, using the Rasch measurement model. Method A sample of 607 adult women completed the measure. Rasch analysis was used to assess unidimensionality, response category functioning, item fit, person reliability, differential item functioning by race and parental status, and item hierarchy. Criterion-related validity was tested using correlations with five other variables related to family functioning. Results The Family Effectiveness Measure measures two separate constructs: The effective family functioning construct was a psychometrically sound measure of the target construct that was more efficient due to the deletion of 22 items. The ineffective family functioning construct consisted of 16 of those deleted items but was not as strong psychometrically. Items in both constructs evidenced no differential item functioning by race. Criterion-related validity was supported for both. Discussion In contrast to the prevailing conceptualization that family functioning is a single construct, assessed by positively and negatively worded items, use of the Rasch analysis suggested the existence of two constructs. While the effective family functioning is a strong and efficient measure of family functioning, the ineffective family functioning will require additional item development and psychometric testing. PMID:23636342

Construct validity of adolescents' self-reported big five personality traits: importance of conceptual breadth and initial validation of a short measure.

PubMed

Morizot, Julien

2014-10-01

While there are a number of short personality trait measures that have been validated for use with adults, few are specifically validated for use with adolescents. To trust such measures, it must be demonstrated that they have adequate construct validity. According to the view of construct validity as a unifying form of validity requiring the integration of different complementary sources of information, this article reports the evaluation of content, factor, convergent, and criterion validities as well as reliability of adolescents' self-reported personality traits. Moreover, this study sought to address an inherent potential limitation of short personality trait measures, namely their limited conceptual breadth. In this study, starting with items from a known measure, after the language-level was adjusted for use with adolescents, items tapping fundamental primary traits were added to determine the impact of added conceptual breadth on the psychometric properties of the scales. The resulting new measure was named the Big Five Personality Trait Short Questionnaire (BFPTSQ). A group of expert judges considered the items to have adequate content validity. Using data from a community sample of early adolescents, the results confirmed the factor validity of the Big Five structure in adolescence as well as its measurement invariance across genders. More important, the added items did improve the convergent and criterion validities of the scales, but did not negatively affect their reliability. This study supports the construct validity of adolescents' self-reported personality traits and points to the importance of conceptual breadth in short personality measures. © The Author(s) 2014.

Using Item Response Theory to Develop a 60-Item Representation of the NEO PI-R Using the International Personality Item Pool: Development of the IPIP-NEO-60.

PubMed

Maples-Keller, Jessica L; Williamson, Rachel L; Sleep, Chelsea E; Carter, Nathan T; Campbell, W Keith; Miller, Joshua D

2017-10-31

Given advantages of freely available and modifiable measures, an increase in the use of measures developed from the International Personality Item Pool (IPIP), including the 300-item representation of the Revised NEO Personality Inventory (NEO PI-R; Costa & McCrae, 1992a ) has occurred. The focus of this study was to use item response theory to develop a 60-item, IPIP-based measure of the Five-Factor Model (FFM) that provides equal representation of the FFM facets and to test the reliability and convergent and criterion validity of this measure compared to the NEO Five Factor Inventory (NEO-FFI). In an undergraduate sample (n = 359), scores from the NEO-FFI and IPIP-NEO-60 demonstrated good reliability and convergent validity with the NEO PI-R and IPIP-NEO-300. Additionally, across criterion variables in the undergraduate sample as well as a community-based sample (n = 757), the NEO-FFI and IPIP-NEO-60 demonstrated similar nomological networks across a wide range of external variables (r ICC = .96). Finally, as expected, in an MTurk sample the IPIP-NEO-60 demonstrated advantages over the Big Five Inventory-2 (Soto & John, 2017 ; n = 342) with regard to the Agreeableness domain content. The results suggest strong reliability and validity of the IPIP-NEO-60 scores.

Measuring assessment standards in undergraduate medical programs: Development and validation of AIM tool.

PubMed

Sajjad, Madiha; Khan, Rehan Ahmed; Yasmeen, Rahila

2018-01-01

To develop a tool to evaluate faculty perceptions of assessment quality in an undergraduate medical program. The Assessment Implementation Measure (AIM) tool was developed by a mixed method approach. A preliminary questionnaire developed through literature review was submitted to a panel of 10 medical education experts for a three-round 'Modified Delphi technique'. Panel agreement of > 75% was considered the criterion for inclusion of items in the questionnaire. Cognitive pre-testing of five faculty members was conducted. Pilot study was done with 30 randomly selected faculty members. Content validity index (CVI) was calculated for individual items (I-CVI) and composite scale (S-CVI). Cronbach's alpha was calculated to determine the internal consistency reliability of the tool. The final AIM tool had 30 items after the Delphi process. S-CVI was 0.98 with the S-CVI/Avg method and 0.86 by S-CVI/UA method, suggesting good content validity. Cut-off value of < 0.9 I-CVI was taken as criterion for item deletion. Cognitive pre-testing revealed good item interpretation. Cronbach's alpha calculated for the AIM was 0.9, whereas Cronbach's alpha for the four domains ranged from 0.67 to 0.80. 'AIM' is a relevant and useful instrument with good content validity and reliability of results, and may be used to evaluate the teachers´ perceptions about assessment quality.

Psychometric properties of the Brisbane Burn Scar Impact Profile in adults with burn scars

PubMed Central

Kimble, Roy; McPhail, Steven; Plaza, Anita; Simons, Megan

2017-01-01

Objective The aim of the study was to determine the longitudinal validity, reproducibility, responsiveness and interpretability of the adult version of the Brisbane Burn Scar Impact Profile, a patient-report measure of health-related quality of life. Methods A prospective longitudinal cohort study of patients with or at risk of burn scarring was conducted at three assessment points (at baseline around the time of wound healing, one to two weeks post-baseline and 1-month post-baseline). Participants attending a major metropolitan adult burn centre at baseline were recruited. Participants completed the Brisbane Burn Scar Impact Profile and the 36-item Short Form Health Survey and Patient Observer Scar Assessment Scale. Intraclass Correlation Coefficients (ICCs), smallest detectable change, percentage of those who improved, stayed the same or worsened and Area under the Receiver Operating Characteristic Curve (AUC) were used to test the aim. Results Data were included for 118 participants at baseline, 68 participants at one to two weeks and 57 participants at 1-month post-baseline. All groups of items had acceptable reproducibility, except for the overall impact of burn scars (ICC = 0.69), the impact of sensations which was not expected to be stable (ICC = 0.63), mobility and daily activities (ICC = 0.63, 0.67 respectively). The responsiveness of six out of seven groups of items able to be tested against external criterion was supported (AUC = 0.72–0.75). Hypothesised correlations of changes in the Brisbane Burn Scar Impact Profile items with changes in criterion measures generally supported longitudinal validity (e.g., nine out of thirteen hypotheses using the SF-36 as an external criterion were supported). Internal consistency estimates, item-total and inter-item correlations indicated there was likely redundancy of some groups of items, particularly in the relationships and social interaction, appearance and emotional reactions items (Chronbach’s alpha range = 0.94–0.95). Conclusion Support was found for the reproducibility, longitudinal validity, responsiveness and interpretability of most groups of Brisbane Burn Scar Impact Profile items and some individual items in the test population. Potential redundancy of items should be investigated further. PMID:28902874

Development and Validation of a Measure of Quality of Life for the Young Elderly in Sri Lanka.

PubMed

de Silva, Sudirikku Hennadige Padmal; Jayasuriya, Anura Rohan; Rajapaksa, Lalini Chandika; de Silva, Ambepitiyawaduge Pubudu; Barraclough, Simon

2016-01-01

Sri Lanka has one of the fastest aging populations in the world. Measurement of quality of life (QoL) in the elderly needs instruments developed that encompass the sociocultural settings. An instrument was developed to measure QoL in the young elderly in Sri Lanka (QLI-YES), using accepted methods to generate and reduce items. The measure was validated using a community sample. Construct, criterion and predictive validity and reliability were tested. A first-order model of 24 items with 6 domains was found to have good fit indices (CMIN/df = 1.567, RMR = 0.05, CFI = 0.95, and RMSEA = 0.053). Both criterion and predictive validity were demonstrated. Good internal consistency reliability (Cronbach's α = 0.93) was shown. The development of the QLI-YES using a societal perspective relevant to the social and cultural beliefs has resulted in a robust and valid instrument to measure QoL for the young elderly in Sri Lanka. © 2015 APJPH.

Development and Validation of Triarchic Construct Scales from the Psychopathic Personality Inventory

PubMed Central

Hall, Jason R.; Drislane, Laura E.; Patrick, Christopher J.; Morano, Mario; Lilienfeld, Scott O.; Poythress, Norman G.

2014-01-01

The Triarchic model of psychopathy describes this complex condition in terms of distinct phenotypic components of boldness, meanness, and disinhibition. Brief self-report scales designed specifically to index these psychopathy facets have thus far demonstrated promising construct validity. The present study sought to develop and validate scales for assessing facets of the Triarchic model using items from a well-validated existing measure of psychopathy—the Psychopathic Personality Inventory (PPI). A consensus rating approach was used to identify PPI items relevant to each Triarchic facet, and the convergent and discriminant validity of the resulting PPI-based Triarchic scales were evaluated in relation to multiple criterion variables (i.e., other psychopathy inventories, antisocial personality disorder features, personality traits, psychosocial functioning) in offender and non-offender samples. The PPI-based Triarchic scales showed good internal consistency and related to criterion variables in ways consistent with predictions based on the Triarchic model. Findings are discussed in terms of implications for conceptualization and assessment of psychopathy. PMID:24447280

Development and validation of Triarchic construct scales from the psychopathic personality inventory.

PubMed

Hall, Jason R; Drislane, Laura E; Patrick, Christopher J; Morano, Mario; Lilienfeld, Scott O; Poythress, Norman G

2014-06-01

The Triarchic model of psychopathy describes this complex condition in terms of distinct phenotypic components of boldness, meanness, and disinhibition. Brief self-report scales designed specifically to index these psychopathy facets have thus far demonstrated promising construct validity. The present study sought to develop and validate scales for assessing facets of the Triarchic model using items from a well-validated existing measure of psychopathy-the Psychopathic Personality Inventory (PPI). A consensus-rating approach was used to identify PPI items relevant to each Triarchic facet, and the convergent and discriminant validity of the resulting PPI-based Triarchic scales were evaluated in relation to multiple criterion variables (i.e., other psychopathy inventories, antisocial personality disorder features, personality traits, psychosocial functioning) in offender and nonoffender samples. The PPI-based Triarchic scales showed good internal consistency and related to criterion variables in ways consistent with predictions based on the Triarchic model. Findings are discussed in terms of implications for conceptualization and assessment of psychopathy.

Development and Validation of a Measure of Quality of Life for the Young Elderly in Sri Lanka

PubMed Central

de Silva, Sudirikku Hennadige Padmal; Jayasuriya, Anura Rohan; Rajapaksa, Lalini Chandika; de Silva, Ambepitiyawaduge Pubudu; Barraclough, Simon

2016-01-01

Sri Lanka has one of the fastest aging populations in the world. Measurement of quality of life (QoL) in the elderly needs instruments developed that encompass the sociocultural settings. An instrument was developed to measure QoL in the young elderly in Sri Lanka (QLI-YES), using accepted methods to generate and reduce items. The measure was validated using a community sample. Construct, criterion and predictive validity and reliability were tested. A first-order model of 24 items with 6 domains was found to have good fit indices (CMIN/df = 1.567, RMR = 0.05, CFI = 0.95, and RMSEA = 0.053). Both criterion and predictive validity were demonstrated. Good internal consistency reliability (Cronbach’s α = 0.93) was shown. The development of the QLI-YES using a societal perspective relevant to the social and cultural beliefs has resulted in a robust and valid instrument to measure QoL for the young elderly in Sri Lanka. PMID:26712893

Development and initial validation of the appropriate antibiotic use self-efficacy scale.

PubMed

Hill, Erin M; Watkins, Kaitlin

2018-06-04

While there are various medication self-efficacy scales that exist, none assess self-efficacy for appropriate antibiotic use. The Appropriate Antibiotic Use Self-Efficacy Scale (AAUSES) was developed, pilot tested, and its psychometric properties were examined. Following pilot testing of the scale, a 28-item questionnaire was examined using a sample (n = 289) recruited through the Amazon Mechanical Turk platform. Participants also completed other scales and items, which were used in assessing discriminant, convergent, and criterion-related validity. Test-retest reliability was also examined. After examining the scale and removing items that did not assess appropriate antibiotic use, an exploratory factor analysis was conducted on 13 items from the original scale. Three factors were retained that explained 65.51% of the variance. The scale and its subscales had adequate internal consistency. The scale had excellent test-retest reliability, as well as demonstrated convergent, discriminant, and criterion-related validity. The AAUSES is a valid and reliable scale that assesses three domains of appropriate antibiotic use self-efficacy. The AAUSES may have utility in clinical and research settings in understanding individuals' beliefs about appropriate antibiotic use and related behavioral correlates. Future research is needed to examine the scale's utility in these settings. Copyright © 2018 Elsevier B.V. All rights reserved.

Reliability and Validity of the Professional Counseling Performance Evaluation

ERIC Educational Resources Information Center

Shepherd, J. Brad; Britton, Paula J.; Kress, Victoria E.

2008-01-01

The definition and measurement of counsellor trainee competency is an issue that has received increased attention yet lacks quantitative study. This research evaluates item responses, scale reliability and intercorrelations, interrater agreement, and criterion-related validity of the Professional Performance Fitness Evaluation/Professional…

Linguistic Validation of the M. D. Anderson Symptom Inventory in Persian-Speaking Iranian Cancer Patients.

PubMed

Saadatpour, Leila; Hemati, Simin; Habibi, Farzaneh; Behzadi, Erfan; Hashemi-Jazi, Marsa Sadat; Kheirabadi, Gholamreza; Mirbagher, Leila; Gholamrezaei, Ali

2015-09-01

Various symptoms frequently affect cancer patients' quality of life. Appropriate assessment of these symptoms provides valuable data for cancer management. This study aimed to validate the Persian version of the M. D. Anderson Symptom Inventory (MDASI-P). This cross-sectional study was conducted at four cancer treatment centers in two cities in Iran. Breast cancer and colorectal cancer patients aged 18 years and older were consecutively included in the study. The standard forward-backward translation method was applied. Patients completed the MDASI-P along with the previously validated Persian version of the European Organization for Research and Treatment of Cancer Quality of Life Questionnaire-Core 30 (EORTC QLQ-C30). Construct validity (factor analysis), criterion validity (against the EORTC QLQ-C30), and reliability (Cronbach's alpha) were analyzed. A total of 146 breast cancer and 94 colorectal cancer patients were studied. Factor analysis for the symptom severity items resulted in a three-factor solution, further reduced to a two-factor solution: general symptoms and gastrointestinal symptoms. Correlation of the MDASI-P symptom severity items with corresponding EORTC QLQ-C30 symptom items (r = 0.48-0.75) and MDASI-P interference items with corresponding EORTC QLQ-C30 functioning domains (r = -0.46 to -0.23) supported the criterion validity. Cronbach's alpha was 0.90, 0.88, and 0.77 for the total questionnaire, symptom severity items, and the interference subscale, respectively. The MDASI-P is a feasible, valid, and reliable instrument for evaluation of symptoms in Persian-speaking cancer patients and can be used to improve symptom management in these patients. Copyright © 2015 American Academy of Hospice and Palliative Medicine. Published by Elsevier Inc. All rights reserved.

Validation of a single summary score for the Prolapse/Incontinence Sexual Questionnaire-IUGA revised (PISQ-IR).

PubMed

Constantine, Melissa L; Pauls, Rachel N; Rogers, Rebecca R; Rockwood, Todd H

2017-12-01

The Prolapse/Incontinence Sexual Questionnaire-International Urogynecology Association (IUGA) Revised (PISQ-IR) measures sexual function in women with pelvic floor disorders (PFDs) yet is unwieldy, with six individual subscale scores for sexually active women and four for women who are not. We hypothesized that a valid and responsive summary score could be created for the PISQ-IR. Item response data from participating women who completed a revised version of the PISQ-IR at three clinical sites were used to generate item weights using a magnitude estimation (ME) and Q-sort (Q) approaches. Item weights were applied to data from the original PISQ-IR validation to generate summary scores. Correlation and factor analysis methods were used to evaluate validity and responsiveness of summary scores. Weighted and nonweighted summary scores for the sexually active PISQ-IR demonstrated good criterion validity with condition-specific measures: Incontinence Severity Index = 0.12, 0.11, 0.11; Pelvic Floor Distress Inventory-20 = 0.39, 0.39, 0.12; Epidemiology of Prolapse and Incontinence Questionnaire-Q35 = 0.26 0,.25, 0.40); Female Sexual Functioning Index subscale total score = 0.72, 0.75, 0.72 for nonweighted, ME, and Q summary scores, respectively. Responsiveness evaluation showed weighted and nonweighted summary scores detected moderate effect sizes (Cohen's d > 0.5). Weighted items for those NSA demonstrated significant floor effects and did not meet criterion validity. A PISQ-IR summary score for use with sexually active women, nonweighted or calculated with ME or Q item weights, is a valid and reliable measure for clinical use. The summary scores provide value for assesing clinical treatment of pelvic floor disorders.

Using Item Data for Evaluating Criterion Reference Measures with an Empirical Investigation of Index Consistency.

ERIC Educational Resources Information Center

Meredith, Keith E.; Sabers, Darrell L.

Data required for evaluating a Criterion Referenced Measurement (CRM) is described with a matrix. The information within the matrix consists of the "pass-fail" decisions of two CRMs. By differentially defining these two CRMs, different concepts of reliability and validity can be examined. Indices suggested for analyzing the matrix are listed with…

Experimentally Manipulating Items Informs on the (Limited) Construct and Criterion Validity of the Humor Styles Questionnaire

PubMed Central

Ruch, Willibald; Heintz, Sonja

2017-01-01

How strongly does humor (i.e., the construct-relevant content) in the Humor Styles Questionnaire (HSQ; Martin et al., 2003) determine the responses to this measure (i.e., construct validity)? Also, how much does humor influence the relationships of the four HSQ scales, namely affiliative, self-enhancing, aggressive, and self-defeating, with personality traits and subjective well-being (i.e., criterion validity)? The present paper answers these two questions by experimentally manipulating the 32 items of the HSQ to only (or mostly) contain humor (i.e., construct-relevant content) or to substitute the humor content with non-humorous alternatives (i.e., only assessing construct-irrelevant context). Study 1 (N = 187) showed that the HSQ affiliative scale was mainly determined by humor, self-enhancing and aggressive were determined by both humor and non-humorous context, and self-defeating was primarily determined by the context. This suggests that humor is not the primary source of the variance in three of the HQS scales, thereby limiting their construct validity. Study 2 (N = 261) showed that the relationships of the HSQ scales to the Big Five personality traits and subjective well-being (positive affect, negative affect, and life satisfaction) were consistently reduced (personality) or vanished (subjective well-being) when the non-humorous contexts in the HSQ items were controlled for. For the HSQ self-defeating scale, the pattern of relationships to personality was also altered, supporting an positive rather than a negative view of the humor in this humor style. The present findings thus call for a reevaluation of the role that humor plays in the HSQ (construct validity) and in the relationships to personality and well-being (criterion validity). PMID:28473794

The Transition Readiness Assessment Questionnaire (TRAQ): its factor structure, reliability, and validity.

PubMed

Wood, David L; Sawicki, Gregory S; Miller, M David; Smotherman, Carmen; Lukens-Bull, Katryne; Livingood, William C; Ferris, Maria; Kraemer, Dale F

2014-01-01

National consensus statements recommend that providers regularly assess the transition readiness skills of adolescent and young adults (AYA). In 2010 we developed a 29-item version of Transition Readiness Assessment Questionnaire (TRAQ). We reevaluated item performance and factor structure, and reassessed the TRAQ's reliability and validity. We surveyed youth from 3 academic clinics in Jacksonville, Florida; Chapel Hill, North Carolina; and Boston, Massachusetts. Participants were AYA with special health care needs aged 14 to 21 years. From a convenience sample of 306 patients, we conducted item reduction strategies and exploratory factor analysis (EFA). On a second convenience sample of 221 patients, we conducted confirmatory factor analysis (CFA). Internal reliability was assessed by Cronbach's alpha and criterion validity. Analyses were conducted by the Wilcoxon rank sum test and mixed linear models. The item reduction and EFA resulted in a 20-item scale with 5 identified subscales. The CFA conducted on a second sample provided a good fit to the data. The overall scale has high reliability overall (Cronbach's alpha = .94) and good reliability for 4 of the 5 subscales (Cronbach's alpha ranging from .90 to .77 in the pooled sample). Each of the 5 subscale scores were significantly higher for adolescents aged 18 years and older versus those younger than 18 (P < .0001) in both univariate and multivariate analyses. The 20-item, 5-factor structure for the TRAQ is supported by EFA and CFA on independent samples and has good internal reliability and criterion validity. Additional work is needed to expand or revise the TRAQ subscales and test their predictive validity. Copyright © 2014 Academic Pediatric Association. Published by Elsevier Inc. All rights reserved.

[Development of a cell phone addiction scale for korean adolescents].

PubMed

Koo, Hyun Young

2009-12-01

This study was done to develop a cell phone addiction scale for Korean adolescents. The process included construction of a conceptual framework, generation of initial items, verification of content validity, selection of secondary items, preliminary study, and extraction of final items. The participants were 577 adolescents in two middle schools and three high schools. Item analysis, factor analysis, criterion related validity, and internal consistency were used to analyze the data. Twenty items were selected for the final scale, and categorized into 3 factors explaining 55.45% of total variance. The factors were labeled as withdrawal/tolerance (7 items), life dysfunction (6 items), and compulsion/persistence (7 items). The scores for the scale were significantly correlated with self-control, impulsiveness, and cell phone use. Cronbach's alpha coefficient for the 20 items was .92. Scale scores identified students as cell phone addicted, heavy users, or average users. The above findings indicate that the cell phone addiction scale has good validity and reliability when used with Korean adolescents.

The Information a Test Provides on an Ability Parameter. Research Report. ETS RR-07-18

ERIC Educational Resources Information Center

Haberman, Shelby J.

2007-01-01

In item-response theory, if a latent-structure model has an ability variable, then elementary information theory may be employed to provide a criterion for evaluation of the information the test provides concerning ability. This criterion may be considered even in cases in which the latent-structure model is not valid, although interpretation of…

A new self-report inventory of dyslexia for students: criterion and construct validity.

PubMed

Tamboer, Peter; Vorst, Harrie C M

2015-02-01

The validity of a Dutch self-report inventory of dyslexia was ascertained in two samples of students. Six biographical questions, 20 general language statements and 56 specific language statements were based on dyslexia as a multi-dimensional deficit. Dyslexia and non-dyslexia were assessed with two criteria: identification with test results (Sample 1) and classification using biographical information (both samples). Using discriminant analyses, these criteria were predicted with various groups of statements. All together, 11 discriminant functions were used to estimate classification accuracy of the inventory. In Sample 1, 15 statements predicted the test criterion with classification accuracy of 98%, and 18 statements predicted the biographical criterion with classification accuracy of 97%. In Sample 2, 16 statements predicted the biographical criterion with classification accuracy of 94%. Estimations of positive and negative predictive value were 89% and 99%. Items of various discriminant functions were factor analysed to find characteristic difficulties of students with dyslexia, resulting in a five-factor structure in Sample 1 and a four-factor structure in Sample 2. Answer bias was investigated with measures of internal consistency reliability. Less than 20 self-report items are sufficient to accurately classify students with and without dyslexia. This supports the usefulness of self-assessment of dyslexia as a valid alternative to diagnostic test batteries. Copyright © 2015 John Wiley & Sons, Ltd.

[The psychometric properties of the Turkish version of Myocardial Infarction Dimensional Assessment Scale (MIDAS)].

PubMed

Yılmaz, Emel; Eser, Erhan; Şekuri, Cevad; Kültürsay, Hakan

2011-08-01

The purpose of this study was to describe the psychometric properties of the Myocardial Infarction Dimensional Assessment Scale (MIDAS). This is a methodological cultural adaptation study. The MIDAS consists of 35-items covering seven domains: physical activity, insecurity, emotional reaction, dependency, diet, concerns over medication, and side effects which are rated on a five-point Likert scale from 1: never to 5:always. The highest score of MIDAS is 100.Quality of life (QOL) decreases as the score of scale increases. Overall 185 myocardial infarction (MI) patients were enrolled in this study. Cronbach alpha was used for the reliability analysis. The criterion validity, structural validity, and sensitivity analysis approach was used for validity analysis. New York Heart Association (NYHA) and the Canadian Cardiovascular Society Functional Classifications (CCSFC) for testing the criterion validity; SF-36 for construct validity testing of the Turkish version of the MIDAS were used. The range of Cronbach alpha values is 0.79-0.90 for seven domains of the scale. No problematic items were observed for the entire scale. Medication related domains of the MIDAS showed considerable floor effects (35.7%-22.7%). Confirmatory Factor analysis indicators [Comparative Fit Index (CFI) =0.95 and Root Mean Square Error of Approximation (RMSEA) =0.075] supported the construct validity of MIDAS. Convergent validity of the MIDAS was confirmed with correlation of SF-36 scale where appropriate. Criterion validity results was also satisfactory by comparing different stages of the NYHA and the CCSFC (p<0.05). Overall results revealed that Turkish version of the MIDAS is a reliable and valid instrument.

Development and psychometric validation of a scale to assess information needs in cardiac rehabilitation: the INCR Tool.

PubMed

Ghisi, Gabriela Lima de Melo; Grace, Sherry L; Thomas, Scott; Evans, Michael F; Oh, Paul

2013-06-01

To develop and psychometrically validate a tool to assess information needs in cardiac rehabilitation (CR) patients. After a literature search, 60 information items divided into 11 areas of needs were identified. To establish content validity, they were reviewed by an expert panel (N=10). Refined items were pilot-tested in 34 patients on a 5-point Likert-scale from 1 "really not helpful" to 5 "very important". A final version was generated and psychometrically tested in 203 CR patients. Test-retest reliability was assessed via the intraclass correlation coefficient (ICC), the internal consistency using Cronbach's alpha, and criterion validity was assessed with regard to patient's education and duration in CR. Five items were excluded after ICC analysis as well as one area of needs. All 10 areas were considered internally consistent (Cronbach's alpha>0.7). Criterion validity was supported by significant differences in mean scores by educational level (p<0.05) and duration in CR (p<0.001). The mean total score was 4.08 ± 0.53. Patients rated safety as their greatest information need. The INCR Tool was demonstrated to have good reliability and validity. This is an appropriate tool for application in clinical and research settings, assessing patients' needs during CR and as part of education programming. Copyright © 2013 Elsevier Ireland Ltd. All rights reserved.

Overview of Classical Test Theory and Item Response Theory for Quantitative Assessment of Items in Developing Patient-Reported Outcome Measures

PubMed Central

Cappelleri, Joseph C.; Lundy, J. Jason; Hays, Ron D.

2014-01-01

Introduction The U.S. Food and Drug Administration’s patient-reported outcome (PRO) guidance document defines content validity as “the extent to which the instrument measures the concept of interest” (FDA, 2009, p. 12). “Construct validity is now generally viewed as a unifying form of validity for psychological measurements, subsuming both content and criterion validity” (Strauss & Smith, 2009, p. 7). Hence both qualitative and quantitative information are essential in evaluating the validity of measures. Methods We review classical test theory and item response theory approaches to evaluating PRO measures including frequency of responses to each category of the items in a multi-item scale, the distribution of scale scores, floor and ceiling effects, the relationship between item response options and the total score, and the extent to which hypothesized “difficulty” (severity) order of items is represented by observed responses. Conclusion Classical test theory and item response theory can be useful in providing a quantitative assessment of items and scales during the content validity phase of patient-reported outcome measures. Depending on the particular type of measure and the specific circumstances, either one or both approaches should be considered to help maximize the content validity of PRO measures. PMID:24811753

Toward a Measure of Accountability in Nursing: A Three-Stage Validation Study.

PubMed

Drach-Zahavy, Anat; Leonenko, Marina; Srulovici, Einav

2018-06-04

To develop and psychometrically evaluate a three-dimensional questionnaire suitable for evaluating personal and organizational accountability in nurses. Accountability is defined as a three-dimensional value, directing professionals to take responsibility for their decisions and actions, to be willing to explain them (transparency) and to be judged according to society's accepted values (answerability). Despite the relatively clear definition, measurement of accountability lags well behind. Existing self-report questionnaires do not fully capture the complexity of the concept; nor do they capture the different sources of accountability (e.g., personal accountability, organizational accountability). A three-stage measure development. Data were collected during 2015-2016. In Phase 1, an initial database of items (N = 74) was developed, based on literature review and qualitative study, establishing face and content validity. In Phase 2, the face, content, construct and criterion-related validity of the initial questionnaires (19 items for personal and organizational accountability questionnaire) was established with a sample of 229 nurses. In Phase 3, the final questionnaires (19 items each) were validated with a new sample of 329 nurses and established construct validity. The final version of the instruments comprised 19 items, suitable for assessing personal and organizational accountability. The questionnaire referred to the dimensions of responsibility, transparency and answerability. The findings established the instrument's content, construct and criterion-related validity, as well as good internal reliability. The questionnaire portrays accountability in nursing, by capturing nurses' subjective perceptions of accountability dimensions (responsibility, transparency, answerability), as demonstrated by personal and organizational values. This article is protected by copyright. All rights reserved. This article is protected by copyright. All rights reserved.

Establishing Reliability and Validity of the Criterion Referenced Exam of GeoloGy Standards EGGS

NASA Astrophysics Data System (ADS)

Guffey, S. K.; Slater, S. J.; Slater, T. F.; Schleigh, S.; Burrows, A. C.

2016-12-01

Discipline-based geoscience education researchers have considerable need for a criterion-referenced, easy-to-administer and -score conceptual diagnostic survey for undergraduates taking introductory science survey courses in order for faculty to better be able to monitor the learning impacts of various interactive teaching approaches. To support ongoing education research across the geosciences, we are continuing to rigorously and systematically work to firmly establish the reliability and validity of the recently released Exam of GeoloGy Standards, EGGS. In educational testing, reliability refers to the consistency or stability of test scores whereas validity refers to the accuracy of the inferences or interpretations one makes from test scores. There are several types of reliability measures being applied to the iterative refinement of the EGGS survey, including test-retest, alternate form, split-half, internal consistency, and interrater reliability measures. EGGS rates strongly on most measures of reliability. For one, Cronbach's alpha provides a quantitative index indicating the extent to which if students are answering items consistently throughout the test and measures inter-item correlations. Traditional item analysis methods further establish the degree to which a particular item is reliably assessing students is actually quantifiable, including item difficulty and item discrimination. Validity, on the other hand, is perhaps best described by the word accuracy. For example, content validity is the to extent to which a measurement reflects the specific intended domain of the content, stemming from judgments of people who are either experts in the testing of that particular content area or are content experts. Perhaps more importantly, face validity is a judgement of how representative an instrument is reflective of the science "at face value" and refers to the extent to which a test appears to measure a the targeted scientific domain as viewed by laypersons, examinees, test users, the public, and other invested stakeholders.

Development of the beliefs about yoga scale.

PubMed

Sohl, Stephanie J; Schnur, Julie B; Daly, Leslie; Suslov, Kathryn; Montgomery, Guy H

2011-01-01

Beliefs about yoga may influence participation in yoga and outcomes of yoga interventions. There is currently no scale appropriate for assessing these beliefs in the general U.S. population. This study took the first steps in developing and validating a Beliefs About Yoga Scale (BAYS) to assess beliefs about yoga that may influence people's engagement in yoga interventions. Items were generated based on previously published research about perceptions of yoga and reviewed by experts within the psychology and yoga communities. 426 adult participants were recruited from an urban medical center to respond to these items. The mean age was 40.7 (SD=13.5) years. Participants completed the BAYS and seven additional indicators of criterion-related validity. The BAYS demonstrated internal consistency (11 items; α=0.76) and three factors emerged: expected health benefits, expected discomfort, and expected social norms. The factor structure was confirmed: x2 (41, n=213)=72.06, p<.001; RMSEA=06, p=.23. Criterion-related validity was supported by positive associations of the BAYS with past experiences and future intentions related to yoga. This initial analysis of the BAYS demonstrated that it is an adequately reliable and valid measure of beliefs about yoga with a three-factor structure. However, the scale may need to be modified based on the population to which it is applied.

Screening for postdeployment conditions: development and cross-validation of an embedded validity scale in the neurobehavioral symptom inventory.

PubMed

Vanderploeg, Rodney D; Cooper, Douglas B; Belanger, Heather G; Donnell, Alison J; Kennedy, Jan E; Hopewell, Clifford A; Scott, Steven G

2014-01-01

To develop and cross-validate internal validity scales for the Neurobehavioral Symptom Inventory (NSI). Four existing data sets were used: (1) outpatient clinical traumatic brain injury (TBI)/neurorehabilitation database from a military site (n = 403), (2) National Department of Veterans Affairs TBI evaluation database (n = 48 175), (3) Florida National Guard nonclinical TBI survey database (n = 3098), and (4) a cross-validation outpatient clinical TBI/neurorehabilitation database combined across 2 military medical centers (n = 206). Secondary analysis of existing cohort data to develop (study 1) and cross-validate (study 2) internal validity scales for the NSI. The NSI, Mild Brain Injury Atypical Symptoms, and Personality Assessment Inventory scores. Study 1: Three NSI validity scales were developed, composed of 5 unusual items (Negative Impression Management [NIM5]), 6 low-frequency items (LOW6), and the combination of 10 nonoverlapping items (Validity-10). Cut scores maximizing sensitivity and specificity on these measures were determined, using a Mild Brain Injury Atypical Symptoms score of 8 or more as the criterion for invalidity. Study 2: The same validity scale cut scores again resulted in the highest classification accuracy and optimal balance between sensitivity and specificity in the cross-validation sample, using a Personality Assessment Inventory Negative Impression Management scale with a T score of 75 or higher as the criterion for invalidity. The NSI is widely used in the Department of Defense and Veterans Affairs as a symptom-severity assessment following TBI, but is subject to symptom overreporting or exaggeration. This study developed embedded NSI validity scales to facilitate the detection of invalid response styles. The NSI Validity-10 scale appears to hold considerable promise for validity assessment when the NSI is used as a population-screening tool.

A Review of ETS Differential Item Functioning Assessment Procedures: Flagging Rules, Minimum Sample Size Requirements, and Criterion Refinement. Research Report. ETS RR-12-08

ERIC Educational Resources Information Center

Zwick, Rebecca

2012-01-01

Differential item functioning (DIF) analysis is a key component in the evaluation of the fairness and validity of educational tests. The goal of this project was to review the status of ETS DIF analysis procedures, focusing on three aspects: (a) the nature and stringency of the statistical rules used to flag items, (b) the minimum sample size…

Measurement versus prediction in the construction of patient-reported outcome questionnaires: can we have our cake and eat it?

PubMed

Smits, Niels; van der Ark, L Andries; Conijn, Judith M

2017-11-02

Two important goals when using questionnaires are (a) measurement: the questionnaire is constructed to assign numerical values that accurately represent the test taker's attribute, and (b) prediction: the questionnaire is constructed to give an accurate forecast of an external criterion. Construction methods aimed at measurement prescribe that items should be reliable. In practice, this leads to questionnaires with high inter-item correlations. By contrast, construction methods aimed at prediction typically prescribe that items have a high correlation with the criterion and low inter-item correlations. The latter approach has often been said to produce a paradox concerning the relation between reliability and validity [1-3], because it is often assumed that good measurement is a prerequisite of good prediction. To answer four questions: (1) Why are measurement-based methods suboptimal for questionnaires that are used for prediction? (2) How should one construct a questionnaire that is used for prediction? (3) Do questionnaire-construction methods that optimize measurement and prediction lead to the selection of different items in the questionnaire? (4) Is it possible to construct a questionnaire that can be used for both measurement and prediction? An empirical data set consisting of scores of 242 respondents on questionnaire items measuring mental health is used to select items by means of two methods: a method that optimizes the predictive value of the scale (i.e., forecast a clinical diagnosis), and a method that optimizes the reliability of the scale. We show that for the two scales different sets of items are selected and that a scale constructed to meet the one goal does not show optimal performance with reference to the other goal. The answers are as follows: (1) Because measurement-based methods tend to maximize inter-item correlations by which predictive validity reduces. (2) Through selecting items that correlate highly with the criterion and lowly with the remaining items. (3) Yes, these methods may lead to different item selections. (4) For a single questionnaire: Yes, but it is problematic because reliability cannot be estimated accurately. For a test battery: Yes, but it is very costly. Implications for the construction of patient-reported outcome questionnaires are discussed.

Survey Development to Assess College Students' Perceptions of the Campus Environment.

PubMed

Sowers, Morgan F; Colby, Sarah; Greene, Geoffrey W; Pickett, Mackenzie; Franzen-Castle, Lisa; Olfert, Melissa D; Shelnutt, Karla; Brown, Onikia; Horacek, Tanya M; Kidd, Tandalayo; Kattelmann, Kendra K; White, Adrienne A; Zhou, Wenjun; Riggsbee, Kristin; Yan, Wangcheng; Byrd-Bredbenner, Carol

2017-11-01

We developed and tested a College Environmental Perceptions Survey (CEPS) to assess college students' perceptions of the healthfulness of their campus. CEPS was developed in 3 stages: questionnaire development, validity testing, and reliability testing. Questionnaire development was based on an extensive literature review and input from an expert panel to establish content validity. Face validity was established with the target population using cognitive interviews with 100 college students. Concurrent-criterion validity was established with in-depth interviews (N = 30) of college students compared to surveys completed by the same 30 students. Surveys completed by college students from 8 universities (N = 1147) were used to test internal structure (factor analysis) and internal consistency (Cronbach's alpha). After development and testing, 15 items remained from the original 48 items. A 5-factor solution emerged: physical activity (4 items, α = .635), water (3 items, α = .773), vending (2 items, α = .680), healthy food (2 items, α = .631), and policy (2 items, α = .573). The mean total score for all universities was 62.71 (±11.16) on a 100-point scale. CEPS appears to be a valid and reliable tool for assessing college students' perceptions of their health-related campus environment.

[Spanish version of the Satisfaction With Decision scale: cross-cultural adaptation, validity and reliability].

PubMed

Chabrera, Carolina; Areal, Joan; Font, Albert; Caro, Mónica; Bonet, Marta; Zabalegui, Adelaida

2015-01-01

The aim of this study is to develop a Spanish version of the Satisfaction With Decision scale (SWDs) and analyse the psychometric properties of validity and reliability. An observational, descriptive study and validation of a tool to measure satisfaction with the decision. Urology, Radiation oncology, and Medical oncology Departments of the Hospital Universitari Germans Trias i Pujol, Institut Català d'Oncologia and the Institut Oncològic del Vallès - Hospital General de Catalunya. A total of 170 participants diagnosed with prostate cancer, and who could read and write in Spanish and gave their informed consent. A translation, back-translation and cross-cultural adaptation to Spanish was performed on the SWDs. The content validity, criterion validity, construct validity and reliability (internal consistency and stability) of the Spanish version were evaluated. The SWDs contains 6 items with 5-item Likert scales. A Spanish version (ESD) was obtained that was linguistically and conceptually equivalent to the original version. Criterion validity, the ESD correlated with "satisfaction with the decision" using a linear analogue scale, was significant (r=0.63, P<.01) for all items. The factorial analysis showed a unique dimension to explain 82.08% of the variance. The ESD showed excellent results in terms of internal consistency (Cronbach alpha=0.95) and good test-retest reliability with intraclass correlation coefficient of 0.711. The ESD is a validated Spanish scale to measure the satisfaction with the decisions taken in health, and demonstrates a correct validity and reliability. Copyright © 2015 Elsevier España, S.L.U. All rights reserved.

Development and Initial Validation of the Multicultural Personality Inventory (MPI).

PubMed

Ponterotto, Joseph G; Fietzer, Alexander W; Fingerhut, Esther C; Woerner, Scott; Stack, Lauren; Magaldi-Dopman, Danielle; Rust, Jonathan; Nakao, Gen; Tsai, Yu-Ting; Black, Natasha; Alba, Renaldo; Desai, Miraj; Frazier, Chantel; LaRue, Alyse; Liao, Pei-Wen

2014-01-01

Two studies summarize the development and initial validation of the Multicultural Personality Inventory (MPI). In Study 1, the 115-item prototype MPI was administered to 415 university students where exploratory factor analysis resulted in a 70-item, 7-factor model. In Study 2, the 70-item MPI and theoretically related companion instruments were administered to a multisite sample of 576 university students. Confirmatory factory analysis found the 7-factor structure to be a relatively good fit to the data (Comparative Fit Index =.954; root mean square error of approximation =.057), and MPI factors predicted variance in criterion variables above and beyond the variance accounted for by broad personality traits (i.e., Big Five). Study limitations and directions for further validation research are specified.

Translating and validating a Training Needs Assessment tool into Greek

PubMed Central

Markaki, Adelais; Antonakis, Nikos; Hicks, Carolyn M; Lionis, Christos

2007-01-01

Background The translation and cultural adaptation of widely accepted, psychometrically tested tools is regarded as an essential component of effective human resource management in the primary care arena. The Training Needs Assessment (TNA) is a widely used, valid instrument, designed to measure professional development needs of health care professionals, especially in primary health care. This study aims to describe the translation, adaptation and validation of the TNA questionnaire into Greek language and discuss possibilities of its use in primary care settings. Methods A modified version of the English self-administered questionnaire consisting of 30 items was used. Internationally recommended methodology, mandating forward translation, backward translation, reconciliation and pretesting steps, was followed. Tool validation included assessing item internal consistency, using the alpha coefficient of Cronbach. Reproducibility (test – retest reliability) was measured by the kappa correlation coefficient. Criterion validity was calculated for selected parts of the questionnaire by correlating respondents' research experience with relevant research item scores. An exploratory factor analysis highlighted how the items group together, using a Varimax (oblique) rotation and subsequent Cronbach's alpha assessment. Results The psychometric properties of the Greek version of the TNA questionnaire for nursing staff employed in primary care were good. Internal consistency of the instrument was very good, Cronbach's alpha was found to be 0.985 (p < 0.001) and Kappa coefficient for reproducibility was found to be 0.928 (p < 0.0001). Significant positive correlations were found between respondents' current performance levels on each of the research items and amount of research involvement, indicating good criterion validity in the areas tested. Factor analysis revealed seven factors with eigenvalues of > 1.0, KMO (Kaiser-Meyer-Olkin) measure of sampling adequacy = 0.680 and Bartlett's test of sphericity, p < 0.001. Conclusion The translated and adapted Greek version is comparable with the original English instrument in terms of validity and reliability and it is suitable to assess professional development needs of nursing staff in Greek primary care settings. PMID:17474989

Development of a scale to measure diabetes self-management behaviors among older Koreans with type 2 diabetes, based on the seven domains identified by the American Association of Diabetes Educators.

PubMed

Seo, Kyoungsan; Song, Misoon; Choi, Suyoung; Kim, Se-An; Chang, Sun Ju

2017-04-01

The purpose of this study was to develop the Diabetes Self-Management Behavior for Older Koreans (DSMB-O). This scale is based on the seven relevant domains that have been identified by the American Association of Diabetes Educators (AADE) and is adjusted for sociocultural and age-related characteristics. Four phases were used to develop of the DSMB-O as a criterion-referenced measure. In phases 1 and 2, the DSMB-O adopted the AADE's seven domains and established a self-report questionnaire using a small number of items that are applicable to older Koreans. In phase 3, the DSMB-O was formulated with 16 preliminary items, including seven subitems. By assessing the content validity, 14 items (including five subitems) were selected. The final phase involved evaluating the DSMB-O's psychometric properties, including test-retest reliability, content validity, and criterion-related validity, using data from 150 older Koreans with type 2 diabetes. The coefficients of agreement and Cohen's Kappa for the test-retest reliability test ranged from 0.32 to 1.0 and -0.07 to 1.0, respectively. For the content validity, the values of both the item- and scale-level content validity indices were 1.0. The scores from the DSMB-O were positively correlated with the scores from the Korean version of the Summary of Diabetes Self-Care Activities Questionnaire. The DSMB-O is short and easy for older Koreans to use, as well as having acceptable levels of reliability and validity. Hence, the DSMB-O can be a useful tool to evaluate diabetes self-management behaviors in older Koreans with type 2 diabetes. © 2016 Japan Academy of Nursing Science.

The trucker strain monitor: an occupation-specific questionnaire measuring psychological job strain.

PubMed

De Croon, E M; Blonk, R W; Van der Beek, J; Frings-Dresen, M H

2001-08-01

To develop and validate a short and user-friendly questionnaire measuring psychological job strain in truck drivers. In cooperation with an occupational physician in the Dutch road transport industry we developed items on the basis of face validity and information of existing questionnaires on the subject. These items were pilot-tested, by means of interviews, in 15 truck drivers. Study I examined the factorial structure of the initial 30-item trucker strain monitor (TSM) in a sample of 153 truck drivers. Subsequently, number of items per factor was reduced on the basis of reliability analyses (Cronbach's alpha). Study II examined construct and criterion validity of the TSM in a randomly selected group of 2,000 truck drivers, of whom 1,111 participated (adjusted response = 63%). Additionally, sensitivity and specificity were assessed by examining the ability of the TSM to identify truck drivers with or without self-reported sickness absence in the past 12 months because of psychological complaints. Factor analyses of the initial 30-item TSM revealed a two-factor solution. Item reduction resulted in a six-item work-related fatigue scale and four-item sleeping problems scale with high internal consistency. Results of study II confirmed the internal consistency of the TSM scales and provided support for construct and criterion validity. The composite, work-related fatigue, and sleeping problems scale had a sensitivity of 83%, 80% and 71% respectively, in identifying truck drivers with prior sickness absence because of psychological complaints. Specificity rates were 72%, 73% and 72% respectively. Despite methodological limitations, the results suggest that the TSM is a reliable and valid indicator of psychological job strain in truck drivers. In particular, the composite and work-related fatigue scale identified drivers with prior absenteeism because of psychological complaints, quite accurately. Future longitudinal research in specific sub-groups of truck drivers including both self-reported and objective psychological health measures should evidence whether (1) the distinction between two indicators of psychological job strain is useful, and whether (2) the TSM can be used in screening out truck drivers at risk of developing psychological health problems.

Development of a tool to measure person-centered maternity care in developing settings: validation in a rural and urban Kenyan population.

PubMed

Afulani, Patience A; Diamond-Smith, Nadia; Golub, Ginger; Sudhinaraset, May

2017-09-22

Person-centered reproductive health care is recognized as critical to improving reproductive health outcomes. Yet, little research exists on how to operationalize it. We extend the literature in this area by developing and validating a tool to measure person-centered maternity care. We describe the process of developing the tool and present the results of psychometric analyses to assess its validity and reliability in a rural and urban setting in Kenya. We followed standard procedures for scale development. First, we reviewed the literature to define our construct and identify domains, and developed items to measure each domain. Next, we conducted expert reviews to assess content validity; and cognitive interviews with potential respondents to assess clarity, appropriateness, and relevance of the questions. The questions were then refined and administered in surveys; and survey results used to assess construct and criterion validity and reliability. The exploratory factor analysis yielded one dominant factor in both the rural and urban settings. Three factors with eigenvalues greater than one were identified for the rural sample and four factors identified for the urban sample. Thirty of the 38 items administered in the survey were retained based on the factors loadings and correlation between the items. Twenty-five items load very well onto a single factor in both the rural and urban sample, with five items loading well in either the rural or urban sample, but not in both samples. These 30 items also load on three sub-scales that we created to measure dignified and respectful care, communication and autonomy, and supportive care. The Chronbach alpha for the main scale is greater than 0.8 in both samples, and that for the sub-scales are between 0.6 and 0.8. The main scale and sub-scales are correlated with global measures of satisfaction with maternity services, suggesting criterion validity. We present a 30-item scale with three sub-scales to measure person-centered maternity care. This scale has high validity and reliability in a rural and urban setting in Kenya. Validation in additional settings is however needed. This scale will facilitate measurement to improve person-centered maternity care, and subsequently improve reproductive outcomes.

Construct Validation of a Multidimensional Computerized Adaptive Test for Fatigue in Rheumatoid Arthritis

PubMed Central

Nikolaus, Stephanie; Bode, Christina; Taal, Erik; Vonkeman, Harald E.; Glas, Cees A. W.; van de Laar, Mart A. F. J.

2015-01-01

Objective Multidimensional computerized adaptive testing enables precise measurements of patient-reported outcomes at an individual level across different dimensions. This study examined the construct validity of a multidimensional computerized adaptive test (CAT) for fatigue in rheumatoid arthritis (RA). Methods The ‘CAT Fatigue RA’ was constructed based on a previously calibrated item bank. It contains 196 items and three dimensions: ‘severity’, ‘impact’ and ‘variability’ of fatigue. The CAT was administered to 166 patients with RA. They also completed a traditional, multidimensional fatigue questionnaire (BRAF-MDQ) and the SF-36 in order to examine the CAT’s construct validity. A priori criterion for construct validity was that 75% of the correlations between the CAT dimensions and the subscales of the other questionnaires were as expected. Furthermore, comprehensive use of the item bank, measurement precision and score distribution were investigated. Results The a priori criterion for construct validity was supported for two of the three CAT dimensions (severity and impact but not for variability). For severity and impact, 87% of the correlations with the subscales of the well-established questionnaires were as expected but for variability, 53% of the hypothesised relations were found. Eighty-nine percent of the items were selected between one and 137 times for CAT administrations. Measurement precision was excellent for the severity and impact dimensions, with more than 90% of the CAT administrations reaching a standard error below 0.32. The variability dimension showed good measurement precision with 90% of the CAT administrations reaching a standard error below 0.44. No floor- or ceiling-effects were found for the three dimensions. Conclusion The CAT Fatigue RA showed good construct validity and excellent measurement precision on the dimensions severity and impact. The dimension variability had less ideal measurement characteristics, pointing to the need to recalibrate the CAT item bank with a two-dimensional model, solely consisting of severity and impact. PMID:26710104

Validation of the Intrinsic Spirituality Scale (ISS) with Muslims.

PubMed

Hodge, David R; Zidan, Tarek; Husain, Altaf

2015-12-01

This study validates an existing spirituality measure--the intrinsic spirituality scale (ISS)--for use with Muslims in the United States. A confirmatory factor analysis was conducted with a diverse sample of self-identified Muslims (N = 281). Validity and reliability were assessed along with criterion and concurrent validity. The measurement model fit the data well, normed χ2 = 2.50, CFI = 0.99, RMSEA = 0.07, and SRMR = 0.02. All 6 items that comprise the ISS demonstrated satisfactory levels of validity (λ > .70) and reliability (R2 > .50). The Cronbach's alpha obtained with the present sample was .93. Appropriate correlations with theoretically linked constructs demonstrated criterion and concurrent validity. The results suggest the ISS is a valid measure of spirituality in clinical settings with the rapidly growing Muslim population. The ISS may, for instance, provide an efficient screening tool to identify Muslims that are particularly likely to benefit from spiritually accommodative treatments. (c) 2015 APA, all rights reserved).

Development and Validation of a Questionnaire on Breastfeeding Intentions, Attitudes and Knowledge of a Sample of Croatian Secondary-School Students.

PubMed

Čatipović, Marija; Marković, Martina; Grgurić, Josip

2018-04-27

Validating a questionnaire/instrument before proceeding to the field for data collection is important. An 18-item breastfeeding intention, 39-item attitude and 44-item knowledge questionnaire was validated in a Croatian sample of secondary-school students ( N = 277). For the intentions, principal component analysis (PCA) yielded a four-factor solution with 8 items explaining 68.3% of the total variance. Cronbach’s alpha (0.71) indicated satisfactory internal consistency. For the attitudes, PCA showed a seven-factor structure with 33 items explaining 58.41% of total variance. Cronbach’s alpha (0.87) indicated good internal consistency. There were 13 knowledge questions that were retained after item analysis, showing good internal consistency (KR20 = 0.83). In terms of criterion validity, the questionnaire differentiated between students who received breastfeeding education compared to students who were not educated in breastfeeding. Correlations between intentions and attitudes (r = 0.49), intentions and knowledge (r = 0.29), and attitudes and knowledge (r = 0.38) confirmed concurrent validity. The final instrument is reliable and valid for data collection on breastfeeding. Therefore, the instrument is recommended for evaluation of breastfeeding education programs aimed at upper-grade elementary and secondary school students.

Development and Validation of a Questionnaire on Breastfeeding Intentions, Attitudes and Knowledge of a Sample of Croatian Secondary-School Students

PubMed Central

Marković, Martina; Grgurić, Josip

2018-01-01

Background: Validating a questionnaire/instrument before proceeding to the field for data collection is important. Methods: An 18-item breastfeeding intention, 39-item attitude and 44-item knowledge questionnaire was validated in a Croatian sample of secondary-school students (N = 277). Results: For the intentions, principal component analysis (PCA) yielded a four-factor solution with 8 items explaining 68.3% of the total variance. Cronbach’s alpha (0.71) indicated satisfactory internal consistency. For the attitudes, PCA showed a seven-factor structure with 33 items explaining 58.41% of total variance. Cronbach’s alpha (0.87) indicated good internal consistency. There were 13 knowledge questions that were retained after item analysis, showing good internal consistency (KR20 = 0.83). In terms of criterion validity, the questionnaire differentiated between students who received breastfeeding education compared to students who were not educated in breastfeeding. Correlations between intentions and attitudes (r = 0.49), intentions and knowledge (r = 0.29), and attitudes and knowledge (r = 0.38) confirmed concurrent validity. Conclusions: The final instrument is reliable and valid for data collection on breastfeeding. Therefore, the instrument is recommended for evaluation of breastfeeding education programs aimed at upper-grade elementary and secondary school students. PMID:29702616

Developing a short measure of organizational justice: a multisample health professionals study.

PubMed

Elovainio, Marko; Heponiemi, Tarja; Kuusio, Hannamaria; Sinervo, Timo; Hintsa, Taina; Aalto, Anna-Mari

2010-11-01

To develop and test the validity of a short version of the original questionnaire measuring organizational justice. The study samples comprised working physicians (N = 2792) and registered nurses (n = 2137) from the Finnish Health Professionals study. Structural equation modelling was applied to test structural validity, using the justice scales. Furthermore, criterion validity was explored with well-being (sleeping problems) and health indicators (psychological distress/self-rated health). The short version of the organizational justice questionnaire (eight items) provides satisfactory psychometric properties (internal consistency, a good model fit of the data). All scales were associated with an increased risk of sleeping problems and psychological distress, indicating satisfactory criterion validity. This short version of the organizational justice questionnaire provides a useful tool for epidemiological studies focused on health-adverse effects of work environment.

A test of the International Personality Item Pool representation of the Revised NEO Personality Inventory and development of a 120-item IPIP-based measure of the five-factor model.

PubMed

Maples, Jessica L; Guan, Li; Carter, Nathan T; Miller, Joshua D

2014-12-01

There has been a substantial increase in the use of personality assessment measures constructed using items from the International Personality Item Pool (IPIP) such as the 300-item IPIP-NEO (Goldberg, 1999), a representation of the Revised NEO Personality Inventory (NEO PI-R; Costa & McCrae, 1992). The IPIP-NEO is free to use and can be modified to accommodate its users' needs. Despite the substantial interest in this measure, there is still a dearth of data demonstrating its convergence with the NEO PI-R. The present study represents an investigation of the reliability and validity of scores on the IPIP-NEO. Additionally, we used item response theory (IRT) methodology to create a 120-item version of the IPIP-NEO. Using an undergraduate sample (n = 359), we examined the reliability, as well as the convergent and criterion validity, of scores from the 300-item IPIP-NEO, a previously constructed 120-item version of the IPIP-NEO (Johnson, 2011), and the newly created IRT-based IPIP-120 in comparison to the NEO PI-R across a range of outcomes. Scores from all 3 IPIP measures demonstrated strong reliability and convergence with the NEO PI-R and a high degree of similarity with regard to their correlational profiles across the criterion variables (rICC = .983, .972, and .976, respectively). The replicability of these findings was then tested in a community sample (n = 757), and the results closely mirrored the findings from Sample 1. These results provide support for the use of the IPIP-NEO and both 120-item IPIP-NEO measures as assessment tools for measurement of the five-factor model. (c) 2014 APA, all rights reserved.

Development and psychometric testing the Health of Body, Mind and Spirit Scale for assessing individuals who have drug abuse histories.

PubMed

Sun, Fan-Ko; Chiang, Chun-Ying; Lu, Chu-Yun; Yu, Pei-Jane; Liao, Tzu-Chiao; Lan, Chu-Mei

2018-03-01

To develop the Health of Body, Mind and Spirit Scale (HBMSS), which was designed to assess drug abusers' health condition. Helping drug abusers to become healthy is important to healthcare professionals. However, no instrument exists to assess drug abusers' state of health. A cross-sectional questionnaire survey was implemented to examine the validity of the HBMSS. Data were collected from 2015-2016 at one drug abuse prevention centre in Taiwan. Participants (N = 320) who had abused drugs were invited to complete a preliminary 64-item version of the HBMSS. An item analysis, criterion-related validity analysis (using the Relapse Prediction Scale [RPS] score), split-half reliability testing and confirmatory factor analysis (CFA) were conducted to examine the psychometric properties of the HBMSS. The final version of the HBMSS contained 15 items that were divided into three subscales: the health of the body, mind and spirit. Cronbach's α and split-half reliability coefficients were all above .85. The factor loading of each item was between .74-.95. The HBMSS had satisfactory criterion-related validity with the RPS score (r = -.50, p < .001). A second-order CFA was conducted on the HBMSS. The fit indexes were good, χ 2  = 184.060, df = 94, χ 2 /df = 1.958 (p = .000). The entire HBMSS and the subscales had satisfactory reliability and validity. Healthcare professionals could use the HBMSS to evaluate the condition of the health of individuals with a drug abuse history. © 2017 John Wiley & Sons Ltd.

The Blood Donor Anxiety Scale: a six-item state anxiety measure based on the Spielberger State-Trait Anxiety Inventory.

PubMed

Chell, Kathleen; Waller, Daniel; Masser, Barbara

2016-06-01

Research demonstrates that anxiety elevates the risk of blood donors experiencing adverse events, which in turn deters the performance of repeat blood donations. Identifying donors suffering from heightened state anxiety is important to assess the impact of evidence-based interventions. This study analyzed the appropriateness of a shortened version of the state subscale of the State-Trait Anxiety Inventory (STAI) in a blood donation context. STAI-State questionnaire data were collected from two separate samples of Australian blood donors (n = 919 and n = 824 after cleaning). Responses to demographic, donation history, and adverse reaction questions were also obtained. Identification of items and analysis was performed systematically to assess and compare internal reliability and content, construct, convergent, and criterion validity of three potential short-form state anxiety scales. Of the three short-form scales tested, STAI-State six-item scale demonstrated the best metric properties with the least number of items across both sample groups. Cronbach's alpha was acceptable (α = 0.844 and α = 0.820), correlated positively with the original measure (r = 0.927 and r = 0.931) and criterion-related variables, and maintained the two-dimension factorial structure of the original measure. The six-item short version of the STAI-State subscale presented the most reliable and valid scale for use with blood donors. A validated donor anxiety tool provides a standardized assessment and record of donor anxiety to gauge the effectiveness of ongoing efforts to enhance the donation experience. © 2016 AABB.

[Development and Validation of the Academic Resilience Inventory for Nursing Students in Taiwan].

PubMed

Li, Cheng-Chieh; Wei, Chi-Fang; Tung, Yuk-Ying

2017-10-01

Failure to cope with learning pressures has been shown to influence the learning achievement and professional performance of nursing students. In order to enable nursing students to adapt successfully to their academic stress, it is essential to explore their academic resilience in the process of learning. To develop the Academic Resilience Inventory for Nursing Students (ARINS) and to test its reliability and validity. A total of 611 nursing students in central and southern Taiwan were recruited as participants. We divided the sample into two subsamples randomly using R software. The first sample was used to conduct item analysis and exploratory factor analysis. The other sample was used to conduct confirmatory factor analysis, cross validation, and criterion-related validity. There are 15 items in the ARINS, with cognitive maturity, emotional regulation, and help-seeking behavior used as the measurement indicators of academic resilience in nursing students. The assessed goodness-of-fit index indicates that the model fit the data well based upon the CFA and has good convergent validity and discriminant validity. Criterion-related validity was supported by the correlation among ARINS, learning performance and attitude, hope and optimistic, and depression. The ARINS has good reliability and validation and is a suitable measure of academic resilience in nursing students. It is helpful for nursing students to examine their academic stress and coping efficacy in the learning process.

Development of a gambling addictive behavior scale for adolescents in Korea.

PubMed

Park, Hyun Sook; Jung, Sun Young

2012-12-01

This study was conducted to develop a gambling addictive behavior scale for adolescents. The process involved construction of a conceptual framework, initial item search, verification of content validity, selection of secondary items, and extraction of final items. The participants were 299 adolescents from two middle schools and four high schools. Item analysis, factor analysis, criterion validity, internal consistency, and ROC curve were used to analyze the data. For the final scale, 25 items were selected, and categorized into 4 factors which accounted for 54.9% of the total variance. The factors were labeled as loss of control, life dysfunction from gambling addiction, gambling experience, and social dysfunction from problem gambling. The scores for the scale were significantly correlated with addictive personality, irrational gambling belief, and adolescent's gambling addictive behavior. Cronbach's alpha coefficient for the 25 items was .94. Scale scores identified adolescents as being in a problem gambling group, a non-problem gambling group, and a non-gambling group by the ROC curve. The above findings indicate that the gambling addictive behavior scale has good validity and reliability and can be used with adolescents in Korea.

Psychometric evaluation of the Dutch version of the Subjective Opiate Withdrawal Scale (SOWS).

PubMed

Dijkstra, Boukje A G; Krabbe, Paul F M; Riezebos, Truus G M; van der Staak, Cees P F; De Jong, Cor A J

2007-01-01

To evaluate the psychometric properties of the Dutch version of the 16-item Subjective Opiate Withdrawal Scale (SOWS). The SOWS measures withdrawal symptoms at the time of assessment. The Dutch SOWS was repeatedly administered to a sample of 272 opioid-dependent inpatients of four addiction treatment centers during rapid detoxification with or without general anesthesia. Examination of the psychometric properties of the SOWS included exploratory factor analysis, internal consistency, test-retest reliability, and criterion validity. Exploratory factor analysis of the SOWS revealed a general pattern of four factors with three items not always clustered in the same factors at different points of measurement. After excluding these items from factor analysis four factors were identified during detoxification (temperature dysregulation, tractus locomotorius, tractus gastro-intestinalis and facial disinhibition). The 13-item SOWS shows high internal consistency and test-retest reliability and good validity at different stages of withdrawal. The 13-item SOWS is a reliable and valid instrument to assess opioid withdrawal during rapid detoxification. Three items were deleted because their content does not correspond directly with opioid withdrawal symptoms. Copyright (c) 2007 S. Karger AG, Basel.

The revised Generalized Expectancy for Success Scale: a validity and reliability study.

PubMed

Hale, W D; Fiedler, L R; Cochran, C D

1992-07-01

The Generalized Expectancy for Success Scale (GESS; Fibel & Hale, 1978) was revised and assessed for reliability and validity. The revised version was administered to 199 college students along with other conceptually related measures, including the Rosenberg Self-Esteem Scale, the Life Orientation Test, and Rotter's Internal-External Locus of Control Scale. One subsample of students also completed the Eysenck Personality Inventory, while another subsample performed a criterion-related task that involved risk taking. Item analysis yielded 25 items with correlations of .45 or higher with the total score. Results indicated high internal consistency and test-retest reliability.

Testing of the SEE and OEE post-hip fracture.

PubMed

Resnick, Barbara; Orwig, Denise; Zimmerman, Sheryl; Hawkes, William; Golden, Justine; Werner-Bronzert, Michelle; Magaziner, Jay

2006-08-01

The purpose of this study was to test the reliability and validity of the Self-Efficacy for Exercise (SEE) and the Outcome Expectations for Exercise (OEE) scales in a sample of 166 older women post-hip fracture. There was some evidence of validity of the SEE and OEE based on confirmatory factor analysis and Rasch model testing, criterion based and convergent validity, and evidence of internal consistency based on alpha coefficients and separation indices and reliability based on R2 estimates. Rasch model testing demonstrated that some items had high variability. Based on these findings suggestions are made for how items could be revised and the scales improved for future use.

[Validity and reliability of Korean version of the Family Management Measure (Korean FaMM) for families with children having chronic illness].

PubMed

Kim, Dong Hee; Im, Yeo Jin

2013-02-01

To develop and test the validity and reliability of the Korean version of the Family Management Measure (Korean FaMM) to assess applicability for families with children having chronic illnesses. The Korean FaMM was articulated through forward-backward translation methods. Internal consistency reliability, construct and criterion validity were calculated using PASW WIN (19.0) and AMOS (20.0). Survey data were collected from 341 mothers of children suffering from chronic disease enrolled in a university hospital in Seoul, South Korea. The Korean version of FaMM showed reliable internal consistency with Cronbach's alpha for the total scale of .69-.91. Factor loadings of the 53 items on the six sub-scales ranged from 0.28-0.84. The model of six subscales for the Korean FaMM was validated by expiratory and confirmatory factor analysis (χ²<.001, RMR<.05, GFI, AGFI, NFI, NNFI>.08). Criterion validity compared to the Parental Stress Index (PSI) showed significant correlation. The findings of this study demonstrate that the Korean FaMM showed satisfactory construct and criterion validity and reliability. It is useful to measure Korean family's management style with their children who have a chronic illness.

The Reliability and Validity of the Self-Reported Drinking Measures in the Army’s Health Risk Appraisal Survey

PubMed Central

Bell, Nicole S.; Williams, Jeffrey O.; Senier, Laura; Strowman, Shelley R.; Amoroso, Paul J.

2007-01-01

Background The reliability and validity of self-reported drinking behaviors from the Army Health Risk Appraisal (HRA) survey are unknown. Methods We compared demographics and health experiences of those who completed the HRA with those who did not (1991–1998). We also evaluated the reliability and validity of eight HRA alcohol-related items, including the CAGE, weekly drinking quantity, and drinking and driving measures. We used Cohen’s κ and Pearson’s r to assess reliability and convergent validity. To assess criterion (predictive) validity, we used proportional hazards and logistical regression models predicting alcohol-related hospitalizations and alcohol-related separations from the Army, respectively. Results A total of 404,966 soldiers completed an HRA. No particular demographic group seems to be over- or underrepresented. Although few respondents skipped alcohol items, those who did tended to be older and of minority race. The alcohol items demonstrate a reasonable degree of reliability, with Cronbach’s α = 0.69 and test-retest reliability associations in the 0.75–0.80 range for most items over 2- to 30-day interims between surveys. The alcohol measures showed good criterion-related validity: those consuming more than 21 drinks per week were at 6 times the risk for subsequent alcohol-related hospitalization versus those who abstained from drinking (hazard ratio, 6.36; 95% confidence interval=5.79, 6.99). Those who said their friends worried about their drinking were almost 5 times more likely to be discharged due to alcoholism (risk ratio, 4.9; 95% confidence interval=4.00, 6.04) and 6 times more likely to experience an alcohol-related hospitalization (hazard ratio, 6.24; 95% confidence interval=5.74, 6.77). Conclusions The Army’s HRA alcohol items seem to elicit reliable and valid responses. Because HRAs contain identifiers, alcohol use can be linked with subsequent health and occupational outcomes, making the HRA a useful epidemiological research tool. Associations between perceived peer opinions of drinking and subsequent problems deserve further exploration. PMID:12766628

Construction and Validation of the Perceived Opportunity to Craft Scale.

PubMed

van Wingerden, Jessica; Niks, Irene M W

2017-01-01

We developed and validated a scale to measure employees' perceived opportunity to craft (POC) in two separate studies conducted in the Netherlands (total N = 2329). POC is defined as employees' perception of their opportunity to craft their job. In Study 1, the perceived opportunity to craft scale (POCS) was developed and tested for its factor structure and reliability in an explorative way. Study 2 consisted of confirmatory analyses of the factor structure and reliability of the scale as well as examination of the discriminant and criterion-related validity of the POCS. The results indicated that the scale consists of one dimension and could be reliably measured with five items. Evidence was found for the discriminant validity of the POCS. The scale also showed criterion-related validity when correlated with job crafting (+), job resources (autonomy +; opportunities for professional development +), work engagement (+), and the inactive construct cynicism (-). We discuss the implications of these findings for theory and practice.

Development and validation of a new tool to measure Iranian pregnant women's empowerment.

PubMed

Borghei, N S; Taghipour, A; Roudsari, R Latifnejad; Keramat, A

2016-03-15

Empowering pregnant women improves their health and reduces maternal mortality, but there is a lack of suitable tools to measure women's empowerment in some cultures. This study aimed to design and validate a questionnaire for measuring the dimensions of empowerment among Iranian pregnant women. After a literature review, and face and content validity testing, a 38-item questionnaire was developed and tested on a sample of 161 pregnant women. Factor analysis grouped the items into 3 subscales: educational empowerment (e.g. prenatal training), autonomy (e.g. financial independency and mental ability) and sociopolitical empowerment (e.g. involvement in social and political activities). Criterion validity testing showed a strong positive correlation of the total scale and subscales scores with the Kameda and the Spritzer empowerment scales. Cronbach alpha was 0.92 for total empowerment. A total of 32 items remained in the Self-Structured Pregnancy Empowerment Questionnaire, which is a valid new tool to measure the dimensions of pregnant women's empowerment.

Toward DSM-V: mapping the alcohol use disorder continuum in college students.

PubMed

Hagman, Brett T; Cohn, Amy M

2011-11-01

The present study examined the dimensionality of DSM-IV Alcohol Use Disorder (AUD) criteria using Item Response Theory (IRT) methods and tested the validity of the proposed DSM-V AUD guidelines in a sample of college students. Participants were 396 college students who reported any alcohol use in the past 90 days and were aged 18 years or older. We conducted factor analyses to determine whether a one- or two-factor model provided a better fit to the AUD criteria. IRT analyses estimated item severity and discrimination parameters for each criterion. Multivariate analyses examined differences among the DSM-V diagnostic cut-off (AUD vs. No AUD) and severity qualifiers (no diagnosis, moderate, severe) across several validating measures of alcohol use. A dominant single-factor model provided the best fit to the AUD criteria. IRT analyses indicated that abuse and dependence criteria were intermixed along the latent continuum. The "legal problems" criterion had the highest severity parameter and the tolerance criterion had the lowest severity parameter. The abuse criterion "social/interpersonal problems" and dependence criterion "activities to obtain alcohol" had the highest discrimination parameter estimates. Multivariate analysis indicated that the DSM-V cut-off point, and severity qualifier groups were distinguishable on several measures of alcohol consumption, drinking consequences, and drinking restraint. Findings suggest that the AUD criteria reflect a latent variable that represents a primary disorder and provide support for the proposed DSM-V AUD criteria in a sample of college students. Continued research in other high-risk samples of college students is needed. Copyright © 2011 Elsevier Ireland Ltd. All rights reserved.

Reliability and validity of the Chinese CECA10 questionnaire for Chinese patients with condyloma acuminata

PubMed Central

Guo, Xinying; Wu, Xinjuan; Guo, Aimin; Zhao, Yanwei

2018-01-01

Abstract Condyloma acuminata (CA) is a sexually transmitted disease that affects quality of life (QOL). CECA10 is an English-language questionnaire for assessing QOL in patients with CA, but there is no equivalent in China. This study aimed to develop a validated and reliable Chinese version of CECA10. The Chinese CECA10 was developed from the English version by forward translation, back translation, comparison with the original, cultural adjustments, and a pre-test (5 patients). The Chinese CECA10 and EuroQol Five Dimensions Three Level Questionnaire (EQ-5D-3L) was administered to patients with CA. Content validity (item/scale content validity indexes, I-CVI/S-CVI), test–retest reliability (intraclass coefficient, ICC), internal consistency (Cronbach α), criterion validity (comparison with the Dermatology Life Quality Index, DLQL, using Spearman correlation analysis), construct validity (exploratory factor analysis), and discriminant validity (between subgroups based on number of warts, number of recurrences, or number of sites involved) were assessed. The Chinese CECA10 had good test–retest reliability (ICC = 0.98, P < .001), internal consistency (Cronbach α values of 0.88, 0.84, and 0.83 for the total questionnaire, psychological dimension, and sexual dimension, respectively), content validity (I-CVI = 1 for all items), and criterion validity (r = -0.50, P < .001). Exploratory factor analysis extracted 2 factors with a cumulative contribution of 61.75%; the factor loading with each item was >0.4. Discriminant validity was not high. The mean CECA10 and EQ-VAS scores of 211 patients with CA (28.19 ± 7.16 years; 139 males) were 34.56 ± 19.01 and 64.64 ± 19.28, respectively. The Chinese CECA10 has good reliability and validity for evaluating the QOL of Chinese patients with CA. PMID:29489693

Development, pilot testing and psychometric validation of a short version of the coronary artery disease education questionnaire: The CADE-Q SV.

PubMed

Ghisi, Gabriela Lima de Melo; Sandison, Nicole; Oh, Paul

2016-03-01

To develop, pilot test and psychometrically validate a shorter version of the coronary artery disease education questionnaire (CADE-Q), called CADE-Q SV. Based on previous versions of the CADE-Q, cardiac rehabilitation (CR) experts developed 20 items divided into 5 knowledge domains to comprise the first version of the CADE-Q SV. To establish content validity, they were reviewed by an expert panel (N=12). Refined items were pilot-tested in 20 patients, in which clarity was provided. A final version was generated and psychometrically-tested in 132CR patients. Test-retest reliability was assessed via the intraclass correlation coefficient (ICC), the internal consistency using Cronbach's alpha, and criterion validity with regard to patients' education and duration in CR. All ICC coefficients meet the minimum recommended standard. All domains were considered internally consistent (α>0.7). Criterion validity was supported by significant differences in mean scores by educational level (p<0.01) and duration in CR (p<0.05). Knowledge about exercise and nutrition was higher than knowledge about medical condition. The CADE-Q SV was demonstrated to have good reliability and validity. This is a short, quick and appropriate tool for application in clinical and research settings, assessing patients' knowledge during CR and as part of education programming. Copyright © 2015. Published by Elsevier Ireland Ltd.

Overview of classical test theory and item response theory for the quantitative assessment of items in developing patient-reported outcomes measures.

PubMed

Cappelleri, Joseph C; Jason Lundy, J; Hays, Ron D

2014-05-01

The US Food and Drug Administration's guidance for industry document on patient-reported outcomes (PRO) defines content validity as "the extent to which the instrument measures the concept of interest" (FDA, 2009, p. 12). According to Strauss and Smith (2009), construct validity "is now generally viewed as a unifying form of validity for psychological measurements, subsuming both content and criterion validity" (p. 7). Hence, both qualitative and quantitative information are essential in evaluating the validity of measures. We review classical test theory and item response theory (IRT) approaches to evaluating PRO measures, including frequency of responses to each category of the items in a multi-item scale, the distribution of scale scores, floor and ceiling effects, the relationship between item response options and the total score, and the extent to which hypothesized "difficulty" (severity) order of items is represented by observed responses. If a researcher has few qualitative data and wants to get preliminary information about the content validity of the instrument, then descriptive assessments using classical test theory should be the first step. As the sample size grows during subsequent stages of instrument development, confidence in the numerical estimates from Rasch and other IRT models (as well as those of classical test theory) would also grow. Classical test theory and IRT can be useful in providing a quantitative assessment of items and scales during the content-validity phase of PRO-measure development. Depending on the particular type of measure and the specific circumstances, the classical test theory and/or the IRT should be considered to help maximize the content validity of PRO measures. Copyright © 2014 Elsevier HS Journals, Inc. All rights reserved.

Adaptation to Portuguese of the Depression, Anxiety and Stress Scales (DASS).

PubMed

Apóstolo, João Luís Alves; Mendes, Aida Cruz; Azeredo, Zaida Aguiar

2006-01-01

To adapt to Portuguese, of Portugal, the Depression, Anxiety and Stress Scales, a 21-item short scale (DASS 21), designed to measure depression, anxiety and stress. After translation and back-translation with the help of experts, the DASS 21 was administered to patients in external psychiatry consults (N=101), and its internal consistency, construct validity and concurrent validity were measured. The DASS 21 properties certify its quality to measure emotional states. The instrument reveals good internal consistency. Factorial analysis shows that the two-factor structure is more adequate. The first factor groups most of the items that theoretically assess anxiety and stress, and the second groups most of the items that assess depression, explaining, on the whole, 58.54% of total variance. The strong positive correlation between the DASS 21 and the Hospital Anxiety and Depression scale (HAD) confirms the hypothesis regarding the criterion validity, however, revealing fragilities as to the divergence between theoretically different constructs.

Domestic violence on children: development and validation of an instrument to evaluate knowledge of health professionals 1

PubMed Central

Oliveira, Lanuza Borges; Soares, Fernanda Amaral; Silveira, Marise Fagundes; de Pinho, Lucinéia; Caldeira, Antônio Prates; Leite, Maísa Tavares de Souza

2016-01-01

ABSTRACT Objective: to develop and validate an instrument to evaluate the knowledge of health professionals about domestic violence on children. Method: this was a study conducted with 194 physicians, nurses and dentists. A literature review was performed for preparation of the items and identification of the dimensions. Apparent and content validation was performed using analysis of three experts and 27 professors of the pediatric health discipline. For construct validation, Cronbach's alpha was used, and the Kappa test was applied to verify reproducibility. The criterion validation was conducted using the Student's t-test. Results: the final instrument included 56 items; the Cronbach alpha was 0.734, the Kappa test showed a correlation greater than 0.6 for most items, and the Student t-test showed a statistically significant value to the level of 5% for the two selected variables: years of education and using the Family Health Strategy. Conclusion: the instrument is valid and can be used as a promising tool to develop or direct actions in public health and evaluate knowledge about domestic violence on children. PMID:27556878

Development and validation of the Alcohol Myopia Scale.

PubMed

Lac, Andrew; Berger, Dale E

2013-09-01

Alcohol myopia theory conceptualizes the ability of alcohol to narrow attention and how this demand on mental resources produces the impairments of self-inflation, relief, and excess. The current research was designed to develop and validate a scale based on this framework. People who were alcohol users rated items representing myopic experiences arising from drinking episodes in the past month. In Study 1 (N = 260), the preliminary 3-factor structure was supported by exploratory factor analysis. In Study 2 (N = 289), the 3-factor structure was substantiated with confirmatory factor analysis, and it was superior in fit to an empirically indefensible 1-factor structure. The final 14-item scale was evaluated with internal consistency reliability, discriminant validity, convergent validity, criterion validity, and incremental validity. The alcohol myopia scale (AMS) illuminates conceptual underpinnings of this theory and yields insights for understanding the tunnel vision that arises from intoxication.

Bandwidth and Fidelity on the NEO-Five Factor Inventory: Replicability and Reliability of Saucier’s (1998) Item Cluster Subcomponents

PubMed Central

Chapman, Benjamin P.

2012-01-01

Many users of the NEO-Five Factor Inventory (NEO-FFI; Costa & McCrae, 1992) are unaware that Saucier (1998) developed item cluster subcomponents for each broad domain of the instrument similar to the facets of the Revised NEO Personality Inventory (Costa & McCrae, 1992). In this study, I examined the following: the replicability of the subcomponents in young adult university and middle-aged community samples; whether item keying accounted for additional covariance among items; subcomponent correlations with a measure of socially desirable responding; subcomponent reliabilities; and subcomponent discriminant validity with respect to age-relevant criterion items expected to reflect varying associations with broad and narrow traits. Confirmatory factor analyses revealed that all subcomponents were recoverable across samples and that the addition of method factors representing positive and negative item keying improved model fit. The subcomponents correlated no more with a measure of socially desirable responding than their parent domains and showed good average reliability. Correlations with criterion items suggested that subcomponents may prove useful in specifying which elements of NEO-FFI domains are more or less related to variables of interest. I discuss their use for enhancing the precision of findings obtained with NEO-FFI domain scores. PMID:17437386

Development and testing of mobile technology for community park improvements: validity and reliability of the eCPAT application with youth.

PubMed

Besenyi, Gina M; Diehl, Paul; Schooley, Benjamin; Turner-McGrievy, Brie M; Wilcox, Sara; Stanis, Sonja A Wilhelm; Kaczynski, Andrew T

2016-12-01

Creation of mobile technology environmental audit tools can provide a more interactive way for youth to engage with communities and facilitate participation in health promotion efforts. This study describes the development and validity and reliability testing of an electronic version of the Community Park Audit Tool (eCPAT). eCPAT consists of 149 items and incorporates a variety of technology benefits. Criterion-related validity and inter-rater reliability were evaluated using data from 52 youth across 47 parks in Greenville County, SC. A large portion of items (>70 %) demonstrated either fair or moderate to perfect validity and reliability. All but six items demonstrated excellent percent agreement. The eCPAT app is a user-friendly tool that provides a comprehensive assessment of park environments. Given the proliferation of smartphones, tablets, and other electronic devices among both adolescents and adults, the eCPAT app has potential to be distributed and used widely for a variety of health promotion purposes.

Spotting Incorrect Rules in Signed-Number Arithmetic by the Individual Consistency Index.

DTIC Science & Technology

1981-08-01

meaning of dimensionality of achievement data. It also shows the importance of construct validity, even in criterion referenced testing of the cognitive ... aspect of performance, and that the traditional means of item analysis that are based on taking the variances of binary scores and content analysis

Psychometric properties of the World Health Organization quality of life assessment – brief in methadone patients: a validation study in northern Taiwan

PubMed Central

2013-01-01

Background Quality of life (QOL) is an important outcome measure in the treatment of heroin addiction. The Taiwan version of the World Health Organization Quality of Life assessment (WHOQOL-BREF [TW]) has been developed and studied in various groups, but not specifically in a population of injection drug users. The aim of this study was to analyze the psychometric properties of the WHOQOL-BREF (TW) in a sample of injection drug users undergoing methadone maintenance treatment. Methods A total of 553 participants were interviewed and completed the instrument. Item-response distributions, internal consistency, corrected item-domain correlation, criterion-related validity, and construct validity through confirmatory factor analysis were evaluated. Results The frequency distribution of the 4 domains of the WHOQOL-BREF (TW) showed no floor or ceiling effects. The instrument demonstrated adequate internal consistency (Cronbach’s alpha coefficients were higher than 0.7 across the 4 domains) and all items had acceptable correlation with the corresponding domain scores (r = 0.32-0.73). Correlations (p < 0.01) of the 4 domains with the 2 benchmark items assessing overall QOL and general health were supportive of criterion-related validity. Confirmatory factor analysis yielded marginal goodness-of-fit between the 4-domain model and the sample data. Conclusions The hypothesized WHOQOL-BREF measurement model was appropriate for the injection drug users after some adjustments. Despite different patterns found in the confirmatory factor analysis, the findings overall suggest that the WHOQOL-BREF (TW) is a reliable and valid measure of QOL among injection drug users and can be utilized in future treatment outcome studies. The factor structure provided by the study also helps to understand the QOL characteristics of the injection drug users in Taiwan. However, more research is needed to examine its test-retest reliability and sensitivity to changes due to treatment. PMID:24325611

Selecting Items for Criterion-Referenced Tests.

ERIC Educational Resources Information Center

Mellenbergh, Gideon J.; van der Linden, Wim J.

1982-01-01

Three item selection methods for criterion-referenced tests are examined: the classical theory of item difficulty and item-test correlation; the latent trait theory of item characteristic curves; and a decision-theoretic approach for optimal item selection. Item contribution to the standardized expected utility of mastery testing is discussed. (CM)

Validity and reliability of three commonly used quality of life measures in a large European population of coronary heart disease patients.

PubMed

De Smedt, Delphine; Clays, Els; Doyle, Frank; Kotseva, Kornelia; Prugger, Christof; Pająk, Andrzej; Jennings, Catriona; Wood, David; De Bacquer, Dirk

2013-09-01

To investigate the validity and reliability of the EuroQol-5D (EQ-5D), the 12-item Short-Form Health Survey (SF-12v2), and the Hospital Anxiety and Depression Scale (HADS) in a stable coronary population. Cross-sectional study EUROASPIRE III. Quality of life data (QoL) were available on 8745 patients hospitalized for coronary artery bypass graft (CABG), percutaneous coronary intervention (PCI), acute myocardial infarction (AMI), or myocardial ischemia. They were interviewed and examined at least 6 months after their hospital admission. Reliability and validity of the 3 instruments were tested. Internal consistency, and discriminative, convergent, criterion and construct validity were assessed. Cronbach's alpha indicated good internal consistency for all measures (0.73 to 0.87). Discriminative validity analyses confirmed significant QoL differences between known groups: age, gender, educational level. In addition, all hypothesized correlations between QoL constructs (convergent validity) and items (criterion validity) were confirmed with significant correlations. Confirmatory factor analyses indicated good construct validity for HADS and SF-12v2. On country-specific level, results were roughly similar. The EQ-5D as well as the SF-12v2 and the HADS are reliable and valid instruments for use in a stable coronary population, both on aggregate European level and on country-specific level. However, our results must be generalized with caution, because EUROASPIRE III patients might not be representative for all patients with stable coronary heart disease. Copyright © 2012 Elsevier Ireland Ltd. All rights reserved.

A multidimensional assessment of the validity and utility of alcohol use disorder severity as determined by item response theory models.

PubMed

Dawson, Deborah A; Saha, Tulshi D; Grant, Bridget F

2010-02-01

The relative severity of the 11 DSM-IV alcohol use disorder (AUD) criteria are represented by their severity threshold scores, an item response theory (IRT) model parameter inversely proportional to their prevalence. These scores can be used to create a continuous severity measure comprising the total number of criteria endorsed, each weighted by its relative severity. This paper assesses the validity of the severity ranking of the 11 criteria and the overall severity score with respect to known AUD correlates, including alcohol consumption, psychological functioning, family history, antisociality, and early initiation of drinking, in a representative population sample of U.S. past-year drinkers (n=26,946). The unadjusted mean values for all validating measures increased steadily with the severity threshold score, except that legal problems, the criterion with the highest score, was associated with lower values than expected. After adjusting for the total number of criteria endorsed, this direct relationship was no longer evident. The overall severity score was no more highly correlated with the validating measures than a simple count of criteria endorsed, nor did the two measures yield different risk curves. This reflects both within-criterion variation in severity and the fact that the number of criteria endorsed and their severity are so highly correlated that severity is essentially redundant. Attempts to formulate a scalar measure of AUD will do as well by relying on simple counts of criteria or symptom items as by using scales weighted by IRT measures of severity. Published by Elsevier Ireland Ltd.

Development and evaluation of a brief screener to estimate fast-food and beverage consumption among adolescents.

PubMed

Nelson, Melissa C; Lytle, Leslie A

2009-04-01

Sweetened beverage and fast-food intake have been identified as important targets for obesity prevention. However, there are few brief dietary assessment tools available to evaluate these behaviors among adolescents. The objective of this research was to examine reliability and validity of a 22-item dietary screener assessing adolescent consumption of specific energy-containing and non-energy-containing beverages (nine items) and fast food (13 items). The screener was administered to adolescents (ages 11 to 18 years) recruited from the Minneapolis/St Paul, MN, metro region. One sample of adolescents completed test-retest reliability of the screener (n=33, primarily white adolescents). Another adolescent sample completed the screener along with three 24-hour dietary recalls to assess criterion validity (n=59 white adolescents). Test-retest assessments were completed approximately 7 to 14 days apart, and agreement between the two administrations of the screener was substantial, with most items yielding Spearman correlations and kappa statistics that were >0.60. When compared to the gold standard dietary recall data, findings indicate that the validity of the screener items assessing adolescents' intake of regular soda, sports drinks, milk, and water was fair. However, the differential assessment periods captured by the two methods (ie, 1 month for the screener vs 3 days for the recalls) posed challenges in analysis and made it impossible to assess the validity of some screener items. Overall while these screener items largely represent reliable measures with fair validity, our findings highlight the challenges inherent in the validation of brief dietary assessment tools.

Development and Validation of the Adolescent Psychological Need Support in Exercise Questionnaire.

PubMed

Emm-Collison, Lydia G; Standage, Martyn; Gillison, Fiona B

2016-10-01

Grounded within self-determination theory (SDT; Deci & Ryan, 2000; Ryan & Deci, in press), three studies were conducted to develop and psychometrically test a measure of adolescents' perceptions of psychological need support for exercise (viz., for autonomy, competence, and relatedness): the Adolescent Psychological Need Support in Exercise Questionnaire (APNSEQ). In Study 1, 34 items were developed in collaboration with an expert panel. Through categorical confirmatory factor analysis and item response theory, responses from 433 adolescents were used to identify the best fitting and performing items in Study 2. Here, a three-factor nine-item measure showed good fit to the data. In Study 3, responses from an independent sample of 373 adolescents provided further evidence for the nine-item solution as well as for internal consistency, criterion validity, and invariance across gender and social agent (friends, family, and physical education teacher). The APNSEQ was supported as a measure of adolescents' perceptions of psychological need support within the context of exercise.

Validation of the German version of the Nurse-Work Instability Scale: baseline survey findings of a prospective study of a cohort of geriatric care workers

PubMed Central

2013-01-01

Background A prospective study of a cohort of nursing staff from nursing homes was undertaken to validate the Nurse-Work Instability Scale (Nurse-WIS). Baseline investigation data was used to test reliability, construct validity and criterion validity. Method A survey of nursing staff from nursing homes was conducted using a questionnaire containing the Nurse-WIS along with other survey instruments (including SF-12, WAI, SPE). The self-reported number of days’ sick leave taken and if a pension for reduced work capacity was drawn were recorded. The reliability of the scale was checked by item difficulty (P), item discrimination (rjt) and by internal consistency according to Cronbach’s coefficient. The hypotheses for checking construct validity were tested on the basis of correlations. Pearson’s chi-square was used to test concurrent criterion validity; discriminant validity was tested by means of binary logistic regression. Results 396 persons answered the questionnaire (21.3% response rate). More than 80% were female and mostly work full-time in a rotating shift pattern. Following the test for item discrimination, two items were removed from the Nurse-WIS test. According to Cronbach’s (0.927) the scale provides a high degree of measuring accuracy. All hypotheses and assumptions used to test validity were confirmed: As the Nurse-WIS risk increases, health-related quality of life, work ability and job satisfaction decline. Depressive symptoms and a poor subjective prognosis of earning capacity are also more frequent. Musculoskeletal disorders and impairments of psychological well-being are more frequent. Age also influences the Nurse-WIS result. While 12.0% of those below the age of 35 had an increased risk, the figure for those aged over 55 was 50%. Conclusion This study is the first validation study of the Nurse-WIS to date. The Nurse-WIS shows good reliability, good validity and a good level of measuring accuracy. It appears to be suitable for recording prevention and rehabilitation needs among health care workers. If, in the follow-up, the Nurse-WIS likewise proves to be a reliable screening instrument with good predictive validity, it could ensure that suitable action is taken at an early stage, thereby helping to counteract early retirement and the anticipated shortage of health care workers. PMID:24330532

[Elaboration and validation of a tool to measure psychological well-being: WBMMS].

PubMed

Massé, R; Poulin, C; Dassa, C; Lambert, J; Bélair, S; Battaglini, M A

1998-01-01

Psychological well-being scales used in epidemiologic surveys usually show high construct validity. The content validation, however, is less convincing since these scales rest on lists of items that reflect the theoretical model of the authors. In this study we present results of the construct and criterion validation of a new Well-Being Manifestations Measure Scale (WBMMS) founded on an initial list of manifestations derived from an original content validation in a general population. It is concluded that national and public health epidemiologic surveys should include both measures of positive and negative mental health.

Development and validation of the simulation-based learning evaluation scale.

PubMed

Hung, Chang-Chiao; Liu, Hsiu-Chen; Lin, Chun-Chih; Lee, Bih-O

2016-05-01

The instruments that evaluate a student's perception of receiving simulated training are English versions and have not been tested for reliability or validity. The aim of this study was to develop and validate a Chinese version Simulation-Based Learning Evaluation Scale (SBLES). Four stages were conducted to develop and validate the SBLES. First, specific desired competencies were identified according to the National League for Nursing and Taiwan Nursing Accreditation Council core competencies. Next, the initial item pool was comprised of 50 items related to simulation that were drawn from the literature of core competencies. Content validity was established by use of an expert panel. Finally, exploratory factor analysis and confirmatory factor analysis were conducted for construct validity, and Cronbach's coefficient alpha determined the scale's internal consistency reliability. Two hundred and fifty students who had experienced simulation-based learning were invited to participate in this study. Two hundred and twenty-five students completed and returned questionnaires (response rate=90%). Six items were deleted from the initial item pool and one was added after an expert panel review. Exploratory factor analysis with varimax rotation revealed 37 items remaining in five factors which accounted for 67% of the variance. The construct validity of SBLES was substantiated in a confirmatory factor analysis that revealed a good fit of the hypothesized factor structure. The findings tally with the criterion of convergent and discriminant validity. The range of internal consistency for five subscales was .90 to .93. Items were rated on a 5-point scale from 1 (strongly disagree) to 5 (strongly agree). The results of this study indicate that the SBLES is valid and reliable. The authors recommend that the scale could be applied in the nursing school to evaluate the effectiveness of simulation-based learning curricula. Copyright © 2016 Elsevier Ltd. All rights reserved.

Cross-cultural adaptation and psychometric testing of the Quality of Dying and Death Questionnaire for the Spanish population.

PubMed

Gutiérrez Sánchez, Daniel; Cuesta-Vargas, Antonio I

2018-04-01

Many measurements have been developed to assess the quality of death (QoD). Among these, the Quality of Dying and Death Questionnaire (QODD) is the most widely studied and best validated. Informal carers and health professionals who care for the patient during their last days of life can complete this assessment tool. The aim of the study is to carry out a cross-cultural adaptation and a psychometric analysis of the QODD for the Spanish population. The translation was performed using a double forward and backward method. An expert panel evaluated the content validity. The questionnaire was tested in a sample of 72 Spanish-speaking adult carers of deceased cancer patients. A psychometric analysis was performed to evaluate internal consistency, divergent criterion-related validity with the Mini-Suffering State Examination (MSSE) and concurrent criterion-related validity with the Palliative Outcome Scale (POS). Some items were deleted and modified to create the Spanish version of the QODD (QODD-ESP-26). The instrument was readable and acceptable. The content validity index was 0.96, suggesting that all items are relevant for the measure of the QoD. This questionnaire showed high internal consistency (Cronbach's α coefficient = 0.88). Divergent validity with MSSE (r = -0.64) and convergent validity with POS (r = -0.61) were also demonstrated. The QODD-ESP-26 is a valid and reliable instrument for the assessment of the QoD of deceased cancer patients that can be used in a clinical and research setting. Copyright © 2018 Elsevier Ltd. All rights reserved.

Short forms of the Child Perceptions Questionnaire for 11–14-year-old children (CPQ11–14): Development and initial evaluation

PubMed Central

Jokovic, Aleksandra; Locker, David; Guyatt, Gordan

2006-01-01

Background The Child Perceptions Questionnaire for children aged 11 to 14 years (CPQ11–14) is a 37-item measure of oral-health-related quality of life (OHRQoL) encompassing four domains: oral symptoms, functional limitations, emotional and social well-being. To facilitate its use in clinical settings and population-based health surveys, it was shortened to 16 and 8 items. Item impact and stepwise regression methods were used to produce each version. This paper describes the developmental process, compares the discriminative properties of the resulting four short-forms and evaluates their precision relative to the original CPQ11–14. Methods The item impact method used data from the CPQ11–14 item reduction study to select the questions with the highest impact scores in each domain. The regression method, where the dependent variable was the overall CPQ11–14 score and the independent variables its individual questions, was applied to the data collected in the validity study for the CPQ11–14. The measurement properties (i.e. criterion validity, construct validity, internal consistency reliability and test-retest reliability) of all 4 short-forms were evaluated using the data from the validity and reliability studies for the CPQ11–14. Results All short forms detected substantial variability in children's OHRQoL. The mean scores on the two 16-item questionnaires were almost identical, while on the two 8-item questionnaires they differed by only one score point. The mean scores standardized to 0–100 were higher on the short forms than the original CPQ11–14 (p < 0.001). There were strong significant correlations between all short-form scores and CPQ11–14 scores (0.87–0.98; p < 0.001). Hypotheses concerning construct validity were confirmed: the short-forms' scores were highest in the oro-facial, lower in the orthodontic and lowest in the paediatric dentistry group; all short-form questionnaires were positively correlated with the ratings of oral health and overall well-being, with the correlation coefficient being higher for the latter. The relative validity coefficients were 0.85 to 1.18. Cronbach's alpha and intraclass correlation coefficients ranged 0.71–0.83 and 0.71–0.77, respectively. Conclusion All short forms demonstrated excellent criterion validity and good construct validity. The reliability coefficients exceeded standards for group-level comparisons. However, these are preliminary findings based on the convenience sampling and further testing in replicated studies involving clinical and general samples of children in various settings is necessary to establish measurement sensitivity and discriminative properties of these questionnaires. PMID:16423298

Family Living and Parenthood. Performance Objectives and Criterion-Referenced Test Items.

ERIC Educational Resources Information Center

Missouri Univ., Columbia. Instructional Materials Lab.

This guide was developed to assist home economics teachers in implementing the Missouri Vocational Instructional Management System into the home economics curriculum at the local level through a family living and parenthood semester course. The course contains a minimum of two performance objectives for each competency developed and validated by…

Psychometric evaluation of the pediatric and parent-proxy Patient-Reported Outcomes Measurement Information System and the Neurology and Traumatic Brain Injury Quality of Life measurement item banks in pediatric traumatic brain injury.

PubMed

Bertisch, Hilary; Rivara, Frederick P; Kisala, Pamela A; Wang, Jin; Yeates, Keith Owen; Durbin, Dennis; Zonfrillo, Mark R; Bell, Michael J; Temkin, Nancy; Tulsky, David S

2017-07-01

The primary objective is to provide evidence of convergent and discriminant validity for the pediatric and parent-proxy versions of the Patient-Reported Outcomes Measurement Information System (PROMIS) Anxiety, Depression, Anger, Peer Relations, Mobility, Pain Interference, and Fatigue item banks, the Neurology Quality of Life measurement system (Neuro-QOL) Cognition-General Concerns and Stigma item banks, and the Traumatic Brain Injury Quality of Life (TBI-QOL) Executive Function and Headache item banks in a pediatric traumatic brain injury (TBI) sample. Participants were 134 parent-child (ages 8-18 years) days. Children all sustained TBI and the dyads completed outcome ratings 6 months after injury at one of six medical centers across the United States. Ratings included PROMIS, Neuro-QOL, and TBI-QOL item banks, as well as the Pediatric Quality of Life inventory (PedsQL), the Health Behavior Inventory (HBI), and the Strengths and Difficulties Questionnaire (SDQ) as legacy criterion measures against which these item banks were validated. The PROMIS, Neuro-QOL, and TBI-QOL item banks demonstrated good convergent validity, as evidenced by moderate to strong correlations with comparable scales on the legacy measures. PROMIS, Neuro-QOL, and TBI-QOL item banks showed weaker correlations with ratings of unrelated constructs on legacy measures, providing evidence of discriminant validity. Our results indicate that the constructs measured by the PROMIS, Neuro-QOL, and TBI-QOL item banks are valid in our pediatric TBI sample and that it is appropriate to use these standardized scores for our primary study analyses.

The Value of the Studied Item in the Matching Criterion in Differential Item Functioning (DIF) Analysis. Research Report. ETS RR-10-13

ERIC Educational Resources Information Center

Tan, Xuan; Xiang, Bihua; Dorans, Neil J.; Qu, Yanxuan

2010-01-01

The nature of the matching criterion (usually the total score) in the study of differential item functioning (DIF) has been shown to impact the accuracy of different DIF detection procedures. One of the topics related to the nature of the matching criterion is whether the studied item should be included. Although many studies exist that suggest…

Construct Validation of Three Nutrition Questions Using Health and Diet Ratings in Older Canadian Males Living in the Community.

PubMed

Akhtar, Usman; Keller, Heather H; Tate, Robert B; Lengyel, Christina O

2015-12-01

Brief nutrition screening tools are desired for research and practice. Seniors in the Community: Risk Evaluation for Eating and Nutrition (SCREEN-II, 14 items) and the abbreviated version SCREEN-II-AB (8 items) are valid and reliable nutrition screening tools for older adults. This exploratory study used a retrospective cross-sectional design to determine the construct validity of a subset of 3 items (weight loss, appetite, and swallowing difficulty) currently on the SCREEN-II and SCREEN-II-AB tools. Secondary data on community-dwelling senior males (n = 522, mean ± SD age = 86.7 ± 3.0 years) in the Manitoba Follow-up Study (MFUS) study were available for analysis. Participants completed the mailed MFUS Nutrition Survey that included SCREEN-II items and questions pertaining to self-rated health, diet healthiness, and rating of the importance of nutrition towards successful aging as the constructs for comparison. Self-perceived health status (F = 14.7, P < 0.001), diet healthiness (ρ = 0.17, P = 0.002) and the rating of nutrition's importance to aging (ρ = 0.10, P = 0.03) were correlated with the 3-item score. Inferences were consistent with associations between these construct variables and the full SCREEN-II. Three items from SCREEN-II and SCREEN-II-AB demonstrate initial construct validity with self-perceived health status and diet healthiness ratings by older males; further exploration for criterion and predictive validity in more diverse samples is needed.

Development and validation of the Chinese version of the Diabetes Management Self-efficacy Scale.

PubMed

Vivienne Wu, Shu-Fang; Courtney, Mary; Edwards, Helen; McDowell, Jan; Shortridge-Baggett, Lillie M; Chang, Pei-Jen

2008-04-01

The purpose of this study was to translate the Diabetes Management Self-Efficacy Scale (DMSES) into Chinese and test the validity and reliability of the instrument within a Taiwanese population. A two-stage design was used for this study. Stage I consisted of a multi-stepped process of forward and backward translation, using focus groups and consensus meetings to translate the 20-item Australia/English version DMSES to Chinese and test content validity. Stage II established the psychometric properties of the Chinese version DMSES (C-DMSES) by examining the criterion, convergent and construct validity, internal consistency and stability testing. The sample for Stage II comprised 230 patients with type 2 diabetes aged 30 years or more from a diabetes outpatient clinic in Taiwan. Three items were modified to better reflect Chinese practice. The C-DMSES obtained a total average CVI score of .86. The convergent validity of the C-DMSES correlated well with the validated measure of the General Self-Efficacy Scale in measuring self-efficacy (r=.55; p<.01). Criterion-related validity showed that the C-DMSES was a significant predictor of the Summary of Diabetes Self-Care Activities scores (Beta=.58; t=10.75, p<.01). Factor analysis supported the C-DMSES being composed of four subscales. Good internal consistency (Cronbach's alpha=.77 to .93) and test-retest reliability (Pearson correlation coefficient r=.86, p<.01) were found. The C-DMSES is a brief and psychometrically sound measure for evaluation of self-efficacy towards management of diabetes by persons with type 2 diabetes in Chinese populations.

First evaluation of the Behavioral Addiction Indoor Tanning Screener (BAITS) in a nationwide representative sample.

PubMed

Diehl, K; Görig, T; Breitbart, E W; Greinert, R; Hillhouse, J J; Stapleton, J L; Schneider, S

2018-01-01

Evidence suggests that indoor tanning may have addictive properties. However, many instruments for measuring indoor tanning addiction show poor validity and reliability. Recently, a new instrument, the Behavioral Addiction Indoor Tanning Screener (BAITS), has been developed. To test the validity and reliability of the BAITS by using a multimethod approach. We used data from the first wave of the National Cancer Aid Monitoring on Sunbed Use, which included a cognitive pretest (August 2015) and a Germany-wide representative survey (October to December 2015). In the cognitive pretest 10 users of tanning beds were interviewed and 3000 individuals aged 14-45 years were included in the representative survey. Potential symptoms of indoor tanning addiction were measured using the BAITS, a brief screening survey with seven items (answer categories: yes vs. no). Criterion validity was assessed by comparing the results of BAITS with usage parameters. Additionally, we tested internal consistency and construct validity. A total of 19·7% of current and 1·8% of former indoor tanning users were screened positive for symptoms of a potential indoor tanning addiction. We found significant associations between usage parameters and the BAITS (criterion validity). Internal consistency (reliability) was good (Kuder-Richardson-20, 0·854). The BAITS was shown to be a homogeneous construct (construct validity). Compared with other short instruments measuring symptoms of a potential indoor tanning addiction, the BAITS seems to be a valid and reliable tool. With its short length and the binary items the BAITS is easy to use in large surveys. © 2017 British Association of Dermatologists.

The psychometric properties of the WHOQOL-BREF in Japanese couples

PubMed Central

Sun, Yi; Sugawara, Masumi; Matsumoto, Satoko; Sakai, Atsushi; Takaoka, Junko; Goto, Noriko

2015-01-01

This study investigated the psychometric properties of the Japanese version of the WHOQOL-BREF among 10,693 community-based married Japanese men and women (4376 couples) who were either expecting or raising a child. Analyses of item-response distributions, internal consistency, criterion validity, and discriminant validity indicated that the scale had acceptable reliability and performed well in preliminary tests of validity. Furthermore, dyadic confirmatory factor analysis revealed that the theoretical factor structure was valid and similar across partners, suggesting that men and women define and value quality of life in a similar way. PMID:28070365

Development of a Work Climate Scale in Emergency Health Services

PubMed Central

Sanduvete-Chaves, Susana; Lozano-Lozano, José A.; Chacón-Moscoso, Salvador; Holgado-Tello, Francisco P.

2018-01-01

An adequate work climate fosters productivity in organizations and increases employee satisfaction. Workers in emergency health services (EHS) have an extremely high degree of responsibility and consequent stress. Therefore, it is essential to foster a good work climate in this context. Despite this, scales with a full study of their psychometric properties (i.e., validity evidence based on test content, internal structure and relations to other variables, and reliability) are not available to measure work climate in EHS specifically. For this reason, our objective was to develop a scale to measure the quality of work climates in EHS. We carried out three studies. In Study 1, we used a mixed-method approach to identify the latent conceptual structure of the construct work climate. Thus, we integrated the results found in (a) a previous study, where a content analysis of seven in-depth interviews obtained from EHS professionals in two hospitals in Gibraltar Countryside County was carried out; and (b) the factor analysis of the responses given by 113 EHS professionals from these same centers to 18 items that measured the work climate in health organizations. As a result, we obtained 56 items grouped into four factors (work satisfaction, productivity/achievement of aims, interpersonal relationships, and performance at work). In Study 2, we presented validity evidence based on test content through experts' judgment. Fourteen experts from the methodology and health fields evaluated the representativeness, utility, and feasibility of each of the 56 items with respect to their factor (theoretical dimension). Forty items met the inclusion criterion, which was to obtain an Osterlind index value greater than or equal to 0.5 in the three aspects assessed. In Study 3, 201 EHS professionals from the same centers completed the resulting 40-item scale. This new instrument produced validity evidence based on the internal structure in a second-order factor model with four components (RMSEA = 0.079, GFI = 0.97, AGFI = 0.97, CFI = 0.97; NFI = 0.95, and NNFI = 0.97); absence of Differential Item Functioning (DIF) in 80% of the items; reliability (α = 0.96); and validity evidence based on relations to other variables, specifically the test-criterion relationship (ρ = 0.680). Finally, we discuss further developments of the instrument and its possible implications for EHS workers. PMID:29403417

Development of a Work Climate Scale in Emergency Health Services.

PubMed

Sanduvete-Chaves, Susana; Lozano-Lozano, José A; Chacón-Moscoso, Salvador; Holgado-Tello, Francisco P

2018-01-01

An adequate work climate fosters productivity in organizations and increases employee satisfaction. Workers in emergency health services (EHS) have an extremely high degree of responsibility and consequent stress. Therefore, it is essential to foster a good work climate in this context. Despite this, scales with a full study of their psychometric properties (i.e., validity evidence based on test content, internal structure and relations to other variables, and reliability) are not available to measure work climate in EHS specifically. For this reason, our objective was to develop a scale to measure the quality of work climates in EHS. We carried out three studies. In Study 1, we used a mixed-method approach to identify the latent conceptual structure of the construct work climate . Thus, we integrated the results found in (a) a previous study, where a content analysis of seven in-depth interviews obtained from EHS professionals in two hospitals in Gibraltar Countryside County was carried out; and (b) the factor analysis of the responses given by 113 EHS professionals from these same centers to 18 items that measured the work climate in health organizations. As a result, we obtained 56 items grouped into four factors (work satisfaction, productivity/achievement of aims, interpersonal relationships, and performance at work). In Study 2, we presented validity evidence based on test content through experts' judgment. Fourteen experts from the methodology and health fields evaluated the representativeness, utility, and feasibility of each of the 56 items with respect to their factor (theoretical dimension). Forty items met the inclusion criterion, which was to obtain an Osterlind index value greater than or equal to 0.5 in the three aspects assessed. In Study 3, 201 EHS professionals from the same centers completed the resulting 40-item scale. This new instrument produced validity evidence based on the internal structure in a second-order factor model with four components ( RMSEA = 0.079, GFI = 0.97, AGFI = 0.97, CFI = 0.97; NFI = 0.95, and NNFI = 0.97); absence of Differential Item Functioning (DIF) in 80% of the items; reliability (α = 0.96); and validity evidence based on relations to other variables, specifically the test-criterion relationship (ρ = 0.680). Finally, we discuss further developments of the instrument and its possible implications for EHS workers.

The psychometric properties of the Portuguese version of the Personality Inventory for DSM-5.

PubMed

Pires, Rute; Sousa Ferreira, Ana; Guedes, David

2017-10-01

The DSM-5 Section III proposes a hybrid dimensional-categorical model of conceptualizing personality and its disorders that includes assessment of impairments in personality functioning (criterion A) and maladaptive personality traits (criterion B). The Personality Inventory for the DSM-5 is a new dimensional tool, composed of 220 items organized into 25 facets that delineate five higher order domains of clinically relevant personality differences, and was developed to operationalize the DSM-5 model of pathological personality traits. The current studies address the internal consistency (study 1), the test-retest reliability (study 2) and the criterion validity (studies 3 and 4) of the Portuguese version of the PID-5 in samples of native speaking psychology students. Results indicated good internal consistency reliabilities and good temporal stability reliabilities for the majority of the PID-5 traits. The correlational pattern of the PID-5 traits with two measures of personality was in accordance with theoretical expectations and showed its concurrent validity. © 2017 Scandinavian Psychological Associations and John Wiley & Sons Ltd.

Psychometric properties of the Chinese version of the Menopause-Specific Quality-of-Life questionnaire.

PubMed

Nie, Guangning; Yang, Hongyan; Liu, Jian; Zhao, ChunMei; Wang, Xiaoyun

2017-05-01

The Menopause-Specific Quality-of-Life (MENQOL) questionnaire was developed as a specific tool to measure the health-related quality-of-life of postmenopausal women. Thus far, the Chinese version questionnaire has not been subjected to psychometric assessment with a large sample. This study aims to evaluate the validity and reliability of the Chinese version of the MENQOL specific to postmenopausal women in China. A total of 1,137 menopausal symptomatic and 491 menopausal asymptomatic women from eight cities in China were recruited using a convenience sampling method. Psychometric properties were evaluated by descriptive statistics, validity, and reliability. Reliability was assessed for each subscale of the MENQOL through internal consistency reliability with Cronbach's α and intersubscale correlations. Item-domain correlations, principal components analysis (PCA), and confirmatory factor analysis were performed to determine construct validity. t tests were used to compare the differences between the menopausal symptomatic and asymptomatic women and to evaluate the discriminate validity. Pearson correlation coefficients were calculated between MENQOL scores and the Kupperman index to assess criterion-related validity. The most common symptoms in Chinese menopausal symptomatic women were "experiencing poor memory" (94.4%), "feeling tired or worn out" (93.8%), "aching in muscle and joints" (89.4%), "low backache" (86.9%), "decrease in physical strength" (86.6%), "aches in back of neck or head" (86.2%), "difficulty sleeping" (83.6%), "accomplishing less than I used to" (83.4%), "feeling a lack of energy" (83.3%), "change in your sexual desire" (81%), and "hot flash" (80.7%) among others. The symptoms of "increased facial hair" were rarely seen (9.9%). The vasomotor domain, as well as psychosocial, physical, and sexual domains showed high reliability (Cronbach's α 0.84, 0.87, 0.89, and 0.86, respectively). Item-domain correlation analysis showed that all items correlated more strongly with their own domains than with other domains. In the PCA, after deleting the "increased facial hair" item, items in the vasomotor, sexual, and psychosocial subscales loaded on their respective domains by and large, and items in the physical subscale divided into two factors. The PCA revealed a latent structure of the Chinese version of MENQOL nearly identical to the original MENQOL domains. The confirmatory factor analysis demonstrated that the questionnaire fits well with a four-domain model. The MENQOL can discriminate between menopausal symptomatic women with asymptomatic women as it showed good discriminate validity. Criterion-related validity was confirmed by a significant correlation between MENQOL scores and the Kupperman index. This study showed that Chinese version of MENQOL has good psychometric properties and would be suitable to measure the health-related quality-of-life of Chinese menopausal women except for item 21 (increased facial hair).

Psychometric Testing of a Religious Belief Scale.

PubMed

Chiang, Yi-Chien; Lee, Hsiang-Chun; Chu, Tsung-Lan; Han, Chin-Yen; Hsiao, Ya-Chu

2017-12-01

Nurses account for a significant percentage of staff in the healthcare system. The religious beliefs of nurses may affect their competence to provide spiritual care to patients. No reliable and valid instruments are currently available to measure the religious beliefs of nurses in Taiwan. The aims of this study were to develop a religious belief scale (RBS) for Taiwanese nurses and to evaluate the psychometric properties of this scale. A cross-sectional study design was used, and 24 RBS items were generated from in-depth interviews, a literature review, and expert recommendations. The RBS self-administered questionnaire was provided to 619 clinical nurses, who were recruited from two medical centers and one local hospital in Taiwan during 2011-2012. A calibration sample was used to explore the factor structure, whereas a validation sample was used to validate the factor structure that was constructed by the calibration sample. Known-group validity and criterion-related validity were also assessed. An exploratory factor analysis resulted in an 18-item RBS with four factors, including "religious effects," "divine," "religious query," and "religious stress." A confirmatory factor analysis recommended the deletion of one item, resulting in a final RBS of 17 items. The convergent validity and discriminate validity of the RBS were acceptable. The RBS correlated positively with spiritual health and supported concurrent validity. The known-group validity was supported by showing that the mean RBS between nurses with or without religious affiliation was significant. The 17-item RBS developed in this study is a reliable, valid, and useful scale for measuring the religious beliefs of nurses in Taiwan. This scale may help measure the religious beliefs of nurses and elicit the relationship between these beliefs and spirituality.

Revision, Criterion Validity, and Multi-group Assessment of the Reactions to Homosexuality Scale

PubMed Central

Smolenski, Derek J.; Diamond, Pamela M.; Ross, Michael W.; Simon Rosser, B. R.

2010-01-01

Internalized homonegativity encompasses negative attitudes toward one’s own sexual orientation, and is associated with negative mental and physical health outcomes. The Reactions to Homosexuality scale (Ross & Rosser, 1996), an instrument used to measure internalized homonegativity, has been criticized for including content irrelevant to the construct of internalized homonegativity. We revised the scale using exploratory and confirmatory factor analyses, and identified a seven-item, three-factor reduced version that demonstrated measurement invariance across racial/ethnic categorizations and between English and Spanish versions. We also investigated criterion validity by estimating correlations with hypothesized outcomes associated with outness, relationship status, sexual orientation, and gay community affiliation. The evidence of measurement invariance suggests that this scale is appropriate for pluralistic treatment or study groups. PMID:20954058

On the dynamic nature of response criterion in recognition memory: effects of base rate, awareness, and feedback.

PubMed

Rhodes, Matthew G; Jacoby, Larry L

2007-03-01

The authors examined whether participants can shift their criterion for recognition decisions in response to the probability that an item was previously studied. Participants in 3 experiments were given recognition tests in which the probability that an item was studied was correlated with its location during the test. Results from all 3 experiments indicated that participants' response criteria were sensitive to the probability that an item was previously studied and that shifts in criterion were robust. In addition, awareness of the bases for criterion shifts and feedback on performance were key factors contributing to the observed shifts in decision criteria. These data suggest that decision processes can operate in a dynamic fashion, shifting from item to item.

Development of the Japanese version of the Council on Nutrition Appetite Questionnaire and its simplified versions, and evaluation of their reliability, validity, and reproducibility.

PubMed

Tokudome, Yuko; Okumura, Keiko; Kumagai, Yoshiko; Hirano, Hirohiko; Kim, Hunkyung; Morishita, Shiho; Watanabe, Yutaka

2017-11-01

Because few Japanese questionnaires assess the elderly's appetite, there is an urgent need to develop an appetite questionnaire with verified reliability, validity, and reproducibility. We translated and back-translated the Council on Nutrition Appetite Questionnaire (CNAQ), which has eight items, into Japanese (CNAQ-J), as well as the Simplified Nutritional Appetite Questionnaire (SNAQ-J), which includes four CNAQ-J-derived items. Using structural equation modeling, we examined the CNAQ-J structure based on data of 649 Japanese elderly people in 2013, including individuals having a certain degree of cognitive impairment, and we developed the SNAQ for the Japanese elderly (SNAQ-JE) according to an exploratory factor analysis. Confirmatory factor analyses on the appetite questionnaires were conducted to probe fitting to the model. We computed Cronbach's α coefficients and criterion-referenced/-related validity figures examining associations of the three appetite battery scores with body mass index (BMI) values and with nutrition-related questionnaire values. Test-retest reproducibility of appetite tools was scrutinized over an approximately 2-week interval. An exploratory factor analysis demonstrated that the CNAQ-J was constructed of one factor (appetite), yielding the SNAQ-JE, which includes four questions derived from the CNAQ-J. The three appetite instruments showed almost equivalent fitting to the model and reproducibility. The CNAQ-J and SNAQ-JE demonstrated satisfactory reliability and significant criterion-referenced/-related validity values, including BMIs, but the SNAQ-J included a low factor-loading item, exhibited less satisfactory reliability and had a non-significant relationship to BMI. The CNAQ-J and SNAQ-JE may be applied to assess the appetite of Japanese elderly, including persons with some cognitive impairment. Copyright © 2017 The Authors. Production and hosting by Elsevier B.V. All rights reserved.

Subscores and Validity. Research Report. ETS RR-08-64

ERIC Educational Resources Information Center

Haberman, Shelby J.

2008-01-01

In educational testing, subscores may be provided based on a portion of the items from a larger test. One consideration in evaluation of such subscores is their ability to predict a criterion score. Two limitations on prediction exist. The first, which is well known, is that the coefficient of determination for linear prediction of the criterion…

Planning, Enactment, and Reflection in Inquiry-Based Learning: Validating the McGill Strategic Demands of Inquiry Questionnaire

ERIC Educational Resources Information Center

Shore, Bruce M.; Chichekian, Tanya; Syer, Cassidy A.; Aulls, Mark W.; Frederiksen, Carl H.

2012-01-01

Tools are needed to track the elements of students' successful engagement in inquiry. The "McGill Strategic Demands of Inquiry Questionnaire" (MSDIQ) is a 79-item, criterion-referenced, learner-focused questionnaire anchored in Schon's model and related models of self-regulated learning. The MSDIQ addresses three phases of inquiry…

The Perceived Leadership Communication Questionnaire (PLCQ): Development and Validation.

PubMed

Schneider, Frank M; Maier, Michaela; Lovrekovic, Sara; Retzbach, Andrea

2015-01-01

The Perceived Leadership Communication Questionnaire (PLCQ) is a short, reliable, and valid instrument for measuring leadership communication from both perspectives of the leader and the follower. Drawing on a communication-based approach to leadership and following a theoretical framework of interpersonal communication processes in organizations, this article describes the development and validation of a one-dimensional 6-item scale in four studies (total N = 604). Results from Study 1 and 2 provide evidence for the internal consistency and factorial validity of the PLCQ's self-rating version (PLCQ-SR)-a version for measuring how leaders perceive their own communication with their followers. Results from Study 3 and 4 show internal consistency, construct validity, and criterion validity of the PLCQ's other-rating version (PLCQ-OR)-a version for measuring how followers perceive the communication of their leaders. Cronbach's α had an average of.80 over the four studies. All confirmatory factor analyses yielded good to excellent model fit indices. Convergent validity was established by average positive correlations of.69 with subdimensions of transformational leadership and leader-member exchange scales. Furthermore, nonsignificant correlations with socially desirable responding indicated discriminant validity. Last, criterion validity was supported by a moderately positive correlation with job satisfaction (r =.31).

[Evaluation of Suicide Risk Levels in Hospitals: Validity and Reliability Tests].

PubMed

Macagnino, Sandro; Steinert, Tilman; Uhlmann, Carmen

2018-05-01

Examination of in-hospital suicide risk levels concerning their validity and their reliability. The internal suicide risk levels were evaluated in a cross sectional study of in 163 inpatients. A reliability check was performed via determining interrater-reliability of senior physician, therapist and the responsible nurse. Within the scope of the validity check, we conducted analyses of criterion validity and construct validity. For the total sample an "acceptable" to "good" interrater-reliability (Kendalls W = .77) of suicide risk levels were obtained. Schizophrenic disorders showed the lowest values, for personality disorders we found the highest level of interrater-reliability. When examining the criterion validity, Item-9 of the BDI-II is substantial correlated to our suicide risk levels (ρ m  = .54, p < .01). Within the scope of construct validity check, affective disorders showed the highest correlation (ρ = .77), compatible also with "convergent validity". They differed with schizophrenic disorders which showed the least concordance (ρ = .43). In-hospital suicide risk levels may represent an important contribution to the assessment of suicidal behavior of inpatients experiencing psychiatric treatment due to their overall good validity and reliability. © Georg Thieme Verlag KG Stuttgart · New York.

Age-Neutrality of a Brief Assessment of the Section III Alternative Model for Personality Disorders in Older Adults.

PubMed

Debast, Inge; Rossi, Gina; van Alphen, S P J

2018-04-01

The alternative model for personality disorders in the fifth edition of the Diagnostic and Statistical Manual of Mental Disorders ( DSM-5) is considered an important step toward a possibly better conceptualization of personality pathology in older adulthood, by the introduction of levels of personality functioning (Criterion A) and trait dimensions (Criterion B). Our main aim was to examine age-neutrality of the Short Form of the Severity Indices of Personality Problems (SIPP-SF; Criterion A) and Personality Inventory for DSM-5-Brief Form (PID-5-BF; Criterion B). Differential item functioning (DIF) analyses and more specifically the impact on scale level through differential test functioning (DTF) analyses made clear that the SIPP-SF was more age-neutral (6% DIF, only one of four domains showed DTF) than the PID-5-BF (25% DIF, all four tested domains had DTF) in a community sample of older and younger adults. Age differences in convergent validity also point in the direction of differences in underlying constructs. Concurrent and criterion validity in geriatric psychiatry inpatients suggest that both the SIPP-SF scales measuring levels of personality functioning (especially self-functioning) and the PID-5-BF might be useful screening measures in older adults despite age-neutrality not being confirmed.

The Therapeutic Environment Screening Survey for Nursing Homes (TESS-NH): an observational instrument for assessing the physical environment of institutional settings for persons with dementia.

PubMed

Sloane, Philip D; Mitchell, C Madeline; Weisman, Gerald; Zimmerman, Sheryl; Foley, Kristie M Long; Lynn, Mary; Calkins, Margaret; Lawton, M Powell; Teresi, Jeanne; Grant, Leslie; Lindeman, David; Montgomery, Rhonda

2002-03-01

To develop an observational instrument that describes the ability of physical environments of institutional settings to address therapeutic goals for persons with dementia. A National Institute on Aging workgroup identified and subsequently revised items that evaluated exit control, maintenance, cleanliness, safety, orientation/cueing, privacy, unit autonomy, outdoor access, lighting, noise, visual/tactile stimulation, space/seating, and familiarity/homelikeness. The final instrument contains 84 discrete items and one global rating. A summary scale, the Special Care Unit Environmental Quality Scale (SCUEQS), consists of 18 items. Lighting items were validated using portable light meters. Concurrent criterion validation compared SCUEQS scores with the Professional Environmental Assessment Protocol (PEAP). Interrater kappa statistics for 74% of items were above.60. For another 10% of items, kappas could not be calculated due to empty cells, but interrater agreement was above 80%. The SCUEQS demonstrated an interrater reliability of.93, a test--retest reliability of.88, and an internal consistency of.81--.83. Light meter ratings correlated significantly with the Therapeutic Environment Screening Survey for Nursing Homes (TESS-NH) lighting items (r =.29--.38, p =.01--.04), and the SCUEQS correlated significantly with global PEAP ratings (r =.52, p <.01). The TESS-NH efficiently assesses discrete elements of the physical environment and has strong reliability and validity. The SCUEQS provides a quantitative measure of environmental quality in institutional settings.

[Assessment of the validity and reliability of the processes of change scale based on the transtheoretical model of vegetable consumption behavior in Japanese male workers].

PubMed

Kushida, Osamu; Murayama, Nobuko

2012-12-01

A core construct of the Transtheoretical model is that the processes and stages of change are strongly related to observable behavioral changes. We created the Processes of Change Scale of vegetable consumption behavior and examined the validity and reliability of this scale. In September 2009, a self-administered questionnaire was administered to male Japanese employees, aged 20-59 years, working at 20 worksites in Niigata City in Japan. The stages of change (precontempration, contemplation, preparation, action, and maintenance stage) were measured using 2 items that assessed participants' current implementation of the target behavior (eating 5 or more servings of vegetables per day) and their readiness to change their habits. The Processes of Change Scale of vegetable consumption behavior comprised 10 items assessing 5 cognitive processes (consciousness raising, emotional arousal, environmental reevaluation, self-reevaluation, and social liberation) and 5 behavioral processes (commitment, rewards, helping relationships, countering, and environment control). Each item was selected from an existing scale. Decisional balance (pros [2 items] and cons [2 items]), and self-efficacy (3 items) were also assessed, because these constructs were considered to be relevant to the processes of change. The internal consistency reliability of the scale was examined using Cronbach's alpha. Its construct validity was examined using a factor analysis of the processes of change, decisional balance, and self-efficacy variables, while its criterion-related validity was determined by assessing the association between the scale scores and the stages of change. The data of 527 (out of 600) participants (mean age, 41.1 years) were analyzed. Results indicated that the Processes of Change Scale had sufficient internal consistency reliability (Cronbach's alpha: cognitive processes=0.722, behavioral processes=0.803). The processes of change were divided into 2 factors: "consciousness raising, emotional arousal, environmental reevaluation, self-reevaluation, commitment, rewards, helping relationships, and social liberation" and "countering and environment control" in the factor analysis. Moreover, each construct--the processes of change, decisional balance, and self-efficacy--could be classified into different factors. The scores for cognitive processes were higher in the contemplation and preparation stages than in the precontemplation stage (P<0.05). Scores for behavioral processes increased from the precontemplation stage to the preparation stages (P<0.05), and were higher in the action + maintenance stage than in the precontemplation stage (P< 0.05). For male workers, the Processes of Change Scale has sufficient validity and reliability, as demonstrated by the internal fitness and the construct and criterion-related validity of the scale found in this study.

Reliability and validity of the Tilburg Frailty Indicator (TFI) among Chinese community-dwelling older people.

PubMed

Dong, Lijuan; Liu, Na; Tian, Xiaoyu; Qiao, Xiaoxia; Gobbens, Robbert J J; Kane, Robert L; Wang, Cuili

2017-11-01

To translate the Tilburg Frailty Indicator (TFI) into Chinese and assess its reliability and validity. A sample of 917 community-dwelling older people, aged ≥60 years, in a Chinese city was included between August 2015 and March 2016. Construct validity was assessed using alternative measures corresponding to the TFI items, including self-rated health status (SRH), unintentional weight loss, walking speed, timed-up-and-go tests (TUGT), making telephone calls, grip strength, exhaustion, Short Portable Mental Status Questionnaire (SPMSQ), Geriatric Depression scale (GDS-15), emotional role, Adaptability Partnership Growth Affection and Resolve scale (APGAR) and Social Support Rating Scale (SSRS). Fried's phenotype and frailty index were measured to evaluate criterion validity. Adverse health outcomes (ADL and IADL disability, healthcare utilization, GDS-15, SSRS) were used to assess predictive (concurrent) validity. The internal consistency reliability was good (Cronbach's α=0.71). The test-retest reliability was strong (r=0.88). Kappa coefficients showed agreements between the TFI items and corresponding alternative measures. Alternative measures correlated as expected with the three domains of TFI, with an exclusion that alternative psychological measures had similar correlations with psychological and physical domains of the TFI. The Chinese TFI had excellent criterion validity with the AUCs regarding physical phenotype and frailty index of 0.87 and 0.86, respectively. The predictive (concurrent) validities of the adverse health outcomes and healthcare utilization were acceptable (AUCs: 0.65-0.83). The Chinese TFI has good validity and reliability as an integral instrument to measure frailty of older people living in the community in China. Copyright © 2017 Elsevier B.V. All rights reserved.

Tobacco Use Prevention for the Young (TUPY-S): Development, Validity and Reliability of an Interactive Multimedia Strategy from the Adolescents’ Perspective in Malaysia

PubMed Central

Zin, Faridah Mohd; Hillaluddin, Azlin Hilma; Mustaffa, Jamaludin

2017-01-01

Objective: This study aims to develop, validate and determine the reliability of an interactive multimedia strategy to prevent tobacco use among the young (TUPY-S) from an adolescents’ perspective. Methods: A descriptive study design was utilized. A modular instruction guideline by Russel (1974) was followed in the entire process, comprising a feasibility study, a review of existing modules, specification of the objectives, identification of the construct criterion items, learner analysis and entry behavior specification, establishment of the sequence instruction and media selection, a tryout with students and a field test. Result: Feasibility was agreed among the researchers and the school authorities. Culturally suitable rigorously developed tobacco use preventive strategies delivered using information technology (IT) are lacking in the literature. The objective of TUPY-S is to prevent tobacco use among adolescents living in Malaysia. Identified construct criterion items include knowledge, attitude, intention to use, self-efficacy, and refusal skill. The target population was early adolescents belonging to generation-Z. Content was developed from the adolescents’ perspective and delivered using IT in Malay language. Content validity, assessed by six experts in the field and module development, was good at 86%. The students’ tryout showed satisfactory face validity subjectively and objectively (85.5%) and high alpha Cronbach reliability (0.91). Conclusion: TUPY-S was confirmed to suit early adolescents of the current generation living in Malaysia. It demonstrated good content validity among the experts, satisfactory face validity and reliability among the target population. TUPY-S is ready to be evaluated for its effectiveness among early adolescents. PMID:28612599

The Servant Leadership Survey: Development and Validation of a Multidimensional Measure.

PubMed

van Dierendonck, Dirk; Nuijten, Inge

2011-09-01

PURPOSE: The purpose of this paper is to describe the development and validation of a multi-dimensional instrument to measure servant leadership. DESIGN/METHODOLOGY/APPROACH: Based on an extensive literature review and expert judgment, 99 items were formulated. In three steps, using eight samples totaling 1571 persons from The Netherlands and the UK with a diverse occupational background, a combined exploratory and confirmatory factor analysis approach was used. This was followed by an analysis of the criterion-related validity. FINDINGS: The final result is an eight-dimensional measure of 30 items: the eight dimensions being: standing back, forgiveness, courage, empowerment, accountability, authenticity, humility, and stewardship. The internal consistency of the subscales is good. The results show that the Servant Leadership Survey (SLS) has convergent validity with other leadership measures, and also adds unique elements to the leadership field. Evidence for criterion-related validity came from studies relating the eight dimensions to well-being and performance. IMPLICATIONS: With this survey, a valid and reliable instrument to measure the essential elements of servant leadership has been introduced. ORIGINALITY/VALUE: The SLS is the first measure where the underlying factor structure was developed and confirmed across several field studies in two countries. It can be used in future studies to test the underlying premises of servant leadership theory. The SLS provides a clear picture of the key servant leadership qualities and shows where improvements can be made on the individual and organizational level; as such, it may also offer a valuable starting point for training and leadership development.

V-TECS Criterion-Referenced Test Item Bank for Radiologic Technology Occupations.

ERIC Educational Resources Information Center

Reneau, Fred; And Others

This Vocational-Technical Education Consortium of States (V-TECS) criterion-referenced test item bank provides 696 multiple-choice items and 33 matching items for radiologic technology occupations. These job titles are included: radiologic technologist, chief; radiologic technologist; nuclear medicine technologist; radiation therapy technologist;…

Criterion-Referenced Test Items for Welding.

ERIC Educational Resources Information Center

Davis, Diane, Ed.

This test item bank on welding contains test questions based upon competencies found in the Missouri Welding Competency Profile. Some test items are keyed for multiple competencies. These criterion-referenced test items are designed to work with the Vocational Instructional Management System. Questions have been statistically sampled and validated…

Psychological Flexibility of Nurses in a Cancer Hospital: Preliminary Validation of a Chinese Version of the Work-related Acceptance and Action Questionnaire.

PubMed

Xu, Xianghua; Liu, Xiangyu; Ou, Meijun; Xie, Chanjuan; Chen, Yongyi

2018-01-01

To translate the English work-related acceptance and action questionnaire (WAAQ), make cross-cultural adaptations, and examine its psychometric properties when used by Chinese oncology nurses. After translation, the psychometric properties of the Chinese WAAQ were analyzed among 417 nurses, and content validity was determined by six experts. Item-level content validity index (CVI) values were between 0.83 and 1.00; scale-level CVI/universal agreement (S-CVI/UA) and S-CVI/average were 0.86 and 0.98, respectively, which implicated a good content validity. The correlation of the Chinese WAAQ with AAQ-II ( r s = -0.247, P < 0.001) suggested criterion validity, and those with General Health Questionnaire-12 (-0.250, <0.001) and general self-efficacy scale (0.491, <0.001) and Utrecht work engagement scale (UWES) (0.439, <0.001) suggested convergent validity. Exploratory factor analysis identified a seven-item, one-factor structure of WAAQ. The Chinese version of WAAQ had high internal consistency (Cronbach's α = 0.920), with an item-total correlation coefficient of 0.702-0.828 ( P < 0.05), split-half reliability of 0.933, and test-retest reliability of 0.772. The Chinese WAAQ is a reliable and valid tool for assessing psychological flexibility in Chinese oncology nurses.

The Revised Child Anxiety and Depression Scale 25-Parent Version: Scale Development and Validation in a School-Based and Clinical Sample.

PubMed

Ebesutani, Chad; Korathu-Larson, Priya; Nakamura, Brad J; Higa-McMillan, Charmaine; Chorpita, Bruce

2017-09-01

To help facilitate the dissemination and implementation of evidence-based assessment practices, we examined the psychometric properties of the shortened 25-item version of the Revised Child Anxiety and Depression Scale-parent report (RCADS-25-P), which was based on the same items as the previously published shortened 25-item child version. We used two independent samples of youth-a school sample ( N = 967, Grades 3-12) and clinical sample ( N = 433; 6-18 years)-to examine the factor structure, reliability, and validity of the RCADS-25-P scale scores. Results revealed that the two-factor structure (i.e., depression and broad anxiety factor) fit the data well in both the school and clinical sample. All reliability estimates, including test-retest indices, exceeded benchmark for good reliability. In the school sample, the RCADS-25-P scale scores converged significantly with related criterion measures and diverged with nonrelated criterion measures. In the clinical sample, the RCADS-25-P scale scores successfully discriminated between those with and without target problem diagnoses. In both samples, child-parent agreement indices were in the expected ranges. Normative data were also reported. The RCADS-25-P thus demonstrated robust psychometric properties across both a school and clinical sample as an effective brief screening instrument to assess for depression and anxiety in children and adolescents.

Reliability and Validity of a Japanese-language and Culturally Adapted Version of the Musculoskeletal Tumor Society Scoring System for the Lower Extremity.

PubMed

Iwata, Shintaro; Uehara, Kosuke; Ogura, Koichi; Akiyama, Toru; Shinoda, Yusuke; Yonemoto, Tsukasa; Kawai, Akira

2016-09-01

The Musculoskeletal Tumor Society (MSTS) scoring system is a widely used functional evaluation tool for patients treated for musculoskeletal tumors. Although the MSTS scoring system has been validated in English and Brazilian Portuguese, a Japanese version of the MSTS scoring system has not yet been validated. We sought to determine whether a Japanese-language translation of the MSTS scoring system for the lower extremity had (1) sufficient reliability and internal consistency, (2) adequate construct validity, and (3) reasonable criterion validity compared with the Toronto Extremity Salvage Score (TESS) and SF-36 using psychometric analysis. The Japanese version of the MSTS scoring system was developed using accepted guidelines, which included translation of the English version of the MSTS into Japanese by five native Japanese bilingual musculoskeletal oncology surgeons and integrated into one document. One hundred patients with a diagnosis of intermediate or malignant bone or soft tissue tumors located in the lower extremity and who had undergone tumor resection with or without reconstruction or amputation participated in this study. Reliability was evaluated by test-retest analysis, and internal consistency was established by Cronbach's alpha coefficient. Construct validity was evaluated using the principal factor analysis and Akaike information criterion network. Criterion validity was evaluated by comparing the MSTS scoring system with the TESS and SF-36. Test-retest analysis showed a high intraclass correlation coefficient (0.92; 95% CI, 0.88-0.95), indicating high reliability of the Japanese version of the MSTS scoring system, although a considerable ceiling effect was observed, with 23 patients (23%) given the maximum score. Cronbach's alpha coefficient was 0.87 (95% CI, 0.82-0.90), suggesting a high level of internal consistency. Factor analysis revealed that all items had high loading values and communalities; we identified a central role for the items "walking" and "gait" according to the Akaike information criterion network. The total MSTS score was correlated with that of the TESS (r = 0.81; 95% CI, 0.73-0.87; p < 0.001) and the physical component summary and physical functioning of the SF-36. The Japanese-language translation of the MSTS scoring system for the lower extremity has sufficient reliability and reasonable validity. Nevertheless, the observation of a ceiling effect suggests poor ability of this system to discriminate from among patients who have a high level of function.

Mental health self-management questionnaire: Development and psychometric properties.

PubMed

Coulombe, Simon; Radziszewski, Stephanie; Trépanier, Sarah-Geneviève; Provencher, Hélène; Roberge, Pasquale; Hudon, Catherine; Meunier, Sophie; Provencher, Martin D; Houle, Janie

2015-08-01

Through self-management, people living with depression, anxiety or bipolar disorders can play an active role in their recovery. However, absence of a validated questionnaire limits empirical research on self-management. The study aimed to develop a French instrument, the Mental Health Self-Management Questionnaire (MHSQ), and to investigate its psychometric properties A pool of 86 items was created based on a qualitative study with 50 people in recovery from depression, anxiety or bipolar disorders. The 64 most pertinent items were identified following ratings from 14 experts. A sample of 149 people in recovery completed these items and criterion-related measures (specific aspects of self-management, clinical and personal recovery, social desirability), and 93 participants also completed MHSQ two weeks later Exploratory and confirmatory factor analyses show that MHSQ is composed of three subscales: Clinical (getting help and using resources), Empowerment (building upon strengths and positive self-concept to gain control) and Vitality (active and healthy lifestyle). These subscales had satisfying consistency and test-retest reliability, and were mostly unrelated to social desirability. Correlations with criterion variables support convergent and concurrent validity, especially for Empowerment and Vitality. Comparison of structural models provides evidence of the distinct nature of MHSQ in comparison to the constructs of clinical and personal recovery Longitudinal studies with larger samples are needed to explore the validity of MHSQ for predicting recovery over time MHSQ is a psychometrically-sound instrument, useful for establishing the role of self-management in recovery and monitoring the efficacy of self-management support programs. Copyright © 2015 Elsevier B.V. All rights reserved.

Criterion-Referenced Test Items for Small Engines.

ERIC Educational Resources Information Center

Herd, Amon

This notebook contains criterion-referenced test items for testing students' knowledge of small engines. The test items are based upon competencies found in the Missouri Small Engine Competency Profile. The test item bank is organized in 18 sections that cover the following duties: shop procedures; tools and equipment; fasteners; servicing fuel…

Machine Shop. Criterion-Referenced Test (CRT) Item Bank.

ERIC Educational Resources Information Center

Davis, Diane, Ed.

This drafting criterion-referenced test item bank is keyed to the machine shop competency profile developed by industry and education professionals in Missouri. The 16 references used for drafting the test items are listed. Test items are arranged under these categories: orientation to machine shop; performing mathematical calculations; performing…

Development and validation of a new instrument for testing functional health literacy in Japanese adults.

PubMed

Nakagami, Katsuyuki; Yamauchi, Toyoaki; Noguchi, Hiroyuki; Maeda, Tohru; Nakagami, Tomoko

2014-06-01

This study aimed to develop a reliable and valid measure of functional health literacy in a Japanese clinical setting. Test development consisted of three phases: generation of an item pool, consultation with experts to assess content validity, and comparison with external criteria (the Japanese Health Knowledge Test) to assess criterion validity. A trial version of the test was administered to 535 Japanese outpatients. Internal consistency reliability, calculated by Cronbach's alpha, was 0.81, and concurrent validity was moderate. Receiver Operating Characteristics and Item Response Theory were used to classify patients as having adequate, marginal, or inadequate functional health literacy. Both inadequate and marginal functional health literacy were associated with older age, lower income, lower educational attainment, and poor health knowledge. The time required to complete the test was 10-15 min. This test should enable health workers to better identify patients with inadequate health literacy. © 2013 Wiley Publishing Asia Pty Ltd.

Development, validity and reliability of the short multidimensional positive mental health instrument.

PubMed

Vaingankar, Janhavi Ajit; Subramaniam, Mythily; Abdin, Edimansyah; Picco, Louisa; Chua, Boon Yiang; Eng, Goi Khia; Sambasivam, Rajeswari; Shafie, Saleha; Zhang, Yunjue; Chong, Siow Ann

2014-06-01

The 47-item positive mental health (PMH) instrument measures the level of PMH in multiethnic adult Asian populations. This study aimed to (1) develop a short PMH instrument and (2) establish its validity and reliability among the adult Singapore population. Two separate studies were conducted among adult community-dwelling Singapore residents of Chinese, Malay or Indian ethnicity where participants completed self-administered questionnaires. In the first study, secondary data analysis was conducted using confirmatory factor analysis (CFA) to shorten the PMH instrument. In the second study, the newly developed short PMH instrument and other scales were administered to 201 residents to establish its factor structure, validity and reliability. A 20-item short PMH instrument fulfilling a higher-order six-factor structure was developed following secondary analysis. The mean age of the participants in the second study was 41 years and about 53% were women. One item with poor factor loading was further removed to generate a 19-item version of the PMH instrument. CFA demonstrated a first-order six-factor model of the short PMH instrument. The PMH-19 instrument and its subscales fulfilled criterion validity hypotheses. Internal consistency and test-retest reliability of the PMH-19 instrument were high (Cronbach's α coefficient = 0.87; intraclass correlation coefficient = 0.93, respectively). The 19-item PMH instrument is multidimensional, valid and reliable, and most importantly, with its reduced administration time, the short PMH instrument can be used to measure and evaluate PMH in Asian communities.

Mixed group validation: a method to address the limitations of criterion group validation in research on malingering detection.

PubMed

Frederick, R I

2000-01-01

Mixed group validation (MGV) is offered as an alternative to criterion group validation (CGV) to estimate the true positive and false positive rates of tests and other diagnostic signs. CGV requires perfect confidence about each research participant's status with respect to the presence or absence of pathology. MGV determines diagnostic efficiencies based on group data; knowing an individual's status with respect to pathology is not required. MGV can use relatively weak indicators to validate better diagnostic signs, whereas CGV requires perfect diagnostic signs to avoid error in computing true positive and false positive rates. The process of MGV is explained, and a computer simulation demonstrates the soundness of the procedure. MGV of the Rey 15-Item Memory Test (Rey, 1958) for 723 pre-trial criminal defendants resulted in higher estimates of true positive rates and lower estimates of false positive rates as compared with prior research conducted with CGV. The author demonstrates how MGV addresses all the criticisms Rogers (1997b) outlined for differential prevalence designs in malingering detection research. Copyright 2000 John Wiley & Sons, Ltd.

Psychometric validation of the PROQOL-HIV questionnaire, a new health-related quality of life instrument-specific to HIV disease.

PubMed

Duracinsky, Martin; Lalanne, Christophe; Le Coeur, Sophie; Herrmann, Susan; Berzins, Baiba; Armstrong, Andrew Richard; Lau, Joseph Tak Fai; Fournier, Isabelle; Chassany, Olivier

2012-04-15

This study reports the psychometric validation of a new HIV/AIDS-specific health-related quality of life (HRQL) questionnaire, the Patient Reported Outcomes Quality of Life-HIV. The instrument was developed simultaneously across Europe, North and South America, Africa, Asia, and Australia to assess multidimensional quality of life impairments in the era of highly active antiretroviral therapy. A cross-sectional study was performed in 8 countries. The pilot 70-item questionnaire was co-administered with the HIV symptoms index, the EQ-5D and Medical Outcomes Study-HIV questionnaires. Demographic and biomedical data were collected. After item analysis and reduction, convergent discriminant concurrent validity and known-group validity were examined. Internal consistency and reliability scores were assessed using Cronbach alpha and intraclass correlation. The final sample of 791 patients was composed of 64% males (median age: 41 years, HIV diagnosis = 5 years), 13.8% were treatment naive. Item reduction yielded a 43-item form surveying 8 dimensions and 1 global health item that showed good convergent and discriminant validity and reliability (98% scaling success; Cronbach alphas 0.77-0.89). Correlations with EQ-5D and Medical Outcomes Study-HIV complied with concurrent validity expectations; likewise, correlations against the number of self-reported symptoms and depression showed good support for criterion validity. A test-retest study on French patients (n = 34) showed temporal stability (intraclass correlation coefficient = 0.86). Significant and meaningful differences of HRQL scores between countries were found. The Patient Reported Outcomes Quality of Life-HIV questionnaire is a valid and reliable instrument for assessing HRQL specific to HIV disease in different cultures and healthcare systems.

The validity of the Satisfaction with Life Scale in adolescents and a comparison with single-item life satisfaction measures: a preliminary study.

PubMed

Jovanović, Veljko

2016-12-01

The validity of the life satisfaction measures commonly used among adults has been rarely examined in adolescent samples. The present research had two main goals: (1) to evaluate the structural validity of the Satisfaction with Life Scale (SWLS) among adolescents and to test measurement invariance across gender; (2) to compare the criterion and convergent validity of the SWLS and single-item life satisfaction measures among adolescents. Three samples of Serbian adolescents were recruited for the present research. Study 1 (N = 481, M age  = 17.01 years) examined the structure of the SWLS via confirmatory factor analysis (CFA) and evaluated measurement invariance of the SWLS across gender by a multi-group CFA. Study 2 (N = 283, M age  = 17.34 years) and Study 3 (N = 220, M age  = 16.73 years) compared the convergent validity of the SWLS and single-item life satisfaction measures. The results of Study 1 supported the original one-factor model of the SWLS among adolescents and provided evidence for strong measurement invariance of the SWLS across gender. The findings of Study 2 and Study 3 showed that the SWLS and single-item measures were equally valid and strongly associated (r = .734 in Study 2 and r = .668 in Study 3). No substantial differences in correlations with school success and well-being indicators were found between the SWLS and single-item measures. Our findings support the use of the SWLS among adolescents and indicate that single-item life satisfaction measures perform as well as the SWLS in adolescent samples.

Development and Validation of a Disease-Specific Instrument to Measure Diet-Targeted Quality of Life for Postoperative Patients with Esophagogastric Cancer.

PubMed

Honda, Michitaka; Wakita, Takafumi; Onishi, Yoshihiro; Nunobe, Souya; Miura, Akinori; Nishigori, Tatsuto; Kusanagi, Hiroshi; Yamamoto, Takatsugu; Boddy, Alexander; Fukuhara, Shunichi

2015-12-01

Patients who have undergone esophagectomy or gastrectomy have certain dietary limitations because of changes to the alimentary tract. This study attempted to develop a psychometric scale, named "Esophago-Gastric surgery and Quality of Dietary life (EGQ-D)," for assessment of impact of upper gastrointestinal surgery on diet-targeted quality of life. Using qualitative methods, the study team interviewed both patients and surgeons involved in esophagogastric cancer surgery, and we prepared an item pool and a draft scale. To evaluate the scale's psychometric reliability and validity, a survey involving a large number of patients was conducted. Items for the final scale were selected by factor analysis and item response theory. Cronbach's alpha was used for assessment of reliability, and correlations with the short form (SF)-12, esophagus and stomach surgery symptom scale (ES(4)), and nutritional indicators were analyzed to assess the criterion-related validity. Through multifaceted discussion and the pilot study, a draft questionnaire comprising 14 items was prepared, and a total of 316 patients were enrolled. On the basis of factor analysis and item response theory, six items were excluded, and the remaining eight items demonstrated strong unidimensionality for the final scale. Cronbach's alpha was 0.895. There were significant associations with all the subscale scores for SF-12, ES(4), and nutritional indicators. The EGQ-D scale has good contents and psychometric validity and can be used to evaluate disease-specific instrument to measure diet-targeted quality of life for postoperative patients with esophagogastric cancer.

Measures of Attitudes Toward and Communication about Condom Use: Their Relationships With Sexual Risk Behavior Among Young Black MSM

PubMed Central

Crosby, Richard A.; Graham, Cynthia A.; Yarber, William L.; Sanders, Stephanie A.; Milhausen, Robin R.; Mena, Leandro

2015-01-01

Objective To construct and test measures of psychosocial mediators that could be used in intervention studies seeking to promote safer sex behavior among young Black men who have sex with men (YBMSM). Methods YBMSM (N=400), ages 18–29 years, were recruited from an STI clinic, in the Southern U.S. All men had engaged in penile-anal sex with a male as a “top” in the past 6 months. Men completed an audio-computer assisted self-interview and provided specimens used for NAAT testing to detect Chlamydia and gonorrhea. Four measures were constructed and tested for criterion validity (Safer Sex Communication, Condom Turn-Offs, Condom Pleasure Scale, and a single item assessing frequency of condom use discussions before sexual arousal). Results With the exception of Safer Sex Communication, all of the measures showed criterion validity for both unprotected anal insertive, and unprotected anal receptive sex. With the exception of the Condom Turn-Offs, the three other measures were supported by criterion validity for oral sex. Both the Condom Turn-Offs and Condom Pleasure Scale were significantly related to whether or not men reported multiple partners as a “top” but only the Condom Pleasure Scale was associated with reports of multiple partners as a “bottom.” Only the Condom Turn-Offs Scale was positively associated with having been diagnosed with either Chlamydia or gonorrhea. Conclusion Findings provide three brief scales and a single item that can be used in intervention studies targeting YBMSM. Perceptions about condoms a turn off and about condoms enhancing pleasure showed strong association with sexual risk behaviors. PMID:26766525

Preliminary study of the bilingual version of the self-actualization value subscale of the Personal Orientation Inventory.

PubMed

Palaniappan, A K

1994-12-01

A bilingual version of Shostrom's Self-actualization Value subscale of the Personal Orientation Inventory was administered to 62 Malaysian students. For the 26-item paired-opposite inventory, test-retest reliability over 6 mo. was .39 (for boys .42, for girls .37) and criterion validity was .57. Replication with other groups is recommended.

Exercise barriers self-efficacy: development and validation of a subcale for individuals with cancer-related lymphedema.

PubMed

Buchan, Jena; Janda, Monika; Box, Robyn; Rogers, Laura; Hayes, Sandi

2015-03-18

No tool exists to measure self-efficacy for overcoming lymphedema-related exercise barriers in individuals with cancer-related lymphedema. However, an existing scale measures confidence to overcome general exercise barriers in cancer survivors. Therefore, the purpose of this study was to develop, validate and assess the reliability of a subscale, to be used in conjunction with the general barriers scale, for determining exercise barriers self-efficacy in individuals facing lymphedema-related exercise barriers. A lymphedema-specific exercise barriers self-efficacy subscale was developed and validated using a cohort of 106 cancer survivors with cancer-related lymphedema, from Brisbane, Australia. An initial ten-item lymphedema-specific barrier subscale was developed and tested, with participant feedback and principal components analysis results used to guide development of the final version. Validity and test-retest reliability analyses were conducted on the final subscale. The final lymphedema-specific subscale contained five items. Principal components analysis revealed these items loaded highly (>0.75) on a separate factor when tested with a well-established nine-item general barriers scale. The final five-item subscale demonstrated good construct and criterion validity, high internal consistency (Cronbach's alpha = 0.93) and test-retest reliability (ICC = 0.67, p < 0.01). A valid and reliable lymphedema-specific subscale has been developed to assess exercise barriers self-efficacy in individuals with cancer-related lymphedema. This scale can be used in conjunction with an existing general exercise barriers scale to enhance exercise adherence in this understudied patient group.

Supervisor Health and Safety Support: Scale Development and Validation

PubMed Central

Butts, Marcus M.; Hurst, Carrie S.; Eby, Lillian T.

2013-01-01

Executive Summary Two studies were conducted to develop a psychometrically sound measure of supervisor health and safety support (SHSS). We identified three dimensions of supervisor support (physical health, psychological health, safety) and used Study 1 to develop items and establish content validity. Study 2 was used to establish the dimensionality of the new measure and provide criterion-related and discriminant validity evidence of the measure using supervisor and subordinate data. The measure had incremental validity in predicting employee performance and psychological strain outcomes above and beyond general work support variables. Implications of these findings and for workplace support theory and practice are discussed. PMID:24771991

Validation of the 'Test of the Adherence to Inhalers' (TAI) for Asthma and COPD Patients.

PubMed

Plaza, Vicente; Fernández-Rodríguez, Concepción; Melero, Carlos; Cosío, Borja G; Entrenas, Luís Manuel; de Llano, Luis Pérez; Gutiérrez-Pereyra, Fernando; Tarragona, Eduard; Palomino, Rosa; López-Viña, Antolín

2016-04-01

To validate the 'Test of Adherence to Inhalers' (TAI), a 12-item questionnaire designed to assess the adherence to inhalers in patients with COPD or asthma. A total of 1009 patients with asthma or COPD participated in a cross-sectional multicenter study. Patients with electronic adherence ≥80% were defined as adherents. Construct validity, internal validity, and criterion validity were evaluated. Self-reported adherence was compared with the Morisky-Green questionnaire. Factor analysis study demonstrated two factors, factor 1 was coincident with TAI patient domain (items 1 to 10) and factor 2 with TAI health-care professional domain (items 11 and 12). The Cronbach's alpha was 0.860 and the test-retest reliability 0.883. TAI scores correlated with electronic adherence (ρ=0.293, p=0.01). According to the best cut-off for 10 items (score 50, area under the ROC curve 0.7), 569 (62.5%) patients were classified as non-adherents. The non-adherence behavior pattern was: erratic 527 (57.9%), deliberate 375 (41.2%), and unwitting 242 (26.6%) patients. As compared to Morisky-Green test, TAI showed better psychometric properties. The TAI is a reliable and homogeneous questionnaire to identify easily non-adherence and to classify from a clinical perspective the barriers related to the use of inhalers in asthma and COPD.

Statistical Learning Theory for High Dimensional Prediction: Application to Criterion-Keyed Scale Development

PubMed Central

Chapman, Benjamin P.; Weiss, Alexander; Duberstein, Paul

2016-01-01

Statistical learning theory (SLT) is the statistical formulation of machine learning theory, a body of analytic methods common in “big data” problems. Regression-based SLT algorithms seek to maximize predictive accuracy for some outcome, given a large pool of potential predictors, without overfitting the sample. Research goals in psychology may sometimes call for high dimensional regression. One example is criterion-keyed scale construction, where a scale with maximal predictive validity must be built from a large item pool. Using this as a working example, we first introduce a core principle of SLT methods: minimization of expected prediction error (EPE). Minimizing EPE is fundamentally different than maximizing the within-sample likelihood, and hinges on building a predictive model of sufficient complexity to predict the outcome well, without undue complexity leading to overfitting. We describe how such models are built and refined via cross-validation. We then illustrate how three common SLT algorithms–Supervised Principal Components, Regularization, and Boosting—can be used to construct a criterion-keyed scale predicting all-cause mortality, using a large personality item pool within a population cohort. Each algorithm illustrates a different approach to minimizing EPE. Finally, we consider broader applications of SLT predictive algorithms, both as supportive analytic tools for conventional methods, and as primary analytic tools in discovery phase research. We conclude that despite their differences from the classic null-hypothesis testing approach—or perhaps because of them–SLT methods may hold value as a statistically rigorous approach to exploratory regression. PMID:27454257

Electronics. Criterion-Referenced Test (CRT) Item Bank.

ERIC Educational Resources Information Center

Davis, Diane, Ed.

This document contains 519 criterion-referenced multiple choice and true or false test items for a course in electronics. The test item bank is designed to work with both the Vocational Instructional Management System (VIMS) and the Vocational Administrative Management System (VAMS) in Missouri. The items are grouped into 15 units covering the…

Auto Mechanics. Criterion-Referenced Test (CRT) Item Bank.

ERIC Educational Resources Information Center

Tannehill, Dana, Ed.

This document contains 546 criterion-referenced multiple choice and true or false test items for a course in auto mechanics. The test item bank is designed to work with both the Vocational Instructional Management System (VIMS) and Vocational Administrative Management System (VAMS) in Missouri. The items are grouped into 35 units covering the…

Development and validation of a brief trauma screening measure for children: The Child Trauma Screen.

PubMed

Lang, Jason M; Connell, Christian M

2017-05-01

Childhood exposure to trauma, including violence and abuse, is a major public health concern that has resulted in increased efforts to promote trauma-informed child-serving systems. Trauma screening is an important component of such trauma-informed systems, yet widespread use of trauma screening is rare in part due to the lack of brief, validated trauma screening measures for children. We describe development and validation of the Child Trauma Screen (CTS), a 10-item screening measure of trauma exposure and posttraumatic stress disorder (PTSD) symptoms for children consistent with the DSM-5 definition of PTSD. Study 1 describes measure development incorporating analysis to derive items based on existing measures from 1,065 children and caregivers together with stakeholder input to finalize item selection. Study 2 describes validation of the CTS with a clinical sample of 74 children and their caregivers. Results support the CTS as an empirically derived, reliable measure to screen children for trauma exposure and PTSD symptoms with strong convergent, divergent, and criterion validity. The CTS is a promising measure for rapidly and reliably screening children for trauma exposure and PTSD symptoms. Future research is needed to confirm validation and to examine feasibility and utility of its use across various child-serving systems. (PsycINFO Database Record (c) 2017 APA, all rights reserved).

Development of a Microsoft Excel tool for applying a factor retention criterion of a dimension coefficient to a survey on patient safety culture.

PubMed

Chien, Tsair-Wei; Shao, Yang; Jen, Dong-Hui

2017-10-27

Many quality-of-life studies have been conducted in healthcare settings, but few have used Microsoft Excel to incorporate Cronbach's α with dimension coefficient (DC) for describing a scale's characteristics. To present a computer module that can report a scale's validity, we manipulated datasets to verify a DC that can be used as a factor retention criterion for demonstrating its usefulness in a patient safety culture survey (PSC). Microsoft Excel Visual Basic for Applications was used to design a computer module for simulating 2000 datasets fitting the Rasch rating scale model. The datasets consisted of (i) five dual correlation coefficients (correl. = 0.3, 0.5, 0.7, 0.9, and 1.0) on two latent traits (i.e., true scores) following a normal distribution and responses to their respective 1/3 and 2/3 items in length; (ii) 20 scenarios of item lengths from 5 to 100; and (iii) 20 sample sizes from 50 to 1000. Each item containing 5-point polytomous responses was uniformly distributed in difficulty across a ± 2 logit range. Three methods (i.e., dimension interrelation ≥0.7, Horn's parallel analysis (PA) 95% confidence interval, and individual random eigenvalues) were used for determining one factor to retain. DC refers to the binary classification (1 as one factor and 0 as many factors) used for examining accuracy with the indicators sensitivity, specificity, and area under receiver operating characteristic curve (AUC). The scale's reliability and DC were simultaneously calculated for each simulative dataset. PSC real data were demonstrated with DC to interpret reports of the unit-based construct validity using the author-made MS Excel module. The DC method presented accurate sensitivity (=0.96), specificity (=0.92) with a DC criterion (≥0.70), and AUC (=0.98) that were higher than those of the two PA methods. PA combined with DC yielded good sensitivity (=0.96), specificity (=1.0) with a DC criterion (≥0.70), and AUC (=0.99). Advances in computer technology may enable healthcare users familiar with MS Excel to apply DC as a factor retention criterion for determining a scale's unidimensionality and evaluating a scale's quality.

Construct and Criterion Validity of the PedsQL™ 4.0 Instrument (Pediatric Quality of Life Inventory) in Colombia.

PubMed

Amaya-Arias, Ana Carolina; Alzate, Juan Pablo; Eslava-Schmalbach, Javier H

2017-01-01

This study aimed at determining the validity of the Pediatric Quality of Life Inventory 4.0 (PedsQL™ 4.0) for the measurement of health-related quality of life (HRQOL) in Colombian children. Validation study of measurement instruments. The PedsQL™ 4.0 was applied by convenience sampling to 375 pairs of children and adolescents between the ages of 5 and 17 and to their parents-caregivers, as well as to 125 parents-caregivers of children between the ages of 2 and 4 in five cities of Colombia (Bogota, Medellin, Cali, Barranquilla and Bucaramanga). Construct validity was assessed through the use of exploratory and confirmatory factor analysis, and criterion validity was assessed by correlations between the PedsQL™ 4.0 and the KIDSCREEN-27. The instrument was applied to 375 children (ages 5-18) and 125 parents of children between the ages of 2 and 4. Factor analysis revealed four factors considered suitable for the sample in both the child and parent reports, whereas Bartlett's test of sphericity showed inter-correlation between variables. Scale and subscales showed proper indicators of internal consistency. It is recommended not to include or review some of the items in the Colombian version of the scale. The Spanish version for Colombia of the PedsQL™ 4.0 displays suitable indicators of criterion and construct validity, therefore becoming a valuable tool for measuring HRQOL in children in our country. Some modifications are recommended for the Colombian version of the scale.

Sources of self-efficacy belief: development and validation of two scales.

PubMed

Liu, Ou Lydia; Wilson, Mark

2010-01-01

Self-efficacy belief has been an instrumental affective factor in predicting student behavior and achievement in academic settings. Although there is abundant literature on efficacy belief per se, the sources of efficacy belief have not been fully researched. Very few instruments exist to quantify the sources of efficacy-beliefs. To fill this void, we developed two scales for the two main sources of self-efficacy belief: past performance and social persuasion. Pilot test data were collected from 255 middle school students. A self-efficacy measure was also administered to the students as a criterion measure. The Rasch rating scale model was used to analyze the data. Information on item fit, item design, content validity, external validity, internal consistency, and person separation reliability was examined. The two scales displayed satisfactory psychometric properties. Applications and limitations of these two scales are also discussed.

The development of the Adolescent Nervios Scale: preliminary findings.

PubMed

Livanis, Andrew; Tryon, Georgiana Shick

2010-01-01

This paper details the construction of a scale to measure the culture-bound syndrome of nervios in Latino early adolescents, ages 11 to 14. Informed by nervios literature and experts, we developed the 31-item Adolescent Nervios Scale (ANS) with items comprised of symptoms representing various psychiatric conditions common to Western culture. In contrast to 277 non-Latino early adolescents who responded to the items as representing disparate constructs, 307 Latino early adolescents responded to ANS items in a unitary fashion. For Latino early adolescents, the ANS demonstrated good internal consistency and stability as well as concurrent, discriminative, and criterion-based validity. The results support the measurement of nervios and its relationship to the school performance and adjustment of Latino youth. (PsycINFO Database Record (c) 2009 APA, all rights reserved).

Indonesian teacher engagement index: a rasch model analysis

NASA Astrophysics Data System (ADS)

Sasmoko; Abbas, B. S.; Indrianti, Y.; Widhoyoko, S. A.

2018-01-01

The research aimed to calibrate Indonesian Teacher Engagement Index (ITEI) using instrument with RASCH MODEL. The respondents were 672 teachers of elementary, junior high, high school and vocational school. The number of items planned was 165 items with the initial reliability of 0.98. The ITEI scale uses Likert Scale (1 to 4) which was converted from ordinal scale to Equal Interval Scale. RASCH MODEL analysis was done by selecting based on Outfit Mean Square (MNSQ) between 0.5-1.5 as a good item, and measuring Point Measure Correlation (Pt Mean Corr) with the criterion of 0.4-0.85. Moderate Outfit Z-Standard (ZSTD) was ignored because the sample was >500. Conclusions: ITEI is valid with 30 items and reliability of 0.97, and less engage teachers significantly at α <0.05.

from the Adolescents’ Perspective in Malaysia

PubMed

Mohd Zin, Faridah; Hillaluddin, Azlin Hilma; Mustaffa, Jamaludin

2017-05-01

Objective: This study aims to develop, validate and determine the reliability of an interactive multimedia strategy to prevent tobacco use among the young (TUPY-S) from an adolescents’ perspective. Methods: A descriptive study design was utilized. A modular instruction guideline by Russel (1974) was followed in the entire process, comprising a feasibility study, a review of existing modules, specification of the objectives, identification of the construct criterion items, learner analysis and entry behavior specification, establishment of the sequence instruction and media selection, a tryout with students and a field test. Result: Feasibility was agreed among the researchers and the school authorities. Culturally suitable rigorously developed tobacco use preventive strategies delivered using information technology (IT) are lacking in the literature. The objective of TUPY-S is to prevent tobacco use among adolescents living in Malaysia. Identified construct criterion items include knowledge, attitude, intention to use, self-efficacy, and refusal skill. The target population was early adolescents belonging to generation-Z. Content was developed from the adolescents’ perspective and delivered using IT in Malay language. Content validity, assessed by six experts in the field and module development, was good at 86%. The students’ tryout showed satisfactory face validity subjectively and objectively (85.5%) and high alpha Cronbach reliability (0.91). Conclusion: TUPY-S was confirmed to suit early adolescents of the current generation living in Malaysia. It demonstrated good content validity among the experts, satisfactory face validity and reliability among the target population. TUPY-S is ready to be evaluated for its effectiveness among early adolescents. Creative Commons Attribution License

Measuring social impacts of breast carcinoma treatment in Chinese women.

PubMed

Fielding, Richard; Lam, Wendy W T

2004-06-15

There is no existing instrument that is suitable for measuring the social impact of breast carcinoma (BC) and its treatment among women of Southern Chinese descent. In the current study, the authors assessed the validity of the Chinese Social Adjustment Scale, which was designed to address the need for such an instrument. Five dimensions of social concern were identified in a previous study of Cantonese-speaking Chinese women with BC; these dimensions were family and other relationships, intimacy, private self-image, and public self-image. The authors designed 40 items to address perceptions of change in these areas. These items were administered to a group of 226 women who had received treatment for BC, and factor analysis subsequently was performed to determine construct characteristics. The resulting draft instrument then was administered, along with other measures for the assessment of basic psychometric properties, to a second group of 367 women who recently had undergone surgery for BC. Factor analysis optimally identified 5 factors (corresponding to 33 items): 1) Relationships with Family (10 items, accounting for 22% of variance); 2) Self-Image (7 items, accounting for 15% of variance); 3) Relationships with Friends (7 items, accounting for 8% of variance); 4) Social Enjoyment (4 items, accounting for 6% of variance); and 5) Attractiveness and Sexuality (5 items, accounting for 5% of variance). Subscales were reliable (alpha = 0.63-0.93) and exhibited convergent validity in positive correlations with related measures and divergent validity in appropriate inverse or nonsignificant correlations with other measures. Criterion validity was good, and sensitivity was acceptable. Patterns of change on the scales were consistent with reports in the literature. Self-administration resulted in improved sensitivity. The 33-item Chinese Social Adjustment Scale validly, reliably, and sensitively measures the social impact of BC on Cantonese-speaking Hong Kong Chinese women. Further development of the scale to increase its sensitivity is underway. Copyright 2004 American Cancer Society.

Refinement and partial validation of the UNESP-Botucatu multidimensional composite pain scale for assessing postoperative pain in horses.

PubMed

Taffarel, Marilda Onghero; Luna, Stelio Pacca Loureiro; de Oliveira, Flavia Augusta; Cardoso, Guilherme Schiess; Alonso, Juliana de Moura; Pantoja, Jose Carlos; Brondani, Juliana Tabarelli; Love, Emma; Taylor, Polly; White, Kate; Murrell, Joanna C

2015-04-01

Quantification of pain plays a vital role in the diagnosis and management of pain in animals. In order to refine and validate an acute pain scale for horses a prospective, randomized, blinded study was conducted. Twenty-four client owned adult horses were recruited and allocated to one of four following groups: anaesthesia only (GA); pre-emptive analgesia and anaesthesia (GAA,); anaesthesia, castration and postoperative analgesia (GC); or pre-emptive analgesia, anaesthesia and castration (GCA). One investigator, unaware of the treatment group, assessed all horses at time-points before and after intervention and completed the pain scale. Videos were also obtained at these time-points and were evaluated by a further four blinded evaluators who also completed the scale. The data were used to investigate the relevance, specificity, criterion validity and inter- and intra-observer reliability of each item on the pain scale, and to evaluate construct validity and responsiveness of the scale. Construct validity was demonstrated by the observed differences in scores between the groups, four hours after anaesthetic recovery and before administration of systemic analgesia in the GC group. Inter- and intra-observer reliability for the items was only satisfactory. Subsequently the pain scale was refined, based on results for relevance, specificity and total item correlation. Scale refinement and exclusion of items that did not meet predefined requirements generated a selection of relevant pain behaviours in horses. After further validation for reliability, these may be used to evaluate pain under clinical and experimental conditions.

Psychometric properties of the Chinese version of the Menopause-Specific Quality-of-Life questionnaire

PubMed Central

Nie, Guangning; Yang, Hongyan; Liu, Jian; Zhao, ChunMei; Wang, Xiaoyun

2017-01-01

Abstract Objective: The Menopause-Specific Quality-of-Life (MENQOL) questionnaire was developed as a specific tool to measure the health-related quality-of-life of postmenopausal women. Thus far, the Chinese version questionnaire has not been subjected to psychometric assessment with a large sample. This study aims to evaluate the validity and reliability of the Chinese version of the MENQOL specific to postmenopausal women in China. Methods: A total of 1,137 menopausal symptomatic and 491 menopausal asymptomatic women from eight cities in China were recruited using a convenience sampling method. Psychometric properties were evaluated by descriptive statistics, validity, and reliability. Reliability was assessed for each subscale of the MENQOL through internal consistency reliability with Cronbach's α and intersubscale correlations. Item-domain correlations, principal components analysis (PCA), and confirmatory factor analysis were performed to determine construct validity. t tests were used to compare the differences between the menopausal symptomatic and asymptomatic women and to evaluate the discriminate validity. Pearson correlation coefficients were calculated between MENQOL scores and the Kupperman index to assess criterion-related validity. Results: The most common symptoms in Chinese menopausal symptomatic women were “experiencing poor memory” (94.4%), “feeling tired or worn out” (93.8%), “aching in muscle and joints” (89.4%), “low backache” (86.9%), “decrease in physical strength” (86.6%), “aches in back of neck or head” (86.2%), “difficulty sleeping” (83.6%), “accomplishing less than I used to” (83.4%), “feeling a lack of energy” (83.3%), “change in your sexual desire” (81%), and “hot flash” (80.7%) among others. The symptoms of “increased facial hair” were rarely seen (9.9%). The vasomotor domain, as well as psychosocial, physical, and sexual domains showed high reliability (Cronbach's α 0.84, 0.87, 0.89, and 0.86, respectively). Item-domain correlation analysis showed that all items correlated more strongly with their own domains than with other domains. In the PCA, after deleting the “increased facial hair” item, items in the vasomotor, sexual, and psychosocial subscales loaded on their respective domains by and large, and items in the physical subscale divided into two factors. The PCA revealed a latent structure of the Chinese version of MENQOL nearly identical to the original MENQOL domains. The confirmatory factor analysis demonstrated that the questionnaire fits well with a four-domain model. The MENQOL can discriminate between menopausal symptomatic women with asymptomatic women as it showed good discriminate validity. Criterion-related validity was confirmed by a significant correlation between MENQOL scores and the Kupperman index. Conclusions: This study showed that Chinese version of MENQOL has good psychometric properties and would be suitable to measure the health-related quality-of-life of Chinese menopausal women except for item 21 (increased facial hair). PMID:27922934

Assessment scale of risk for surgical positioning injuries 1

PubMed Central

Lopes, Camila Mendonça de Moraes; Haas, Vanderlei José; Dantas, Rosana Aparecida Spadoti; de Oliveira, Cheila Gonçalves; Galvão, Cristina Maria

2016-01-01

ABSTRACT Objective: to build and validate a scale to assess the risk of surgical positioning injuries in adult patients. Method: methodological research, conducted in two phases: construction and face and content validation of the scale and field research, involving 115 patients. Results: the Risk Assessment Scale for the Development of Injuries due to Surgical Positioning contains seven items, each of which presents five subitems. The scale score ranges between seven and 35 points in which, the higher the score, the higher the patient's risk. The Content Validity Index of the scale corresponded to 0.88. The application of Student's t-test for equality of means revealed the concurrent criterion validity between the scores on the Braden scale and the constructed scale. To assess the predictive criterion validity, the association was tested between the presence of pain deriving from surgical positioning and the development of pressure ulcer, using the score on the Risk Assessment Scale for the Development of Injuries due to Surgical Positioning (p<0.001). The interrater reliability was verified using the intraclass correlation coefficient, equal to 0.99 (p<0.001). Conclusion: the scale is a valid and reliable tool, but further research is needed to assess its use in clinical practice. PMID:27579925

A Brief Measure of Narcissism Among Female Juvenile Delinquents and Community Youths: The Narcissistic Personality Inventory-13.

PubMed

Pechorro, Pedro; Maroco, João; Ray, James V; Gonçalves, Rui Abrunhosa; Nunes, Cristina

2018-06-01

Research on narcissism has a long tradition, but there is limited knowledge regarding its application among female youth, especially for forensic samples of incarcerated female youth. Drawing on 377 female adolescents (103 selected from forensic settings and 274 selected from school settings) from Portugal, the current study is the first to examine simultaneously the psychometric properties of a brief version of the Narcissistic Personality Inventory (NPI-13) among females drawn from incarcerated and community settings. The results support the three-factor structure model of narcissism after the removal of one item due to its low factor loading. Internal consistency, convergent validity, and discriminant validity showed promising results. In terms of criterion-related validity, significant associations were found with criterion-related variables such as age of criminal onset, conduct disorder, crime severity, violent crimes, and alcohol and drug use. The findings provide support for use of the NPI-13 among female juveniles.

Measuring quality of life in low-income, Spanish-speaking Puerto Ricans with type 2 diabetes residing in the mainland U.S.

PubMed

Lemon, Stephenie C; Rosal, Milagros C; Welch, Garry

2011-11-01

This study assessed the psychometric properties of the Audit of Diabetes-Dependent Quality of Life (ADDQoL) modified for low-income, low-education, Spanish-speaking Puerto Ricans with type 2 diabetes residing in the northeastern United States. Cross-sectional data from 226 patients were analyzed. Scale modifications included simplification of instructions, question wording and response format, and oral administration. Reliability was assessed with Cronbach's alpha coefficient and internal structure by exploratory factor analysis. Criterion validity was assessed using correlation analysis and linear and logistic regression models assessing the association of the ADDQoL with standardized physical health status, mental health status, depression, and comorbidity indices. Two ADDQoL items were dropped. The modified scale had excellent internal consistency and supported the original scale factor structure. Criterion validity results supported the validity of this measure. The modified ADDQoL showed psychometric properties that support its use in low-income, Spanish-speaking Puerto Ricans with type 2 diabetes who reside in mainland U.S.

Identifying dyspepsia in the Greek population: translation and validation of a questionnaire.

PubMed

Anastasiou, Foteini; Antonakis, Nikos; Chaireti, Georgia; Theodorakis, Pavlos N; Lionis, Christos

2006-03-04

Studies on clinical issues, including diagnostic strategies, are considered to be the core content of general practice research. The use of standardised instruments is regarded as an important component for the development of Primary Health Care research capacity. Demand for epidemiological cross-cultural comparisons in the international setting and the use of common instruments and definitions valid to each culture is bigger than ever. Dyspepsia is a common complaint in primary practice but little is known with respect to its incidence in Greece. There are some references about the Helicobacter Pylori infection in patients with functional dyspepsia or gastric ulcer in Greece but there is no specific instrument for the identification of dyspepsia. This paper reports on the validation and translation into Greek, of an English questionnaire for the identification of dyspepsia in the general population and discusses several possibilities of its use in the Greek primary care. The selected English postal questionnaire for the identification of people with dyspepsia in the general population consists of 30 items and was developed in 1995. The translation and cultural adaptation of the questionnaire has been performed according to international standards. For the validation of the instrument the internal consistency of the items was established using the alpha coefficient of Chronbach, the reproducibility (test - retest reliability) was measured by kappa correlation coefficient and the criterion validity was calculated against the diagnosis of the patients' records using also kappa correlation coefficient. The final Greek version of the postal questionnaire for the identification of dyspepsia in the general population was reliably translated. The internal consistency of the questionnaire was good, Chronbach's alpha was found to be 0.88 (95% CI: 0.81-0.93), suggesting that all items were appropriate to measure. Kappa coefficient for reproducibility (test - retest reliability) was found 0.66 (95% CI: 0.62-0.71), whereas the kappa analysis for criterion validity was 0.63 (95% CI: 0.36-0.89). This study indicates that the Greek translation is comparable with the English-language version in terms of validity and reliability, and is suitable for epidemiological research within the Greek primary health care setting.

Is the Simple Shoulder Test a valid outcome instrument for shoulder arthroplasty?

PubMed

Hsu, Jason E; Russ, Stacy M; Somerson, Jeremy S; Tang, Anna; Warme, Winston J; Matsen, Frederick A

2017-10-01

The Simple Shoulder Test (SST) is a brief, inexpensive, and widely used patient-reported outcome tool, but it has not been rigorously evaluated for patients having shoulder arthroplasty. The goal of this study was to rigorously evaluate the validity of the SST for outcome assessment in shoulder arthroplasty using a systematic review of the literature and an analysis of its properties in a series of 408 surgical cases. SST scores, 36-Item Short Form Health Survey scores, and satisfaction scores were collected preoperatively and 2 years postoperatively. Responsiveness was assessed by comparing preoperative and 2-year postoperative scores. Criterion validity was determined by correlating the SST with the 36-Item Short Form Health Survey. Construct validity was tested through 5 clinical hypotheses regarding satisfaction, comorbidities, insurance status, previous failed surgery, and narcotic use. Scores after arthroplasty improved from 3.9 ± 2.8 to 10.2 ± 2.3 (P < .001). The change in SST correlated strongly with patient satisfaction (P < .001). The SST had large Cohen's d effect sizes and standardized response means. Criterion validity was supported by significant differences between satisfied and unsatisfied patients, those with more severe and less severe comorbidities, those with workers' compensation or Medicaid and other types of insurance, those with and without previous failed shoulder surgery, and those taking and those not taking narcotic pain medication before surgery (P < .005). These data combined with a systematic review of the literature demonstrate that the SST is a valid and responsive patient-reported outcome measure for assessing the outcomes of shoulder arthroplasty. Copyright © 2017 Journal of Shoulder and Elbow Surgery Board of Trustees. Published by Elsevier Inc. All rights reserved.

Measuring the emotional climate of an organization.

PubMed

Yurtsever, Gülçimen; De Rivera, Joseph

2010-04-01

The importance of emotional climate in the organizational climate literature has gained interest. However, few studies have concentrated on adequately measuring the emotional climate of organizations. In this study, a reliable and valid scale was developed to measure the most important aspects of emotional climate in different organizations. This study presents evidence of reliability and validity for 28 items constructed to measure emotional climate in an organization in four separate studies. The data were obtained from working people from four different organizations by self-administered questionnaires. The findings indicate that three factors--Trust, Hope, and Security--were factors of the 28-item scale. Validation data also included correlations with duration of employment. The other method of assessing criterion validity was by comparing mean scores in organizations with differing productivity; results indicated that the organization with more productive members had a significantly higher mean score on emotional climate and its subscales. The generalizability of the results to private businesses also was assessed.

Psychological Flexibility of Nurses in a Cancer Hospital: Preliminary Validation of a Chinese Version of the Work-related Acceptance and Action Questionnaire

PubMed Central

Xu, Xianghua; Liu, Xiangyu; Ou, Meijun; Xie, Chanjuan; Chen, Yongyi

2018-01-01

Objective: To translate the English work-related acceptance and action questionnaire (WAAQ), make cross-cultural adaptations, and examine its psychometric properties when used by Chinese oncology nurses. Methods: After translation, the psychometric properties of the Chinese WAAQ were analyzed among 417 nurses, and content validity was determined by six experts. Results: Item-level content validity index (CVI) values were between 0.83 and 1.00; scale-level CVI/universal agreement (S-CVI/UA) and S-CVI/average were 0.86 and 0.98, respectively, which implicated a good content validity. The correlation of the Chinese WAAQ with AAQ-II (rs = −0.247, P < 0.001) suggested criterion validity, and those with General Health Questionnaire-12 (−0.250, <0.001) and general self-efficacy scale (0.491, <0.001) and Utrecht work engagement scale (UWES) (0.439, <0.001) suggested convergent validity. Exploratory factor analysis identified a seven-item, one-factor structure of WAAQ. The Chinese version of WAAQ had high internal consistency (Cronbach's α = 0.920), with an item-total correlation coefficient of 0.702–0.828 (P < 0.05), split-half reliability of 0.933, and test-retest reliability of 0.772. Conclusions: The Chinese WAAQ is a reliable and valid tool for assessing psychological flexibility in Chinese oncology nurses. PMID:29379839

A new instrument to measure quality of life of heart failure family caregivers.

PubMed

Nauser, Julie A; Bakas, Tamilyn; Welch, Janet L

2011-01-01

Family caregivers of heart failure (HF) patients experience poor physical and mental health leading to poor quality of life. Although several quality-of-life measures exist, they are often too generic to capture the unique experience of this population. The purpose of this study was to evaluate the psychometric properties of the Family Caregiver Quality of Life (FAMQOL) Scale that was designed to assess the physical, psychological, social, and spiritual dimensions of quality of life among caregivers of HF patients. Psychometric testing of the FAMQOL with 100 HF family caregivers was conducted using item analysis, Cronbach α, intraclass correlation, factor analysis, and hierarchical multiple regression guided by a conceptual model. Caregivers were predominately female (89%), white, (73%), and spouses (62%). Evidence of internal consistency reliability (α=.89) was provided for the FAMQOL, with item-total correlations of 0.39 to 0.74. Two-week test-retest reliability was supported by an intraclass correlation coefficient of 0.91. Using a 1-factor solution and principal axis factoring, loadings ranged from 0.31 to 0.78, with 41% of the variance explained by the first factor (eigenvalue=6.5). With hierarchical multiple regression, 56% of the FAMQOL variance was explained by model constructs (F8,91=16.56, P<.001). Criterion-related validity was supported by correlations with SF-36 General (r=0.45, P<.001) and Mental (r=0.59, P<.001) Health subscales and Bakas Caregiving Outcomes Scale (r=0.73, P<.001). Evidence of internal and test-retest reliability and construct and criterion validity was provided for physical, psychological, and social well-being subscales. The 16-item FAMQOL is a brief, easy-to-administer instrument that has evidence of reliability and validity in HF family caregivers. Physical, psychological, and social well-being can be measured with 4-item subscales. The FAMQOL scale could serve as a valuable measure in research, as well as an assessment tool to identify caregivers in need of intervention.

An acute cough-specific quality-of-life questionnaire for children: Development and validation.

PubMed

Anderson-James, Sophie; Newcombe, Peter A; Marchant, Julie M; O'Grady, Kerry-Ann F; Acworth, Jason P; Stone, D Grant; Turner, Catherine T; Chang, Anne B

2015-05-01

Patient-relevant outcome measures are essential for high-quality clinical research, and quality-of-life (QoL) tools are the current standard. Currently, there is no validated children's acute cough-specific QoL questionnaire. The objective of this study was to develop and validate the Parent-proxy Children's Acute Cough-specific QoL Questionnaire (PAC-QoL). Using focus groups, a 48-item PAC-QoL questionnaire was developed and later reduced to 16 items by using the clinical impact method. Parents of children with a current acute cough (<2 weeks) at enrollment completed 2 validated cough score measures, the preliminary 48-item PAC-QoL, and 3 other questionnaires (the State Trait Anxiety Inventory [STAI], the Short-Form 8-item 24-hour recall Health Survey [SF-8], and the Depression, Anxiety, and Stress 21-item Scale [DASS21]). All measures were repeated on days 3 and 14. The median age of the 155 children enrolled was 2.3 years (interquartile range, 1.3-4.6). Median cough duration at enrollment was 3 days (interquartile range, 2-5). The reduced 16-item scale had high internal consistency (Cronbach α = 0.95). Evidence for repeatability and criterion validity was shown by significant correlations between the domains and total PAC-QoL scores and the SF-8 (r = -0.36 and -0.51), STAI (r = -0.27 and -0.39), and DASS21 (r = -0.32 and -0.41) scales on days 0 and 3, respectively. The final PAC-QoL questionnaire was sensitive to change over time, with changes significantly relating to changes in cough score measures (P < .001). The 16-item PAC-QoL is a reliable and valid outcome measure that assesses QoL related to childhood acute cough at a given time point and reflects changes in acute cough-specific QoL over time. Copyright © 2014 American Academy of Allergy, Asthma & Immunology. Published by Elsevier Inc. All rights reserved.

Validating the Demand Control Support Questionnaire among white-collar employees in Switzerland and the United States.

PubMed

Mauss, Daniel; Herr, Raphael M; Theorell, Töres; Angerer, Peter; Li, Jian

2018-01-01

The Demand Control Support Questionnaire (DCSQ) is an established self-reported tool to measure a stressful work environment. Validated German and English versions are however currently missing. The aim of this study was therefore to evaluate the psychometric properties of German and English versions of the DCSQ among white-collar employees in Switzerland and the US. This cross-sectional study was carried out on 499 employees in Switzerland and 411 in the US, respectively. The 17-item DCSQ with three scales assessed psychosocial stress at work (psychological demands, decision latitude, and social support at work). Depressive symptoms were measured by the 2-item Patient Health Questionnaire. Cronbach's α and item-total correlations tested the scale reliability (internal consistency). Construct validity of the questionnaire was examined using exploratory factor analysis (EFA). Logistic regressions estimated associations of each scale and job strain with depressive symptoms (criterion validity). In both samples, all DCSQ scales presented satisfactory internal consistency (Cronbach's α ≥ 0.72; item-total correlations ≥ 0.33), and EFA showed the 17 items loading on three factors, which is in line with the theoretically assumed structure of the DCSQ construct. Moreover, all three scales as well as high job strain were significantly associated with depressive symptoms. The associations were stronger in the US sample. The German and the English versions of the DCSQ seem to be reliable and valid instruments to measure psychosocial stress based on the job demand-control-support model in the workplace of white-collar employees in Switzerland and the US.

Cigarette dependence questionnaire: development and psychometric testing with male smokers.

PubMed

Huang, Chih-Ling; Lin, Hsi-Hui; Wang, Hsiu-Hung

2010-10-01

This paper is a report of a study conducted to develop and test a theoretically derived Cigarette Dependence Questionnaire for adult male smokers. Fagerstrom questionnaires have been used worldwide to assess cigarette dependence. However, these assessments lack any theoretical perspective. A theory-based approach is needed to ensure valid assessment. In 2007, an initial pool of 103 Cigarette Dependence Questionnaire items was distributed to 109 adult smokers in Taiwan. Item analysis was conducted to select items for inclusion in the refined scale. The psychometric properties of the Cigarette Dependence Questionnaire were further evaluated 2007-08, when it was administered to 256 respondents and their saliva was collected and analysed for cotinine levels. Criterion validity was established through the Pearson correlation between the scale and saliva cotinine levels. Exploratory factor analysis was used to test construct validity. Reliability was determined with Cronbach's alpha coefficient and a 2-week test-retest coefficient. The selection of 30 items for seven perspectives was based on item analysis. One factor accounting for 44.9% of the variance emerged from the factor analysis. The factor was named as cigarette dependence. Cigarette Dependence Questionnaire scores were statistically significantly correlated with saliva cotinine levels (r = 0.21, P = 0.01). Cronbach's alpha was 0.95 and test-retest reliability using an intra-class correlation was 0.92. The Cigarette Dependence Questionnaire showed sound reliability and validity and could be used by nurses to set up smoking cessation interventions based on assessment of cigarette dependence. © 2010 Blackwell Publishing Ltd.

Development and validation of a vision-specific quality-of-life questionnaire for Timor-Leste.

PubMed

du Toit, Rènée; Palagyi, Anna; Ramke, Jacqueline; Brian, Garry; Lamoureux, Ecosse L

2008-10-01

To develop and determine the reliability and validity of a vision-specific quality-of-life instrument (TL-VSQOL) designed to assess the impact of distance and near vision impairment in adults living in Timor-Leste. A vision-specific quality-of-life questionnaire was developed, piloted, and administered to 704 Timorese aged >or=40 years during a population-based eye health rapid assessment. Rasch analysis was performed on the data of 457 participants with presenting near vision worse than N8 (78.5%) and/or distance vision worse than 6/18 (69.8%). Unidimensionality, item fit to the model, response category performance, differential item functioning, and targeting of items to participants were assessed. Initially, the questionnaire lacked fit to the Rasch model. Removal of two items concerning emotional well-being resulted in a fit of the data (overall item-trait interaction: chi(2) (df) = 81 (51); mean (SD) person and item fit residual values: -0.30 (1.02) and -0.32 (1.46), and good targeting of person ability and item difficulty was evident. Poorer distance and near visual acuities were significantly associated with worse quality-of-life scores (P < 0.001). Person separation reliability was substantial (0.93), indicating that the instrument can discriminate between groups with normal and impaired vision. All 17 items were free of differential item functioning, and there was no evidence of multidimensionality. This 17-item TL-VSQOL has high reliability, construct, and criterion validity and effective targeting. It can effectively assess the impact on quality of life of adult Timorese with distance and near vision impairment. The TL-VSQOL could be adapted for use in other low-resource settings.

Criterion-Referenced Test (CRT) Items for Air Conditioning, Heating and Refrigeration.

ERIC Educational Resources Information Center

Davis, Diane, Ed.

These criterion-referenced test (CRT) items for air conditioning, heating, and refrigeration are keyed to the Missouri Air Conditioning, Heating, and Refrigeration Competency Profile. The items are designed to work with both the Vocational Instructional Management System and Vocational Administrative Management System. For word processing and…

Development and Field Test of an Audit Tool and Tracer Methodology for Clinician Assessment of Quality in End-of-Life Care.

PubMed

Bookbinder, Marilyn; Hugodot, Amandine; Freeman, Katherine; Homel, Peter; Santiago, Elisabeth; Riggs, Alexa; Gavin, Maggie; Chu, Alice; Brady, Ellen; Lesage, Pauline; Portenoy, Russell K

2018-02-01

Quality improvement in end-of-life care generally acquires data from charts or caregivers. "Tracer" methodology, which assesses real-time information from multiple sources, may provide complementary information. The objective of this study was to develop a valid brief audit tool that can guide assessment and rate care when used in a clinician tracer to evaluate the quality of care for the dying patient. To identify items for a brief audit tool, 248 items were created to evaluate overall quality, quality in specific content areas (e.g., symptom management), and specific practices. Collected into three instruments, these items were used to interview professional caregivers and evaluate the charts of hospitalized patients who died. Evidence that this information could be validly captured using a small number of items was obtained through factor analyses, canonical correlations, and group comparisons. A nurse manager field tested tracer methodology using candidate items to evaluate the care provided to other patients who died. The survey of 145 deaths provided chart data and data from 445 interviews (26 physicians, 108 nurses, 18 social workers, and nine chaplains). The analyses yielded evidence of construct validity for a small number of items, demonstrating significant correlations between these items and content areas identified as latent variables in factor analyses. Criterion validity was suggested by significant differences in the ratings on these items between the palliative care unit and other units. The field test evaluated 127 deaths, demonstrated the feasibility of tracer methodology, and informed reworking of the candidate items into the 14-item Tracer EoLC v1. The Tracer EoLC v1 can be used with tracer methodology to guide the assessment and rate the quality of end-of-life care. Copyright © 2017 American Academy of Hospice and Palliative Medicine. Published by Elsevier Inc. All rights reserved.

Development of Korean Smartphone addiction proneness scale for youth.

PubMed

Kim, Dongil; Lee, Yunhee; Lee, Juyoung; Nam, JeeEun Karin; Chung, Yeoju

2014-01-01

This study developed a Smartphone Addiction Proneness Scale (SAPS) based on the existing internet and cellular phone addiction scales. For the development of this scale, 29 items (1.5 times the final number of items) were initially selected as preliminary items, based on the previous studies on internet/phone addiction as well as the clinical experience of involved experts. The preliminary scale was administered to a nationally representative sample of 795 students in elementary, middle, and high schools across South Korea. Then, final 15 items were selected according to the reliability test results. The final scale consisted of four subdomains: (1) disturbance of adaptive functions, (2) virtual life orientation, (3) withdrawal, and (4) tolerance. The final scale indicated a high reliability with Cronbach's α of .880. Support for the scale's criterion validity has been demonstrated by its relationship to the internet addiction scale, KS-II (r  =  .49). For the analysis of construct validity, we tested the Structural Equation Model. The results showed the four-factor structure to be valid (NFI  =  .943, TLI  =  .902, CFI  =  .902, RMSEA  =  .034). Smartphone addiction is gaining a greater spotlight as possibly a new form of addiction along with internet addiction. The SAPS appears to be a reliable and valid diagnostic scale for screening adolescents who may be at risk of smartphone addiction. Further implications and limitations are discussed.

Development of Korean Smartphone Addiction Proneness Scale for Youth

PubMed Central

Kim, Dongil; Lee, Yunhee; Lee, Juyoung; Nam, JeeEun Karin; Chung, Yeoju

2014-01-01

This study developed a Smartphone Addiction Proneness Scale (SAPS) based on the existing internet and cellular phone addiction scales. For the development of this scale, 29 items (1.5 times the final number of items) were initially selected as preliminary items, based on the previous studies on internet/phone addiction as well as the clinical experience of involved experts. The preliminary scale was administered to a nationally representative sample of 795 students in elementary, middle, and high schools across South Korea. Then, final 15 items were selected according to the reliability test results. The final scale consisted of four subdomains: (1) disturbance of adaptive functions, (2) virtual life orientation, (3) withdrawal, and (4) tolerance. The final scale indicated a high reliability with Cronbach's α of .880. Support for the scale's criterion validity has been demonstrated by its relationship to the internet addiction scale, KS-II (r  =  .49). For the analysis of construct validity, we tested the Structural Equation Model. The results showed the four-factor structure to be valid (NFI  =  .943, TLI  =  .902, CFI  =  .902, RMSEA  =  .034). Smartphone addiction is gaining a greater spotlight as possibly a new form of addiction along with internet addiction. The SAPS appears to be a reliable and valid diagnostic scale for screening adolescents who may be at risk of smartphone addiction. Further implications and limitations are discussed. PMID:24848006

Development of a Brief Version of the Pathological Narcissism Inventory

PubMed Central

Schoenleber, Michelle; Roche, Michael J.; Wetzel, Eunike; Pincus, Aaron L.; Roberts, Brent W.

2015-01-01

With theoretical and empirical interest in narcissism growing, there is a need for brief measures of pathological narcissism that can be used more practically while assessing the construct comprehensively. Data from four samples (total n = 3,851) collected across two separate research groups and representing undergraduate, community, and clinical populations was used to establish the reliability, validity, and utility of the Brief-Pathological Narcissism Inventory (B-PNI). Item response theory and confirmatory factor analyses were used to determine the best-performing 28 items from the original PNI and ensure that the B-PNI exhibited a factor structure consistent with the original PNI. Items were retained for all seven pathological narcissism facet scales. Additional results also support the criterion validity of the B-PNI, suggesting it can be used in place of the original PNI to assess the various facets of pathological narcissism effectively and without loss of information, which may enhance the ability of researchers to investigate pathological narcissism in future work. PMID:26011478

Development of a brief version of the Pathological Narcissism Inventory.

PubMed

Schoenleber, Michelle; Roche, Michael J; Wetzel, Eunike; Pincus, Aaron L; Roberts, Brent W

2015-12-01

With theoretical and empirical interest in narcissism growing, there is a need for brief measures of pathological narcissism that can be used more practically while assessing the construct comprehensively. Data from four samples (total N = 3,851) collected across two separate research groups and representing undergraduate, community, and clinical populations were used to establish the reliability, validity, and utility of the Brief-Pathological Narcissism Inventory (B-PNI). Item response theory and confirmatory factor analyses were used to determine the best-performing 28 items from the original PNI and ensure that the B-PNI exhibited a factor structure consistent with the original PNI. Items were retained for all seven pathological narcissism facet scales. Additional results also support the criterion validity of the B-PNI, suggesting that it can be used in place of the original PNI to assess the various facets of pathological narcissism effectively and without loss of information, which may enhance the ability of researchers to investigate pathological narcissism in future work. (c) 2015 APA, all rights reserved).

Development of short-form measures to assess four types of elder mistreatment: Findings from an evidence-based study of APS elder abuse substantiation decisions.

PubMed

Beach, Scott R; Liu, Pi-Ju; DeLiema, Marguerite; Iris, Madelyn; Howe, Melissa J K; Conrad, Kendon J

2017-01-01

Improving the standardization and efficiency of adult protective services (APS) investigations is a top priority in APS practice. Using data from the Elder Abuse Decision Support System (EADSS), we developed short-form measures of four types of elder abuse: financial, emotional/psychological, physical, and neglect. The EADSS data set contains 948 elder abuse cases (age 60+) with yes/no abuse substantiation decisions for each abuse type following a 30-day investigation. Item sensitivity/specificity analyses were conducted on long-form items with the substantiation decision for each abuse type as the criterion. Validity was further tested using receiver-operator characteristic (ROC) curve analysis, correlation with long forms and internal consistency. The four resulting short-form measures, containing 36 of the 82 original items, have validity similar to the original long forms. These short forms can be used to standardize and increase efficiency of APS investigations, and may also offer researchers new options for brief elder abuse assessments.

Development of short-form measures to assess four types of elder mistreatment: Findings from an evidence-based study of APS elder abuse substantiation decisions

PubMed Central

Beach, Scott R.; Liu, Pi-Ju; DeLiema, Marguerite; Iris, Madelyn; Howe, Melissa J.K.; Conrad, Kendon J.

2018-01-01

Improving the standardization and efficiency of adult protective services (APS) investigations is a top priority in APS practice. Using data from the Elder Abuse Decision Support System (EADSS), we developed short-form measures of four types of elder abuse: financial, emotional/psychological, physical, and neglect. The EADSS data set contains 948 elder abuse cases (age 60+) with yes/no abuse substantiation decisions for each abuse type following a 30-day investigation. Item sensitivity/specificity analyses were conducted on long-form items with the substantiation decision for each abuse type as the criterion. Validity was further tested using receiver–operator characteristic (ROC) curve analysis, correlation with long forms and internal consistency. The four resulting short-form measures, containing 36 of the 82 original items, have validity similar to the original long forms. These short forms can be used to standardize and increase efficiency of APS investigations, and may also offer researchers new options for brief elder abuse assessments. PMID:28590799

Statistical learning theory for high dimensional prediction: Application to criterion-keyed scale development.

PubMed

Chapman, Benjamin P; Weiss, Alexander; Duberstein, Paul R

2016-12-01

Statistical learning theory (SLT) is the statistical formulation of machine learning theory, a body of analytic methods common in "big data" problems. Regression-based SLT algorithms seek to maximize predictive accuracy for some outcome, given a large pool of potential predictors, without overfitting the sample. Research goals in psychology may sometimes call for high dimensional regression. One example is criterion-keyed scale construction, where a scale with maximal predictive validity must be built from a large item pool. Using this as a working example, we first introduce a core principle of SLT methods: minimization of expected prediction error (EPE). Minimizing EPE is fundamentally different than maximizing the within-sample likelihood, and hinges on building a predictive model of sufficient complexity to predict the outcome well, without undue complexity leading to overfitting. We describe how such models are built and refined via cross-validation. We then illustrate how 3 common SLT algorithms-supervised principal components, regularization, and boosting-can be used to construct a criterion-keyed scale predicting all-cause mortality, using a large personality item pool within a population cohort. Each algorithm illustrates a different approach to minimizing EPE. Finally, we consider broader applications of SLT predictive algorithms, both as supportive analytic tools for conventional methods, and as primary analytic tools in discovery phase research. We conclude that despite their differences from the classic null-hypothesis testing approach-or perhaps because of them-SLT methods may hold value as a statistically rigorous approach to exploratory regression. (PsycINFO Database Record (c) 2016 APA, all rights reserved).

Development of a questionnaire to measure heart disease risk knowledge in people with diabetes: the Heart Disease Fact Questionnaire.

PubMed

Wagner, Julie; Lacey, Kimberly; Chyun, Deborah; Abbott, Gina

2005-07-01

This paper describes a paper and pencil questionnaire that measures heart disease risk knowledge in people with diabetes. The Heart Disease Fact Questionnaire (HDFQ) is a 25-item questionnaire that was developed to tap into respondents' knowledge of major risk factors for the development of CHD. Approximately half of these items specifically address diabetes-related CHD risk factors. Based on extensive pilot data, the current study analyzed responses from 524 people with diabetes to assess the psychometric properties. The HDFQ is readable to an average 13-year old and imposes little burden. It shows good content and face validity. It demonstrates adequate internal consistency, with Kuder-Richardson-20 formula = 0.77 and good item-total correlations. Item analysis showed a desirable range in P-values. In discriminant function analyses, HDFQ scores differentiated respondents by knowledge of their own cardiovascular health, use of lipid lowering medications, health insurance status, and educational attainment, thus indicating good criterion related validity. This measure of heart disease risk knowledge is brief, understandable to respondents, and easy to administer and score. Its potential for use in research and practice is discussed. Future research should establish norms as well as investigate its test-retest reliability and predictive validity.

Construct and Criterion Validity of the PedsQL™ 4.0 Instrument (Pediatric Quality of Life Inventory) in Colombia

PubMed Central

Amaya-Arias, Ana Carolina; Alzate, Juan Pablo; Eslava-Schmalbach, Javier H

2017-01-01

Background: This study aimed at determining the validity of the Pediatric Quality of Life Inventory 4.0 (PedsQL™ 4.0) for the measurement of health-related quality of life (HRQOL) in Colombian children. Methods: Validation study of measurement instruments. The PedsQL™ 4.0 was applied by convenience sampling to 375 pairs of children and adolescents between the ages of 5 and 17 and to their parents-caregivers, as well as to 125 parents-caregivers of children between the ages of 2 and 4 in five cities of Colombia (Bogota, Medellin, Cali, Barranquilla and Bucaramanga). Construct validity was assessed through the use of exploratory and confirmatory factor analysis, and criterion validity was assessed by correlations between the PedsQL™ 4.0 and the KIDSCREEN-27. Results: The instrument was applied to 375 children (ages 5–18) and 125 parents of children between the ages of 2 and 4. Factor analysis revealed four factors considered suitable for the sample in both the child and parent reports, whereas Bartlett's test of sphericity showed inter-correlation between variables. Scale and subscales showed proper indicators of internal consistency. It is recommended not to include or review some of the items in the Colombian version of the scale. Conclusions: The Spanish version for Colombia of the PedsQL™ 4.0 displays suitable indicators of criterion and construct validity, therefore becoming a valuable tool for measuring HRQOL in children in our country. Some modifications are recommended for the Colombian version of the scale. PMID:28900536

Criterion-Referenced Test Items for Auto Body.

ERIC Educational Resources Information Center

Tannehill, Dana, Ed.

This test item bank on auto body repair contains criterion-referenced test questions based upon competencies found in the Missouri Auto Body Competency Profile. Some test items are keyed for multiple competencies. The tests cover the following 26 competency areas in the auto body curriculum: auto body careers; measuring and mixing; tools and…

Validation of the mothers object relations scales in 2–4 year old children and comparison with the child–parent relationship scale

PubMed Central

2013-01-01

Background The quality of the parent–child relationship has an important effect on a wide range of child outcomes. The evaluation of interventions to promote healthy parenting and family relationships is dependent on outcome measures which can quantify the quality of parent–child relationships. Between the Mothers’ Object Relations – Short Form (MORS-SF) scale for babies and the Child–parent Relationship Scale (C-PRS) there is an age gap where no validated scales are available. We report the development and testing of an adaptation of the MORS-SF; the MORS (Child) scale and its use in children from the age of 2 years to 4 years. This scale aims to capture the nature of the parent–child relationship in a form which is short enough to be used in population surveys and intervention evaluations. Methods Construct and criterion validity, item salience and internal consistency were assessed in a sample of 166 parents of children aged 2–4 years old and compared with that of the C-PRS. The performance of the MORS (Child) as part of a composite measure with the HOME inventory was compared with that of the C-PRS using data collected in a randomised controlled trial and the national evaluation of Sure Start. Results MORS (Child) performed well in children aged 2–4 with high construct and criterion validity, item salience and internal consistency. One item in the C-PRS failed to load on either subscale and parents found this scale slightly more difficult to complete than the MORS (Child). The two measures performed very similarly in a factor analysis with the HOME inventory producing almost identical loadings. Conclusions Adapting the MORS-SF for children aged 2–4 years old produces a scale to assess parent–child relationships that is easy to use and outperforms the more commonly used C-PRS in several respects. PMID:23518176

Burnout and hopelessness among farmers: The Farmers Stressors Inventory.

PubMed

Truchot, Didier; Andela, Marie

2018-05-03

Farming is a stressful occupation with a high rate of suicide. However, there have been relatively few studies that have examined the antecedents of stress and suicide in farmers. We also lack methodologically sound scales aimed at assessing the stressors faced by farmers. Therefore, the purposes of this study were to develop an instrument assessing the stressors met by farmers, The Farmers Stressors Inventory, and to test its factorial structure, internal consistency and criterion validity. First, based on the existing literature and interviews with farmers, we designed a scale containing 37 items. Then a sample of 2142 French farmers completed a questionnaire containing the 37 items along with two measures: The MBIGS that assesses burnout and the BHS that assesses hopelessness. The statistical analyses (EFA and CFA) revealed eight factors in accordance with different aspects of farmers job stressors: workload and lack of time, incertitude toward the future and the financial market, agricultural legislation pressure, social and geographical isolation, financial worry, conflicts with associates or family members, family succession of the farm, and unpredictable interference with farm work. The internal consistency of the eight subscales was satisfactory. Correlation between these eight dimensions and burnout on the one side and hopelessness on the other side support the criterion-related validity of the scale.

[Measurement properties of self-report questionnaires published in Korean nursing journals].

PubMed

Lee, Eun-Hyun; Kim, Chun-Ja; Kim, Eun Jung; Chae, Hyun-Ju; Cho, Soo-Yeon

2013-02-01

The purpose of this study was to evaluate measurement properties of self-report questionnaires for studies published in Korean nursing journals. Of 424 Korean nursing articles initially identified, 168 articles met the inclusion criteria. The methodological quality of the measurements used in the studies and interpretability were assessed using the COnsensus-based Standards for the selection of health Measurement INstruments (COSMIN) checklist. It consists of items on internal consistency, reliability, measurement error, content validity, construct validity including structural validity, hypothesis testing, cross-cultural validity, and criterion validity, and responsiveness. For each item of the COSMIN checklist, measurement properties are rated on a four-point scale: excellent, good, fair, and poor. Each measurement property is scored with worst score counts. All articles used the classical test theory for measurement properties. Internal consistency (72.6%), construct validity (56.5%), and content validity (38.2%) were most frequently reported properties being rated as 'excellent' by COSMIN checklist, whereas other measurement properties were rarely reported. A systematic review of measurement properties including interpretability of most instruments warrants further research and nursing-focused checklists assessing measurement properties should be developed to facilitate intervention outcomes across Korean studies.

Validity of an adapted Household Food Insecurity Access Scale in urban households in Iran.

PubMed

Mohammadi, Fatemeh; Omidvar, Nasrin; Houshiar-Rad, Anahita; Khoshfetrat, Mohammad-Reza; Abdollahi, Morteza; Mehrabi, Yadollah

2012-01-01

To assess the validity of a locally adapted Household Food Insecurity Access Scale (HFIAS) in the measurement of household food insecurity (FI) in the city of Tehran. A cross-sectional study. Urban households were selected through a systematic cluster sampling method from six different districts of Tehran. The socio-economic status of households was evaluated using a questionnaire by means of interviews. An adapted HFIAS was used to measure FI. Content validity was assessed by an expert panel, and the questionnaire was then tested among ten households for clarity. Criterion validity was assessed by comparing the measure with a number of determinants and consequences of FI. Internal consistency was evaluated by Cronbach's α and exploratory factor analysis. For repeatability, the questionnaire was administered twice to twenty-five households at an interval of 20 d and Pearson's correlation coefficient was calculated. A total of 416 households. In all, 11·8 %, 14·4 % and 17·5 % of the households were severely, moderately and mildly food insecure, respectively. Cronbach's α was 0·855. A significant correlation was observed between the two administrations of the questionnaire (r = 0·895, P < 0·001). Factor analysis of HFIAS items revealed two factors: the first five items as factor 1 (mild-to-moderate FI) and the last four as factor 2 (severe FI). Heads of food-secure households had higher education and higher job position compared with heads of food-insecure households (P < 0·001). Income and expenditure were lower in food-insecure households compared with food-secure households. Adapted HFIAS showed acceptable levels of internal consistency, criterion validity and reliability in assessing household FI among Tehranians.

Assessment of the psychometric properties of the Spanish language version of questionnaire ICIQ-Male Lower Urinary Tract Symptoms (ICIQ-MLUTS).

PubMed

Castro-Díaz, D M; Esteban-Fuertes, M; Salinas-Casado, J; Bustamante-Alarma, S; Gago-Ramos, J L; Galacho-Bech, A; García-Matres, M J; Rodríguez-Toves, L A; Zubiaur-Líbano, C; Collado-Serra, A; Batista-Miranda, J E; Ortiz-Gámiz, A

2014-03-01

To evaluate the psychometric properties of the Spanish version of the ICIQ-Male Lower Urinary Tract Symptoms Questionnaire (ICIQ-MLUTS): Feasibility (% of completion and ceiling/ground effects), reliability (Test-retest), convergent validity (vs Bladder Control Self-Assessment Questionnaire [BSAQ] and vs International Prostate Symptom Score [I-PSS]) and criterion validity (according to presence or absence of symptoms). This was an observational, non-interventionist and multicenter study. 223 male patients with lower urinary tract symptoms (LUTS), predominantly storage symptoms and aged 18-65, took part in the study. Patients completed the ICIQ-MLUTS (test), I-PSS and BSAQ questionnaires and referred their urinary symptoms in a single visit, with the exception of a subgroup composed by 49 patients that completed the questionnaire again 15 days after initial visit to evaluate test-retest reliability. The questionnaire includes 13 items divided in 2 sub-scales: Voiding symptoms (V) from 0-20 and Incontinence symptoms (I) from 0-24. Percentage of patients that completed all items: 98.84%. Ground effect is 0 and ceiling effect was under 6% in both sub-scales. Test-retest reliability: Intraclass correlation coefficient (ICC) ranged from 0.68 to 0.88, except on Delay. Kappa shows a good agreement, between 0.60 and 0.81, except for Nocturia. Convergent validity: Correlation (Spearman) between the questionnaire sub-scales scores and the rest of measures is statistically significant (P < .01 and P < .05). Criterion validity: Statistically significant differences (P < .05) between scores on ICIQ-MLUTS, from patients that refer experiencing symptoms and those who do not. The Spanish version of the ICIQ-MLUTS questionnaire shows adequate feasibility, reliability and validity. Copyright © 2013 AEU. Published by Elsevier Espana. All rights reserved.

Cross-cultural validity of a dietary questionnaire for studies of dental caries risk in Japanese.

PubMed

Shinga-Ishihara, Chikako; Nakai, Yukie; Milgrom, Peter; Murakami, Kaori; Matsumoto-Nakano, Michiyo

2014-01-02

Diet is a major modifiable contributing factor in the etiology of dental caries. The purpose of this paper is to examine the reliability and cross-cultural validity of the Japanese version of the Food Frequency Questionnaire to assess dietary intake in relation to dental caries risk in Japanese. The 38-item Food Frequency Questionnaire, in which Japanese food items were added to increase content validity, was translated into Japanese, and administered to two samples. The first sample comprised 355 pregnant women with mean age of 29.2 ± 4.2 years for the internal consistency and criterion validity analyses. Factor analysis (principal components with Varimax rotation) was used to determine dimensionality. The dietary cariogenicity score was calculated from the Food Frequency Questionnaire and used for the analyses. Salivary mutans streptococci level was used as a semi-quantitative assessment of dental caries risk and measured by Dentocult SM. Dentocult SM scores were compared with the dietary cariogenicity score computed from the Food Frequency Questionnaire to examine criterion validity, and assessed by Spearman's correlation coefficient (rs) and Kruskal-Wallis test. Test-retest reliability of the Food Frequency Questionnaire was assessed with a second sample of 25 adults with mean age of 34.0 ± 3.0 years by using the intraclass correlation coefficient analysis. The Japanese language version of the Food Frequency Questionnaire showed high test-retest reliability (ICC = 0.70) and good criterion validity assessed by relationship with salivary mutans streptococci levels (rs = 0.22; p < 0.001). Factor analysis revealed four subscales that construct the questionnaire (solid sugars, solid and starchy sugars, liquid and semisolid sugars, sticky and slowly dissolving sugars). Internal consistency were low to acceptable (Cronbach's alpha = 0.67 for the total scale, 0.46-0.61 for each subscale). Mean dietary cariogenicity scores were 50.8 ± 19.5 in the first sample, 47.4 ± 14.1, and 40.6 ± 11.3 for the first and second administrations in the second sample. The distribution of Dentocult SM score was 6.8% (score = 0), 34.4% (score = 1), 39.4% (score = 2), and 19.4% (score = 3). Participants with higher scores were more likely to have higher dietary cariogenicity scores (p < 0.001; Kruskal-Wallis test). These results provide the preliminary evidence for the reliability and validity of the Japanese language Food Frequency Questionnaire.

Criterion-related validity of the Test of Children's Speech sentence intelligibility measure for children with cerebral palsy and dysarthria.

PubMed

Hodge, Megan; Gotzke, Carrie Lynne

2014-08-01

To evaluate the criterion-related validity of the TOCS+ sentence measure (TOCS+, Hodge, Daniels & Gotzke, 2009 ) for children with dysarthria and CP by comparing intelligibility and rate scores obtained concurrently from the TOCS+ and from a conversational sample. Twenty children (3 to 10 years old) diagnosed with spastic cerebral palsy (CP) participated. Nineteen children also had a confirmed diagnosis of dysarthria. Children's intelligibility and speaking rate scores obtained from the TOCS+, which uses imitation of sets of randomly selected items ranging from 2-7 words (80 words in total) and from a contiguous 100-word conversational speech were compared. Mean intelligibility scores were 46.5% (SD = 26.4%) and 50.9% (SD = 19.1%) and mean rates in words per minute (WPM) were 90.2 (SD = 22.3) and 94.1 (SD = 25.6), respectively, for the TOCS+ and conversational samples. No significant differences were found between the two conditions for intelligibility or rate scores. Strong correlations were found between the TOCS+ and conversational samples for intelligibility (r = 0.86; p < 0.001) and WPM (r = 0.77; p < 0.001), supporting the criterion validity of the TOCS+ sentence task as a time efficient procedure for measuring intelligibility and rate in children with CP, with and without confirmed dysarthria. The results support the criterion validity of the TOCS+ sentence task as a time efficient procedure for measuring intelligibility and rate in children with CP, with and without confirmed dysarthria. Children varied in their relative performance on the two speaking tasks, reflecting the complexity of factors that influence intelligibility and rate scores.

Using Chinese Version of MYMOP in Chinese Medicine Evaluation: Validity, Responsiveness and Minimally Important Change

PubMed Central

2010-01-01

Background Measure Yourself Medical Outcome Profile (MYMOP) is a patient generated outcome instrument applicable in the evaluation of both allopathic and complementary medicine treatment. This study aims to adapt MYMOP into Chinese, and to assess its validity, responsiveness and minimally important change values in a sample of patients using Chinese medicine (CM) services. Methods A Chinese version of MYMOP (CMYMOP) is developed by forward-backward-forward translation strategy, expert panel assessment and pilot testing amongst patients. 272 patients aged 18 or above with subjective symptoms in the past 2 weeks were recruited at a CM clinic, and were invited to complete a set of questionnaire containing CMYMOP and SF-36. Follow ups were performed at 2nd and 4th week after consultation, using the same set of questionnaire plus a global rating of change question. Criterion validity of CMYMOP was assessed by its correlation with SF-36 at baseline, and responsiveness was evaluated by calculating the Cohen effect size (ES) of change at two follow ups. Minimally important difference (MID) values were estimated via anchor based method, while minimally detectable difference (MDC) figures were calculated by distribution based method. Results Criterion validity of CMYMOP was demonstrated by negative correlation between CMYMOP Profile scores and all SF-36 domain and summary scores at baseline. For responsiveness between baseline and 4th week follow up, ES of CMYMOP Symptom 1, Activity and Profile reached the moderate change threshold (ES>0.5), while Symptom 2 and Wellbeing reached the weak change threshold (ES>0.2). None of the SF-36 scores reached the moderate change threshold, implying CMYMOP's stronger responsiveness in CM setting. At 2nd week follow up, MID values for Symptom 1, Symptom 2, Wellbeing and Profile items were 0.894, 0.580, 0.263 and 0.516 respectively. For Activity item, MDC figure of 0.808 was adopted to estimate MID. Conclusions The findings support the validity and responsiveness of CMYMOP for capturing patient centred clinical changes within 2 weeks in a CM clinical setting. Further researches are warranted (1) to estimate Activity item MID, (2) to assess the test-retest reliability of CMYMOP, and (3) to perform further MID evaluation using multiple, item specific anchor questions. PMID:20920284

Validation of the short version of the Cognitive Emotion Regulation Questionnaire for Spanish children.

PubMed

Orgilés, Mireia; Morales, Alexandra; Fernández-Martínez, Iván; Melero, Silvia; Espada, José P

2018-01-01

This study aimed to validate a short version of the Cognitive Emotion Regulation Questionnaire for Spanish kids (CERQ-Sk) based on the 18-item version available for adults. A sample of 654 children aged 7-12 years completed the CERQ-Sk and tests for depression and anxiety measures. Confirmatory factor analysis supported the 18-item version and the original nine-factor structure, which includes self-blame, acceptance, rumination, positive refocusing, refocus on planning, positive reappraisal, putting into perspective, catastrophizing, and other-blame (comparative fit index = .99, Tucker-Lewis index = .98, root mean square error of approximation = .02). Internal consistency was adequate (ordinal α = .80), and the eight-week stability of this version was moderate (intraclass correlation = .69). Criterion validity was supported by correlations among self-blame, rumination, and catastrophizing (positive) and among positive reappraisal and depression and anxiety symptoms (negative). Results suggest that the short version of the CERQ-Sk is a valid and reliable instrument for assessing these cognitive emotion regulation strategies during the middle childhood developmental period. Clinicians and researchers will benefit from this briefer acceptable version when time is not available for the 36-item version. This study offers preliminary results for the first short version of the CERQ for children.

The revised transliminality scale: reliability and validity data from a Rasch top-down purification procedure.

PubMed

Lange, R; Thalbourne, M A; Houran, J; Storm, L

2000-12-01

The concept of transliminality ("a hypothesized tendency for psychological material to cross thresholds into or out of consciousness") was anticipated by William James (1902/1982), but it was only recently given an empirical definition by Thalbourne in terms of a 29-item Transliminality Scale. This article presents the 17-item Revised Transliminality Scale (or RTS) that corrects age and gender biases, is unidimensional by a Rasch criterion, and has a reliability of.82. The scale defines a probabilistic hierarchy of items that address magical ideation, mystical experience, absorption, hyperaesthesia, manic experience, dream interpretation, and fantasy proneness. These findings validate the suggestions by James and Thalbourne that some mental phenomena share a common underlying dimension with selected sensory experiences (such being overwhelmed by smells, bright lights, sights, and sounds). Low scores on transliminality remain correlated with "tough mindedness" in on Cattell 16PF test, as well as "self-control" and "rule consciousness," whereas high scores are associated with "abstractedness" and an "openness to change" on that test. An independent validation study confirmed the predictions implied by our definition of transliminality. Implications for test construction are discussed. Copyright 2000 Academic Press.

Reliability and validity of the Outcome Expectations for Exercise Scale-2.

PubMed

Resnick, Barbara

2005-10-01

Development of a reliable and valid measure of outcome expectations for exercise for older adults will help establish the relationship between outcome expectations and exercise and facilitate the development of interventions to increase physical activity in older adults. The purpose of this study was to test the reliability and validity of the Outcome Expectations for Exercise-2 Scale (OEE-2), a 13-item measure with two subscales: positive OEE (POEE) and negative OEE (NOEE). The OEE-2 scale was given to 161 residents in a continuing-care retirement community. There was some evidence of validity based on confirmatory factor analysis, Rasch-analysis INFIT and OUTFIT statistics, and convergent validity and test criterion relationships. There was some evidence for reliability of the OEE-2 based on alpha coefficients, person- and item-separation reliability indexes, and R(2)values. Based on analyses, suggested revisions are provided for future use of the OEE-2. Although ongoing reliability and validity testing are needed, the OEE-2 scale can be used to identify older adults with low outcome expectations for exercise, and interventions can then be implemented to strengthen these expectations and improve exercise behavior.

Semi-structured Interview Measure of Stigma (SIMS) in psychosis: Assessment of psychometric properties.

PubMed

Wood, Lisa; Burke, Eilish; Byrne, Rory; Enache, Gabriela; Morrison, Anthony P

2016-10-01

Stigma is a significant difficulty for people who experience psychosis. To date, there have been no outcome measures developed to examine stigma exclusively in people with psychosis. The aim of this study was develop and validate a semi-structured interview measure of stigma (SIMS) in psychosis. The SIMS is an eleven item measure of stigma developed in consultation with service users who have experienced psychosis. 79 participants with experience of psychosis were recruited for the purposes of this study. They were administered the SIMS alongside a battery of other relevant outcome measures to examine reliability and validity. A one-factor solution was identified for the SIMS which encompassed all ten rateable items. The measure met all reliability and validity criteria and illustrated good internal consistency, inter-rater reliability, test retest reliability, criterion validity, construct validity, sensitivity to change and had no floor or ceiling effects. The SIMS is a reliable and valid measure of stigma in psychosis. It may be more engaging and acceptable than other stigma measures due to its semi-structured interview format. Crown Copyright © 2016. Published by Elsevier B.V. All rights reserved.

Home Healthcare Nurses' Job Satisfaction Scale: refinement and psychometric testing.

PubMed

Ellenbecker, Carol H; Byleckie, James J

2005-10-01

This paper describes a study to further develop and test the psychometric properties of the Home Healthcare Nurses' Job Satisfaction Scale, including reliability and construct and criterion validity. Numerous scales have been developed to measure nurses' job satisfaction. Only one, the Home Healthcare Nurses' Job Satisfaction Scale, has been designed specifically to measure job satisfaction of home healthcare nurses. The Home Healthcare Nurses' Job Satisfaction Scale is based on a theoretical model that integrates the findings of empirical research related to job satisfaction. A convenience sample of 340 home healthcare nurses completed the Home Healthcare Nurses' Job Satisfaction Scale and the Mueller and McCloskey Satisfaction Scale, which was used to test criterion validity. Factor analysis was used for testing and refinement of the theory-based assignment of items to constructs. Reliability was assessed by Cronbach's alpha internal consistency reliability coefficients. The data were collected in 2003. Nine factors contributing to home healthcare nurses' job satisfaction emerged from the factor analysis and were strongly supported by the underlying theory. Factor loadings were all above 0.4. Cronbach's alpha coefficients for each of the nine subscales ranged from 0.64 to 0.83; the alpha for the global scale was 0.89. The correlations between the Home Healthcare Nurses' Job Satisfaction Scale and Mueller and McCloskey Satisfaction Scale was 0.79, indicating good criterion-related validity. The Home Healthcare Nurses' Job Satisfaction Scale has potential as a reliable and valid scale for measurement of job satisfaction of home healthcare nurses.

Tool development to assess the work related neck and upper limb musculoskeletal disorders among female garment workers in Sri-Lanka.

PubMed

Amarasinghe, Nirmalie Champika; De AlwisSenevirathne, Rohini

2016-10-17

Musculoskeletal disorders (MSDs) have been identified as a predisposing factor for lesser productivity, but no validated tool has been developed to assess them in the Sri- Lankan context. To develop a validated tool to assess the neck and upper limb MSDs. It comprises three components: item selections, item reduction using principal component analysis, and validation. A tentative self-administrated questionnaire was developed, translated, and pre-tested. Four important domains - neck, shoulder, elbow and wrist - were identified through principal component analysis. Prevalence of any MSDs was 38.1% and prevalence of neck, shoulder, elbow and wrist MSDs are 12.85%, 13.71%, 12%, 13.71% respectively. Content and criterion validity of the tool was assessed. Separate ROC curves were produced and sensitivity and specificity of neck (83.1%, 71.7%), shoulder (97.6%, 91.9%), elbow (98.2%, 87.2%), and wrist (97.6%, 94.9%) was determined. Cronbach's Alpha and correlation coefficient was above 0.7. The tool has high sensitivity, specificity, internal consistency, and test re-test reliability.

Psychometric examination and factorial validity of the Exercise Dependence Scale-Revised in Italian exercisers.

PubMed

Costa, Sebastiano; Cuzzocrea, Francesca; Hausenblas, Heather A; Larcan, Rosalba; Oliva, Patrizia

2012-12-01

Background and aims The purpose of this study was to verify the factorial structure, internal validity, reliability, and criterion validity of the 21-item Exercise Dependence Scale-Revised (EDS-R) in an Italian sample. Methods Italian voluntary (N = 519) users of gyms who had a history of regular exercise for over a year completed the EDS-R and measures of exercise frequency. Results and conclusions Confirmatory factor analyses demonstrated a good fit to the hypothesized 7-factor model, and adequate internal consistency for the scale was evidenced. Criterion validity was evidenced by significant correlations among all the subscale of the EDS and exercise frequency. Finally, individuals at risk for exercise dependence reported more exercise behavior compared to the nondependent-symptomatic and nondependent-asymptomatic groups. These results suggest that the seven subscales of the Italian version of the EDS are measuring the construct of exercise dependence as defined by the DSM-IV criteria for substance dependence and also confirm previous research using the EDS-R in other languages. More research is needed to examine the psychometric properties of the EDS-R in diverse populations with various research designs.

Measurement Development and Validation of the Family Supportive Supervisor Behavior Short-Form (FSSB-SF)

PubMed Central

Hammer, Leslie B.; Kossek, Ellen Ernst; Bodner, Todd; Crain, Tori

2013-01-01

Recently, scholars have demonstrated the importance of Family Supportive Supervisor Behaviors (FSSB), defined as behaviors exhibited by supervisors that are supportive of employees’ family roles, in relation to health, well-being, and organizational outcomes. FSSB was originally conceptualized as a multidimensional, superordinate construct with four subordinate dimensions assessed with 14 items: emotional support, instrumental support, role modeling behaviors, and creative work-family management. Retaining one item from each dimension, two studies were conducted to support the development and use of a new FSSB-Short Form (FSSB-SF). Study 1 draws on the original data from the FSSB validation study of retail employees to determine if the results using the 14-item measure replicate with the shorter 4-item measure. Using data from a sample of 823 information technology professionals and their 219 supervisors, Study 2 extends the validation of the FSSB-SF to a new sample of professional workers and new outcome variables. Results from multilevel confirmatory factor analyses and multilevel regression analyses provide evidence of construct and criterion-related validity of the FSSB-SF, as it was significantly related to work-family conflict, job satisfaction, turnover intentions, control over work hours, obligation to work when sick, perceived stress, and reports of family time adequacy. We argue that it is important to develop parsimonious measures of work-family specific support to ensure supervisor support for work and family is mainstreamed into organizational research and practice. PMID:23730803

Measurement development and validation of the Family Supportive Supervisor Behavior Short-Form (FSSB-SF).

PubMed

Hammer, Leslie B; Ernst Kossek, Ellen; Bodner, Todd; Crain, Tori

2013-07-01

Recently, scholars have demonstrated the importance of Family Supportive Supervisor Behaviors (FSSB), defined as behaviors exhibited by supervisors that are supportive of employees' family roles, in relation to health, well-being, and organizational outcomes. FSSB was originally conceptualized as a multidimensional, superordinate construct with four subordinate dimensions assessed with 14 items: emotional support, instrumental support, role modeling behaviors, and creative work-family management. Retaining one item from each dimension, two studies were conducted to support the development and use of a new FSSB-Short Form (FSSB-SF). Study 1 draws on the original data from the FSSB validation study of retail employees to determine whether the results using the 14-item measure replicate with the shorter 4-item measure. Using data from a sample of 823 information technology professionals and their 219 supervisors, Study 2 extends the validation of the FSSB-SF to a new sample of professional workers and new outcome variables. Results from multilevel confirmatory factor analyses and multilevel regression analyses provide evidence of construct and criterion-related validity of the FSSB-SF, as it was significantly related to work-family conflict, job satisfaction, turnover intentions, control over work hours, obligation to work when sick, perceived stress, and reports of family time adequacy. We argue that it is important to develop parsimonious measures of work-family specific support to ensure supervisor support for work and family is mainstreamed into organizational research and practice. PsycINFO Database Record (c) 2013 APA, all rights reserved.

The pornography craving questionnaire: psychometric properties.

PubMed

Kraus, Shane; Rosenberg, Harold

2014-04-01

Despite the prevalence of pornography use, and recent conceptualization of problematic use as an addiction, we could find no published scale to measure craving for pornography. Therefore, we conducted three studies employing young male pornography users to develop and evaluate such a questionnaire. In Study 1, we had participants rate their agreement with 20 potential craving items after reading a control script or a script designed to induce craving to watch pornography. We dropped eight items because of low endorsement. In Study 2, we revised both the questionnaire and cue exposure stimuli and then evaluated several psychometric properties of the modified questionnaire. Item loadings from a principal components analysis, a high internal consistency reliability coefficient, and a moderate mean inter-item correlation supported interpreting the 12 revised items as a single scale. Correlations of craving scores with preoccupation with pornography, sexual history, compulsive internet use, and sensation seeking provided support for convergent validity, criterion validity, and discriminant validity, respectively. The enhanced imagery script did not impact reported craving; however, more frequent users of pornography reported higher craving than less frequent users regardless of script condition. In Study 3, craving scores demonstrated good one-week test-retest reliability and predicted the number of times participants used pornography during the following week. This questionnaire could be applied in clinical settings to plan and evaluate therapy for problematic users of pornography and as a research tool to assess the prevalence and contextual triggers of craving among different types of pornography users.

Identifying dyspepsia in the Greek population: translation and validation of a questionnaire

PubMed Central

Anastasiou, Foteini; Antonakis, Nikos; Chaireti, Georgia; Theodorakis, Pavlos N; Lionis, Christos

2006-01-01

Background Studies on clinical issues, including diagnostic strategies, are considered to be the core content of general practice research. The use of standardised instruments is regarded as an important component for the development of Primary Health Care research capacity. Demand for epidemiological cross-cultural comparisons in the international setting and the use of common instruments and definitions valid to each culture is bigger than ever. Dyspepsia is a common complaint in primary practice but little is known with respect to its incidence in Greece. There are some references about the Helicobacter Pylori infection in patients with functional dyspepsia or gastric ulcer in Greece but there is no specific instrument for the identification of dyspepsia. This paper reports on the validation and translation into Greek, of an English questionnaire for the identification of dyspepsia in the general population and discusses several possibilities of its use in the Greek primary care. Methods The selected English postal questionnaire for the identification of people with dyspepsia in the general population consists of 30 items and was developed in 1995. The translation and cultural adaptation of the questionnaire has been performed according to international standards. For the validation of the instrument the internal consistency of the items was established using the alpha coefficient of Chronbach, the reproducibility (test – retest reliability) was measured by kappa correlation coefficient and the criterion validity was calculated against the diagnosis of the patients' records using also kappa correlation coefficient. Results The final Greek version of the postal questionnaire for the identification of dyspepsia in the general population was reliably translated. The internal consistency of the questionnaire was good, Chronbach's alpha was found to be 0.88 (95% CI: 0.81–0.93), suggesting that all items were appropriate to measure. Kappa coefficient for reproducibility (test – retest reliability) was found 0.66 (95% CI: 0.62–0.71), whereas the kappa analysis for criterion validity was 0.63 (95% CI: 0.36–0.89). Conclusion This study indicates that the Greek translation is comparable with the English-language version in terms of validity and reliability, and is suitable for epidemiological research within the Greek primary health care setting. PMID:16515708

Psychometrics of the Fitness-to-Drive Screening Measure.

PubMed

Classen, Sherrilene; Velozo, Craig A; Winter, Sandra M; Bédard, Michel; Wang, Yanning

2015-01-01

We employed item response theory (IRT), specifically using Rasch modeling, to determine the measurement precision of the Fitness-to-Drive Screening Measure (FTDS), a tool that can be used by caregivers and occupational therapists to help detect at-risk drivers. We examined unidimensionality through the factor structure (how items contribute to the central construct of fitness to drive), rating scale (use of the categories of the rating scale), item/person-level separation (distinguishing between items with different difficulty levels or persons with different ability levels) and reliability, item hierarchy (easier driving items advancing to more difficult driving items), rater reliability, rater effects (severity vs. leniency of a rater), and criterion validity of the FTDS to an on-road assessment, via three rater groups (n = 200 older drivers; n = 200 caregivers; n = 2 evaluators). The FTDS is unidimensional, the rating scale performed well, has good person (> 3.07) and item (> 5.43) separation, good person (> 0.90) and item reliability (> 0.97), with < 10% misfitting items for two rater groups (caregivers and drivers). The intraclass correlation (ICC) coefficient among the three rater groups was significant (.253, p < .001) and the evaluators were the most severe raters. When comparing the caregivers' FTDS rating with the drivers' on-road assessment, the areas under the curve (index of discriminability; caregivers .726, p < .001) suggested concurrent validity between the FTDS and the on-road assessment. Despite limitations, the FTDS is a reliable and accurate screening measure for caregivers to help identify at-risk older drivers and for occupational therapy practitioners to start conversations about driving.

A PROMIS Measure of Neuropathic Pain Quality

PubMed Central

Askew, Robert L.; Cook, Karon F.; Keefe, Francis J.; Nowinski, Cindy J; Cella, David; Revicki, Dennis A.; DeWitt, Esi M. Morgan; Michaud, Kaleb; Trence, Dace L.; Amtmann, Dagmar

2016-01-01

Objectives Neuropathic pain is a consequence of many chronic conditions. This study aimed to develop a unidimensional neuropathic pain scale whose scores represent levels of neuropathic pain and distinguish between individuals with neuropathic and non-neuropathic pain conditions. Methods A candidate item pool of 42 pain quality descriptors was administered to participants with osteoarthritis, rheumatoid arthritis, diabetic neuropathy, and cancer chemotherapy-induced peripheral neuropathy. A subset of pain quality descriptors (items) that best distinguished between participants with and those without neuropathic pain conditions were identified. Dimensionality of pain descriptors was evaluated in a development sample and cross-validated in a hold-out sample. Item responses were calibrated using an item response theory model, and scores were generated on a T-score metric. Neuropathic pain scale scores were evaluated in terms of reliability, validity, and the ability to distinguish between participants with and without conditions typically associated with neuropathic pain. Results Of the 42 initial items, 5 were identified for the Patient Reported Outcome Measurement Information System (PROMIS) Neuropathic Pain Quality scale (PROMIS-PQ-Neuro). The IRT-generated T-scores exhibited good discriminatory ability based on receiver operator characteristic analysis. Score thresholds were identified that optimize sensitivity and specificity. Construct, criterion, and discriminant validity, and reliability of scale scores were supported. Conclusions The 5-item PROMIS PQ-Neuro is a short and practical measure that can be used to identify patients more likely to have neuropathic pain and to distinguish levels of neuropathic pain. The data collected will support future research that targets other unidimensional pain quality domains (e.g., nociceptive pain). PMID:27565279

Validity and reliability of the TED-QOL: a new three-item questionnaire to assess quality of life in thyroid eye disease.

PubMed

Fayers, Tessa; Dolman, Peter J

2011-12-01

To develop and test a user-friendly questionnaire for rapidly assessing quality of life (QOL) in thyroid eye disease (TED). A three-item questionnaire, the TED-QOL, was designed and compared to the 16-item Graves Ophthalmopathy (GO)-QOL and the nine-item GO-Quality of Life Scale (QLS). 100 patients with TED were administered all three questionnaires on two occasions. Results were compared to clinical severity scores (Vision, Inflammation, Strabismus, Appearance (VISA) classification). Main outcomes were construct and criterion validity, test-retest reliability, duration, comprehension and completion rates. TED-QOL correlated strongly with the other questionnaires for corresponding items (Pearson correlation: appearance 0.71, 0.62; functioning 0.69, 0.66; overall QOL 0.53). Test-retest analysis demonstrated good reliability for all three questionnaires (intraclass correlations: TED-QOL 0.81, 0.74, 0.87; GO-QOL 0.81, 0.82; GO-QLS 0.74, 0.86, 0.67). TED-QOL was significantly faster to complete (1.6 min vs GO-QOL 3.1 min, GO-QLS 2.7 min, p<0.0001) and had a higher completion rate (100% vs GO-QOL 78%, GO-QLS 94%). There was only moderate correlation between items on all three questionnaires and VISA scores. The TED-QOL is rapid and easy to complete and analyse and has similar validity and reliability to longer questionnaires. All questionnaires showed only moderate correlation with disease severity, emphasising the discrepancy between objective and subjective assessments and the importance of measuring both.

Development of the Holistic Nursing Competence Scale.

PubMed

Takase, Miyuki; Teraoka, Sachiko

2011-12-01

This study developed a scale to measure the nursing competence of Japanese registered nurses and to test its psychometric properties. Following the derivation of scale items and pilot testing, the final version of the scale was administered to 331 nurses to establish its internal consistency, as well as its construct and criterion-related validity. Using an exploratory and a confirmatory factor analysis, 36 items with a five-factor structure were retained to form the Holistic Nursing Competence Scale. These factors illustrate nurses' general aptitude and their competencies in staff education and management, ethical practice, the provision of nursing care, and professional development. The Scale has a positive correlation with the length of clinical experience. A Cronbach's alpha coefficient was 0.967. The Scale is a reliable and valid measure, helping both nurses and organizations to correctly evaluate nurses' competence and identify their needs for professional development. © 2011 Blackwell Publishing Asia Pty Ltd.

Development and Validation of Triarchic Psychopathy Scales from the Multidimensional Personality Questionnaire

PubMed Central

Brislin, Sarah J.; Drislane, Laura E.; Smith, Shannon Toney; Edens, John F.; Patrick, Christopher J.

2015-01-01

Psychopathy is conceptualized by the triarchic model as encompassing three distinct phenotypic constructs: boldness, meanness, and disinhibition. In the current study, the Multidimensional Personality Questionnaire (MPQ), a normal-range personality measure, was evaluated for representation of these three constructs. Consensus ratings were used to identify MPQ items most related to each triarchic (Tri) construct. Scale measures were developed from items indicative of each construct, and scores for these scales were evaluated for convergent and discriminant validity in community (N = 176) and incarcerated samples (N = 240). A cross the two samples, MPQ-Tri scale scores demonstrated good internal consistencies and relationships with criterion measures of various types consistent with predictions based on the triarchic model. Findings are discussed in terms of their implications for further investigation of the triarchic model constructs in preexisting datasets that include the MPQ, in particular longitudinal and genetically informative datasets. PMID:25642934

Quality of Life after Brain Injury (QOLIBRI) Overall Scale for patients after aneurysmal subarachnoid hemorrhage.

PubMed

Wong, George Kwok Chu; Lam, Sandy Wai; Ngai, Karine; Wong, Adrian; Mok, Vincent; Poon, Wai Sang

2014-06-01

The Quality of Life after Brain Injury Overall Scale (QOLIBRI-OS) is a recently developed instrument that provides a brief summary measure of health-related quality of life (HRQoL) in domains typically affected by brain injury. This study examined the application of the six item QOLIBRI-OS in patients after aneurysmal subarachnoid hemorrhage (aSAH). Hong Kong Chinese aSAH patients were evaluated prospectively within the chronic phase of 1 year after aSAH in this multi-center observational study. Cronbach's α was 0.88, and correlations were satisfactory for all six items. QOLIBRI-OS demonstrated good criterion validity with other 1 year outcome assessments. In conclusion, QOLIBRI-OS can be used as a brief index for disease-specific HRQoL assessment after aSAH. Further validation in another population of aSAH patients is recommended. Copyright © 2013 Elsevier Ltd. All rights reserved.

Psychometrics of the PHQ-9 as a measure of depressive symptoms in patients with heart failure.

PubMed

Hammash, Muna H; Hall, Lynne A; Lennie, Terry A; Heo, Seongkum; Chung, Misook L; Lee, Kyoung Suk; Moser, Debra K

2013-10-01

Depression in patients with heart failure commonly goes undiagnosed and untreated. The Patient Health Questionnaire-9 (PHQ-9) is a simple, valid measure of depressive symptoms that may facilitate clinical assessment. It has not been validated in patients with heart failure. To test the reliability, and concurrent and construct validity of the PHQ-9 in patients with heart failure. A total of 322 heart failure patients (32% female, 61 ± 12 years, 56% New York Heart Association class III/IV) completed the PHQ-9, the Beck Depression Inventory-II (BDI-II), and the Control Attitudes Scale (CAS). Cronbach's alpha of .83 supported the internal consistency reliability of the PHQ-9 in this sample. Inter-item correlations (range .22-.66) and item-total correlation (except item 9) supported homogeneity of the PHQ-9. Spearman's rho of .80, (p < .001) between the PHQ-9 and the BDI-II supported the concurrent validity as did the agreement between the PHQ-9 and the BDI-II (Kappa = 0.64, p < .001). At cut-off score of 10, the PHQ-9 was 70% sensitive and 92% specific in identifying depressive symptoms, using the BDI-II scores as the criterion for comparison. Differences in PHQ-9 scores by level of perceived control measured by CAS (t(318) = -5.05, p < .001) supported construct validity. The PHQ-9 is a reliable, valid measure of depressive symptoms in patients with heart failure.

The Cambridge Otology Quality of Life Questionnaire: an otology-specific patient-recorded outcome measure. A paper describing the instrument design and a report of preliminary reliability and validity.

PubMed

Martin, T P C; Moualed, D; Paul, A; Ronan, N; Tysome, J R; Donnelly, N P; Cook, R; Axon, P R

2015-04-01

The Cambridge Otology Quality of Life Questionnaire (COQOL) is a patient-recorded outcome measurement (PROM) designed to quantify the quality of life of patients attending otology clinics. Item-reduction model. A systematically designed long-form version (74 items) was tested with patient focus groups before being presented to adult otology patients (n. 137). Preliminary item analysis tested reliability, reducing the COQOL to 24 questions. This was then presented in conjunction with the SF-36 (V1) questionnaire to a total of 203 patients. Subsequently, these were re-presented at T + 3 months, and patients recorded whether they felt their condition had improved, deteriorated or remained the same. Non-responders were contacted by post. A correlation between COQOL scores and patient perception of change was examined to analyse content validity. Teaching hospital and university psychology department. Adult patients attending otology clinics with a wide range of otological conditions. Item reliability measured by item–total correlation, internal consistency and test– retest reliability. Validity measured by correlation between COQOL scores and patient-reported symptom change. Reliability: the COQOL showed excellent internal consistency at both initial presentation (a = 0.90) and 3 months later (a = 0.93). Validity: One-way analysis of variance showed a significant difference between groups reporting change and those reporting no change in quality of life (F(2, 80) = 5.866, P < 0.01). The COQOL is the first otology-specific PROM. Initial studies demonstrate excellent reliability and encouraging preliminary criterion validity: further studies will allow a deeper validation of the instrument.

Brazilian validation of the Alberta Infant Motor Scale.

PubMed

Valentini, Nadia Cristina; Saccani, Raquel

2012-03-01

The Alberta Infant Motor Scale (AIMS) is a well-known motor assessment tool used to identify potential delays in infants' motor development. Although Brazilian researchers and practitioners have used the AIMS in laboratories and clinical settings, its translation to Portuguese and validation for the Brazilian population is yet to be investigated. This study aimed to translate and validate all AIMS items with respect to internal consistency and content, criterion, and construct validity. A cross-sectional and longitudinal design was used. A cross-cultural translation was used to generate a Brazilian-Portuguese version of the AIMS. In addition, a validation process was conducted involving 22 professionals and 766 Brazilian infants (aged 0-18 months). The results demonstrated language clarity and internal consistency for the motor criteria (motor development score, α=.90; prone, α=.85; supine, α=.92; sitting, α=.84; and standing, α=.86). The analysis also revealed high discriminative power to identify typical and atypical development (motor development score, P<.001; percentile, P=.04; classification criterion, χ(2)=6.03; P=.05). Temporal stability (P=.07) (rho=.85, P<.001) was observed, and predictive power (P<.001) was limited to the group of infants aged from 3 months to 9 months. Limited predictive validity was observed, which may have been due to the restricted time that the groups were followed longitudinally. In sum, the translated version of AIMS presented adequate validity and reliability.

Measuring resource utilization in patient-oriented comparative effectiveness research: a psychometric study of the Resource Utilization Questionnaire.

PubMed

Smaldone, Arlene; Tsimicalis, Argerie; Stone, Patricia W

2011-01-01

In the United States, rising health care costs have led to discussion about bending the cost curve. To understand the true burden of disease and its treatment, costs of care, including those incurred by patients and their families, must be comprehensively assessed using psychometrically sound instruments. The Resource Utilization Questionnaire (RUQ) is a 21-item self-report questionnaire first developed to measure the costs incurred by families of infants who had required intensive care during the newborn period. The purpose of this article is to describe the conceptualization of resource utilization and costs and other methodological issues in conducting economic analyses, the process of adapting the RUQ for use in children and families with Type 1 diabetes mellitus (T1DM), and the psychometric evaluation to establish content and criterion validity of the instrument. The finalized modified RUQ for T1DM (mRUQ-T1DM) contained 25 items reflecting direct (5 items) and nondirect (3 items) health care, patient/family time (8 items), and patient/family productivity (9 items) costs using a 3-month recall. The mRUQ-T1DM validly measures cost incurred by children and families with T1DM and is easily completed by parents. Furthermore, the mRUQ-T1DM may be adapted for use in other populations using a similar process.

Development and validation of 26-item dysfunctional attitude scale.

PubMed

Ebrahimi, Amrollah; Samouei, Rahele; Mousavii, Sayyed Ghafour; Bornamanesh, Ali Reza

2013-06-01

Dysfunctional Attitude Scale is one of the most common instruments used to assess cognitive vulnerability. This study aimed to develop and validate a short form of Dysfunctional Attitude Scale appropriate for an Iranian clinical population. Participants were 160 psychiatric patients from medical centers affiliated with Isfahan Medical University, as well as 160 non-patients. Research instruments were clinical interviews based on the Diagnostic and Statistical Manual-IV-TR, Dysfunctional Attitude Scale and General Heath Questionnaire (GHQ-28). Data was analyzed using multicorrelation calculations and factor analysis. Based on the results of factor analysis and item-total correlation, 14 items were judged candidates for omission. Analysis of the 26-item Dysfunctional Attitude Scale (DAS-26) revealed a Cronbach's alpha of 0.92. Evidence for the concurrent criterion validity was obtained through calculating the correlation between the Dysfunctional Attitude Scale and psychiatric diagnosis (r = 0.55), GHQ -28 (r = 0.56) and somatization, anxiety, social dysfunction, and depression subscales (0.45,0.53,0.48, and 0.57, respectively). Factor analysis deemed a four-factor structure the best. The factors were labeled as success-perfectionism, need for approval, need for satisfying others, and vulnerability-performance evaluation. The results showed that the Iranian version of the Dysfunctional Attitude Scale (DAS-26) bears satisfactory psychometric properties suggesting that this cognitive instrument is appropriate for use in an Iranian cultural context. Copyright © 2012 Wiley Publishing Asia Pty Ltd.

The positive mental health instrument: development and validation of a culturally relevant scale in a multi-ethnic Asian population.

PubMed

Vaingankar, Janhavi Ajit; Subramaniam, Mythily; Chong, Siow Ann; Abdin, Edimansyah; Orlando Edelen, Maria; Picco, Louisa; Lim, Yee Wei; Phua, Mei Yen; Chua, Boon Yiang; Tee, Joseph Y S; Sherbourne, Cathy

2011-10-31

Instruments to measure mental health and well-being are largely developed and often used within Western populations and this compromises their validity in other cultures. A previous qualitative study in Singapore demonstrated the relevance of spiritual and religious practices to mental health, a dimension currently not included in exiting multi-dimensional measures. The objective of this study was to develop a self-administered measure that covers all key and culturally appropriate domains of mental health, which can be applied to compare levels of mental health across different age, gender and ethnic groups. We present the item reduction and validation of the Positive Mental Health (PMH) instrument in a community-based adult sample in Singapore. Surveys were conducted among adult (21-65 years) residents belonging to Chinese, Malay and Indian ethnicities. Exploratory and confirmatory factor analysis (EFA, CFA) were conducted and items were reduced using item response theory tests (IRT). The final version of the PMH instrument was tested for internal consistency and criterion validity. Items were tested for differential item functioning (DIF) to check if items functioned in the same way across all subgroups. EFA and CFA identified six first-order factor structure (General coping, Personal growth and autonomy, Spirituality, Interpersonal skills, Emotional support, and Global affect) under one higher-order dimension of Positive Mental Health (RMSEA=0.05, CFI=0.96, TLI=0.96). A 47-item self-administered multi-dimensional instrument with a six-point Likert response scale was constructed. The slope estimates and strength of the relation to the theta for all items in each six PMH subscales were high (range:1.39 to 5.69), suggesting good discrimination properties. The threshold estimates for the instrument ranged from -3.45 to 1.61 indicating that the instrument covers entire spectrums for the six dimensions. The instrument demonstrated high internal consistency and had significant and expected correlations with other well-being measures. Results confirmed absence of DIF. The PMH instrument is a reliable and valid instrument that can be used to measure and compare level of mental health across different age, gender and ethnic groups in Singapore.

Item response theory-based validation of a short form of the Eating Behavior Scale for Japanese adults

PubMed Central

Tayama, Jun; Ogawa, Sayaka; Takeoka, Atsushi; Kobayashi, Masakazu; Shirabe, Susumu

2017-01-01

Abstract Obesity has become a serious social problem in industrialized countries in recent years. Clinically, although the evaluation of dietary behavior abnormalities is as important as any method of risk assessment for obesity, almost all the existing scales with many items may have numerous practical clinical difficulties. In this study, we aimed to prepare a short questionnaire to assess the dietary behavior abnormalities related to obesity. A total of 1032 individuals aged 20 to 59 years participated in the present study. Using item response theory (IRT), we selected the items for a short version from among 30 items of Sakata Eating Behavior Scale (EBS), which is widely used in Japan. As a result of the IRT-based analysis on the original 30-item version, 7 items were adopted as the short version. The correlation between the total score of the original EBS and the EBS short form was extremely high (r = 0.93, P = .001). In examining the criterion validity, for all participants (n = 1032), male (n = 516), and female (n = 516), the correlation coefficients between the total score of the EBS short form and body mass index (BMI) were r = 0.26, r = 0.28, and r = 0.28, respectively. The results of the receiver operating characteristic analysis was performed with obesity BMI > 25 kg/m2 as a dependent variable, the value of the area under the curve in the ROC was significantly higher in the 7-item version than in the total score of the original items (P = .0005). In conclusion, the 7-item EBS short form was created. Furthermore, it was found that the EBS short form is a reliable and valid measure that can be used as an indicator of obesity in both clinical and research settings. PMID:29049248

Development and validation of the ASPIRE-VA coaching fidelity checklist (ACFC): a tool to help ensure delivery of high-quality weight management interventions.

PubMed

Damschroder, Laura J; Goodrich, David E; Kim, Hyungjin Myra; Holleman, Robert; Gillon, Leah; Kirsh, Susan; Richardson, Caroline R; Lutes, Lesley D

2016-09-01

Practical and valid instruments are needed to assess fidelity of coaching for weight loss. The purpose of this study was to develop and validate the ASPIRE Coaching Fidelity Checklist (ACFC). Classical test theory guided ACFC development. Principal component analyses were used to determine item groupings. Psychometric properties, internal consistency, and inter-rater reliability were evaluated for each subscale. Criterion validity was tested by predicting weight loss as a function of coaching fidelity. The final 19-item ACFC consists of two domains (session process and session structure) and five subscales (sets goals and monitor progress, assess and personalize self-regulatory content, manages the session, creates a supportive and empathetic climate, and stays on track). Four of five subscales showed high internal consistency (Cronbach alphas > 0.70) for group-based coaching; only two of five subscales had high internal reliability for phone-based coaching. All five sub-scales were positively and significantly associated with weight loss for group- but not for phone-based coaching. The ACFC is a reliable and valid instrument that can be used to assess fidelity and guide skill-building for weight management interventionists.

Reliability, Factor Structure, and Associations With Measures of Problem Relationship and Behavior of the Personality Inventory for DSM-5 in a Sample of Italian Community-Dwelling Adolescents.

PubMed

Somma, Antonella; Borroni, Serena; Maffei, Cesare; Giarolli, Laura E; Markon, Kristian E; Krueger, Robert F; Fossati, Andrea

2017-10-01

In order to assess the reliability, factorial validity, and criterion validity of the Personality Inventory for DSM-5 (PID-5) among adolescents, 1,264 Italian high school students were administered the PID-5. Participants were also administered the Questionnaire on Relationships and Substance Use as a criterion measure. In the full sample, McDonald's ω values were adequate for the PID-5 scales (median ω = .85, SD = .06), except for Suspiciousness. However, all PID-5 scales showed average inter-item correlation values in the .20-.55 range. Exploratory structural equation modeling analyses provided moderate support for the a priori model of PID-5 trait scales. Ordinal logistic regression analyses showed that selected PID-5 trait scales predicted a significant, albeit moderate (Cox & Snell R 2 values ranged from .08 to .15, all ps < .001) amount of variance in Questionnaire on Relationships and Substance Use variables.

Development and validation of the coronary heart disease scale under the system of quality of life instruments for chronic diseases QLICD-CHD: combinations of classical test theory and Generalizability Theory.

PubMed

Wan, Chonghua; Li, Hezhan; Fan, Xuejin; Yang, Ruixue; Pan, Jiahua; Chen, Wenru; Zhao, Rong

2014-06-04

Quality of life (QOL) for patients with coronary heart disease (CHD) is now concerned worldwide with the specific instruments being seldom and no one developed by the modular approach. This paper is aimed to develop the CHD scale of the system of Quality of Life Instruments for Chronic Diseases (QLICD-CHD) by the modular approach and validate it by both classical test theory and Generalizability Theory. The QLICD-CHD was developed based on programmed decision procedures with multiple nominal and focus group discussions, in-depth interview, pre-testing and quantitative statistical procedures. 146 inpatients with CHD were used to provide the data measuring QOL three times before and after treatments. The psychometric properties of the scale were evaluated with respect to validity, reliability and responsiveness employing correlation analysis, factor analyses, multi-trait scaling analysis, t-tests and also G studies and D studies of Genralizability Theory analysis. Multi-trait scaling analysis, correlation and factor analyses confirmed good construct validity and criterion-related validity when using SF-36 as a criterion. The internal consistency α and test-retest reliability coefficients (Pearson r and Intra-class correlations ICC) for the overall instrument and all domains were higher than 0.70 and 0.80 respectively; The overall and all domains except for social domain had statistically significant changes after treatments with moderate effect size SRM (standardized response mea) ranging from 0.32 to 0.67. G-coefficients and index of dependability (Ф coefficients) confirmed the reliability of the scale further with more exact variance components. The QLICD-CHD has good validity, reliability, and moderate responsiveness and some highlights, and can be used as the quality of life instrument for patients with CHD. However, in order to obtain better reliability, the numbers of items for social domain should be increased or the items' quality, not quantity, should be improved.

Korean Version of Inventory of Complicated Grief Scale: Psychometric Properties in Korean Adolescents

PubMed Central

2016-01-01

We aimed to validate the Inventory of Complicated Grief (ICG)-Korean version among 1,138 Korean adolescents, representing a response rate of 57% of 1,997 students. Participants completed a set of questionnaires including demographic variables (age, sex, years of education, experience of grief), the ICG, the Children's Depression Inventory (CDI) and the Lifetime Incidence of Traumatic Events-Child (LITE-C). Exploratory factor analysis was performed to determine whether the ICG items indicated complicated grief in Korean adolescents. The internal consistency of the ICG-Korean version was Cronbach's α=0.87. The test-retest reliability for a randomly selected sample of 314 participants in 2 weeks was r=0.75 (P<0.001). Concurrent validity was assessed using a correlation between the ICG total scores and the CDI total scores (r=0.75, P<0.001). The criterion-related validity based on the comparison of ICG total scores between adolescents without complicated grief (1.2±3.7) and adolescent with complicated grief (3.2±6.6) groups was relatively high (t=5.71, P<0.001). The data acquired from the 1,138 students was acceptable for a factor analysis (Kaiser-Meyer-Olkin Measure of Sampling Adequacy=0.911; Bartlett's Test of Sphericity, χ2=13,144.7, P<0.001). After omission of 3 items, the value of Cronbach's α increased from 0.87 for the 19-item ICG-Korean version to 0.93 for the 16-item ICG-Korean version. These results suggest that the ICG is a useful tool in assessing for complicated grief in Korean adolescents. However, the 16-item version of the ICG appeared to be more valid compared to the 19-item version of the ICG. We suggest that the 16-item version of the ICG be used to screen for complicated grief in Korean adolescents. PMID:26770046

Korean Version of Inventory of Complicated Grief Scale: Psychometric Properties in Korean Adolescents.

PubMed

Han, Doug Hyun; Lee, Jung Jae; Moon, Duk-Soo; Cha, Myoung-Jin; Kim, Min A; Min, Seonyeong; Yang, Ji Hoon; Lee, Eun Jeong; Yoo, Seo Koo; Chung, Un-Sun

2016-01-01

We aimed to validate the Inventory of Complicated Grief (ICG)-Korean version among 1,138 Korean adolescents, representing a response rate of 57% of 1,997 students. Participants completed a set of questionnaires including demographic variables (age, sex, years of education, experience of grief), the ICG, the Children's Depression Inventory (CDI) and the Lifetime Incidence of Traumatic Events-Child (LITE-C). Exploratory factor analysis was performed to determine whether the ICG items indicated complicated grief in Korean adolescents. The internal consistency of the ICG-Korean version was Cronbach's α=0.87. The test-retest reliability for a randomly selected sample of 314 participants in 2 weeks was r=0.75 (P<0.001). Concurrent validity was assessed using a correlation between the ICG total scores and the CDI total scores (r=0.75, P<0.001). The criterion-related validity based on the comparison of ICG total scores between adolescents without complicated grief (1.2 ± 3.7) and adolescent with complicated grief (3.2 ± 6.6) groups was relatively high (t=5.71, P<0.001). The data acquired from the 1,138 students was acceptable for a factor analysis (Kaiser-Meyer-Olkin Measure of Sampling Adequacy=0.911; Bartlett's Test of Sphericity, χ(2)=13,144.7, P<0.001). After omission of 3 items, the value of Cronbach's α increased from 0.87 for the 19-item ICG-Korean version to 0.93 for the 16-item ICG-Korean version. These results suggest that the ICG is a useful tool in assessing for complicated grief in Korean adolescents. However, the 16-item version of the ICG appeared to be more valid compared to the 19-item version of the ICG. We suggest that the 16-item version of the ICG be used to screen for complicated grief in Korean adolescents.

The Personality Inventory for DSM-5 Short Form (PID-5-SF): psychometric properties and association with big five traits and pathological beliefs in a Norwegian population.

PubMed

Thimm, Jens C; Jordan, Stian; Bach, Bo

2016-12-07

With the publication of the fifth edition of the Diagnostic and Statistical Manual of Mental Disorders (DSM-5), an alternative model for personality disorders based on personality dysfunction and pathological personality traits was introduced. The Personality Inventory for DSM-5 (PID-5) is a 220-item self-report inventory designed to assess the personality traits of this model. Recently, a short 100-item version of the PID-5 (PID-5-SF) has been developed. The aim of this study was to investigate the score reliability and structure of the Norwegian PID-5-SF. Further, criterion validity with the five factor model of personality (FFM) and pathological personality beliefs was examined. A derivation sample of university students (N = 503) completed the PID-5, the Big Five Inventory (BFI), and the Personality Beliefs Questionnaire - Short Form (PBQ-SF), whereas a replication sample of 127 students completed the PID-5-SF along with the aforementioned measures. The short PID-5 showed overall good score reliability and structural validity. The associations with FFM traits and pathological personality beliefs were conceptually coherent and similar for the two forms of the PID-5. The results suggest that the Norwegian PID-5 short form is a reliable and efficient measure of the trait criterion of the alternative model for personality disorders in DSM-5.

Development and validation of a tool to evaluate the quality of medical education websites in pathology.

PubMed

Alyusuf, Raja H; Prasad, Kameshwar; Abdel Satir, Ali M; Abalkhail, Ali A; Arora, Roopa K

2013-01-01

The exponential use of the internet as a learning resource coupled with varied quality of many websites, lead to a need to identify suitable websites for teaching purposes. The aim of this study is to develop and to validate a tool, which evaluates the quality of undergraduate medical educational websites; and apply it to the field of pathology. A tool was devised through several steps of item generation, reduction, weightage, pilot testing, post-pilot modification of the tool and validating the tool. Tool validation included measurement of inter-observer reliability; and generation of criterion related, construct related and content related validity. The validated tool was subsequently tested by applying it to a population of pathology websites. Reliability testing showed a high internal consistency reliability (Cronbach's alpha = 0.92), high inter-observer reliability (Pearson's correlation r = 0.88), intraclass correlation coefficient = 0.85 and κ =0.75. It showed high criterion related, construct related and content related validity. The tool showed moderately high concordance with the gold standard (κ =0.61); 92.2% sensitivity, 67.8% specificity, 75.6% positive predictive value and 88.9% negative predictive value. The validated tool was applied to 278 websites; 29.9% were rated as recommended, 41.0% as recommended with caution and 29.1% as not recommended. A systematic tool was devised to evaluate the quality of websites for medical educational purposes. The tool was shown to yield reliable and valid inferences through its application to pathology websites.

Validation of a scale for assessing attitudes towards outcomes of genetic cancer testing among primary care providers and breast specialists

PubMed Central

N’Diaye, Khadim; Evans, D. Gareth; Harris, Hilary; Tibben, Aad; van Asperen, Christi; Schmidtke, Joerg; Nippert, Irmgard; Mancini, Julien; Julian-Reynier, Claire

2017-01-01

Objective To develop a generic scale for assessing attitudes towards genetic testing and to psychometrically assess these attitudes in the context of BRCA1/2 among a sample of French general practitioners, breast specialists and gyneco-obstetricians. Study design and setting Nested within the questionnaire developed for the European InCRisC (International Cancer Risk Communication Study) project were 14 items assessing expected benefits (8 items) and drawbacks (6 items) of the process of breast/ovarian genetic cancer testing (BRCA1/2). Another item assessed agreement with the statement that, overall, the expected health benefits of BRCA1/2 testing exceeded its drawbacks, thereby justifying its prescription. The questionnaire was mailed to a sample of 1,852 French doctors. Of these, 182 breast specialists, 275 general practitioners and 294 gyneco-obstetricians completed and returned the questionnaire to the research team. Principal Component Analysis, Cronbach’s α coefficient, and Pearson’s correlation coefficients were used in the statistical analyses of collected data. Results Three dimensions emerged from the respondents’ responses, and were classified under the headings: “Anxiety, Conflict and Discrimination”, “Risk Information”, and “Prevention and Surveillance”. Cronbach’s α coefficient for the 3 dimensions was 0.79, 0.76 and 0.62, respectively, and each dimension exhibited strong correlation with the overall indicator of agreement (criterion validity). Conclusions The validation process of the 15 items regarding BRCA1/2 testing revealed satisfactory psychometric properties for the creation of a new scale entitled the Attitudes Towards Genetic Testing for BRCA1/2 (ATGT-BRCA1/2) Scale. Further testing is required to confirm the validity of this tool which could be used generically in other genetic contexts. PMID:28570656

The reliability and validity of a sexual functioning questionnaire.

PubMed

Corty, E W; Althof, S E; Kurit, D M

1996-01-01

The present study assessed the reliability and validity of a measure of sexual functioning, the CMSH-SFQ, for male patients and their partners. The CMSH-SFQ measures erectile and orgasmic functioning, sexual drive, frequency of sexual behavior, and sexual satisfaction. Test-retest reliability was assessed with 19 males and 19 females for the baseline CMSH-SFQ. Criterion validity was measured by comparing the answers of 25 male patients to those of their partners at baseline and follow-up. The majority of items had acceptable levels of reliability and validity. The CMSH-SFQ provides a reliable and valid device that can be used to measure global sexual functioning in men and their partners and may be used to evaluate the efficacy of treatments for sexual dysfunctions. Limitations and suggestions for use of the CMSH-SFQ are addressed.

Development of The Science Processes Test.

ERIC Educational Resources Information Center

Ludeman, Robert R.

Presented is a description and copy of a test manual developed to include items in the test on the basis of children's performance; each item correlated highly with performance on an external criterion. The external criterion was the Individual Competency Measures of the elementary science program Science - A Process Approach (SAPA). The test…

Measuring Belief in Conspiracy Theories: The Generic Conspiracist Beliefs Scale

PubMed Central

Brotherton, Robert; French, Christopher C.; Pickering, Alan D.

2013-01-01

The psychology of conspiracy theory beliefs is not yet well understood, although research indicates that there are stable individual differences in conspiracist ideation – individuals’ general tendency to engage with conspiracy theories. Researchers have created several short self-report measures of conspiracist ideation. These measures largely consist of items referring to an assortment of prominent conspiracy theories regarding specific real-world events. However, these instruments have not been psychometrically validated, and this assessment approach suffers from practical and theoretical limitations. Therefore, we present the Generic Conspiracist Beliefs (GCB) scale: a novel measure of individual differences in generic conspiracist ideation. The scale was developed and validated across four studies. In Study 1, exploratory factor analysis of a novel 75-item measure of non-event-based conspiracist beliefs identified five conspiracist facets. The 15-item GCB scale was developed to sample from each of these themes. Studies 2, 3, and 4 examined the structure and validity of the GCB, demonstrating internal reliability, content, criterion-related, convergent and discriminant validity, and good test-retest reliability. In sum, this research indicates that the GCB is a psychometrically sound and practically useful measure of conspiracist ideation, and the findings add to our theoretical understanding of conspiracist ideation as a monological belief system unpinned by a relatively small number of generic assumptions about the typicality of conspiratorial activity in the world. PMID:23734136

Validation of the Early Functional Abilities scale: An assessment of four dimensions in early recovery after traumatic brain injury.

PubMed

Poulsen, Ingrid; Kreiner, Svend; Engberg, Aase W

2018-02-13

The Early Functional Abilities scale assesses the restoration of brain function after brain injury, based on 4 dimensions. The primary objective of this study was to evaluate the validity, objectivity, reliability and measurement precision of the Early Functional Abilities scale by Rasch model item analysis. A secondary objective was to examine the relationship between the Early Functional Abilities scale and the Functional Independence Measurement™, in order to establish the criterion validity of the Early Functional Abilities scale and to compare the sensitivity of measurements using the 2 instruments. The Rasch analysis was based on the assessment of 408 adult patients at admission to sub-acute rehabilitation in Copenhagen, Denmark after traumatic brain injury. The Early Functional Abilities scale provides valid and objective measurement of vegetative (autonomic), facio-oral, sensorimotor and communicative/cognitive functions. Removal of one item from the sensorimotor scale confirmed unidimensionality for each of the 4 subscales, but not for the entire scale. The Early Functional Abilities subscales are sensitive to differences between patients in ranges in which the Functional Independence Measurement™ has a floor effect. The Early Functional Abilities scale assesses the early recovery of important aspects of brain function after traumatic brain injury, but is not unidimensional. We recommend removal of the "standing" item and calculation of summary subscales for the separate dimensions.

Cross-cultural validity of a dietary questionnaire for studies of dental caries risk in Japanese

PubMed Central

2014-01-01

Background Diet is a major modifiable contributing factor in the etiology of dental caries. The purpose of this paper is to examine the reliability and cross-cultural validity of the Japanese version of the Food Frequency Questionnaire to assess dietary intake in relation to dental caries risk in Japanese. Methods The 38-item Food Frequency Questionnaire, in which Japanese food items were added to increase content validity, was translated into Japanese, and administered to two samples. The first sample comprised 355 pregnant women with mean age of 29.2 ± 4.2 years for the internal consistency and criterion validity analyses. Factor analysis (principal components with Varimax rotation) was used to determine dimensionality. The dietary cariogenicity score was calculated from the Food Frequency Questionnaire and used for the analyses. Salivary mutans streptococci level was used as a semi-quantitative assessment of dental caries risk and measured by Dentocult SM. Dentocult SM scores were compared with the dietary cariogenicity score computed from the Food Frequency Questionnaire to examine criterion validity, and assessed by Spearman’s correlation coefficient (rs) and Kruskal-Wallis test. Test-retest reliability of the Food Frequency Questionnaire was assessed with a second sample of 25 adults with mean age of 34.0 ± 3.0 years by using the intraclass correlation coefficient analysis. Results The Japanese language version of the Food Frequency Questionnaire showed high test-retest reliability (ICC = 0.70) and good criterion validity assessed by relationship with salivary mutans streptococci levels (rs = 0.22; p < 0.001). Factor analysis revealed four subscales that construct the questionnaire (solid sugars, solid and starchy sugars, liquid and semisolid sugars, sticky and slowly dissolving sugars). Internal consistency were low to acceptable (Cronbach’s alpha = 0.67 for the total scale, 0.46-0.61 for each subscale). Mean dietary cariogenicity scores were 50.8 ± 19.5 in the first sample, 47.4 ± 14.1, and 40.6 ± 11.3 for the first and second administrations in the second sample. The distribution of Dentocult SM score was 6.8% (score = 0), 34.4% (score = 1), 39.4% (score = 2), and 19.4% (score = 3). Participants with higher scores were more likely to have higher dietary cariogenicity scores (p < 0.001; Kruskal-Wallis test). Conclusions These results provide the preliminary evidence for the reliability and validity of the Japanese language Food Frequency Questionnaire. PMID:24383547

Health Sciences-Evidence Based Practice questionnaire (HS-EBP) for measuring transprofessional evidence-based practice: Creation, development and psychometric validation

PubMed Central

Fernández-Domínguez, Juan Carlos; de Pedro-Gómez, Joan Ernest; Morales-Asencio, José Miguel; Sastre-Fullana, Pedro; Sesé-Abad, Albert

2017-01-01

Introduction Most of the EBP measuring instruments available to date present limitations both in the operationalisation of the construct and also in the rigour of their psychometric development, as revealed in the literature review performed. The aim of this paper is to provide rigorous and adequate reliability and validity evidence of the scores of a new transdisciplinary psychometric tool, the Health Sciences Evidence-Based Practice (HS-EBP), for measuring the construct EBP in Health Sciences professionals. Methods A pilot study and a subsequent two-stage validation test sample were conducted to progressively refine the instrument until a reduced 60-item version with a five-factor latent structure. Reliability was analysed through both Cronbach’s alpha coefficient and intraclass correlations (ICC). Latent structure was contrasted using confirmatory factor analysis (CFA) following a model comparison aproach. Evidence of criterion validity of the scores obtained was achieved by considering attitudinal resistance to change, burnout, and quality of professional life as criterion variables; while convergent validity was assessed using the Spanish version of the Evidence-Based Practice Questionnaire (EBPQ-19). Results Adequate evidence of both reliability and ICC was obtained for the five dimensions of the questionnaire. According to the CFA model comparison, the best fit corresponded to the five-factor model (RMSEA = 0.049; CI 90% RMSEA = [0.047; 0.050]; CFI = 0.99). Adequate criterion and convergent validity evidence was also provided. Finally, the HS-EBP showed the capability to find differences between EBP training levels as an important evidence of decision validity. Conclusions Reliability and validity evidence obtained regarding the HS-EBP confirm the adequate operationalisation of the EBP construct as a process put into practice to respond to every clinical situation arising in the daily practice of professionals in health sciences (transprofessional). The tool could be useful for EBP individual assessment and for evaluating the impact of specific interventions to improve EBP. PMID:28486533

Health Sciences-Evidence Based Practice questionnaire (HS-EBP) for measuring transprofessional evidence-based practice: Creation, development and psychometric validation.

PubMed

Fernández-Domínguez, Juan Carlos; de Pedro-Gómez, Joan Ernest; Morales-Asencio, José Miguel; Bennasar-Veny, Miquel; Sastre-Fullana, Pedro; Sesé-Abad, Albert

2017-01-01

Most of the EBP measuring instruments available to date present limitations both in the operationalisation of the construct and also in the rigour of their psychometric development, as revealed in the literature review performed. The aim of this paper is to provide rigorous and adequate reliability and validity evidence of the scores of a new transdisciplinary psychometric tool, the Health Sciences Evidence-Based Practice (HS-EBP), for measuring the construct EBP in Health Sciences professionals. A pilot study and a subsequent two-stage validation test sample were conducted to progressively refine the instrument until a reduced 60-item version with a five-factor latent structure. Reliability was analysed through both Cronbach's alpha coefficient and intraclass correlations (ICC). Latent structure was contrasted using confirmatory factor analysis (CFA) following a model comparison aproach. Evidence of criterion validity of the scores obtained was achieved by considering attitudinal resistance to change, burnout, and quality of professional life as criterion variables; while convergent validity was assessed using the Spanish version of the Evidence-Based Practice Questionnaire (EBPQ-19). Adequate evidence of both reliability and ICC was obtained for the five dimensions of the questionnaire. According to the CFA model comparison, the best fit corresponded to the five-factor model (RMSEA = 0.049; CI 90% RMSEA = [0.047; 0.050]; CFI = 0.99). Adequate criterion and convergent validity evidence was also provided. Finally, the HS-EBP showed the capability to find differences between EBP training levels as an important evidence of decision validity. Reliability and validity evidence obtained regarding the HS-EBP confirm the adequate operationalisation of the EBP construct as a process put into practice to respond to every clinical situation arising in the daily practice of professionals in health sciences (transprofessional). The tool could be useful for EBP individual assessment and for evaluating the impact of specific interventions to improve EBP.

Utility of the Rosenberg self-esteem scale.

PubMed

Davis, Clare; Kellett, Stephen; Beail, Nigel

2009-05-01

The Rosenberg Self-Esteem Scale (RSES) continues to be used to purportedly measure self-esteem of people with intellectual disabilities, despite the lack of sound evidence concerning its validity and reliability when employed with this population. The psychometric foundations of the RSES were analyzed here with a sample of 219 participants with intellectual disabilities. The factor analytic methods employed revealed two factors (Self-Worth and Self-Criticism) and more specific problems with RSES Items 5 and 8. Overall, this scale showed only moderate temporal and moderate internal reliability and poor aspects of criterion validity. Results are discussed with reference to either developing a new measure of self-esteem or redesigning and simplifying the RSES in order to increase its initial face validity in intellectual disability samples.

The Development of an Instrument for Measuring Healing

PubMed Central

Meza, James Peter; Fahoome, Gail F.

2008-01-01

PURPOSE Our lack of ability to measure healing attributes impairs our ability to research the topic. The specific aim of this project is to describe the psychological and social construct of healing and to create a valid and reliable measurement scale for attributes of healing. METHODS A content expert conducted a domain analysis examining the existing literature of midrange theories of healing. Theme saturation of content sampling was ensured by brainstorming more than 220 potential items. Selection of items was sequential: pile sorting and data reduction, with factor analysis of a mailed 54-item questionnaire. Criterion validity (convergent and divergent) and temporal reliability were established using a second mailing of the development version of the instrument. Construct validity was judged with structural equation modeling for goodness of fit. RESULTS Cronbach’s α of the original questionnaire was .869 and the final scale was .862. The test-retest reliability was .849. Eigenvalues for the 2 factors were 8 and 4, respectively. Divergent and convergent validity using the Spann-Fischer Codependency Scale and SF-36 mental health and emotional subscales were consistent with predictions. The root mean square error of approximation was 0.066 and Bentler’s Comparative Fit Index was 0.871. Root mean square residual was 0.102. CONCLUSIONS We developed a valid and reliable measurement scale for attributes of healing, which we named the Self-Integration Scale v 2.1. By creating a new variable, new areas of research in humanistic health care are possible. PMID:18626036

An instrument assessing satisfaction with iron chelation therapy: Psychometric testing from an open-label clinical trial.

PubMed

Rofail, Diana; Viala, Muriel; Gater, Adam; Abetz-Webb, Linda; Baladi, Jean-Francois; Cappellini, Maria Domenica

2010-08-01

The Satisfaction with Iron Chelation Therapy (SICT) instrument was developed based on a literature review, in-depth patient and clinician interviews, and cognitive debriefing interviews. An, open-label, single arm, multicenter trial evaluating the efficacy and safety of deferasirox in patients diagnosed with transfusion-dependent iron overload, provided an opportunity to assess the psychometric measurement properties of the instrument. Psychometric analyses were performed using data at baseline from 273 patients with a range of transfusion-dependent iron overload conditions who were participating in a multinational study. Responsiveness was further evaluated for all patients who also had subsequent satisfaction domain scores collected at week 4. Baseline SICT domain scores had acceptable floor and ceiling effects and internal consistency reliability (Cronbach's alpha: 0.75-0.85). Item discriminant and item convergent validity were both excellent although one item in each analysis did not meet the specified criterion. Small to moderate correlations were observed between SICT and Short Form 36 Health Survey (SF-36) domain scores. Patients with the highest levels of serum ferritin at baseline (>3100 ng/mL) were the least satisfied about the Perceived Effectiveness of ICT and vice versa. Satisfaction improved in all patients, although there were no clear differences observed between groups of patients defined according to changes in serum ferritin levels from baseline to week 4 (stable, improved, or worsened). The SICT domains are reliable and valid. Further testing using a more specific criterion (such as assessing patient global ratings of change in satisfaction domains that correspond to the SICT domains) could help to establish with greater confidence the responsiveness of the instrument.

Development and Validation of MMPI-2-RF Scales for Indexing Triarchic Psychopathy Constructs.

PubMed

Sellbom, Martin; Drislane, Laura E; Johnson, Alexandria K; Goodwin, Brandee E; Phillips, Tasha R; Patrick, Christopher J

2016-10-01

The triarchic model characterizes psychopathy in terms of three distinct dispositional constructs of boldness, meanness, and disinhibition. The model can be operationalized through scales designed specifically to index these domains or by using items from other inventories that provide coverage of related constructs. The present study sought to develop and validate scales for assessing the triarchic model domains using items from the Minnesota Multiphasic Personality Inventory-2-Restructured Form (MMPI-2-RF). A consensus rating approach was used to identify items relevant to each triarchic domain, and following psychometric refinement, the resulting MMPI-2-RF-based triarchic scales were evaluated for convergent and discriminant validity in relation to multiple psychopathy-relevant criterion variables in offender and nonoffender samples. Expected convergent and discriminant associations were evident very clearly for the Boldness and Disinhibition scales and somewhat less clearly for the Meanness scale. Moreover, hierarchical regression analyses indicated that all MMPI-2-RF triarchic scales incremented standard MMPI-2-RF scale scores in predicting extant triarchic model scale scores. The widespread use of MMPI-2-RF in clinical and forensic settings provides avenues for both clinical and research applications in contexts where traditional psychopathy measures are less likely to be administered. © The Author(s) 2015.

Development and validation of a patient-reported outcome measure for stroke patients.

PubMed

Luo, Yanhong; Yang, Jie; Zhang, Yanbo

2015-05-08

Family support and patient satisfaction with treatment are crucial for aiding in the recovery from stroke. However, current validated stroke-specific questionnaires may not adequately capture the impact of these two variables on patients undergoing clinical trials of new drugs. Therefore, the aim of this study was to develop and evaluate a new stroke patient-reported outcome measure (Stroke-PROM) instrument for capturing more comprehensive effects of stroke on patients participating in clinical trials of new drugs. A conceptual framework and a pool of items for the preliminary Stroke-PROM were generated by consulting the relevant literature and other questionnaires created in China and other countries, and interviewing 20 patients and 4 experts to ensure that all germane parameters were included. During the first item-selection phase, classical test theory and item response theory were applied to an initial scale completed by 133 patients with stroke. During the item-revaluation phase, classical test theory and item response theory were used again, this time with 475 patients with stroke and 104 healthy participants. During the scale assessment phase, confirmatory factor analysis was applied to the final scale of the Stroke-PROM using the same study population as in the second item-selection phase. Reliability, validity, responsiveness and feasibility of the final scale were tested. The final scale of Stroke-PROM contained 46 items describing four domains (physiology, psychology, society and treatment). These four domains were subdivided into 10 subdomains. Cronbach's α coefficients for the four domains ranged from 0.861 to 0.908. Confirmatory factor analysis supported the validity of the final scale, and the model fit index satisfied the criterion. Differences in the Stroke-PROM mean scores were significant between patients with stroke and healthy participants in nine subdomains (P < 0.001), indicating that the scale showed good responsiveness. The Stroke-PROM is a patient-reported outcome multidimensional questionnaire developed especially for clinical trials of new drugs and is focused on issues of family support and patient satisfaction with treatment. Extensive data analyses supported the validity, reliability and responsiveness of the Stroke-PROM.

Validation of environmental content in the Young Children's Participation and Environment Measure.

PubMed

Khetani, Mary A

2015-02-01

To evaluate the concurrent validity of the environment content in the newly developed Young Children's Participation and Environment Measure (YC-PEM). Cross-sectional study. Data were collected online. Convenience and snowball sampling methods were used to survey caregivers of children (N=381; 85 children with developmental disabilities and delays and 296 children without developmental disabilities and delays) aged 0 and 5 years (mean age, 36.49±20.18 mo). Not applicable. The YC-PEM includes an assessment of the effect of environment on children's participation for 3 settings: home, daycare/preschool, and community. Pearson and Spearman correlational analyses were used to examine the concurrent validity of the YC-PEM environmental content according to a criterion measure, the Craig Hospital Inventory of Environmental Factors-Child and Parent Version (CHIEF-CP). The YC-PEM and the CHIEF-CP items were first mapped to the International Classification of Functioning, Disability, and Health-Children and Youth Version to identify items for pairwise comparison. We found small to moderate negative associations for 51 of 66 pairwise comparisons involving CHIEF-CP and YC-PEM environment items (r=-.13 to -.39; P<.01). Significant associations were found for items in all 5 International Classification of Functioning, Disability and Health-Children and Youth Version environmental domains. Results lend further support for the use of the YC-PEM for valid caregiver assessment of the physical, social, attitudinal, and institutional features of environments in terms of their effect on young children's participation within the home, daycare/preschool, and community settings. Copyright © 2015 American Congress of Rehabilitation Medicine. Published by Elsevier Inc. All rights reserved.

The Internet Gaming Disorder Scale.

PubMed

Lemmens, Jeroen S; Valkenburg, Patti M; Gentile, Douglas A

2015-06-01

Recently, the American Psychiatric Association included Internet gaming disorder (IGD) in the appendix of the 5th edition of the Diagnostic and Statistical Manual of Mental Disorders (DSM-5). The main aim of the current study was to test the reliability and validity of 4 survey instruments to measure IGD on the basis of the 9 criteria from the DSM-5: a long (27-item) and short (9-item) polytomous scale and a long (27-item) and short (9-item) dichotomous scale. The psychometric properties of these scales were tested among a representative sample of 2,444 Dutch adolescents and adults, ages 13-40 years. Confirmatory factor analyses demonstrated that the structural validity (i.e., the dimensional structure) of all scales was satisfactory. Both types of assessment (polytomous and dichotomous) were also reliable (i.e., internally consistent) and showed good criterion-related validity, as indicated by positive correlations with time spent playing games, loneliness, and aggression and negative correlations with self-esteem, prosocial behavior, and life satisfaction. The dichotomous 9-item IGD scale showed solid psychometric properties and was the most practical scale for diagnostic purposes. Latent class analysis of this dichotomous scale indicated that 3 groups could be discerned: normal gamers, risky gamers, and disordered gamers. On the basis of the number of people in this last group, the prevalence of IGD among 13- through 40-year-olds in the Netherlands is approximately 4%. If the DSM-5 threshold for diagnosis (experiencing 5 or more criteria) is applied, the prevalence of disordered gamers is more than 5%. (c) 2015 APA, all rights reserved).

Toward an alcohol use disorder continuum using item response theory: results from the National Epidemiologic Survey on Alcohol and Related Conditions.

PubMed

Saha, Tulshi D; Chou, S Patricia; Grant, Bridget F

2006-07-01

Item response theory (IRT) was used to determine whether the DSM-IV diagnostic criteria for alcohol abuse and dependence are arrayed along a continuum of severity. Data came from a large nationally representative sample of the US population, 18 years and older. A two-parameter logistic IRT model was used to determine the severity and discrimination of each DSM-IV criterion. Differential criterion functioning (DCF) was also assessed across subgroups of the population defined by sex, age and race-ethnicity. All DSM-IV alcohol abuse and dependence criteria, except alcohol-related legal problems, formed a continuum of alcohol use disorder severity. Abuse and dependence criteria did not consistently tap the mildest or more severe end of the continuum respectively, and several criteria were identified as potentially redundant. The drinking in larger amounts or for longer than intended dependence criterion had the greatest discrimination and lowest severity than any other criterion. Although several criteria were found to function differentially between subgroups defined in terms of sex and age, there was evidence that the generalizability and validity of the criterion forming the continuum remained intact at the test score level. DSM-IV diagnostic criteria for alcohol abuse and dependence form a continuum of severity, calling into question the abuse-dependence distinction in the DSM-IV and the interpretation of abuse as a milder disorder than dependence. The criteria tapped the more severe end of the alcohol use disorder continuum, highlighting the need to identify other criteria capturing the mild to intermediate range of the severity. The drinking larger amounts or longer than intended dependence criterion may be a bridging criterion between drinking patterns that incur risk of alcohol use disorder at the milder end of the continuum, with tolerance, withdrawal, impaired control and serious social and occupational dysfunction at the more severe end of the alcohol use disorder continuum. Future IRT and other dimensional analyses hold great promise in informing revisions to categorical classifications and constructing new dimensional classifications of alcohol use disorders based on the DSM and the ICD.

Building and Retaining the Career Force: New Procedures for Accessing and Assigning Army Enlisted Personnel Annual Report, 1991 Fiscal Year

DTIC Science & Technology

1994-03-01

criterion-related validity studies conducted between 1960 and 1984. Results showed that temperament constructs predict multiple components of job...interpretable factors that accounted for 65 percent of the variance. The first seven rotated factors from the item-level analyses roughly corresponded to...developed for use as a training aid. Using a demilitarized M16 rifle, the The text of this section is adapted from the Project A Final Report (ARI

The Matching Criterion Purification for Differential Item Functioning Analyses in a Large-Scale Assessment

ERIC Educational Resources Information Center

Lee, HyeSun; Geisinger, Kurt F.

2016-01-01

The current study investigated the impact of matching criterion purification on the accuracy of differential item functioning (DIF) detection in large-scale assessments. The three matching approaches for DIF analyses (block-level matching, pooled booklet matching, and equated pooled booklet matching) were employed with the Mantel-Haenszel…

Issues and Procedures in the Development of Criterion Referenced Tests.

ERIC Educational Resources Information Center

Klein, Stephen P.; Kosecoff, Jacqueline

The basic steps and procedures in the development of criterion referenced tests (CRT), as well as the issues and problems associated with these activities are discussed. In the first section of the paper, the discussions focus upon the purpose and defining characteristics of CRTs, item construction and selection, improving item quality, content…

Criterion-Referenced Test (CRT) Items for Building Trades.

ERIC Educational Resources Information Center

Davis, Diane, Ed.

This test item bank is intended to help instructors construct criterion-referenced tests for secondary-level courses in building trades. The bank is keyed to the Missouri Building Trades Competency Profile, which was developed by industry and education professionals in Missouri, and is designed to be used in conjunction with the Vocational…

An Ethical Issue Scale for Community Pharmacy Setting (EISP): Development and Validation.

PubMed

Crnjanski, Tatjana; Krajnovic, Dusanka; Tadic, Ivana; Stojkov, Svetlana; Savic, Mirko

2016-04-01

Many problems that arise when providing pharmacy services may contain some ethical components and the aims of this study were to develop and validate a scale that could assess difficulties of ethical issues, as well as the frequency of those occurrences in everyday practice of community pharmacists. Development and validation of the scale was conducted in three phases: (1) generating items for the initial survey instrument after qualitative analysis; (2) defining the design and format of the instrument; (3) validation of the instrument. The constructed Ethical Issue scale for community pharmacy setting has two parts containing the same 16 items for assessing the difficulty and frequency thereof. The results of the 171 completely filled out scales were analyzed (response rate 74.89%). The Cronbach's α value of the part of the instrument that examines difficulties of the ethical situations was 0.83 and for the part of the instrument that examined frequency of the ethical situations was 0.84. Test-retest reliability for both parts of the instrument was satisfactory with all Interclass correlation coefficient (ICC) values above 0.6, (for the part that examines severity ICC = 0.809, for the part that examines frequency ICC = 0.929). The 16-item scale, as a self assessment tool, demonstrated a high degree of content, criterion, and construct validity and test-retest reliability. The results support its use as a research tool to asses difficulty and frequency of ethical issues in community pharmacy setting. The validated scale needs to be further employed on a larger sample of pharmacists.

The psychometric properties of an Iranian translation of the Work Ability Index (WAI) questionnaire.

PubMed

Abdolalizadeh, M; Arastoo, A A; Ghsemzadeh, R; Montazeri, A; Ahmadi, K; Azizi, A

2012-09-01

This study was carried out to evaluate the psychometric properties of an Iranian translation of the Work Ability Index (WAI) questionnaire. In this methodological study, nurses and healthcare workers aged 40 years and older who worked in educational hospitals in Ahvaz (236 workers) in 2010, completed the questionnaire and 60 of the workers filled out the WAI questionnaire for the second time to ensure test-retest reliability. Forward-backward method was applied to translate the questionnaire from English into Persian. The psychometric properties of the Iranian translation of the WAI were assessed using the fallowing tests: Internal consistency (to test reliability), test-retest analysis, exploratory factor analysis (construct validity), discriminate validity by comparing the mean WAI score in two groups of the employees that had different levels of sick leave, criterion validity by determining the correlation between the Persian version of short form health survey (SF-36) and WAI score. Cronbach's alpha coefficient was estimated to be 0.79 and it was concluded that the internal consistency was high enough. The intraclass correlation coefficient was recognized to be 0.92. Factor analysis indicated three factors in the structure of the work ability including self-perceived work ability (24.5% of the variance), mental resources (22.23% of the variance), and presence of disease and health related limitation (18.55% of the variance). Statistical tests showed that this questionnaire was capable of discriminating two groups of employees who had different levels of sick leave. Criterion validity analysis showed that this instrument and all dimensions of the Iranian version of SF-36 were correlated significantly. Item correlation corrective for overlap showed the items tests had a good correlation except for one. The finding of the study showed that the Iranian version of the WAI is a reliable and valid measure of work ability and can be used both in research and practical activities.

Music therapy career aptitude test.

PubMed

Lim, Hayoung A

2011-01-01

The purpose of the Music Therapy Career Aptitude Test (MTCAT) was to measure the affective domain of music therapy students including their self-awareness as it relates to the music therapy career, value in human development, interest in general therapy, and aptitude for being a professional music therapist. The MTCAT was administered to 113 music therapy students who are currently freshman or sophomores in an undergraduate music therapy program or in the first year of a music therapy master's equivalency program. The results of analysis indicated that the MTCAT is normally distributed and that all 20 questions are significantly correlated with the total test score of the MTCAT. The reliability of the MTCAT was considerably high (Cronbach's Coefficient Alpha=0.8). The criterion-related validity was examined by comparing the MTCAT scores of music therapy students with the scores of 43 professional music therapists. The correlation between the scores of students and professionals was found to be statistically significant. The results suggests that normal distribution, internal consistency, homogeneity of construct, item discrimination, correlation analysis, content validity, and criterion-related validity in the MTCAT may be helpful in predicting music therapy career aptitude and may aid in the career decision making process of college music therapy students.

A practical scale for Multi-Faceted Organizational Health Climate Assessment.

PubMed

Zweber, Zandra M; Henning, Robert A; Magley, Vicki J

2016-04-01

The current study sought to develop a practical scale to measure 3 facets of workplace health climate from the employee perspective as an important component of a healthy organization. The goal was to create a short, usable yet comprehensive scale that organizations and occupational health professionals could use to determine if workplace health interventions were needed. The proposed Multi-faceted Organizational Health Climate Assessment (MOHCA) scale assesses facets that correspond to 3 organizational levels: (a) workgroup, (b) supervisor, and (c) organization. Ten items were developed and tested on 2 distinct samples, 1 cross-organization and 1 within-organization. Exploratory and confirmatory factor analyses yielded a 9-item, hierarchical 3-factor structure. Tests confirmed MOHCA has convergent validity with related constructs, such as perceived organizational support and supervisor support, as well as discriminant validity with safety climate. Lastly, criterion-related validity was found between MOHCA and health-related outcomes. The multi-faceted nature of MOHCA provides a scale that has face validity and can be easily translated into practice, offering a means for diagnosing the shortcomings of an organization or workgroup's health climate to better plan health and well-being interventions. (c) 2016 APA, all rights reserved).

Brief Assessment of Motor Function: Content Validity and Reliability of the Upper Extremity Gross Motor Scale

PubMed Central

Cintas, Holly Lea; Parks, Rebecca; Don, Sarah; Gerber, Lynn

2011-01-01

Content validity and reliability of the Brief Assessment of Motor Function (BAMF) Upper Extremity Gross Motor Scale (UEGMS) were evaluated in this prospective, descriptive study. The UEGMS is one of five ordinal scales designed for quick documentation of gross, fine and oral motor skill levels. Designed to be independent of age and diagnosis, it is intended for use for infants through young adults. An expert panel of 17 physical therapists and 13 occupational therapists refined the content by responding to a standard questionnaire comprised of questions which asked whether each item should be included, is clearly worded, should be reordered higher or lower, is functionally relevant, and is easily discriminated. Ratings of content validity exceeded the criterion except for two items which may represent different perspectives of physical and occupational therapists. The UEGMS was modified using the quantitative and qualitative feedback from the questionnaires. For reliability, five raters scored videotaped motor performances of ten children. Coefficients for inter-rater (0.94) and intra-rater (0.95) reliability were high. The results provide evidence of content validity and reliability of the UEGMS for assessment of upper extremity gross motor skill. PMID:21599568

Psychometric Properties of the Work Well Index: A Short Questionnaire for Work-Related Stress.

PubMed

Mauss, Daniel; Li, Jian; Angerer, Peter

2017-02-01

The aim of this study was to test the psychometric properties of a short questionnaire for work-related stress entitled Work Well index (WWi) and its interaction with different variables of self-reported health. An online survey was conducted in a sample of 1,218 employees (51% female) in four countries of an international insurance company. Internal consistency reliability, factorial validity, convergent validity and criterion validity of the 10-item WWi were analyzed. Good internal consistency reliability of the WWi was obtained (Cronbach's α coefficient = 0.85). Confirmatory factor analysis showed a satisfactory model fit of the data (AGFI = 0.92). The WWi was highly correlated to conceptually close constructs such as demand-control, effort-reward imbalance and workplace social capital (p < 0.001). Moreover, the 10-item WWi was significantly (p < 0.001) associated with elevated risk of self-rated health, absenteeism, presenteeism and depression (odds ratio 1.63, 1.36, 2.08, 2.95, respectively). We conclude that this short questionnaire is a reliable and valid instrument measuring psychosocial stress at work. Copyright © 2016 John Wiley & Sons, Ltd. Copyright © 2016 John Wiley & Sons, Ltd.

Design and validation of a questionnaire to assess organizational culture in French hospital wards.

PubMed

Saillour-Glénisson, F; Domecq, S; Kret, M; Sibe, M; Dumond, J P; Michel, P

2016-09-17

Although many organizational culture questionnaires have been developed, there is a lack of any validated multidimensional questionnaire assessing organizational culture at hospital ward level and adapted to health care context. Facing the lack of an appropriate tool, a multidisciplinary team designed and validated a dimensional organizational culture questionnaire for healthcare settings to be administered at ward level. A database of organizational culture items and themes was created after extensive literature review. Items were regrouped into dimensions and subdimensions (classification validated by experts). Pre-test and face validation was conducted with 15 health care professionals. In a stratified cluster random sample of hospitals, the psychometric validation was conducted in three phases on a sample of 859 healthcare professionals from 36 multidisciplinary medicine services: 1) the exploratory phase included a description of responses' saturation levels, factor and correlations analyses and an internal consistency analysis (Cronbach's alpha coefficient); 2) confirmatory phase used the Structural Equation Modeling (SEM); 3) reproducibility was studied by a test-retest. The overall response rate was 80 %; the completion average was 97 %. The metrological results were: a global Cronbach's alpha coefficient of 0.93, higher than 0.70 for 12 sub-dimensions; all Dillon-Goldstein's rho coefficients higher than 0.70; an excellent quality of external model with a Goodness of Fitness (GoF) criterion of 0.99. Seventy percent of the items had a reproducibility ranging from moderate (Intra-Class Coefficient between 50 and 70 % for 25 items) to good (ICC higher than 70 % for 33 items). COMEt (Contexte Organisationnel et Managérial en Etablissement de Santé) questionnaire is a validated multidimensional organizational culture questionnaire made of 6 dimensions, 21 sub-dimensions and 83 items. It is the first dimensional organizational culture questionnaire, specific to healthcare context, for a unit level assessment showing robust psychometric properties (validity and reliability). This tool is suited for research purposes, especially for assessing organizational context in research analysing the effectiveness of hospital quality improvement strategies. Our tool is also suited for an overall assessment of ward culture and could be a powerful trigger to improve management and clinical performance. Its psychometric properties in other health systems need to be tested.

Assessment of self-efficacy to employ self-initiated pornography use-reduction strategies.

PubMed

Kraus, Shane W; Rosenberg, Harold; Tompsett, Carolyn J

2015-01-01

This study evaluated several psychometric properties of a newly developed questionnaire designed to assess individuals' self-efficacy (from 0% to 100%) to employ self-initiated cognitive-behavioral strategies intended to reduce the frequency and duration of their pornography use. Using a web-based data collection procedure, we recruited 1298 male users of pornography to complete questionnaires assessing hypersexuality, pornography use history, and general self-efficacy. Based on a principal component analysis and examination of inter-item correlations, we deleted 13 items from the initial pool of 21 strategies. The resulting 8-item questionnaire had excellent internal consistency reliability, and a moderate mean inter-item correlation considered indicative of unidimensionality. In support of criterion validity, self-efficacy to employ use-reduction strategies was significantly associated with the frequency with which participants used pornography, with scores on a measure of hypersexuality, and with the number of times one had attempted to cut back using pornography. In support of discriminant validity, we found that pornography use-reduction self-efficacy scores were not strongly correlated with general self-efficacy. Both researchers and clinicians could use this questionnaire to assess pornography users' confidence to employ self-initiated strategies intended to reduce the duration and frequency with which they use pornography. Published by Elsevier Ltd.

Development of short and very short forms of the Children's Behavior Questionnaire.

PubMed

Putnam, Samuel P; Rothbart, Mary K

2006-08-01

Using data from 468 parents and taking into account internal consistency, breadth of item content, within-scale factor analysis, and patterns of missing data, we developed short (94 items, 15 scales) and very short (36 items, 3 broad scales) forms of the Children's Behavior Questionnaire (CBQ; Rothbart, Ahadi, & Hershey, 1994; Rothbart, Ahadi, Hershey, & Fisher, 2001), a well-established parent-report measure of temperament for children aged 3 to 8 years. We subsequently evaluated the forms with data from 1,189 participants. In mid/high-income and White samples, the CBQ short and very short forms demonstrated both satisfactory internal consistency and criterion validity, and exhibited longitudinal stability and cross-informant agreement comparable to that of the standard CBQ. Internal consistency was somewhat lower among African American and low-income samples for some scales. Very short form scales demonstrated acceptable internal consistency for all samples, and confirmatory factor analyses indicated marginal fit of the very short form items to a three-factor model.

Psychometric evaluation of a short measure of social capital at work.

PubMed

Kouvonen, Anne; Kivimäki, Mika; Vahtera, Jussi; Oksanen, Tuula; Elovainio, Marko; Cox, Tom; Virtanen, Marianna; Pentti, Jaana; Cox, Sara J; Wilkinson, Richard G

2006-10-13

Prior studies on social capital and health have assessed social capital in residential neighbourhoods and communities, but the question whether the concept should also be applicable in workplaces has been raised. The present study reports on the psychometric properties of an 8-item measure of social capital at work. Data were derived from the Finnish Public Sector Study (N = 48,592) collected in 2000-2002. Based on face validity, an expert unfamiliar with the data selected 8 questionnaire items from the available items for a scale of social capital. Reliability analysis included tests of internal consistency, item-total correlations, and within-unit (interrater) agreement by rwg index. The associations with theoretically related and unrelated constructs were examined to assess convergent and divergent validity (construct validity). Criterion-related validity was explored with respect to self-rated health using multilevel logistic regression models. The effects of individual level and work unit level social capital were modelled on self-rated health. The internal consistency of the scale was good (Cronbach's alpha = 0.88). The rwg index was 0.88, which indicates a significant within-unit agreement. The scale was associated with, but not redundant to, conceptually close constructs such as procedural justice, job control, and effort-reward imbalance. Its associations with conceptually more distant concepts, such as trait anxiety and magnitude of change in work, were weaker. In multilevel models, significantly elevated age adjusted odds ratios (ORs) of poor self-rated health (OR = 2.42, 95% confidence interval (CI): 2.24-2.61 for the women and OR = 2.99, 95% CI: 2.56-3.50 for the men) were observed for the employees in the lowest vs. highest quartile of individual level social capital. In addition, low social capital at the work unit level was associated with a higher likelihood of poor self-rated health. Psychometric techniques show our 8-item measure of social capital to be a valid tool reflecting the construct and displaying the postulated links with other variables.

Adaptive screening for depression--recalibration of an item bank for the assessment of depression in persons with mental and somatic diseases and evaluation in a simulated computer-adaptive test environment.

PubMed

Forkmann, Thomas; Kroehne, Ulf; Wirtz, Markus; Norra, Christine; Baumeister, Harald; Gauggel, Siegfried; Elhan, Atilla Halil; Tennant, Alan; Boecker, Maren

2013-11-01

This study conducted a simulation study for computer-adaptive testing based on the Aachen Depression Item Bank (ADIB), which was developed for the assessment of depression in persons with somatic diseases. Prior to computer-adaptive test simulation, the ADIB was newly calibrated. Recalibration was performed in a sample of 161 patients treated for a depressive syndrome, 103 patients from cardiology, and 103 patients from otorhinolaryngology (mean age 44.1, SD=14.0; 44.7% female) and was cross-validated in a sample of 117 patients undergoing rehabilitation for cardiac diseases (mean age 58.4, SD=10.5; 24.8% women). Unidimensionality of the itembank was checked and a Rasch analysis was performed that evaluated local dependency (LD), differential item functioning (DIF), item fit and reliability. CAT-simulation was conducted with the total sample and additional simulated data. Recalibration resulted in a strictly unidimensional item bank with 36 items, showing good Rasch model fit (item fit residuals<|2.5|) and no DIF or LD. CAT simulation revealed that 13 items on average were necessary to estimate depression in the range of -2 and +2 logits when terminating at SE≤0.32 and 4 items if using SE≤0.50. Receiver Operating Characteristics analysis showed that θ estimates based on the CAT algorithm have good criterion validity with regard to depression diagnoses (Area Under the Curve≥.78 for all cut-off criteria). The recalibration of the ADIB succeeded and the simulation studies conducted suggest that it has good screening performance in the samples investigated and that it may reasonably add to the improvement of depression assessment. © 2013.

The Chinese version of the Outcome Expectations for Exercise scale: validation study.

PubMed

Lee, Ling-Ling; Chiu, Yu-Yun; Ho, Chin-Chih; Wu, Shu-Chen; Watson, Roger

2011-06-01

Estimates of the reliability and validity of the English nine-item Outcome Expectations for Exercise (OEE) scale have been tested and found to be valid for use in various settings, particularly among older people, with good internal consistency and validity. Data on the use of the OEE scale among older Chinese people living in the community and how cultural differences might affect the administration of the OEE scale are limited. To test the validity and reliability of the Chinese version of the Outcome Expectations for Exercise scale among older people. A cross-sectional validation study was designed to test the Chinese version of the OEE scale (OEE-C). Reliability was examined by testing both the internal consistency for the overall scale and the squared multiple correlation coefficient for the single item measure. The validity of the scale was tested on the basis of both a traditional psychometric test and a confirmatory factor analysis using structural equation modelling. The Mokken Scaling Procedure (MSP) was used to investigate if there were any hierarchical, cumulative sets of items in the measure. The OEE-C scale was tested in a group of older people in Taiwan (n=108, mean age=77.1). There was acceptable internal consistency (alpha=.85) and model fit in the scale. Evidence of the validity of the measure was demonstrated by the tests for criterion-related validity and construct validity. There was a statistically significant correlation between exercise outcome expectations and exercise self-efficacy (r=.34, p<.01). An analysis of the Mokken Scaling Procedure found that nine items of the scale were all retained in the analysis and the resulting scale was reliable and statistically significant (p=.0008). The results obtained in the present study provided acceptable levels of reliability and validity evidence for the Chinese Outcome Expectations for Exercise scale when used with older people in Taiwan. Future testing of the OEE-C scale needs to be carried out to see whether these results are generalisable to older Chinese people living in urban areas. Copyright © 2010 Elsevier Ltd. All rights reserved.

Reliability and validity of the Daily Cognitive-Communication and Sleep Profile: a new instrument for monitoring sleep, wakefulness and daytime function.

PubMed

Fung, Christina Hoi Ling; Nguyen, Michelle; Moineddin, Rahim; Colantonio, Angela; Wiseman-Hakes, Catherine

2014-06-01

The Daily Cognitive Communicative and Sleep Profile (DCCASP) is a seven-item instrument that captures daily subjective sleep quality, perceived mood, cognitive, and communication functions. The objective of this study was to evaluate the reliability and validity of the DCCASP. The DCCASP was self-administered daily to a convenience sample of young adults (n = 54) for two two-week blocks, interspersed with a two-week rest period. Afterwards, participants completed the Pittsburgh Sleep Quality Index (PSQI). Internal consistency and criterion validity were calculated by Cronbach's α coefficient, Concordance Correlation Coefficient (CCC), and Spearman rank (rs) correlation coefficient, respectively. Results indicated high internal consistency (Cronbach-s α = 0.864-0.938) among mean ratings of sleep quality on the DCCASP. There were significant correlations between mean ratings of sleep quality and all domains (rs=0.38-0.55, p<0.0001). Criterion validity was established between mean sleep quality ratings on the DCCASP and PSQI (rs=0.40, p<0.001). The DCCASP is a reliable and valid self-report instrument to monitor daily sleep quality and perceived mood, cognitive, and communication functions over time, amongst a normative sample of young adults. Further studies on its psychometric properties are necessary to clarify its utility in a clinical population. Copyright © 2014 John Wiley & Sons, Ltd.

Development of a Breast Cancer Awareness Scale for Thai Women: Moving towards a Validated Measure.

PubMed

Rakkapao, Nitchamon; Promthet, Supannee; Moore, Malcolm A; Hurst, Cameron P

2016-01-01

Breast cancer is a major health problem among women around the world. Recent developments in screening and treatment have greatly improved the prognosis of patients with breast cancer in developed countries. However, in developing countries breast cancer mortality remains high.Breast cancer awareness is a first and important step in reducing breast cancer mortality. The development of a validated instrument to measure breast cancer awareness is crucial for the understanding and implementation of suitable health education programs to facilitate early deletion and minimize mortality. The objective of this study was to develop an instrument for the assessment of breast cancer awareness in Thai women. This methodological study was conducted in two stages: (1) literature searches and semi-structured interviews were conducted to generate items of the breast cancer awareness scale (B-CAS) which were subsequently examined for content and face validity, and (2) an exploration of the factor structure of the resulting instrument and an examination of its reliability. Data were collected using a self-administered questionnaire in Thai women aged 20-64 in August, 2015. A total of 219 women (response rate 97.4 %) participated in this validation study. The B-CAS contains five domains with 53 items on breast cancer awareness: 1) knowledge of risk factors, 2) knowledge of signs and symptoms, 3) attitude to breast cancer prevention, 4) barriers of breast screening, and 5) health behavior related to breast cancer awareness. Items with a content validity index <0.80 were excluded, and factor structure for the remaining items reflected the hypothesized five factor model. The scales based on all retained items was shown to have strongly internal consistency reliability (Cronbach's α=0.86). The B-CAS provides good psychometric properties to assess breast cancer awareness in women. It can be used to examine breast cancer awareness in Thai women and it could lead to the development and evaluation of suitable educational interventions for raising breast cancer awareness. Future research should focus on further validating the B-CAS including an assessment of construct and criterion-based validity.

Construction and Initial Validation of the Multiracial Experiences Measure (MEM)

PubMed Central

Yoo, Hyung Chol; Jackson, Kelly; Guevarra, Rudy P.; Miller, Matthew J.; Harrington, Blair

2015-01-01

This article describes the development and validation of the Multiracial Experiences Measure (MEM): a new measure that assesses uniquely racialized risks and resiliencies experienced by individuals of mixed racial heritage. Across two studies, there was evidence for the validation of the 25-item MEM with 5 subscales including Shifting Expressions, Perceived Racial Ambiguity, Creating Third Space, Multicultural Engagement, and Multiracial Discrimination. The 5-subscale structure of the MEM was supported by a combination of exploratory and confirmatory factor analyses. Evidence of criterion-related validity was partially supported with MEM subscales correlating with measures of racial diversity in one’s social network, color-blind racial attitude, psychological distress, and identity conflict. Evidence of discriminant validity was supported with MEM subscales not correlating with impression management. Implications for future research and suggestions for utilization of the MEM in clinical practice with multiracial adults are discussed. PMID:26460977

Construction and initial validation of the Multiracial Experiences Measure (MEM).

PubMed

Yoo, Hyung Chol; Jackson, Kelly F; Guevarra, Rudy P; Miller, Matthew J; Harrington, Blair

2016-03-01

This article describes the development and validation of the Multiracial Experiences Measure (MEM): a new measure that assesses uniquely racialized risks and resiliencies experienced by individuals of mixed racial heritage. Across 2 studies, there was evidence for the validation of the 25-item MEM with 5 subscales including Shifting Expressions, Perceived Racial Ambiguity, Creating Third Space, Multicultural Engagement, and Multiracial Discrimination. The 5-subscale structure of the MEM was supported by a combination of exploratory and confirmatory factor analyses. Evidence of criterion-related validity was partially supported with MEM subscales correlating with measures of racial diversity in one's social network, color-blind racial attitude, psychological distress, and identity conflict. Evidence of discriminant validity was supported with MEM subscales not correlating with impression management. Implications for future research and suggestions for utilization of the MEM in clinical practice with multiracial adults are discussed. (c) 2016 APA, all rights reserved).

Development and validation of a tool to evaluate the quality of medical education websites in pathology

PubMed Central

Alyusuf, Raja H.; Prasad, Kameshwar; Abdel Satir, Ali M.; Abalkhail, Ali A.; Arora, Roopa K.

2013-01-01

Background: The exponential use of the internet as a learning resource coupled with varied quality of many websites, lead to a need to identify suitable websites for teaching purposes. Aim: The aim of this study is to develop and to validate a tool, which evaluates the quality of undergraduate medical educational websites; and apply it to the field of pathology. Methods: A tool was devised through several steps of item generation, reduction, weightage, pilot testing, post-pilot modification of the tool and validating the tool. Tool validation included measurement of inter-observer reliability; and generation of criterion related, construct related and content related validity. The validated tool was subsequently tested by applying it to a population of pathology websites. Results and Discussion: Reliability testing showed a high internal consistency reliability (Cronbach's alpha = 0.92), high inter-observer reliability (Pearson's correlation r = 0.88), intraclass correlation coefficient = 0.85 and κ =0.75. It showed high criterion related, construct related and content related validity. The tool showed moderately high concordance with the gold standard (κ =0.61); 92.2% sensitivity, 67.8% specificity, 75.6% positive predictive value and 88.9% negative predictive value. The validated tool was applied to 278 websites; 29.9% were rated as recommended, 41.0% as recommended with caution and 29.1% as not recommended. Conclusion: A systematic tool was devised to evaluate the quality of websites for medical educational purposes. The tool was shown to yield reliable and valid inferences through its application to pathology websites. PMID:24392243

Validation of an Arabic version of the Diabetes Treatment Satisfaction Questionnaire in Qatar.

PubMed

Wilbur, Kerry; Al Hammaq, Abdulla O

2016-03-01

Several instruments evaluate patient-reported outcomes in diabetes mellitus (DM), but almost none are validated for use in Arabic language. The aim of this study is to test the psychometric properties and responsiveness of the Arabic version of the Diabetes Treatment Satisfaction Questionnaire (DTSQs) in Qatar. Ambulatory Arabic speaking DM patients were interviewed at two consecutive time points in Doha, Qatar. The 8-item DTSQs was administered in conjunction with the Medical Outcomes Study 36-Item Short-Form Health Survey (SF-36) and the World Health Organization Quality of Life Measure (WHOQOL-Bref) to assess convergent validity. Reliability was evaluated by internal consistency and item analysis. Construct validity was evaluated using "known groups" comparisons (including gender, insulin use, and HbA1c). Sensitivity of DTSQs scores to the subject's metabolic conditions was determined. One hundred subjects (mean age 50.7) participated. Half (54%) were female. The majority (93%) had Type 2 DM, but 39 (42%) were using insulin. Results revealed satisfactory internal consistency. Metabolic measures (fasting blood glucose and AIC) had significant inverse correlations with DTSQs scores (interview 1, Pearson's r=-0.333 and r=-0.401, respectively, p<0.01). Scale criterion and construct validity were found to be satisfactory. Most sub-dimensions of the SF-36 and WHOQOL-Bref were correlated with the DTSQ, indicating a good concurrent validity. As in prior studies, women demonstrated poorer treatment satisfaction. The Qatar Arabic DTSQs version was found to be a reliable and valid instrument for the assessment of treatment satisfaction in Arabic diabetes mellitus patients in the country. Copyright © 2016 Elsevier Ireland Ltd. All rights reserved.

Development and psychometric properties of an informant assessment scale of theory of mind for adults with traumatic brain injury.

PubMed

Zhang, Dengke; Pang, Yanxia; Cai, Weixiong; Fazio, Rachel L; Ge, Jianrong; Su, Qiaorong; Xu, Shuiqin; Pan, Yinan; Chen, Sanmei; Zhang, Hongwei

2016-08-01

Impairment of theory of mind (ToM) is a common phenomenon following traumatic brain injury (TBI) that has clear effects on patients' social functioning. A growing body of research has focused on this area, and several methods have been developed to assess ToM deficiency. Although an informant assessment scale would be useful for examining individuals with TBI, very few studies have adopted this approach. The purpose of the present study was to develop an informant assessment scale of ToM for adults with traumatic brain injury (IASToM-aTBI) and to test its reliability and validity with 196 adults with TBI and 80 normal adults. A 44-item scale was developed following a literature review, interviews with patient informants, consultations with experts, item analysis, and exploratory factor analysis (EFA). The following three common factors were extracted: social interaction, understanding of beliefs, and understanding of emotions. The psychometric analyses indicate that the scale has good internal consistency reliability, split-half reliability, test-retest reliability, inter-rater reliability, structural validity, discriminate validity and criterion validity. These results provide preliminary evidence that supports the reliability and validity of the IASToM-aTBI as a ToM assessment tool for adults with TBI.

The development and preliminary validation of the behavior, environment, and changeability survey (BECS).

PubMed

Walsh, Jennifer R; Hebert, Angel; Byrd-Bredbenner, Carol; Carey, Gale; Colby, Sarah; Brown-Esters, Onikia N; Greene, Geoffrey; Hoerr, Sharon; Horacek, Tanya; Kattelmann, Kendra; Kidd, Tandalayo; Koenings, Mallory; Phillips, Beatrice; Shelnutt, Karla P; White, Adrienne A

2012-01-01

To develop and test the validity of the Behavior, Environment, and Changeability Survey (BECS) for identifying the importance and changeability of nutrition, exercise, and stress management behavior and related aspects of the environment. A cross-sectional, online survey of the BECS and selected validated instruments. Ten state universities. A convenience sample of college students (n = 1,283), ages 18-24 years. Principal component analysis was used to confirm a 6-component structure of the BECS in 2 independent samples for the purpose of cross-validation. Internal consistency was measured and construct and criterion-related analyses were conducted to test the reliability and validity of the BECS subscales. Six components representing 34 BECS items were revealed from the original 69 items and explained 64% of the total variance. Six scales were retained, and internal consistency of each ranged from α = .82 to .93. BECS Nutrition Behavior and Nutrition Changeability scale scores were highest for participants in action/maintenance Stages of Change for fruit and vegetable intake. There is strong support for the use of the BECS when planning health programs to gain insight into behavior that young adults are willing to improve, specifically related to nutrition, exercise, and sleep. Copyright © 2012 Society for Nutrition Education and Behavior. Published by Elsevier Inc. All rights reserved.

Validation of cross-cultural child mental health and psychosocial research instruments: adapting the Depression Self-Rating Scale and Child PTSD Symptom Scale in Nepal

PubMed Central

2011-01-01

Background The lack of culturally adapted and validated instruments for child mental health and psychosocial support in low and middle-income countries is a barrier to assessing prevalence of mental health problems, evaluating interventions, and determining program cost-effectiveness. Alternative procedures are needed to validate instruments in these settings. Methods Six criteria are proposed to evaluate cross-cultural validity of child mental health instruments: (i) purpose of instrument, (ii) construct measured, (iii) contents of construct, (iv) local idioms employed, (v) structure of response sets, and (vi) comparison with other measurable phenomena. These criteria are applied to transcultural translation and alternative validation for the Depression Self-Rating Scale (DSRS) and Child PTSD Symptom Scale (CPSS) in Nepal, which recently suffered a decade of war including conscription of child soldiers and widespread displacement of youth. Transcultural translation was conducted with Nepali mental health professionals and six focus groups with children (n = 64) aged 11-15 years old. Because of the lack of child mental health professionals in Nepal, a psychosocial counselor performed an alternative validation procedure using psychosocial functioning as a criterion for intervention. The validation sample was 162 children (11-14 years old). The Kiddie-Schedule for Affective Disorders and Schizophrenia (K-SADS) and Global Assessment of Psychosocial Disability (GAPD) were used to derive indication for treatment as the external criterion. Results The instruments displayed moderate to good psychometric properties: DSRS (area under the curve (AUC) = 0.82, sensitivity = 0.71, specificity = 0.81, cutoff score ≥ 14); CPSS (AUC = 0.77, sensitivity = 0.68, specificity = 0.73, cutoff score ≥ 20). The DSRS items with significant discriminant validity were "having energy to complete daily activities" (DSRS.7), "feeling that life is not worth living" (DSRS.10), and "feeling lonely" (DSRS.15). The CPSS items with significant discriminant validity were nightmares (CPSS.2), flashbacks (CPSS.3), traumatic amnesia (CPSS.8), feelings of a foreshortened future (CPSS.12), and easily irritated at small matters (CPSS.14). Conclusions Transcultural translation and alternative validation feasibly can be performed in low clinical resource settings through task-shifting the validation process to trained mental health paraprofessionals using structured interviews. This process is helpful to evaluate cost-effectiveness of psychosocial interventions. PMID:21816045

Screening for hearing, visual and dual sensory impairment in older adults using behavioural cues: a validation study.

PubMed

Roets-Merken, Lieve M; Zuidema, Sytse U; Vernooij-Dassen, Myrra J F J; Kempen, Gertrudis I J M

2014-11-01

This study investigated the psychometric properties of the Severe Dual Sensory Loss screening tool, a tool designed to help nurses and care assistants to identify hearing, visual and dual sensory impairment in older adults. Construct validity of the Severe Dual Sensory Loss screening tool was evaluated using Crohnbach's alpha and factor analysis. Interrater reliability was calculated using Kappa statistics. To evaluate the predictive validity, sensitivity and specificity were calculated by comparison with the criterion standard assessment for hearing and vision. The criterion used for hearing impairment was a hearing loss of ≥40 decibel measured by pure-tone audiometry, and the criterion for visual impairment was a visual acuity of ≤0.3 diopter or a visual field of ≤0.3°. Feasibility was evaluated by the time needed to fill in the screening tool and the clarity of the instruction and items. Prevalence of dual sensory impairment was calculated. A total of 56 older adults receiving aged care and 12 of their nurses and care assistants participated in the study. Crohnbach's alpha was 0.81 for the hearing subscale and 0.84 for the visual subscale. Factor analysis showed two constructs for hearing and two for vision. Kappa was 0.71 for the hearing subscale and 0.74 for the visual subscale. The predictive validity showed a sensitivity of 0.71 and a specificity of 0.72 for the hearing subscale; and a sensitivity of 0.69 and a specificity of 0.78 for the visual subscale. The optimum cut-off point for each subscale was score 1. The nurses and care assistants reported that the Severe Dual Sensory Loss screening tool was easy to use. The prevalence of hearing and vision impairment was 55% and 29%, respectively, and that of dual sensory impairment was 20%. The Severe Dual Sensory Loss screening tool was compared with the criterion standards for hearing and visual impairment and was found a valid and reliable tool, enabling nurses and care assistants to identify hearing, visual and dual sensory impairment among older adults. Copyright © 2014 Elsevier Ltd. All rights reserved.

[ICF-Checklist to Evaluate Inclusion of Elderlies with Intellectual Disability - Psychometric Properties].

PubMed

Queri, Silvia; Eggart, Michael; Wendel, Maren; Peter, Ulrike

2017-11-28

Background An instrument should have been developed to measure participation as one possible criterion to evaluate inclusion of elderly people with intellectual disability. The ICF was utilized, because participation is one part of health related functioning, respectively disability. Furthermore ICF includes environmental factors (contextual factors) and attaches them an essentially influence on health related functioning, in particular on participation. Thus ICF Checklist additionally identifies environmental barriers for elimination. Methodology A linking process with VINELAND-II yielded 138 ICF items for the Checklist. The sample consists of 50 persons with a light or moderate intellectual disability. Two-thirds are female and the average age is 68. They were directly asked about their perceived quality of life. Additionally, proxy interviews were carried out with responsible staff members concerning necessary support and behavioral deviances. The ICF Checklist was administered twice, once (t2) the current staff member should rate health related functioning at the given time and in addition, a staff member who knows the person at least 10 years before (t1) should rate the former functioning. Content validity was investigated with factor analysis and criterion validity with correlational analysis related to supports need, behavioral deviances and perceived quality of life. Quantitative analysis was validated by qualitative content analysis of patient documentation. Results Factor analysis shows logical variable clusters across the extracted factors but neither interpretable factors. The Checklist is reliable, valid related to the chosen criterions and shows the expected age-related shifts. Qualitative analysis corresponds with quantitative data. Consequences/Conclusion ICF Checklist is appropriate to manage and evaluate patient-centered care. © Georg Thieme Verlag KG Stuttgart · New York.

A newer and broader definition of burnout: validation of the "Burnout Clinical Subtype Questionnaire (BCSQ-36)".

PubMed

Montero-Marín, Jesús; García-Campayo, Javier

2010-06-02

Burnout syndrome has been clinically characterised by a series of three subtypes: frenetic, underchallenged, and worn-out, with reference to coping strategies for stress and frustration at work with different degrees of dedication. The aims of the study are to present an operating definition of these subtypes in order to assess their reliability and convergent validity with respect to a standard burnout criterion and to examine differences with regard to sex and the temporary nature of work contracts. An exploratory factor analysis was performed by the main component method on a range of items devised by experts. The sample was composed of 409 employees of the University of Zaragoza, Spain. The reliability of the scales was assessed with Cronbach's alpha, convergent validity in relation to the Maslach Burnout Inventory with Pearson's r, and differences with Student's t-test and the Mann-Whitney U test. The factorial validity and reliability of the scales were good. The subtypes presented relations of differing degrees with the criterion dimensions, which were greater when dedication to work was lower. The frenetic profile presented fewer relations with the criterion dimensions while the worn-out profile presented relations of the greatest magnitude. Sex was not influential in establishing differences. However, the temporary nature of work contracts was found to have an effect: temporary employees exhibited higher scores in the frenetic profile (p < 0.001), while permanent employees did so in the underchallenged (p = 0.018) and worn-out (p < 0.001) profiles. The classical Maslach description of burnout does not include the frenetic profile; therefore, these patients are not recognised. The developed questionnaire may be a useful tool for the design and appraisal of specific preventive and treatment approaches based on the type of burnout experienced.

Validation of the Internet Gaming Disorder Scale - Short-Form (IGDS9-SF) in an Italian-speaking sample.

PubMed

Monacis, Lucia; Palo, Valeria de; Griffiths, Mark D; Sinatra, Maria

2016-12-01

Background and aims The inclusion of Internet Gaming Disorder (IGD) in Section III of the fifth edition of the Diagnostic and Statistical Manual of Mental Disorders has increased the interest of researchers in the development of new standardized psychometric tools for the assessment of such a disorder. To date, the nine-item Internet Gaming Disorder Scale - Short-Form (IGDS9-SF) has only been validated in English, Portuguese, and Slovenian languages. Therefore, the aim of this investigation was to examine the psychometric properties of the IGDS9-SF in an Italian-speaking sample. Methods A total of 757 participants were recruited to the present study. Confirmatory factor analysis and multi-group analyses were applied to assess the construct validity. Reliability analyses comprised the average variance extracted, the standard error of measurement, and the factor determinacy coefficient. Convergent and criterion validities were established through the associations with other related constructs. The receiver operating characteristic curve analysis was used to determine an empirical cut-off point. Results Findings confirmed the single-factor structure of the instrument, its measurement invariance at the configural level, and the convergent and criterion validities. Satisfactory levels of reliability and a cut-off point of 21 were obtained. Discussion and conclusions The present study provides validity evidence for the use of the Italian version of the IGDS9-SF and may foster research into gaming addiction in the Italian context.

Validation of the Internet Gaming Disorder Scale – Short-Form (IGDS9-SF) in an Italian-speaking sample

PubMed Central

Monacis, Lucia; de Palo, Valeria; Griffiths, Mark D.; Sinatra, Maria

2016-01-01

Background and aims The inclusion of Internet Gaming Disorder (IGD) in Section III of the fifth edition of the Diagnostic and Statistical Manual of Mental Disorders has increased the interest of researchers in the development of new standardized psychometric tools for the assessment of such a disorder. To date, the nine-item Internet Gaming Disorder Scale – Short-Form (IGDS9-SF) has only been validated in English, Portuguese, and Slovenian languages. Therefore, the aim of this investigation was to examine the psychometric properties of the IGDS9-SF in an Italian-speaking sample. Methods A total of 757 participants were recruited to the present study. Confirmatory factor analysis and multi-group analyses were applied to assess the construct validity. Reliability analyses comprised the average variance extracted, the standard error of measurement, and the factor determinacy coefficient. Convergent and criterion validities were established through the associations with other related constructs. The receiver operating characteristic curve analysis was used to determine an empirical cut-off point. Results Findings confirmed the single-factor structure of the instrument, its measurement invariance at the configural level, and the convergent and criterion validities. Satisfactory levels of reliability and a cut-off point of 21 were obtained. Discussion and conclusions The present study provides validity evidence for the use of the Italian version of the IGDS9-SF and may foster research into gaming addiction in the Italian context. PMID:27876422

Psychometric validation of the Turkish nine-item Internet Gaming Disorder Scale-Short Form (IGDS9-SF).

PubMed

Evren, Cuneyt; Dalbudak, Ercan; Topcu, Merve; Kutlu, Nilay; Evren, Bilge; Pontes, Halley M

2018-07-01

The main aims of the current study were to test the factor structure, reliability and validity of the nine-item Internet Gaming Disorder Scale-Short Form (IGDS9-SF), a standardized measure to assess symptoms and prevalence of Internet Gaming Disorder (IGD). In the present study participants were assessed with the IGDS9-SF, nine-item Internet Gaming Disorder Scale (IGDS) and the Young's Internet Addiction Test-Short Form (YIAT-SF). Confirmatory factor analyzes demonstrated that the factor structure (i.e., the dimensional structure) of the IGDS9-SF was satisfactory. The scale was also reliable (i.e., internally consistent with a Cronbach's alpha of 0.89) and showed adequate convergent and criterion-related validity, as indicated by statistically significant positive correlations between average time daily spent playing games during last year, IGDS and YIAT-SF scores. By applying the Diagnostic and Statistical Manual of Mental Disorders (DSM-5) threshold for diagnosing IGD (e.g., endorsing at least five criteria), it was found that the prevalence of disordered gamers ranged from 0.96% (whole sample) to 2.57% (e-sports players). These findings support the Turkish version of the IGDS9-SF as a valid and reliable tool for determining the extent of IGD-related problems among young adults and for the purposes of early IGD diagnosis in clinical settings and similar research. Copyright © 2018 Elsevier B.V. All rights reserved.

Evaluation of the psychometric properties of the PROMIS Cancer Fatigue Short Form with cancer patients.

PubMed

Cessna, Julie M; Jim, Heather S L; Sutton, Steven K; Asvat, Yasmin; Small, Brent J; Salsman, John M; Zachariah, Babu; Fishman, Mayer; Field, Teresa; Fernandez, Hugo; Perez, Lia; Jacobsen, Paul B

2016-02-01

Fatigue is common among cancer patients and adversely impacts quality of life. As such, it is important to measure fatigue accurately in a way that is not burdensome to patients. The 7-item Patient Reported Outcome Measurement Information System (PROMIS) Cancer Fatigue Short Form scale was recently developed using item response theory (IRT). The current study evaluated the psychometric properties of this scale in two samples of cancer patients using classical test theory (CTT). Two samples were used: 121 men with prostate cancer and 136 patients scheduled to undergo hematopoietic cell transplantation (HCT) for hematologic cancer. All participants completed the PROMIS Cancer Fatigue Short Form as well as validated measures of fatigue, vitality, and depression. HCT patients also completed measures of anxiety, perceived stress, and a clinical interview designed to identify cases of cancer-related fatigue. PROMIS Cancer Fatigue Short Form items loaded on a single factor (CFI=0.948) and the scale demonstrated good internal consistency reliability in both samples (Cronbach's alphas>0.86). Correlations with psychosocial measures were significant (p values<.0001) and in the expected direction, offering evidence for convergent and concurrent validity. PROMIS Fatigue scores were significantly higher in patients who met case definition criteria for cancer-related fatigue (p<.0001), demonstrating criterion validity. The current study provides evidence that the PROMIS Cancer Fatigue Short Form is a reliable and valid measure of fatigue in cancer patients. Copyright © 2015 Elsevier Inc. All rights reserved.

Montreal Battery of Evaluation of Amusia: Validity evidence and norms for adolescents in Belo Horizonte, Minas Gerais, Brazil

PubMed Central

Nunes-Silva, Marília; Haase, Vitor Geraldi

2012-01-01

The Montreal Battery of Evaluation of Amusia (MBEA) is a battery of tests that assesses six music processing components: scale, contour, interval, rhythm, metric, and music memory. The present study sought to verify the psychometric characteristics of the MBEA in a sample of 150 adolescents aged 14-18 years in the city of Belo Horizonte, Minas Gerais, Brazil, and to develop specific norms for this population. We used statistical procedures that explored the dimensional structure of the MBEA and its items, evaluating their adequacy from empirical data, verifying their reliability, and providing evidence of validity. The results for the difficult levels for each test indicated a trend toward higher scores, corroborating previous studies. From the analysis of the criterion groups, almost all of the items were considered discriminatory. The global score of the MBEA was shown to be valid and reliable (rK-R20=0.896) for assessing the musical ability of normal teenagers. Based on the analysis of the items, we proposed a short version of the MBEA. Further studies with larger samples and amusic individuals are necessary to provide evidence of the validity of the MBEA in the Brazilian milieu. The present study brings to the Brazilian context a tool for diagnosing deficits in musical skills and will serve as a basis for comparisons with single case studies and studies of populations with specific neuropsychological syndromes. PMID:29213804

Evaluation of the Psychometric Properties of the PROMIS Cancer Fatigue Short Form with Cancer Patients

PubMed Central

Cessna, Julie M.; Jim, Heather S.L.; Sutton, Steven K.; Asvat, Yasmin; Small, Brent J.; Salsman, John M.; Zachariah, Babu; Fishman, Mayer; Field, Teresa; Fernandez, Hugo; Perez, Lia; Jacobsen, Paul B.

2016-01-01

Objective Fatigue is common among cancer patients and adversely impacts quality of life. As such, it is important to measure fatigue accurately in a way that is not burdensome to patients. The 7-item Patient Reported Outcome Measurement Information System (PROMIS) Cancer Fatigue Short Form scale was recently developed using item response theory (IRT). The current study evaluated the psychometric properties of this scale in two samples of cancer patients using classical test theory (CTT). Methods Two samples were used: 121 men with prostate cancer and 136 patients scheduled to undergo hematopoietic cell transplantation (HCT) for hematologic cancer. All participants completed the PROMIS Cancer Fatigue Short Form as well as validated measures of fatigue, vitality, and depression. HCT patients also completed measures of anxiety, perceived stress, and a clinical interview designed to identify cases of cancer -related fatigue. Results PROMIS Cancer Fatigue Short Form items loaded on a single factor (CFI = 0.948) and the scale demonstrated good internal consistency reliability in both samples (Cronbach’s alphas > 0.86). Correlations with psychosocial measures were significant (p-values < .0001) and in the expected direction, offering evidence for convergent and concurrent validity. PROMIS Fatigue scores were significantly higher in patients who met case definition criteria for cancer-related fatigue (p < .0001), demonstrating criterion validity. Conclusion The current study provides evidence that the PROMIS Cancer Fatigue Short Form is a reliable and valid measure of fatigue in cancer patients. PMID:26800633

Test Design Optimization in CAT Early Stage with the Nominal Response Model

ERIC Educational Resources Information Center

Passos, Valeria Lima; Berger, Martijn P. F.; Tan, Frans E.

2007-01-01

The early stage of computerized adaptive testing (CAT) refers to the phase of the trait estimation during the administration of only a few items. This phase can be characterized by bias and instability of estimation. In this study, an item selection criterion is introduced in an attempt to lessen this instability: the D-optimality criterion. A…

On the Dynamic Nature of Response Criterion in Recognition Memory: Effects of Base Rate, Awareness, and Feedback

ERIC Educational Resources Information Center

Rhodes, Matthew G.; Jacoby, Larry L.

2007-01-01

The authors examined whether participants can shift their criterion for recognition decisions in response to the probability that an item was previously studied. Participants in 3 experiments were given recognition tests in which the probability that an item was studied was correlated with its location during the test. Results from all 3…

Relapse Risk Assessment for Schizophrenia Patients (RASP): A New Self-Report Screening Tool.

PubMed

Velligan, Dawn; Carpenter, William; Waters, Heidi C; Gerlanc, Nicole M; Legacy, Susan N; Ruetsch, Charles

2018-01-01

The Relapse Assessment for Schizophrenia Patients (RASP) was developed as a six-question self-report screener that measures indicators of Increased Anxiety and Social Isolation to assess patient stability and predict imminent relapse. This paper describes the development and psychometric characteristics of the RASP. The RASP and Positive and Negative Syndrome Scale (PANSS) were administered to patients with schizophrenia (n=166) three separate times. Chart data were collected on a subsample of patients (n=81). Psychometric analyses of RASP included tests of reliability, construct validity, and concurrent validity of items. Factors from RASP were correlated with subscales from PANSS (sensitivity to change and criterion validity [agreement between RASP and evidence of relapse]). Test-retest reliability returned modest to strong agreement at the item level and strong agreement at the questionnaire level. RASP showed good item response curves and internal consistency for the total instrument and within each of the two subscales (Increased Anxiety and Social Isolation). RASP Total Score and subscales showed good concurrent validity when correlated with PANSS Total Score, Positive, Excitement, and Anxiety subscales. RASP correctly predicted relapse in 67% of cases, with good specificity and negative predictive power and acceptable positive predictive power and sensitivity. The reliability and validity data presented support the use of RASP in settings where addition of a brief self-report assessment of relapse risk among patients with schizophrenia may be of benefit. Ease of use and scoring, and the ability to administer without clinical supervision allows for routine administration and assessment of relapse risk.

Evaluation of Criterion Validity for Scales with Congeneric Measures

ERIC Educational Resources Information Center

Raykov, Tenko

2007-01-01

A method for estimating criterion validity of scales with homogeneous components is outlined. It accomplishes point and interval estimation of interrelationship indices between composite scores and criterion variables and is useful for testing hypotheses about criterion validity of measurement instruments. The method can also be used with missing…

Psychometric assessment of a scale to measure bonding workplace social capital

PubMed Central

Tsutsumi, Akizumi; Inoue, Akiomi; Odagiri, Yuko

2017-01-01

Objectives Workplace social capital (WSC) has attracted increasing attention as an organizational and psychosocial factor related to worker health. This study aimed to assess the psychometric properties of a newly developed WSC scale for use in work environments, where bonding social capital is important. Methods We assessed the psychometric properties of a newly developed 6-item scale to measure bonding WSC using two data sources. Participants were 1,650 randomly selected workers who completed an online survey. Exploratory factor analyses were conducted. We examined the item–item and item–total correlations, internal consistency, and associations between scale scores and a previous 8-item measure of WSC. We evaluated test–retest reliability by repeating the survey with 900 of the respondents 2 weeks later. The overall scale reliability was quantified by an intraclass coefficient and the standard error of measurement. We evaluated convergent validity by examining the association with several relevant workplace psychosocial factors using a dataset from workers employed by an electrical components company (n = 2,975). Results The scale was unidimensional. The item–item and item–total correlations ranged from 0.52 to 0.78 (p < 0.01) and from 0.79 to 0.89 (p < 0.01), respectively. Internal consistency was good (Cronbach’s α coefficient: 0.93). The correlation with the 8-item scale indicated high criterion validity (r = 0.81) and the scale showed high test–retest reliability (r = 0.74, p < 0.01). The intraclass coefficient and standard error of measurement were 0.74 (95% confidence intervals: 0.71–0.77) and 4.04 (95% confidence intervals: 1.86–6.20), respectively. Correlations with relevant workplace psychosocial factors showed convergent validity. Conclusions The results confirmed that the newly developed WSC scale has adequate psychometric properties. PMID:28662058

Varying the valuating function and the presentable bank in computerized adaptive testing.

PubMed

Barrada, Juan Ramón; Abad, Francisco José; Olea, Julio

2011-05-01

In computerized adaptive testing, the most commonly used valuating function is the Fisher information function. When the goal is to keep item bank security at a maximum, the valuating function that seems most convenient is the matching criterion, valuating the distance between the estimated trait level and the point where the maximum of the information function is located. Recently, it has been proposed not to keep the same valuating function constant for all the items in the test. In this study we expand the idea of combining the matching criterion with the Fisher information function. We also manipulate the number of strata into which the bank is divided. We find that the manipulation of the number of items administered with each function makes it possible to move from the pole of high accuracy and low security to the opposite pole. It is possible to greatly improve item bank security with much fewer losses in accuracy by selecting several items with the matching criterion. In general, it seems more appropriate not to stratify the bank.

Measuring family functioning in families with parental cancer: Reliability and validity of the German adaptation of the Family Assessment Device (FAD).

PubMed

Beierlein, Volker; Bultmann, Johanna Christine; Möller, Birgit; von Klitzing, Kai; Flechtner, Hans-Henning; Resch, Franz; Herzog, Wolfgang; Brähler, Elmar; Führer, Daniel; Romer, Georg; Koch, Uwe; Bergelt, Corinna

2017-02-01

The concept of family functioning is gaining importance in psycho-oncology research and health care services. The Family Assessment Device (FAD) is a well-established measure of family functioning. Psychometric properties inherent in the German 51-item adaptation of the FAD are examined in different samples of families with parental cancer. Acceptance, reliability, and validity of FAD scales are analysed in samples from different study settings (N=1701 cancer patients, N=261 partners, N=158 dependent adolescent children 11 to 18years old). Missing items in the FAD scales (acceptance) are rare for adults (<1.1%) and adolescent children (<4.4%). In samples of adults and older adolescents (15 to 18years), all FAD scales except for the Roles scale are significantly reliable (0.75≤Cronbach's α≤0.88). The scales correlate highly (0.46≤Pearson's r≤0.59) with the criterion satisfaction with family life (convergent validity), and have smaller correlations (0.16≤r≤0.49) with measures of emotional distress and subjective well-being (divergent validity). In most FAD scales, adults seeking family counselling report worse family functioning (0.24≤Cohen's d≤0.59) than adults in other samples with parental cancer (discriminative validity). Overall, the German 51-item adaptation of the FAD reveals good acceptance, reliability, and validity for cancer patients and their relatives. Particularly the scale General Functioning shows excellent psychometric properties. The FAD is suitable in the assessment of families with parental cancer for adults and adolescents older than 11years. Copyright © 2016 Elsevier Inc. All rights reserved.

Adolescent substance use screening in primary care: validity of computer self-administered vs. clinician-administered screening

PubMed Central

Harris, Sion Kim; Knight, John R; Van Hook, Shari; Sherritt, Lon; Brooks, Traci; Kulig, John W; Nordt, Christina; Saitz, Richard

2015-01-01

Background Computer self-administration may help busy pediatricians’ offices increase adolescent substance use screening rates efficiently and effectively, if proven to yield valid responses. The CRAFFT screening protocol for adolescents has demonstrated validity as an interview, but a computer self-entry approach needs validity testing. The aim of this study was to evaluate the criterion validity and time efficiency of a computerized adolescent substance use screening protocol implemented by self-administration or clinician-administration. Methods 12- to 17-year-old patients coming for routine care at three primary care clinics completed the computerized screen by both self-administration and clinician-administration during their visit. To account for order effects, we randomly assigned participants to self-administer the screen either before or after seeing their clinician. Both were conducted using a tablet computer and included identical items (any past-12-month use of tobacco, alcohol, drugs; past-3-months frequency of each; and six CRAFFT items). The criterion measure for substance use was the Timeline Follow-Back, and for alcohol/drug use disorder, the Adolescent Diagnostic Interview, both conducted by confidential research assistant-interview after the visit. Tobacco dependence risk was assessed with the self-administered Hooked on Nicotine Checklist (HONC). Analyses accounted for the multi-site cluster sampling design. Results Among 136 participants, mean age was 15.0±1.5 yrs, 54% were girls, 53% were Black or Hispanic, and 67% had ≥3 prior visits with their clinician. Twenty-seven percent reported any substance use (including tobacco) in the past 12 months, 7% met criteria for an alcohol or cannabis use disorder, and 4% were HONC-positive. Sensitivity/specificity of the screener were high for detecting past-12-month use or disorder and did not differ between computer and clinician. Mean completion time was 49 seconds (95%CI 44-54) for computer and 74 seconds (95%CI 68-87) for clinician (paired comparison p<0.001). Conclusions Substance use screening by computer self-entry is a valid and time-efficient alternative to clinician-administered screening. PMID:25774878

Development of the Informing Relatives Inventory (IRI): Assessing Index Patients' Knowledge, Motivation and Self-Efficacy Regarding the Disclosure of Hereditary Cancer Risk Information to Relatives.

PubMed

de Geus, Eveline; Aalfs, Cora M; Menko, Fred H; Sijmons, Rolf H; Verdam, Mathilde G E; de Haes, Hanneke C J M; Smets, Ellen M A

2015-08-01

Despite the use of genetic services, counselees do not always share hereditary cancer information with at-risk relatives. Reasons for not informing relatives may be categorized as a lack of: knowledge, motivation, and/or self-efficacy. This study aims to develop and test the psychometric properties of the Informing Relatives Inventory, a battery of instruments that intend to measure counselees' knowledge, motivation, and self-efficacy regarding the disclosure of hereditary cancer risk information to at-risk relatives. Guided by the proposed conceptual framework, existing instruments were selected and new instruments were developed. We tested the instruments' acceptability, dimensionality, reliability, and criterion-related validity in consecutive index patients visiting the Clinical Genetics department with questions regarding hereditary breast and/or ovarian cancer or colon cancer. Data of 211 index patients were included (response rate = 62%). The Informing Relatives Inventory (IRI) assesses three barriers in disclosure representing seven domains. Instruments assessing index patients' (positive) motivation and self-efficacy were acceptable and reliable and suggested good criterion-related validity. Psychometric properties of instruments assessing index patients knowledge were disputable. These items were moderately accepted by index patients and the criterion-related validity was weaker. This study presents a first conceptual framework and associated inventory (IRI) that improves insight into index patients' barriers regarding the disclosure of genetic cancer information to at-risk relatives. Instruments assessing (positive) motivation and self-efficacy proved to be reliable measurements. Measuring index patients knowledge appeared to be more challenging. Further research is necessary to ensure IRI's dimensionality and sensitivity to change.

Occupation-specific screening for future sickness absence: criterion validity of the trucker strain monitor (TSM).

PubMed

De Croon, Einar M; Blonk, Roland W B; Sluiter, Judith K; Frings-Dresen, Monique H W

2005-02-01

Monitoring psychological job strain may help occupational physicians to take preventive action at the appropriate time. For this purpose, the 10-item trucker strain monitor (TSM) assessing work-related fatigue and sleeping problems in truck drivers was developed. This study examined (1) test-retest reliability, (2) criterion validity of the TSM with respect to future sickness absence due to psychological health complaints and (3) usefulness of the TSM two-scales structure. The TSM and self-administered questionnaires, providing information about stressful working conditions (job control and job demands) and sickness absence, were sent to a random sample of 2000 drivers in 1998. Of the 1123 responders, 820 returned a completed questionnaire 2 years later (response: 72%). The TSM work-related fatigue scale, the TSM sleeping problems scale and the TSM composite scale showed satisfactory 2-year test-retest reliability (coefficient r=0.62, 0.66 and 0.67, respectively). The work-related fatigue, sleeping problems scale and composite scale had sensitivities of 61, 65 and 61%, respectively in identifying drivers with future sickness absence due to psychological health complaints. The specificity and positive predictive value of the TSM composite scale were 77 and 11%, respectively. The work-related fatigue scale and the sleeping problems scale were moderately strong correlated (r=0.62). However, stressful working conditions were differentially associated with the two scales. The results support the test-retest reliability, criterion validity and two-factor structure of the TSM. In general, the results suggest that the use of occupation-specific psychological job strain questionnaires is fruitful.

Validation of the Dutch Eating Behaviour Questionnaire (DEBQ) among Maltese women.

PubMed

Dutton, Elaine; Dovey, Terence M

2016-12-01

The main aim of this study was to assess the dimensional structure of the Maltese version of the Dutch Eating Behaviour Questionnaire (DEBQ) and evaluate the instrument's validity and reliability among Maltese women (N = 586). Exploratory factor analysis reflected the theoretical structure of three factors; emotional, restrained and external eating which was supported by a Confirmatory Factor analysis. Minor issues with specific items in the Emotional and External eating scale were identified and discussed. Criterion-related validity was ascertained through correlations with the EAT-26. The study also assessed the DEBQ's predictive value in differentiating between BMI groups and between dieters and weight maintainers. The results suggest that the Maltese DEBQ is a psychometrically valid and reliable instrument for assessing eating behaviours with women in the Maltese community. The study also highlights the critical role of Emotional and Restrained eating in dieting and overweight Maltese women. Copyright © 2016 Elsevier Ltd. All rights reserved.

Development and evaluation of short forms of the Pain Catastrophizing Scale and the Pain Self-efficacy Questionnaire.

PubMed

McWilliams, L A; Kowal, J; Wilson, K G

2015-10-01

To facilitate efficient screening and reduce the length of comprehensive self-report batteries, a four-item short form of the Pain Catastrophizing Scale (PCS) and a two-item short form of the Pain Self-Efficacy Questionnaire (PSEQ) have been developed and evaluated in samples of patients with arm and upper extremity pain. The first aim of this study was to evaluate these short forms in a heterogeneous sample of patients seeking treatment for chronic musculoskeletal pain, using a priori criteria for determining adequate internal consistency, construct validity and sensitivity to change. In addition, the findings of past studies were used to identify items suitable for new and potentially stronger short forms of these measures. Data were provided by 280 patients who completed the original PCS and PSEQ as part of an interdisciplinary rehabilitation programme. The previously developed four-item PCS and the newly developed six-item short form of the PCS both met the internal consistency and construct validity criteria. They did not meet the criterion regarding sensitivity to change. However, similar to what was obtained using the original PCS, large effect sizes were found when using these short forms to examine pre-treatment to post-treatment changes in catastrophizing. For the PSEQ, the new four-item short form was clearly superior to the other alternatives and met all three criteria. The strongest short forms of the PCS and PSEQ could facilitate the assessment of pain catastrophizing and self-efficacy in situations in which the use of the longer original measures is not feasible. © 2015 European Pain Federation - EFIC®

Development and preliminary evaluation of a music-based attention assessment for patients with traumatic brain injury.

PubMed

Jeong, Eunju; Lesiuk, Teresa L

2011-01-01

Impairments in attention are commonly seen in individuals with traumatic brain injury (TBI). While visual attention assessment measurements have been rigorously developed and frequently used in cognitive neurorehabilitation, there is a paucity of auditory attention assessment measurements for patients with TBI. The purpose of this study was to field test a researcher-developed Music-based Attention Assessment (MAA), a melodic contour identification test designed to assess three different types of attention (i.e., sustained attention, selective attention, and divided attention), for patients with TBI. Additionally, this study aimed to evaluate the readability and comprehensibility of the test items and to examine the preliminary psychometric properties of the scale and test items. Fifteen patients diagnosed with TBI completed 3 different series of tasks in which they were required to identify melodic contours. The resulting data showed that (a) test items in each of the 3 subtests were found to have an easy to moderate level of item difficulty and an acceptable to high level of item discrimination, and (b) the musical characteristics (i.e., contour, congruence, and pitch interference) were found to be associated with the level of item difficulty, and (c) the internal consistency of the MAA as computed by Cronbach's alpha was .95. Subsequent studies using a larger sample of typical participants, along with individuals with TBI, are needed to confirm construct validity and internal consistency of the MAA. In addition, the authors recommend examination of criterion validity of the MAA as correlated with current neuropsychological attention assessment measurements.

Translation, Cross-cultural Adaptation and Psychometric Validation of the Korean-Language Cardiac Rehabilitation Barriers Scale (CRBS-K).

PubMed

Baek, Sora; Park, Hee-Won; Lee, Yookyung; Grace, Sherry L; Kim, Won-Seok

2017-10-01

To perform a translation and cross-cultural adaptation of the Cardiac Rehabilitation Barriers Scale (CRBS) for use in Korea, followed by psychometric validation. The CRBS was developed to assess patients' perception of the degree to which patient, provider and health system-level barriers affect their cardiac rehabilitation (CR) participation. The CRBS consists of 21 items (barriers to adherence) rated on a 5-point Likert scale. The first phase was to translate and cross-culturally adapt the CRBS to the Korean language. After back-translation, both versions were reviewed by a committee. The face validity was assessed in a sample of Korean patients (n=53) with history of acute myocardial infarction that did not participate in CR through semi-structured interviews. The second phase was to assess the construct and criterion validity of the Korean translation as well as internal reliability, through administration of the translated version in 104 patients, principle component analysis with varimax rotation and cross-referencing against CR use, respectively. The length, readability, and clarity of the questionnaire were rated well, demonstrating face validity. Analysis revealed a six-factor solution, demonstrating construct validity. Cronbach's alpha was greater than 0.65. Barriers rated highest included not knowing about CR and not being contacted by a program. The mean CRBS score was significantly higher among non-attendees (2.71±0.26) than CR attendees (2.51±0.18) (p<0.01). The Korean version of CRBS has demonstrated face, content and criterion validity, suggesting it may be useful for assessing barriers to CR utilization in Korea.

LC-PROM: Validation of a patient reported outcomes measure for liver cirrhosis patients.

PubMed

Zhang, Ying; Yang, Yuanyuan; Lv, Jing; Zhang, Yanbo

2016-05-10

The aim of the study is to develop a specific patient-reported scale of liver cirrhosis according to the Patient Reported Outcome guidelines of the Food and Drug Administration (FDA), and to examine its capacity to fill gaps in this field. A conceptual framework was developed and a preliminary item pool developed through literature review and interviews of 10 patients with liver cirrhosis. With the preliminary items, we performed a pilot survey that included a cognitive test with patients and interviews with experts; the focus was on content and language of the scale. In the item selection stage, seven statistical methods including discrete trends method, discrimination analysis, exploratory factor analysis, Cronbach's α coefficient, correlation coefficient, test-retest reliability, Item-Response Theory were applied to survey data from 200 subjects (150 liver cirrhosis patients and 50 controls). This produced the preliminary Liver Cirrhosis Patient-reported Outcome Measure (LC-PROM). In the next stage, we conducted the survey with 620 subjects (500 patients and 120 controls) to validate reliability, validity and acceptability of this scale. The 55 items and 13 dimensions addressed four domains: physical, psychological, social, and therapeutic. Cronbach's α coefficients were 0.921 for the total scale; the confirmatory factor analysis, t-tests and ANOVA supported scale validity; the model fit index as Root Mean Square Error of Approximation (RMSEA), Root Mean Square Residual (RMR), Normed Fit Index (NFI), Non-Normed Fit Index (NNFI), Comparative Fit Index (CFI) and Incremental Fit Index (IFI) met the criterion generally. The acceptance ratio and response rate indicated good feasibility. This study developed an accurate and stable patient-reported outcome scale of liver cirrhosis, which is able to evaluate clinical effects effectively, is helpful to patients in recognizing their health condition, and contributes to clinical decision making both for patients and physicians. Additionally, the LC-PROM can perform as an ultimate assessment of medical and health care effects and can inform clinical trials of new drugs for liver cirrhosis.

A new test for the assessment of working memory in clinical settings: Validation and norming of a month ordering task.

PubMed

Buekenhout, Imke; Leitão, José; Gomes, Ana A

2018-05-24

Month ordering tasks have been used in experimental settings to obtain measures of working memory (WM) capacity in older/clinical groups based solely on their face validity. We sought to assess the appropriateness of using a month ordering task in other contexts, including clinical settings, as a psychometrically sound WM assessment. To this end, we constructed a month ordering task (ucMOT), studied its reliability (internal consistency and temporal stability), and gathered construct-related and criterion-related validity evidence for its use as a WM assessment. The ucMOT proved to be internally consistent and temporally stable, and analyses of the criterion-related validity evidence revealed that its scores predicted the efficiency of language comprehension processes known to depend crucially on WM resources, namely, processes involved in pronoun interpretation. Furthermore, all ucMOT items discriminated between younger and older age groups; the global scores were significantly correlated with scores on well-established WM tasks and presented lower correlations with instruments that evaluate different (although related) processes, namely, inhibition and processing speed. We conclude that the ucMOT possesses solid psychometric properties. Accordingly, we acquired normative data for the Portuguese population, which we present as a regression-based algorithm that yields z scores adjusted for age, gender, and years of formal education. (PsycINFO Database Record (c) 2018 APA, all rights reserved).

The Work-Health-Check (WHC): a brief new tool for assessing psychosocial stress in the workplace.

PubMed

Gadinger, M C; Schilling, O; Litaker, D; Fischer, J E

2012-01-01

Brief, psychometrically robust questionnaires assessing work-related psychosocial stressors are lacking. The purpose of the study is to evaluate the psychometric properties of a brief new questionnaire for assessing sources of work-related psychosocial stress. Managers, blue- and white-collar workers (n= 628 at measurement point one, n=459 at measurement point two), sampled from an online panel of a German marketing research institute. We either developed or identified appropriate items from existing questionnaires for ten scales, which are conceptually based in work stress models and reflected either work-related demands or resources. Factorial structure was evaluated by confirmatory factor analyses (CFA). Scale reliability was assessed by Cronbach's Alpha, and test-retest; correlations with work-related efforts demonstrated convergent and discriminant validity for the demand and resource scales, respectively. Scale correlations with health indicators tested criterion validity. All scales had satisfactory reliability (Cronbach's Alpha: 0.74-0.93, retest reliabilities: 0.66-0.81). CFA supported the anticipated factorial structure. Significant correlations between job-related efforts and demand scales (mean r=0.44) and non-significant correlations with the resource scales (mean r=0.07) suggested good convergent and discriminant validity, respectively. Scale correlations with health indicators demonstrated good criterion validity. The WHC appears to be a brief, psychometrically robust instrument for assessing work-related psychosocial stressors.

Development and Validation of the Five-by-Five Resilience Scale.

PubMed

DeSimone, Justin A; Harms, P D; Vanhove, Adam J; Herian, Mitchel N

2017-09-01

This article introduces a new measure of resilience and five related protective factors. The Five-by-Five Resilience Scale (5×5RS) is developed on the basis of theoretical and empirical considerations. Two samples ( N = 475 and N = 613) are used to assess the factor structure, reliability, convergent validity, and criterion-related validity of the 5×5RS. Confirmatory factor analysis supports a bifactor model. The 5×5RS demonstrates adequate internal consistency as evidenced by Cronbach's alpha and empirical reliability estimates. The 5×5RS correlates positively with the Connor-Davidson Resilience Scale (CD-RISC), a commonly used measure of resilience. The 5×5RS exhibits similar criterion-related validity to the CD-RISC as evidenced by positive correlations with satisfaction with life, meaning in life, and secure attachment style as well as negative correlations with rumination and anxious or avoidant attachment styles. 5×5RS scores are positively correlated with healthy behaviors such as exercise and negatively correlated with sleep difficulty and symptomology of anxiety and depression. The 5×5RS incrementally explains variance in some criteria above and beyond the CD-RISC. Item responses are modeled using the graded response model. Information estimates demonstrate the ability of the 5×5RS to assess individuals within at least one standard deviation of the mean on relevant latent traits.

Spinal Cord Injury Pain Instrument and painDETECT questionnaire: Convergent construct validity in individuals with Spinal Cord Injury.

PubMed

Franz, S; Schuld, C; Wilder-Smith, E P; Heutehaus, L; Lang, S; Gantz, S; Schuh-Hofer, S; Treede, R-D; Bryce, T N; Wang, H; Weidner, N

2017-11-01

Neuropathic pain (NeuP) is a frequent sequel of spinal cord injury (SCI). The SCI Pain Instrument (SCIPI) was developed as a SCI-specific NeuP screening tool. A preliminary validation reported encouraging results requiring further evaluation in terms of psychometric properties. The painDETECT questionnaire (PDQ), a commonly applied NeuP assessment tool, was primarily validated in German, but not specifically developed for SCI and not yet validated according to current diagnostic guidelines. We aimed to provide convergent construct validity and to identify the optimal item combination for the SCIPI. The PDQ was re-evaluated according to current guidelines with respect to SCI-related NeuP. Prospective monocentric study. Subjects received a neurological examination according to the International Standards for Neurological Classification of SCI. After linguistic validation of the SCIPI, the IASP-grading system served as reference to diagnose NeuP, accompanied by the PDQ after its re-evaluation as binary classifier. Statistics were evaluated through ROC-analysis, with the area under the ROC curve (AUROC) as optimality criterion. The SCIPI was refined by systematic item permutation. Eighty-eight individuals were assessed with the German SCIPI. Of 127 possible combinations, a 4-item-SCIPI (cut-off-score = 1.5/sensitivity = 0.864/specificity = 0.839) was identified as most reasonable. The SCIPI showed a strong correlation (r sp  = 0.76) with PDQ. ROC-analysis of SCIPI/PDQ (AUROC = 0.877) revealed comparable results to SCIPI/IASP (AUROC = 0.916). ROC-analysis of PDQ/IASP delivered a score threshold of 10.5 (sensitivity = 0.727/specificity = 0.903). The SCIPI is a valid easy-to-apply NeuP screening tool in SCI. The PDQ is recommended as complementary NeuP assessment tool in SCI, e.g. to monitor pain severity and/or its time-dependent course. In SCI-related pain, both SCIPI and PainDETECT show strong convergent construct validity versus the current IASP-grading system. SCIPI is now optimized from a 7-item to an easy-to-apply 4-item screening tool in German and English. We provided evidence that the scope for PainDETECT can be expanded to individuals with SCI. © 2017 European Pain Federation - EFIC®.

The 7 up 7 down inventory: a 14-item measure of manic and depressive tendencies carved from the General Behavior Inventory.

PubMed

Youngstrom, Eric A; Murray, Greg; Johnson, Sheri L; Findling, Robert L

2013-12-01

The aim of this study was to develop and validate manic and depressive scales carved from the full-length General Behavior Inventory (GBI). The brief version was designed to be applicable for youths and adults and to improve separation between mania and depression dimensions. Data came from 9 studies (2 youth clinical samples, aggregate N = 738, and 7 nonclinical adult samples, aggregate N = 1,756). Items with high factor loadings on the 2 extracted dimensions of mania and depression were identified from both data sets, and final item selection was based on internal reliability criteria. Confirmatory factor analyses described the 2-factor model's fit. Criterion validity was compared between mania and depression scales, and with the full-length GBI scales. For both mania and depression factors, 7 items produced a psychometrically adequate measure applicable across both aggregate samples. Internal reliability of the Mania scale was .81 (youth) and .83 (adult) and for Depression was .93 (youth) and .95 (adult). By design, the brief scales were less strongly correlated with each other than were the original GBI scales. Construct validity of the new instrument was supported in observed discriminant and convergent relationships with external correlates and discrimination of diagnostic groups. The new brief GBI, the 7 Up 7 Down Inventory, demonstrates sound psychometric properties across a wide age range, showing expected relationships with external correlates. The new instrument provides a clearer separation of manic and depressive tendencies than the original. (PsycINFO Database Record (c) 2013 APA, all rights reserved).

Development and validation of a self-efficacy scale for postoperative rehabilitation management of lung cancer patients.

PubMed

Huang, Fei-Fei; Yang, Qing; Han, Xuan Ye; Zhang, Jing-Ping; Lin, Ting

2017-08-01

The purpose of this study was to develop a Self-Efficacy Scale for Rehabilitation Management designed specifically for postoperative lung cancer patients (SESPRM-LC) and to evaluate its psychometric properties. Based on the concept of self-management of chronic disease, items were developed from literature review and semistructured interviews of 10 lung cancer patients and screened by expert consultation and pilot testing. Psychometric evaluation was done with 448 postoperative lung cancer patients recruited from 5 tertiary hospitals in Fuzhou, China, by incorporating classical test theory and item response theory methods. A 6-factor structure was illustrated by exploratory factor analysis and confirmed by confirmatory factor analysis, explaining 60.753% of the total variance. The SESPRM-LC achieved Cronbach's α of 0.694 to 0.893, 2-week test-retest reliability of 0.652 to 0.893, and marginal reliability of 0.565 to 0.934. The predictive and criterion validities were demonstrated by significant association with theoretically supported quality-of-life variables (r = 0.211-0.392, P < .01), and General Perceived Self-efficacy Scale (r = 0.465, P < .01), respectively. Item response theory analysis showed that the SESPRM-LC offers information about a broad range of self-efficacy measures and discriminates well between patients with high and low levels of self-efficacy. We demonstrated initial support for the reliability and validity of the 27-item SESPRM-LC, as a developmentally appropriate instrument for assessing self-efficacy among lung cancer patients during postoperative rehabilitation. Copyright © 2016 John Wiley & Sons, Ltd.

A Model-Free Diagnostic for Single-Peakedness of Item Responses Using Ordered Conditional Means.

PubMed

Polak, Marike; de Rooij, Mark; Heiser, Willem J

2012-09-01

In this article we propose a model-free diagnostic for single-peakedness (unimodality) of item responses. Presuming a unidimensional unfolding scale and a given item ordering, we approximate item response functions of all items based on ordered conditional means (OCM). The proposed OCM methodology is based on Thurstone & Chave's (1929) criterion of irrelevance, which is a graphical, exploratory method for evaluating the "relevance" of dichotomous attitude items. We generalized this criterion to graded response items and quantified the relevance by fitting a unimodal smoother. The resulting goodness-of-fit was used to determine item fit and aggregated scale fit. Based on a simulation procedure, cutoff values were proposed for the measures of item fit. These cutoff values showed high power rates and acceptable Type I error rates. We present 2 applications of the OCM method. First, we apply the OCM method to personality data from the Developmental Profile; second, we analyze attitude data collected by Roberts and Laughlin (1996) concerning opinions of capital punishment.

Severity of illness index for surgical departments in a Cuban hospital: a revalidation study.

PubMed

Armas-Bencomo, Amadys; Tamargo-Barbeito, Teddy Osmin; Fuentes-Valdés, Edelberto; Jiménez-Paneque, Rosa Eugenia

2017-03-08

In the context of the evaluation of hospital services, the incorporation of severity indices allows an essential control variable for performance comparisons in time and space through risk adjustment. The severity index for surgical services was developed in 1999 and validated as a general index for surgical services. Sixteen years later the hospital context is different in many ways and a revalidation was considered necessary to guarantee its current usefulness. To evaluate the validity and reliability of the surgical services severity index to warrant its reasonable use under current conditions. A descriptive study was carried out in the General Surgery service of the "Hermanos Ameijeiras" Clinical Surgical Hospital of Havana, Cuba during the second half of 2010. We reviewed the medical records of 511 patients discharged from this service. Items were the same as the original index as were their weighted values. Conceptual or construct validity, criterion validity and inter-rater reliability as well as internal consistency of the proposed index were evaluated. Construct validity was expressed as a significant association between the value of the severity index for surgical services and discharge status. A significant association was also found, although weak, with length of hospital stay. Criterion validity was demonstrated through the correlations between the severity index for surgical services and other similar indices. Regarding criterion validity, the Horn index showed a correlation of 0.722 (95% CI: 0.677-0.761) with our index. With the POSSUM score, correlation was 0.454 (95% CI: 0.388-0.514) with mortality risk and 0.539 (95% CI: 0.462-0.607) with morbidity risk. Internal consistency yielded a standardized Cronbach's alpha of 0.8; inter-rater reliability resulted in a reliability coefficient of 0.98 for the quantitative index and a weighted global Kappa coefficient of 0.87 for the ordinal surgical index of severity for surgical services (IGQ). The validity and reliability of the proposed index was satisfactory in all aspects evaluated. The surgical services severity index may be used in the original context and is easily adaptable to other contexts as well.

The tinnitus functional index: development of a new clinical measure for chronic, intrusive tinnitus.

PubMed

Meikle, Mary B; Henry, James A; Griest, Susan E; Stewart, Barbara J; Abrams, Harvey B; McArdle, Rachel; Myers, Paula J; Newman, Craig W; Sandridge, Sharon; Turk, Dennis C; Folmer, Robert L; Frederick, Eric J; House, John W; Jacobson, Gary P; Kinney, Sam E; Martin, William H; Nagler, Stephen M; Reich, Gloria E; Searchfield, Grant; Sweetow, Robert; Vernon, Jack A

2012-01-01

Chronic subjective tinnitus is a prevalent condition that causes significant distress to millions of Americans. Effective tinnitus treatments are urgently needed, but evaluating them is hampered by the lack of standardized measures that are validated for both intake assessment and evaluation of treatment outcomes. This work was designed to develop a new self-report questionnaire, the Tinnitus Functional Index (TFI), that would have documented validity both for scaling the severity and negative impact of tinnitus for use in intake assessment and for measuring treatment-related changes in tinnitus (responsiveness) and that would provide comprehensive coverage of multiple tinnitus severity domains. To use preexisting knowledge concerning tinnitus-related problems, an Item Selection Panel (17 expert judges) surveyed the content (175 items) of nine widely used tinnitus questionnaires. From those items, the Panel identified 13 separate domains of tinnitus distress and selected 70 items most likely to be responsive to treatment effects. Eliminating redundant items while retaining good content validity and adding new items to achieve the recommended minimum of 3 to 4 items per domain yielded 43 items, which were then used for constructing TFI Prototype 1.Prototype 1 was tested at five clinics. The 326 participants included consecutive patients receiving tinnitus treatment who provided informed consent-constituting a convenience sample. Construct validity of Prototype 1 as an outcome measure was evaluated by measuring responsiveness of the overall scale and its individual items at 3 and 6 mo follow-up with 65 and 42 participants, respectively. Using a predetermined list of criteria, the 30 best-functioning items were selected for constructing TFI Prototype 2.Prototype 2 was tested at four clinics with 347 participants, including 155 and 86 who provided 3 and 6 mo follow-up data, respectively. Analyses were the same as for Prototype 1. Results were used to select the 25 best-functioning items for the final TFI. Both prototypes and the final TFI displayed strong measurement properties, with few missing data, high validity for scaling of tinnitus severity, and good reliability. All TFI versions exhibited the same eight factors characterizing tinnitus severity and negative impact. Responsiveness, evaluated by computing effect sizes for responses at follow-up, was satisfactory in all TFI versions.In the final TFI, Cronbach's alpha was 0.97 and test-retest reliability 0.78. Convergent validity (r = 0.86 with Tinnitus Handicap Inventory [THI]; r = 0.75 with Visual Analog Scale [VAS]) and discriminant validity (r = 0.56 with Beck Depression Inventory-Primary Care [BDI-PC]) were good. The final TFI was successful at detecting improvement from the initial clinic visit to 3 mo with moderate to large effect sizes and from initial to 6 mo with large effect sizes. Effect sizes for the TFI were generally larger than those obtained for the VAS and THI. After careful evaluation, a 13-point reduction was considered a preliminary criterion for meaningful reduction in TFI outcome scores. The TFI should be useful in both clinical and research settings because of its responsiveness to treatment-related change, validity for scaling the overall severity of tinnitus, and comprehensive coverage of multiple domains of tinnitus severity.

A Psychometric Review of Measures Assessing Discrimination Against Sexual Minorities.

PubMed

Morrison, Todd G; Bishop, C J; Morrison, Melanie A; Parker-Taneo, Kandice

2016-08-01

Discrimination against sexual minorities is widespread and has deleterious consequences on victims' psychological and physical wellbeing. However, a review of the psychometric properties of instruments measuring lesbian, gay, and bisexual (LGB) discrimination has not been conducted. The results of this review, which involved evaluating 162 articles, reveal that most have suboptimal psychometric properties. Specifically, myriad scales possess questionable content validity as (1) items are not created in collaboration with sexual minorities; (2) measures possess a small number of items and, thus, may not sufficiently represent the domain of interest; and (3) scales are "adapted" from measures designed to examine race- and gender-based discrimination. Additional limitations include (1) summed scores are computed, often in the absence of scale score reliability metrics; (2) summed scores operate from the questionable assumption that diverse forms of discrimination are necessarily interrelated; (3) the dimensionality of instruments presumed to consist of subscales is seldom tested; (4) tests of criterion-related validity are routinely omitted; and (5) formal tests of measures' construct validity are seldom provided, necessitating that one infer validity based on the results obtained. The absence of "gold standard" measures, the attendant difficulty in formulating a coherent picture of this body of research, and suggestions for psychometric improvements are noted.

Risk Competence in Dealing With Alcohol and Other Drugs in Adolescence.

PubMed

Nagy, Ede; Verres, Rolf; Grevenstein, Dennis

2017-12-06

Adolescence is a critical phase for the development substance use patterns. We propose that individual competence in dealing with psychoactive substances is crucial for the development of healthy substance use behavior and prevention of substance misuse or addiction. We present a new concept of health related skills in dealing with alcohol and other drugs in adolescence, its operationalization and validation. Our conception of risk competence (RICO) consists of the four major factors being Reflective, Informed, Self-Controlled and Life-Oriented, and their sub-facets. Based on a sample of N = 753 adolescents we used classical test theory as well as item response theory to create a new measure of RICO. Validity was investigated in a new sample of N = 229 with regard to substance use, risk perception, and measures of personality (Big Five, sense of coherence, general self-efficacy). RICO contains 7 scales with 28 items that measure independent aspects of risk competence. Cross-sectional criterion validity for most of the scales could be shown. Conclusions/Importance: The new RICO scales are a valid measure of different aspects of risk competence in dealing with psychoactive substances. The questionnaire can be used in general research settings, but may also be applied to assess the effects of interventions.

How do cognitively impaired elderly patients define "testament": reliability and validity of the testament definition scale.

PubMed

Heinik, J; Werner, P; Lin, R

1999-01-01

The testament definition scale (TDS) is a specifically designed six-item scale aimed at measuring the respondent's capacity to define "testament." We assessed the reliability and validity of this new short scale in 31 community-dwelling cognitively impaired elderly patients. Interrater reliability for the six items ranged from .87 to .97. The interrater reliability for the total score was .77. Significant correlations were found between the TDS score and the Mini-Mental State Examination (MMSE) and the Cambridge Cognitive Examination scores (r = .71 and .72 respectively, p = .001). Criterion validity yielded significantly different means for subjects with MMSE scores of 24-30 and 0-23: mean 3.9 and 1.6 respectively (t(20) = 4.7, p = .001). Using a cutoff point of 0-2 vs. 3+, 79% of the subjects were correctly classified as severely cognitively impaired, with only 8.3% false positives, and a positive predictive value of 94%. Thus, TDS was found both reliable and valid. This scale, however, is not synonymous with testamentary capacity. The discussion deals with the methodological limitations of this study, and highlights the practical as well as the theoretical relevance of TDS. Future studies are warranted to elucidate the relationships between TDS and existing legal requirements of testamentary capacity.

Development and psychometric properties of the Ethics Environment Questionnaire.

PubMed

McDaniel, C

1997-09-01

The author reports on the development and the psychometric properties of the Ethics Environment Questionnaire (EEQ), an instrument by which to measure the opinions of health-care providers about ethics in their clinical practice organizations. The EEQ was developed to increase the number of valid and reliable measures pertaining to ethics in health-care delivery. The EEQ is a 20-item self-administered questionnaire using a Likert-type 5-point format, offering ease of administration. It is applicable to a cross-section of health-care practitioners and health-care facilities. The mean administration time is 10 minutes. The EEQ represents testing on 450 respondents in acute care settings among a cross-section of acute care facilities. Internal consistency reliability using Cronbach's alpha coefficient is 0.93, and the test-retest reliability is 0.88. Construct, content, and criterion validity are established. The scale is unidimensional, with factor loadings exceeding the minimum preset criterion. Mean score is 3.1 out of 5.0, with scores of 3.5 and above interpreted as reflective of a positive ethics environment. The EEQ provides a measure of ethics in health-care organizations among multi-practitioners in clinical practice on a valid, reliable, cost effective, and easily administered instrument that requires minimum investment of personnel time.

Measurement of alienation among adolescents: construct validity of three scales on powerlessness, meaninglessness and social isolation.

PubMed

Rayce, Signe Boe; Kreiner, Svend; Damsgaard, Mogens Trab; Nielsen, Tine; Holstein, Bjørn Evald

2017-01-01

Psychological alienation is an important concept in the study of adolescents' health and behavior but no gold standard for measuring alienation among adolescents exists. There is a need for new scales with high validity for use in adolescent health and social research. The purpose of the present study was to develop and validate alienation scales in accordance with Seeman's conceptualization of alienation focusing on three independent variants specifically relevant in adolescent health research: powerlessness, meaninglessness and social isolation. Cross-sectional data from 3083 adolescents aged 13 to 15 years from the Danish contribution to the cross-national study Health Behaviour in School-aged Children (HBSC) were used. We identified and developed items, addressed content and face validity through interviews, and examined the criterion-related construct validity of the scales using graphical loglinear Rasch models (GLLRM). The three scales each comprised three to five face valid items. The powerlessness scale reflected the adolescent's expectancy as to whether his/her behavior can determine the outcome or reinforcement he/she seeks. The meaninglessness scale reflected the expectancy as to whether satisfactory predictions regarding the effects of one's behavior are possible. Finally, the social isolation scale reflected whether the adolescent had a low expectancy for inclusion and social acceptance. All scales contained some uniform local dependency and differential item functioning. However, only to a limited degree, which could be accounted for using GLLRM. Thus the scales fitted GLLRMs and can therefore be considered to be essentially construct valid and essentially objective. The three alienation scales appear to be content and face valid and fulfill the psychometric properties of a good construct valid reflective scale. This suggests that the scales may be appropriate in future large-scale surveys to examine the relation between alienation and a range of adolescent health outcomes such as health, behavior and wellbeing.

Validation of an Arabic version of an instrument to measure waterpipe smoking behavior.

PubMed

Abou Arbid, S; Al Mulla, A; Ghandour, B; Ammar, N; Adawi, M; Daher, R; Younes, N; Chami, H A

2017-04-01

Reliable and valid measures of waterpipe smoking are essential to study its health effects. The purpose of this study was to examine the reliability and validity of an Arabic translation of Maziak questionnaire that assesses various aspects of waterpipe smoking in epidemiological studies. A cross-sectional study. This questionnaire was translated, back translated, and culturally adapted to the local Arabic dialect. Construct and convergent validity were assessed in a sample of 119 daily waterpipe smokers (WPS) and 30 occasional WPS, defined as smoking at least one waterpipe per week but less than daily from Beirut and Doha (mean age = 52.4 years, males = 61.7%). Construct validity was assessed by comparing the smoking behavior of daily and occasional WPS. Convergent validity was assessed by correlating daily smoking intensity ('number of waterpipe smoked per day') with 'number of waterpipe smoked yesterday' and by correlating lifetime smoking exposure (waterpipe-year) calculated by multiplying number of waterpipe smoked per day × duration of waterpipe smoking with alternate measures obtained graphically (graphical waterpipe-year) or adjusted (adjusted waterpipe-year). Criterion validity was assessed by correlating daily smoking intensity and lifetime smoking exposure with serum cotinine level. Test-retest reliability was analyzed by re-administering the questionnaire to 30 daily and 30 occasional WPS after 2 weeks. Smoking intensity, patterns of use, and willingness to quit differed significantly between daily and occasional WPS. Daily smoking intensity correlated strongly with the number of waterpipe smoked yesterday (r s  = 0.68, P < 0.001), but not in the occasional WPS (r s  = 0.13, P = 0.70). Waterpipe-year correlated very strongly with adjusted waterpipe-year and graphical waterpipe-year (r s  = 0.98, P < 0.001 and r s  = 0.92, P < 0.001, respectively). Waterpipe-year, daily smoking intensity, and number of waterpipe smoked yesterday, correlated weakly but significantly with serum cotinine levels (r s  = 0.243, P = 0.01; r s  = 0.359, P < 0.01 and r s  = 0.387, P < 0.01, respectively). The type and pattern of waterpipe use items showed high test-retest reliability with near perfect agreement (k > 0.9), the sharing and intention to quit waterpipe items had substantial agreement (k > 0.6), and the intent to quit item showed moderate agreement (k > 0.4). The questionnaire showed strong reliability, face validity, construct and convergent validity, and a weak but statistically significant criterion validity. Maziak questionnaire is valid and reliable for assessing waterpipe smoking patterns, intensity, and willingness to quit. Copyright © 2016 The Royal Society for Public Health. Published by Elsevier Ltd. All rights reserved.

Validity and Reliability of the US National Cancer Institute's Patient-Reported Outcomes Version of the Common Terminology Criteria for Adverse Events (PRO-CTCAE).

PubMed

Dueck, Amylou C; Mendoza, Tito R; Mitchell, Sandra A; Reeve, Bryce B; Castro, Kathleen M; Rogak, Lauren J; Atkinson, Thomas M; Bennett, Antonia V; Denicoff, Andrea M; O'Mara, Ann M; Li, Yuelin; Clauser, Steven B; Bryant, Donna M; Bearden, James D; Gillis, Theresa A; Harness, Jay K; Siegel, Robert D; Paul, Diane B; Cleeland, Charles S; Schrag, Deborah; Sloan, Jeff A; Abernethy, Amy P; Bruner, Deborah W; Minasian, Lori M; Basch, Ethan

2015-11-01

To integrate the patient perspective into adverse event reporting, the National Cancer Institute developed a patient-reported outcomes version of the Common Terminology Criteria for Adverse Events (PRO-CTCAE). To assess the construct validity, test-retest reliability, and responsiveness of PRO-CTCAE items. A total of 975 adults with cancer undergoing outpatient chemotherapy and/or radiation therapy enrolled in this questionnaire-based study between January 2011 and February 2012. Eligible participants could read English and had no clinically significant cognitive impairment. They completed PRO-CTCAE items on tablet computers in clinic waiting rooms at 9 US cancer centers and community oncology practices at 2 visits 1 to 6 weeks apart. A subset completed PRO-CTCAE items during an additional visit 1 business day after the first visit. Primary comparators were clinician-reported Eastern Cooperative Oncology Group Performance Status (ECOG PS) and the European Organisation for Research and Treatment of Cancer Core Quality of Life Questionnaire (QLQ-C30). A total of 940 of 975 (96.4%) and 852 of 940 (90.6%) participants completed PRO-CTCAE items at visits 1 and 2, respectively. At least 1 symptom was reported by 938 of 940 (99.8%) participants. Participants' median age was 59 years; 57.3% were female, 32.4% had a high school education or less, and 17.1% had an ECOG PS of 2 to 4. All PRO-CTCAE items had at least 1 correlation in the expected direction with a QLQ-C30 scale (111 of 124, P<.05 for all). Stronger correlations were seen between PRO-CTCAE items and conceptually related QLQ-C30 domains. Scores for 94 of 124 PRO-CTCAE items were higher in the ECOG PS 2 to 4 vs 0 to 1 group (58 of 124, P<.05 for all). Overall, 119 of 124 items met at least 1 construct validity criterion. Test-retest reliability was 0.7 or greater for 36 of 49 prespecified items (median [range] intraclass correlation coefficient, 0.76 [0.53-.96]). Correlations between PRO-CTCAE item changes and corresponding QLQ-C30 scale changes were statistically significant for 27 prespecified items (median [range] r=0.43 [0.10-.56]; all P≤.006). Evidence demonstrates favorable validity, reliability, and responsiveness of PRO-CTCAE in a large, heterogeneous US sample of patients undergoing cancer treatment. Studies evaluating other measurement properties of PRO-CTCAE are under way to inform further development of PRO-CTCAE and its inclusion in cancer trials.

Assessing Student Understanding of the "New Biology": Development and Evaluation of a Criterion-Referenced Genomics and Bioinformatics Assessment

NASA Astrophysics Data System (ADS)

Campbell, Chad Edward

Over the past decade, hundreds of studies have introduced genomics and bioinformatics (GB) curricula and laboratory activities at the undergraduate level. While these publications have facilitated the teaching and learning of cutting-edge content, there has yet to be an evaluation of these assessment tools to determine if they are meeting the quality control benchmarks set forth by the educational research community. An analysis of these assessment tools indicated that <10% referenced any quality control criteria and that none of the assessments met more than one of the quality control benchmarks. In the absence of evidence that these benchmarks had been met, it is unclear whether these assessment tools are capable of generating valid and reliable inferences about student learning. To remedy this situation the development of a robust GB assessment aligned with the quality control benchmarks was undertaken in order to ensure evidence-based evaluation of student learning outcomes. Content validity is a central piece of construct validity, and it must be used to guide instrument and item development. This study reports on: (1) the correspondence of content validity evidence gathered from independent sources; (2) the process of item development using this evidence; (3) the results from a pilot administration of the assessment; (4) the subsequent modification of the assessment based on the pilot administration results and; (5) the results from the second administration of the assessment. Twenty-nine different subtopics within GB (Appendix B: Genomics and Bioinformatics Expert Survey) were developed based on preliminary GB textbook analyses. These subtopics were analyzed using two methods designed to gather content validity evidence: (1) a survey of GB experts (n=61) and (2) a detailed content analyses of GB textbooks (n=6). By including only the subtopics that were shown to have robust support across these sources, 22 GB subtopics were established for inclusion in the assessment. An expert panel subsequently developed, evaluated, and revised two multiple-choice items to align with each of the 22 subtopics, producing a final item pool of 44 items. These items were piloted with student samples of varying content exposure levels. Both Classical Test Theory (CTT) and Item Response Theory (IRT) methodologies were used to evaluate the assessment's validity, reliability and ability inferences, and its ability to differentiate students with different magnitudes of content exposure. A total of 18 items were subsequently modified and reevaluated by an expert panel. The 26 original and 18 modified items were once again piloted with student samples of varying content exposure levels. Both CTT and IRT methodologies were once again used to evaluate student responses in order to evaluate the assessment's validity and reliability inferences as well as its ability to differentiate students with different magnitudes of content exposure. Interviews with students from different content exposure levels were also performed in order to gather convergent validity evidence (external validity evidence) as well as substantive validity evidence. Also included are the limitations of the assessment and a set of guidelines on how the assessment can best be used.

The development and validation of Science Learning Inventory (SLI): A conceptual change framework

NASA Astrophysics Data System (ADS)

Seyedmonir, Mehdi

2000-12-01

A multidimensional theoretical model, Conceptual Change Science Learning (CCSL), was developed based on Standard Model of Conceptual Change and Cognitive Reconstruction of Knowledge Model. The model addresses three main components of science learning, namely the learner's conceptual ecology, the message along with its social context, and the cognitive engagement. A learner's conceptual ecology is organized around three clusters, including epistemological beliefs, existing conceptions, and motivation. Learner's cognitive engagement is represented by a continuum from peripheral processing involving shallow cognitive engagement to central processing involving deep cognitive engagement. Through reciprocal, non-sequential interactions of such constructs, the learners' conceptual change is achieved. Using a quantitative empirical approach, three studies were conducted to investigate the theoretical constructs based on the CCSL Model. The first study reports the development and validation of the hypothesized and factor-analytic scales comprising the instrument, Science Learning Inventory (SLI) intended for college students. The self-report instrument was designed in two parts, SLI-A (conceptual ecology and cognitive engagement) with 48 initial items, and SLI-B (science epistemology) with 49 initial items. The items for SLI-B were based on the tenets of Nature of Science as reflected in the recent reform documents, Science for All Americans (Project 2061) and National Science Education Standards. The results of factor analysis indicated seven factors for SLI-A and four factors for SLI-B. The second study investigated the criterion-related (conceptual change) predictive validity of the SLI in an instructional setting (a college-level physics course). The findings suggested the possibility of different interplay of factors and dynamics depending on the nature of the criterion (gain scores from a three-week intervention versus final course grade). Gain scores were predicted by "self-reflective study behavior" and "science self-efficacy" scales of SLI, whereas the course grade was predicted by "metacognitive engagement" and "dynamic scientific truth," (a factor from science epistemology). The third study investigated the effects of text-based conceptual-change strategy (Enhanced Refutational Text; ERT) on Newtonian Laws of Motion, and the efficacy of the SLI scales in a controlled setting. Also, initial divergent and convergent validity procedures are reported in the study. The results provided partial support for the superiority of ERT over expository text. The ERT was an effective intervention for students with no prior physics background but not for students with prior physics background.

Psychometric characteristics and dimensionality of a Persian version of Rosenberg Self-esteem Scale.

PubMed

Shapurian, R; Hojat, M; Nayerahmadi, H

1987-08-01

The Rosenberg Self-esteem scale was translated into Persian and 12 Iranian bilingual judges confirmed the soundness of translation. The psychometric properties of the Persian version of Rosenberg Self-esteem Scale were studied in two samples of Iranian college students separately. Sample I consisted of 232 Iranian students in American universities, and Sample II comprised 305 Iranian students in Iranian universities. Criterion measures of loneliness, depression, anxiety, neuroticism, psychoticism, misanthropy, locus of control, tendency to dissimulate, and measures of relationship with parents, peers, and academic achievement were obtained. Item-total score correlations and alpha reliabilities supported the internal consistency of the scale. Test-retest reliabilities indicated the stability of the scores, and correlations between scores of the scale, and criterion measures supported the concurrent validity of the Rosenberg scale. Factor analysis of the Rosenberg scores confirmed the unidimensionality of the scale.

Development and validation of a fine-motor assessment tool for use with young children in a Chinese population.

PubMed

Siu, Andrew M H; Lai, Cynthia Y Y; Chiu, Amy S M; Yip, Calvin C K

2011-01-01

Most of the fine-motor assessment tools used in Hong Kong have been designed in Western countries, so there is a need to develop a standardized assessment which is relevant to the culture and daily living tasks of the local (that is, Chinese) population. This study aimed to (1) develop a fine-motor assessment tool (the Hong Kong Preschool Fine-Motor Developmental Assessment [HK-PFMDA]) for use with young children in a Chinese population and (2) examine the HK-PFMDA's psychometric properties. The HK-PFMDA was developed by a group of occupational therapists specializing in the area of developmental disabilities in Hong Kong. A panel of 21 experts reviewed the content validity of the instrument. Rasch item analysis was used to examine the model fit of items against the rating scale model, and to explore the dimensionality of the test. Intra- and interrater reliability, convergent validity, and criterion-related validity were examined. The participants included 783 children without disabilities, 45 with autistic spectrum disorder, and 35 with developmental delay. The Rasch analysis suggested that the 87-item HK-PFMDA had a unidimensional structure, as the items explained most (91.6%) of the variance. The HK-PFMDA demonstrated excellent intra- (ICC = .99) and interrater reliability (ICC = .99), and internal consistency (α ranging from .83 to .92). In terms of validity, the HK-PFMDA had significant positive correlations with both age and the convergent measures of the Peabody Developmental Motor Scales (PDMS-2). A set of normative data for local children aged from birth to 6 years was established. The HK-PFMDA has shown excellent psychometric properties and is suitable for clinical application by occupational therapists in the assessment of fine-motor skills development of young children in Chinese populations. Copyright © 2010 Elsevier Ltd. All rights reserved.

[Motivation for psychosomatic-psychotherapeutic treatment of vocational stresses -- development and validation of a questionnaire].

PubMed

Zwerenz, R; Knickenberg, R J; Schattenburg, L; Beutel, M E

2005-02-01

There is a lack of questionnaires assessing the motivation of inpatients to scrutinize occupational stresses and deal with them as part of their psychotherapeutic treatment. Work-related stress contributes significantly to the development of mental disorders. Vocational reintegration is an outcome criterion for the success of vocational rehabilitation. Patients are often not motivated for dealing with occupational stresses during inpatient medical rehabilitation. Therefore it is necessary to assess patient motivation at the beginning of treatment, in order to assign them to specific interventions, e. g. promoting motivation. A questionnaire (Fragebogen zur berufsbezogenen Therapiemotivation -- FBTM) consisting of 84 items was developed, based on published questionnaires for psychotherapy motivation. 283 psychosomatic rehabilitation inpatients were administered the FBTM, subsequently analyzed by item and factor analyses. Based on a second sample (n = 282) confirmatory factor analyses and validation of the questionnaire were executed. Item and factor analyses revealed a four factor structure. 24 items constituted the subscales that could be described as "intention to change", "wish for pension", "negative treatment expectations" and "active coping". Reliability (Cronbach's Alpha) was satisfactory with coefficients between 0.69 and 0.87, and only low correlations could be found between the four subscales. Correlations with other measures were most pronounced for the subscale "intention to change". Some significant but low correlations could be reported between the FBTM and a standardized questionnaire of psychotherapy motivation (FMP). Confirmatory factor analyses of a second sample (n = 282) confirmed the original four factors. First evidence of sensitivity could be observed in a sample of patients who took part in an intervention promoting work-related therapy motivation during psychosomatic inpatient rehabilitation. The FBTM is a reliable and valid instrument assessing work-related therapy motivation of inpatients, as a relevant therapeutic measure in psychosomatic rehabilitation. Further validation, especially the analysis of predictive validity is desirable.

The development and validation of the Incivility from Customers Scale.

PubMed

Wilson, Nicole L; Holmvall, Camilla M

2013-07-01

Scant research has examined customers as sources of workplace incivility, despite evidence suggesting that mistreatment is more common from organizational outsiders, including customers, than from organizational members (Grandey, Kern, & Frone, 2007; Schat & Kelloway, 2005). As an important step in extending the literature on customer incivility, we conducted two studies to develop and validate a measure of this construct. Study 1 used focus groups of retail and restaurant employees (n = 30) to elicit a list of uncivil customer behaviors, based on which we wrote initial scale items. Study 2 used a correlational survey design (n = 439) to pare down the number of scale items to 10 and to garner reliability and validity evidence for the scale. Exploratory and confirmatory factor analyses show that the scale is unidimensional and distinguishable from measures of the related, but distinct, constructs of interpersonal justice and psychological aggression from customers. Reliability analyses show that the scale is internally consistent. Significant correlations between the scale and individuals' job satisfaction, turnover intentions, and general and job-specific psychological strain provide evidence of criterion-related validity. Hierarchical regression analyses show that the scale significantly predicts three of four organizational and personal strain outcomes over and above a workplace incivility measure adapted for customer incivility, providing some evidence of incremental validity. Limitations and future research directions are discussed. PsycINFO Database Record (c) 2013 APA, all rights reserved.

Development and validation of an Overreporting Scale for the Personality Inventory for DSM-5 (PID-5).

PubMed

Sellbom, Martin; Dhillon, Sonya; Bagby, R Michael

2018-05-01

Our aim in the current study was to develop a validity scale for the Personality Inventory for DSM-5 (PID-5) to detect noncredible overreported responding. To this end, we used a rare symptoms approach and identified extreme response options on PID-5 items that were infrequently endorsed by students in 3 different university samples (N = 1,370) and in a psychiatric patient sample (N = 194). The resulting 10-item scale (the PID-5-ORS) produced adequate-to-good estimates of internal reliability and was significantly correlated with the Minnesota Multiphasic Personality Inventory-2 Restructued Form (MMPI-2-RF) overreporting validity scales, providing evidence of concurrent validity. The criterion validity of the PID-5-ORS was demonstrated in an analog simulation design study. More specifically, university students instructed to overreport (n = 80) scored substantially higher on the PID-5-ORS relative to both a group of genuine psychiatric patients and students instructed to complete the PID-5 under standard (honest) instructions (n = 161); the effect size magnitudes associated with these differences were large. Classification accuracy analyses further revealed that high scores on the PID-5-ORS were associated with high specificity (and thus, low rates of false positive classifications) in differentiating overreporters from genuine patients, with sensitivity being somewhat weaker. (PsycINFO Database Record (c) 2018 APA, all rights reserved).

Psychometric support of the school climate measure in a large, diverse sample of adolescents: a replication and extension.

PubMed

Zullig, Keith J; Collins, Rani; Ghani, Nadia; Patton, Jon M; Scott Huebner, E; Ajamie, Jean

2014-02-01

The School Climate Measure (SCM) was developed and validated in 2010 in response to a dearth of psychometrically sound school climate instruments. This study sought to further validate the SCM on a large, diverse sample of Arizona public school adolescents (N = 20,953). Four SCM domains (positive student-teacher relationships, academic support, order and discipline, and physical environment) were available for the analysis. Confirmatory factor analysis and structural equation modeling were established to construct validity, and criterion-related validity was assessed via selected Youth Risk Behavior Survey (YRBS) school safety items and self-reported grade (GPA) point average. Analyses confirmed the 4 SCM school climate domains explained approximately 63% of the variance (factor loading range .45-.92). Structural equation models fit the data well χ(2) = 14,325 (df = 293, p < .001), comparative fit index (CFI) = .951, Tuker-Lewis index (TLI) = .952, root mean square error of approximation (RMSEA) = .05). The goodness-of-fit index was .940. Coefficient alphas ranged from .82 to .93. Analyses of variance with post hoc comparisons suggested the SCM domains related in hypothesized directions with the school safety items and GPA. Additional evidence supports the validity and reliability of the SCM. Measures, such as the SCM, can facilitate data-driven decisions and may be incorporated into evidenced-based processes designed to improve student outcomes. © 2014, American School Health Association.

The Internalized Stigma of Mental Illness (ISMI) scale: validation of the Japanese version.

PubMed

Tanabe, Yosuke; Hayashi, Kunihiko; Ideno, Yuki

2016-04-29

The present study investigated the reliability and validity of a Japanese version of the Internalized Stigma of Mental Illness (ISMI) scale, designed to assess internalized stigma experienced by people with mental illness. A survey was conducted with 173 outpatients with mental illness who attended psychiatric clinics on a regular basis. A retest was conducted with 51 participants to evaluate the scale's psychometric properties. The alpha coefficient for the overall internal consistency was 0.91, and the coefficients of the individual ISMI subscales ranged from 0.57 to 0.81. The test-retest reliability was r = 0.85 (n = 51, P < 0.01). In terms of criterion-related validity, the Japanese version of the ISMI scale was significantly correlated with the Beck Depression Inventory (r = 0.61, P < 0.01), the Rosenberg Self-Esteem Scale (r = -0.53, P < 0.01), and the Empowerment Scale (r = -0.52, P < 0.01). In addition, factor analyses of the ISMI items demonstrated a four-factor solution for the alienation, stereotype endorsement, discrimination experience, and social withdrawal subscales, with the stigma resistance items excluded. The Japanese version of the ISMI scale demonstrated similar reliability and validity to the original English version. Therefore, the Japanese version of the ISMI scale may be an effective and valid tool to measure internalized stigma among Japanese people who have a mental illness.

Discriminant Validity Assessment: Use of Fornell & Larcker criterion versus HTMT Criterion

NASA Astrophysics Data System (ADS)

Hamid, M. R. Ab; Sami, W.; Mohmad Sidek, M. H.

2017-09-01

Assessment of discriminant validity is a must in any research that involves latent variables for the prevention of multicollinearity issues. Fornell and Larcker criterion is the most widely used method for this purpose. However, a new method has emerged for establishing the discriminant validity assessment through heterotrait-monotrait (HTMT) ratio of correlations method. Therefore, this article presents the results of discriminant validity assessment using these methods. Data from previous study was used that involved 429 respondents for empirical validation of value-based excellence model in higher education institutions (HEI) in Malaysia. From the analysis, the convergent, divergent and discriminant validity were established and admissible using Fornell and Larcker criterion. However, the discriminant validity is an issue when employing the HTMT criterion. This shows that the latent variables under study faced the issue of multicollinearity and should be looked into for further details. This also implied that the HTMT criterion is a stringent measure that could detect the possible indiscriminant among the latent variables. In conclusion, the instrument which consisted of six latent variables was still lacking in terms of discriminant validity and should be explored further.

Introducing the Professionalism Mini-Evaluation Exercise (P-MEX) in Japan: results from a multicenter, cross-sectional study.

PubMed

Tsugawa, Yusuke; Ohbu, Sadayoshi; Cruess, Richard; Cruess, Sylvia; Okubo, Tomoya; Takahashi, Osamu; Tokuda, Yasuharu; Heist, Brian S; Bito, Seiji; Itoh, Toshiyuki; Aoki, Akiko; Chiba, Tsutomu; Fukui, Tsuguya

2011-08-01

Despite the growing importance of and interest in medical professionalism, there is no standardized tool for its measurement. The authors sought to verify the validity, reliability, and generalizability of the Professionalism Mini-Evaluation Exercise (P-MEX), a previously developed and tested tool, in the context of Japanese hospitals. A multicenter, cross-sectional evaluation study was performed to investigate the validity, reliability, and generalizability of the P-MEX in seven Japanese hospitals. In 2009-2010, 378 evaluators (attending physicians, nurses, peers, and junior residents) completed 360-degree assessments of 165 residents and fellows using the P-MEX. The content validity and criterion-related validity were examined, and the construct validity of the P-MEX was investigated by performing confirmatory factor analysis through a structural equation model. The reliability was tested using generalizability analysis. The contents of the P-MEX achieved good acceptance in a preliminary working group, and the poststudy survey revealed that 302 (79.9%) evaluators rated the P-MEX items as appropriate, indicating good content validity. The correlation coefficient between P-MEX scores and external criteria was 0.78 (P < .001), demonstrating good criterion-related validity. Confirmatory factor analysis verified high path coefficient (0.60-0.99) and adequate goodness of fit of the model. The generalizability analysis yielded a high dependability coefficient, suggesting good reliability, except when evaluators were peers or junior residents. Findings show evidence of adequate validity, reliability, and generalizability of the P-MEX in Japanese hospital settings. The P-MEX is the only evaluation tool for medical professionalism verified in both a Western and East Asian cultural context.

Translation and validation of the Cancer-Related Fatigue Scale in Greek in a sample of patients with advanced prostate cancer.

PubMed

Charalambous, Andreas; Kaite, Charis; Constantinou, Marianna; Kouta, Christiana

2016-12-02

To translate and validate the Cancer-Related Fatigue (CRF) Scale in the Greek language. A cross-sectional descriptive design was used in order to translate and validate the CRF Scale in Greek. Factor analyses were performed to understand the psychometric properties of the scale and to establish construct, criterion and convergent validity. Outpatients' oncology clinics of two public hospitals in Cyprus. 148 patients with advanced prostate cancer undergoing chemotherapy. The Cancer Fatigue Scale (CFS) had good stability (test-retest reliability r=0.79, p<0.001) and good internal consistency (Cronbach's α coefficient for all 15 items α=0.916). Furthermore, the Kaiser-Meyer-Olkin Measure of Sampling Adequacy (KMO value) was found to be 0.743 and considered to be satisfactory (>0.5). The correlations between the CFS physical scale (CFS-FS scale) and the European Organization for Research and Treatment of Cancer (EORTC) QLQ-C30 physical subscales were found to be significant (r=-0.715). The same occurred between CFS cognitive and EORTC cognitive subscale (r=-0.579). Overall, the criterion validity was verified. The same occurs for the convergent validity of the CFS since all correlations with the Global Health Status (q29-q30) were found to be significant. This is the first validation study of the CRF Scale in Greek and warrant of its use in the assessment of prostate cancer patient's related fatigue. However, further testing and validation is needed in the early stages of the disease and in patients in later chemotherapy cycles. Published by the BMJ Publishing Group Limited. For permission to use (where not already granted under a licence) please go to http://www.bmj.com/company/products-services/rights-and-licensing/.

Translation and validation of the Cancer-Related Fatigue Scale in Greek in a sample of patients with advanced prostate cancer

PubMed Central

Kaite, Charis; Constantinou, Marianna; Kouta, Christiana

2016-01-01

Objective To translate and validate the Cancer-Related Fatigue (CRF) Scale in the Greek language. Design A cross-sectional descriptive design was used in order to translate and validate the CRF Scale in Greek. Factor analyses were performed to understand the psychometric properties of the scale and to establish construct, criterion and convergent validity. Setting Outpatients' oncology clinics of two public hospitals in Cyprus. Participants 148 patients with advanced prostate cancer undergoing chemotherapy. Results The Cancer Fatigue Scale (CFS) had good stability (test–retest reliability r=0.79, p<0.001) and good internal consistency (Cronbach's α coefficient for all 15 items α=0.916). Furthermore, the Kaiser-Meyer-Olkin Measure of Sampling Adequacy (KMO value) was found to be 0.743 and considered to be satisfactory (>0.5). The correlations between the CFS physical scale (CFS-FS scale) and the European Organization for Research and Treatment of Cancer (EORTC) QLQ-C30 physical subscales were found to be significant (r=−0.715). The same occurred between CFS cognitive and EORTC cognitive subscale (r=−0.579). Overall, the criterion validity was verified. The same occurs for the convergent validity of the CFS since all correlations with the Global Health Status (q29–q30) were found to be significant. Conclusions This is the first validation study of the CRF Scale in Greek and warrant of its use in the assessment of prostate cancer patient's related fatigue. However, further testing and validation is needed in the early stages of the disease and in patients in later chemotherapy cycles. PMID:27913557

Cross-cultural adaptation, reliability and validity of the Spanish version of the Quality of Life in Adult Cancer Survivors (QLACS) questionnaire: application in a sample of short-term survivors.

PubMed

Escobar, Antonio; Trujillo-Martín, Maria del Mar; Rueda, Antonio; Pérez-Ruiz, Elisabeth; Avis, Nancy E; Bilbao, Amaia

2015-11-16

The aim of this study was to validate the Quality of Life in Adult Cancer Survivors (QLACS) in short-term Spanish cancer survivor's patients. Patients with breast, colorectal or prostate cancer that had finished their initial cancer treatment 3 years before the beginning of this study completed QLACS, WHOQOL, Short Form-36, Hospital Anxiety and Depression Scale, EORTC-QLQ-BR23 and EQ-5D. Cultural adaptation was made based on established guidelines. Reliability was evaluated using internal consistency and test-retest. Convergent validity was studied by mean of Pearson's correlation coefficient. Structural validity was determined by a second-order confirmatory factor analysis (CFA) and Rasch analysis was used to assess the unidimensionality of the Generic and Cancer-specific scales. Cronbach's alpha were above 0.7 in all domains and summary scales. Test-retest coefficients were 0.88 for Generic and 0.82 for Cancer-specific summary scales. QLACS generic summary scale was correlated with other generic criterion measures, SF-36 MCS (r = - 0.74) and EQ-VAS (r = - 0.63). QLACS cancer-specific scale had lower values with the same constructs. CFA provided satisfactory fit indices in all cases. The RMSEA value was 0.061 and CFI and TLI values were 0.929 and 0.925, respectively. All factor loadings were higher than 0.40 and statistically significant (P < 0.001). Generic summary scale had eight misfitting items. In the remaining 20 items, the unidimensionality was supported. Cancer Specific summary scale showed four misfitting items, the remaining showed unidimensionality. The findings support the validity and reliability of QLACS questionnaire to be used in short-term cancer survivors.

The european organization for research and treatment of cancer quality of life questionnaire-BR 23 breast cancer-specific quality of life questionnaire: psychometric properties in a Moroccan sample of breast cancer patients

PubMed Central

2014-01-01

Background Quality of life (QOL) and its measurement in cancer patients is becoming increasingly important. Breast cancer diagnosis and treatment are often associated with psychological distress and reduced QoL. In Arabic-speaking countries, QoL of patients with cancer is inadequately studied. The aim of this study was to test the reliability and validity of the Moroccan Arabic version of the European Organization for Research and Treatment of Cancer (EORTC) Breast Cancer-Specific Quality of Life Questionnaire (QLQ-BR23). Methods After translation and cross-cultural adaptation, the questionnaire was tested on breast cancer patients. The participants’ number for the test and the retest were 105 and 37 respectively. Internal consistency was tested using Cronbach’s alpha coefficient (α), the test-retest reliability using intraclass correlation coefficients (ICC). Construct validity was assessed by examining item-convergent and divergent validity. Results The questionnaire was administered to 105 patients. The mean age of patients was 48 years (SD: 16), 62.9% were married. 68.6% of all participants lived in urban area. The average time to complete the QLQ- BR23 was 15 min. Cronbach’s alpha coefficient, were all >0.7, with the exception of breast symptoms and arm symptoms. All items exceeded the 0.4 criterion for convergent validity except item 20 and 23 related to pain and skin problems in the affected breast respectively. Conclusion In general, the findings of this study indicated that the Moroccan Arabic version of the EORTC QLQ-BR23 is a reliable and valid supplementary measure of the QOL in breast cancer patients and can be used in clinical trials and studies of outcome research in oncology. PMID:24447401

The European Organization for Research and Treatment of Cancer quality of life questionnaire-BR23 Breast Cancer-Specific Quality of Life Questionnaire: psychometric properties in a Moroccan sample of breast cancer patients.

PubMed

El Fakir, Samira; Abda, Naima; Bendahhou, Karima; Zidouh, Ahmed; Bennani, Maria; Errihani, Hassan; Benider, Abdelatif; Bekkali, Rachid; Nejjari, Chakib

2014-01-21

Quality of life (QOL) and its measurement in cancer patients is becoming increasingly important. Breast cancer diagnosis and treatment are often associated with psychological distress and reduced QoL. In Arabic-speaking countries, QoL of patients with cancer is inadequately studied.The aim of this study was to test the reliability and validity of the Moroccan Arabic version of the European Organization for Research and Treatment of Cancer (EORTC) Breast Cancer-Specific Quality of Life Questionnaire (QLQ-BR23). After translation and cross-cultural adaptation, the questionnaire was tested on breast cancer patients. The participants' number for the test and the retest were 105 and 37 respectively. Internal consistency was tested using Cronbach's alpha coefficient (α), the test-retest reliability using intraclass correlation coefficients (ICC). Construct validity was assessed by examining item-convergent and divergent validity. The questionnaire was administered to 105 patients. The mean age of patients was 48 years (SD: 16), 62.9% were married. 68.6% of all participants lived in urban area.The average time to complete the QLQ- BR23 was 15 min. Cronbach's alpha coefficient, were all >0.7, with the exception of breast symptoms and arm symptoms. All items exceeded the 0.4 criterion for convergent validity except item 20 and 23 related to pain and skin problems in the affected breast respectively. In general, the findings of this study indicated that the Moroccan Arabic version of the EORTC QLQ-BR23 is a reliable and valid supplementary measure of the QOL in breast cancer patients and can be used in clinical trials and studies of outcome research in oncology.

Psychometric evaluation of a short measure of social capital at work

PubMed Central

Kouvonen, Anne; Kivimäki, Mika; Vahtera, Jussi; Oksanen, Tuula; Elovainio, Marko; Cox, Tom; Virtanen, Marianna; Pentti, Jaana; Cox, Sara J; Wilkinson, Richard G

2006-01-01

Background Prior studies on social capital and health have assessed social capital in residential neighbourhoods and communities, but the question whether the concept should also be applicable in workplaces has been raised. The present study reports on the psychometric properties of an 8-item measure of social capital at work. Methods Data were derived from the Finnish Public Sector Study (N = 48,592) collected in 2000–2002. Based on face validity, an expert unfamiliar with the data selected 8 questionnaire items from the available items for a scale of social capital. Reliability analysis included tests of internal consistency, item-total correlations, and within-unit (interrater) agreement by rwg index. The associations with theoretically related and unrelated constructs were examined to assess convergent and divergent validity (construct validity). Criterion-related validity was explored with respect to self-rated health using multilevel logistic regression models. The effects of individual level and work unit level social capital were modelled on self-rated health. Results The internal consistency of the scale was good (Cronbach's alpha = 0.88). The rwg index was 0.88, which indicates a significant within-unit agreement. The scale was associated with, but not redundant to, conceptually close constructs such as procedural justice, job control, and effort-reward imbalance. Its associations with conceptually more distant concepts, such as trait anxiety and magnitude of change in work, were weaker. In multilevel models, significantly elevated age adjusted odds ratios (ORs) of poor self-rated health (OR = 2.42, 95% confidence interval (CI): 2.24–2.61 for the women and OR = 2.99, 95% CI: 2.56–3.50 for the men) were observed for the employees in the lowest vs. highest quartile of individual level social capital. In addition, low social capital at the work unit level was associated with a higher likelihood of poor self-rated health. Conclusion Psychometric techniques show our 8-item measure of social capital to be a valid tool reflecting the construct and displaying the postulated links with other variables. PMID:17038200

Assessing self-efficacy to reduce one's drinking: further evaluation of the Alcohol Reduction Strategies-Current Confidence questionnaire.

PubMed

Kraus, Shane W; Rosenberg, Harold; Bonar, Erin E; Hoffmann, Erica; Kryszak, Elizabeth; Young, Kathleen M; Ashrafioun, Lisham; Bannon, Erin E

2012-01-01

To evaluate the psychometric properties of a previously published questionnaire designed to assess young drinkers' self-efficacy to employ 31 cognitive-behavioral alcohol reduction strategies. Undergraduates (n = 353) recruited from a large Midwestern university completed the previously published Alcohol Reduction Strategies-Current Confidence questionnaire (and other measures) for a self-selected heavy drinking setting. Item loadings from a principal components analysis, a high internal consistency reliability coefficient, and a moderate mean inter-item correlation suggested that all 31 items comprised a single scale. Correlations of questionnaire scores with selected aspects of drinking history and personality provided support for criterion and discriminant validity, respectively. Women reported higher current confidence to use these strategies than did men, but current confidence did not vary as a function of recent binge status. Given this further demonstration of its psychometric qualities, this questionnaire holds promise as a clinical tool to identify clients who lack confidence in their ability to employ cognitive-behavioral coping strategies to reduce their drinking.

Development of the Trying New Foods Scale: A preschooler self-assessment of willingness to try new foods.

PubMed

Johnson, Susan L; Moding, Kameron J; Maloney, Katheryn; Bellows, Laura L

2018-05-26

Food neophobia, or reluctance to try new foods, emerges typically in early childhood and can impact child food acceptance and dietary quality. Measures of child neophobia have largely been developed from an adult point of view and the items focusing on fear and disgust were created from observations of children's behaviors or from adult assumptions regarding the source of children's reluctance to try new foods. Using group interviews with 3-5-y-old children (n = 229) we investigated what the experience of being asked trying new foods is like for preschoolers. From their answers, we crafted a new assessment, The Trying New Foods Scale, designed to ask children about their self-competence to try new foods. Next, we measured preschoolers' responses (n = 233; 3-5 years of age; 107 boys, 126 girls) to these items and observed their willingness to taste 7 novel foods and their affective ratings of the foods as measures of criterion validity. A principal components analysis (PCA) revealed a single 9-item component for the Trying New Foods Scale (mean ± s.d. = 3.08 ± 0.70; α = 0.88). Children's Trying New Foods Scale score positively correlated with their willingness to try foods ratio (r = 0.21, p = .001). Initial findings indicate that the Trying New Foods Scale for preschoolers has good psychometric characteristics, including preliminary evidence of criterion validity. Children who perceived themselves as more willing to try foods actually performed the behavior of trying more foods and rated the foods more favorably than children who reported lower self-competence to try foods. Understanding neophobia from the perspective of the young child, and their perceptions of self-competence related to trying new foods, may facilitate our ability to evaluate young children's food acceptance patterns. Copyright © 2018. Published by Elsevier Ltd.

Development, Validation, and Fairness of a Biographical Data Questionnaire for the Air Traffic Control Specialist Occupation

DTIC Science & Technology

2012-12-01

Development and validation. ABA, BQ , and criterion data were extracted from AT- SAT concurrent, criterion- related validation database. Overall, 1,232...dependent on responses to the other instrument. 3 A subset of 260 controllers in the AT- SAT dataset had full and complete ABA, BQ , and criterion data (i.e... SAT cases with ABA, BQ , and criterion data (n=260) was very small, making fairness analyses with the validation sample impractical. However, the

Clinimetrics of ultrasound pathologies in osteoarthritis: systematic literature review and meta-analysis.

PubMed

Oo, W M; Linklater, J M; Daniel, M; Saarakkala, S; Samuels, J; Conaghan, P G; Keen, H I; Deveza, L A; Hunter, D J

2018-05-01

The aims of this study were to systematically review clinimetrics of commonly assessed ultrasound pathologies in knee, hip and hand osteoarthritis (OA), and to conduct a meta-analysis for each clinimetric. Medline, Embase, and Cochrane Library databases were searched from their inceptions to September 2016. According to the Outcome Measures in Rheumatology (OMERACT) Instrument Selection Algorithm, data extraction focused on ultrasound technical features and performance metrics. Methodological quality was assessed with modified 19-item Downs and Black score and 11-item Quality Appraisal of Diagnostic Reliability (QAREL) score. Separate meta-analyses were performed for clinimetrics: (1) inter-rater/intra-rater reliability; (2) construct validity; (3) criteria validity; and (4) internal/external responsiveness. Statistical Package for the Social Sciences (SPSS), Excel and Comprehensive Meta-analysis were used. Our search identified 1126 records; of these, 100 were eligible, including a total of 8542 patients and 32,373 joints. The average Downs and Black score was 13.01, and average QAREL was 5.93. The stratified meta-analysis was performed only for knee OA, which demonstrated moderate to substantial reliability [minimum kappa > 0.44(0.15,0.74), minimum intraclass correlation coefficient (ICC) > 0.82(0.73-0.89)], weak construct validity against pain (r = 0.12 to 0.27), function (r = 0.15 to 0.23), and blood biomarkers (r = 0.01 to 0.21), but weak to strong correlation with plain radiography (r = 0.13 to 0.60), strong association with Magnetic Resonance Imaging (MRI) [minimum r = 0.60(0.52,0.67)] and strong discrimination against symptomatic patients (OR = 3.08 to 7.46). There was strong criterion validity against cartilage histology [r = 0.66(-0.05,0.93)], and small to moderate internal [standardized mean difference(SMD) = 0.20 to 0.58] and external (r = 0.35 to 0.43) responsiveness to interventions. Ultrasound demonstrated strong criterion validity with cartilage histology, poor to strong correlation with patient findings and MRI, moderate reliability, and low responsiveness to interventions. CRD42016039954. Copyright © 2018 Osteoarthritis Research Society International. All rights reserved.

Psychometric properties of the brief version of the Fear of Negative Evaluation Scale in a Turkish sample.

PubMed

Koydemir, Selda; Demir, Ayhan

2007-06-01

The purpose of the study was to report initial data on the psychometric properties of the Brief Fear of Negative Evaluation Scale. The scale was applied to a nonclinical sample of 250 (137 women, 113 men) Turkish undergraduate students selected randomly from Middle East Technical University. Their mean age was 20.4 yr. (SD= 1.9). The factor structure of the Turkish version, its criterion validity, and internal reliability coefficients were assessed. Although maximum likelihood factor analysis initially indicated that the scale had only one factor, a forced two-factor solution accounted for more variance (61%) in scale scores than a single factor. The straightforward items loaded on the first factor, and the reverse-coded items loaded on the second factor. The total score was significantly positively correlated with scores on the Revised Cheek and Buss Shyness Scale and significantly negatively correlated with scores on the Rosenberg Self-Esteem Scale. Factor 1 (straightforward items) correlated more highly with both Shyness and Self-esteem than Factor 2 (reverse-coded items). Internal consistency estimate was .94 for the Total scores, .91 for the Factor 1 (straightforward items), and .87 for the Factor 2 (reverse-coded items). No sex differences were evident for Fear of Negative Evaluation.

Development and psychometric testing of the Knowledge, Attitudes and Practices (KAP) questionnaire among student Tuberculosis (TB) Patients (STBP-KAPQ) in China.

PubMed

Fan, Yahui; Zhang, Shaoru; Li, Yan; Li, Yuelu; Zhang, Tianhua; Liu, Weiping; Jiang, Hualin

2018-05-08

TB outbreaking in schools is extremely complex, and presents a major challenge for public health. Understanding the knowledge, attitudes and practices among student TB patients in such settings is fundamental when it comes to decreasing future TB cases. The objective of this study was to develop a Knowledge, Attitudes and Practices Questionnaire among Student Tuberculosis Patients (STBP-KAPQ), and evaluate its psychometric properties. This study was conducted in three stages: item construction, pilot testing in 10 student TB patients and psychometric testing, including reliability and validity. The item pool for the questionnaire was compiled from literature review and early individual interviews. The questionnaire items were evaluated by the Delphi method based on 12 experts. Reliability and validity were assessed using student TB patients (n = 416) and healthy students (n = 208). Reliability was examined with internal consistency reliability and test-retest reliability. Content validity was calculated by content validity index (CVI); Construct validity was examined using exploratory factor analysis (EFA) and confirmatory factor analysis (CFA); The Public Tuberculosis Knowledge, Attitudes and Practices Questionnaire (PTB-KAPQ) was applied to evaluate criterion validity; As concerning discriminant validity, T-test was performed. The final STBP-KAPQ consisted of three dimensions and 25 items. Cronbach's α coefficient and intraclass correlation coefficient (ICC) was 0.817 and 0.765, respectively. Content validity index (CVI) was 0.962. Seven common factors were extracted by principal factor analysis and varimax rotation, with a cumulative contribution of 66.253%. The resulting CFA model of the STBP-KAPQ exhibited an appropriate model fit (χ2/df = 1.74, RMSEA = 0.082, CFI = 0.923, NNFI = 0.962). STBP-KAPQ and PTB-KAPQ had a strong correlation in the knowledge part, and the correlation coefficient was 0.606 (p < 0.05). Discriminant validity was supported through a significant difference between student TB patients and healthy students across all domains (p < 0.05). An instrument, "Knowledge, Attitudes and Practices Questionnaire among Student Tuberculosis Patients (STBP-KAPQ)" was developed. Psychometric testing indicated that it had adequate validity and reliability for use in KAP researches with student TB patients in China. The new tool might help public health researchers evaluate the level of KAP in student TB patients, and it could also be used to examine the effects of TB health education.

Problems in Criterion-Referenced Measurement. CSE Monograph Series in Evaluation, 3.

ERIC Educational Resources Information Center

Harris, Chester W., Ed.; And Others

Six essays on technical measurement problems in criterion referenced tests and four essays by psychometricians proposing solutions are presented: (1) "Criterion-Referenced Measurement" and Other Such Terms, by Marvin C. Alkin which is an overview of the first six papers; (2) Selecting Objectives and Generating Test Items for Objectives-Based…

Diagnosing criterion-level effects on memory: what aspects of memory are enhanced by repeated retrieval?

PubMed

Vaughn, Kalif E; Rawson, Katherine A

2011-09-01

Previous research has shown that increasing the criterion level (i.e., the number of times an item must be correctly retrieved during practice) improves subsequent memory, but which specific components of memory does increased criterion level enhance? In two experiments, we examined the extent to which the criterion level affects associative memory, target memory, and cue memory. Participants studied Lithuanian-English word pairs via cued recall with restudy until items were correctly recalled one to five times. In Experiment 1, participants took one of four recall tests and one of three recognition tests after a 2-day delay. In Experiment 2, participants took only recognition tests after a 1-week delay. In both experiments, increasing the criterion level enhanced associative memory, as indicated by enhanced performance on forward and backward cued-recall tests and on tests of associative recognition. An increased criterion level also improved target memory, as indicated by enhanced free recall and recognition of targets, and improved cue memory, as indicated by enhanced free recall and recognition of cues.

A new IRT-based standard setting method: application to eCat-listening.

PubMed

García, Pablo Eduardo; Abad, Francisco José; Olea, Julio; Aguado, David

2013-01-01

Criterion-referenced interpretations of tests are highly necessary, which usually involves the difficult task of establishing cut scores. Contrasting with other Item Response Theory (IRT)-based standard setting methods, a non-judgmental approach is proposed in this study, in which Item Characteristic Curve (ICC) transformations lead to the final cut scores. eCat-Listening, a computerized adaptive test for the evaluation of English Listening, was administered to 1,576 participants, and the proposed standard setting method was applied to classify them into the performance standards of the Common European Framework of Reference for Languages (CEFR). The results showed a classification closely related to relevant external measures of the English language domain, according to the CEFR. It is concluded that the proposed method is a practical and valid standard setting alternative for IRT-based tests interpretations.

Making and Executing Decisions for Safe and Independent Living (MED-SAIL): development and validation of a brief screening tool.

PubMed

Mills, Whitney L; Regev, Tziona; Kunik, Mark E; Wilson, Nancy L; Moye, Jennifer; McCullough, Laurence B; Naik, Aanand D

2014-03-01

Older adults prefer to remain in their own homes for as long as possible. The purpose of this article is to describe the development and preliminary validation of Making and Executing Decisions for Safe and Independent Living (MED-SAIL), a brief screening tool for capacity to live safely and independently in the community. Prospective preliminary validation study. Outpatient geriatrics clinic located in a community-based hospital. Forty-nine community-dwelling older adults referred to the clinic for a comprehensive capacity assessment. We examined internal consistency, criterion-based validity, concurrent validity, and accuracy of classification for MED-SAIL. The items included in MED-SAIL demonstrated internal consistency (5 items; α = 0.85). MED-SAIL was significantly correlated with the Independent Living Scales (r = 0.573, p ≤0.001) and instrumental activities of daily living (r = 0.440, p ≤0.01). The Mann-Whitney U test revealed significant differences between the no capacity and partial/full capacity classifications on MED-SAIL (U(48) = 60.5, Z = -0.38, p <0.0001). The area under the curve was 0.864 (95% confidence interval: 0.84-0.99). This study demonstrated the validity of MED-SAIL as a brief screening tool to identify older adults with impaired capacity for remaining safe and independent in their current living environment. MED-SAIL is useful tool for health and social service providers in the community for the purpose of referral for definitive capacity evaluation. Published by Elsevier Inc.

Psychometric properties of the existence subscale of the purpose in life questionnaire for Chinese adolescents in Hong Kong.

PubMed

Law, Ben M F

2012-01-01

The current study aims to test the psychometric properties of the Existence Subscale of the Purpose in Life Questionnaire (EPIL) for early adolescence. The Purpose in Life Questionnaire (PIL), originally created by Craumbaugh and Maholick, is a 20-item scale measuring different dimensions of life purposes. The current study selected seven items representative of the existence dimension to form another scale, the EPIL. The analysis was based on 2842 early adolescents, ranging from 11 to 14 years old. Principal axis factoring found one factor, with 60% variance being explained. Cronbach's alpha for the EPIL was 0.89, which was high. The factor structure was stable across genders. Criterion-related validity was determined when the scale was used to differentiate volunteers and nonvolunteers. Construct validity was found when the scale was associated with life satisfaction. The results give support to the fact that the EPIL could be used alone to measure the psychological well-being of early adolescents and the appropriateness of the EPIL in adolescent research.

The Adolescent HIV Disclosure Cognition and Affect Scale: Preliminary Reliability and Validity.

PubMed

Evangeli, Michael

2017-07-01

Globally, there are 2 million HIV-positive 10-19-year-olds. One challenge for this population is sharing their HIV status with others (onward HIV disclosure). There are no multi-item, multidimensional scales of HIV disclosure cognitions and affect for young people living with HIV. An 18-item measure of HIV disclosure cognition and affect was developed, administered to 65 adolescents living with HIV (aged 12-16 years). Data were explored using principal component analysis and preliminary construct and criterion validity assessed. Three factors were revealed: negative disclosure attitudes and feelings, self-efficacy, and positive disclosure attitudes and feelings. The full scale and its subscales were internally consistent. The total score showed statistically significant positive relationships with HIV disclosure in the past 6 months, HIV disclosure intention and self-perception. Preliminary evidence of the measure's good psychometric properties suggests it may be helpful in future clinical and research work. © The Author 2017. Published by Oxford University Press on behalf of the Society of Pediatric Psychology. All rights reserved. For permissions, please e-mail: journals.permissions@oup.com

Self-report assessment of the DSM-IV personality disorders. Measurement of trait and distress characteristics: the ADP-IV.

PubMed

Schotte, C K; de Doncker, D; Vankerckhoven, C; Vertommen, H; Cosyns, P

1998-09-01

Self-report instruments assessing the DSM personality disorders are characterized by overdiagnosis due to their emphasis on the measurement of personality traits rather than the impairment and distress associated with the criteria. The ADP-IV, a Dutch questionnaire, introduces an alternative assessment method: each test item assesses 'Trait' as well as 'Distress/impairment' characteristics of a DSM-IV criterion. This item format allows dimensional as well as categorical diagnostic evaluations. The present study explores the validity of the ADP-IV in a sample of 659 subjects of the Flemish population. The dimensional personality disorder subscales, measuring Trait characteristics, are internally consistent and display a good concurrent validity with the Wisconsin Personality Disorders Inventory. Factor analysis at the item-level resulted in 11 orthogonal factors, describing personality dimensions such as psychopathy, social anxiety and avoidance, negative affect and self-image. Factor analysis at the subscale-level identified two basic dimensions, reflecting hostile (DSM-IV Cluster B) and anxious (DSM-IV Cluster C) interpersonal attitudes. Categorical ADP-IV diagnoses are obtained using scoring algorithms, which emphasize the Trait or the Distress concepts in the diagnostic evaluation. Prevalences of ADP-IV diagnoses of any personality disorder according to these algorithms vary between 2.28 and 20.64%. Although further research in clinical samples is required, the present results support the validity of the ADP-IV and the potential of the measurement of trait and distress characteristics as a method for assessing personality pathology.

Psychometric evaluation of the Persian version of the quality of life in epilepsy inventory-31

PubMed Central

Mohammadi, Navid; Kian, Shiva; Nia, Seyed Mohammad Ali Akbarian; Nojomi, Marzieh

2013-01-01

Background Health assessment in patients with epilepsy (PWE) should include both clinical outcomes and health related quality of life (HRQOL) measures. The quality of life (QoL) in epilepsy-31 inventory (QOLIE-31) is widely used for QOL studies in epilepsy. This study aims to evaluate psychometrics of the Persian version of the inventory (QOLIE-31-P). Methods Following a standard forward-backward translation and cultural adaptation, the construct validity of the QOLIE-31-P was assessed by explanatory factor analysis, multi-trait scaling analysis, and known group comparison. The criterion validity was assessed by calculating the Pearson correlation to SF-36 (36-item short-form health survey). The reliability was assessed by calculating Cronbach's alpha and test-retest study. Results The factor analysis extracted from 8 factors explaining 70.35% of the variations. Item-scale correlations revealed that individual items significantly had the strongest association with the domain they were loaded on. The Pearson coefficient of correlation between QOLIE-31-P and the overall scores of SF-36 was 0.876 (P < 0.0001). Patient with medically controlled seizures scored higher than those who experienced seizures during the previous year to study date (P < 0.0001). The Cronbach's α of overall QOLIE-31-P inventory was 0.9. The overall test-retest coefficient of correlation was 0.68 (P = 0.003). Conclusion QOLIE-31-P is a valid and reliable tool to be applied in health assessment of patients with epilepsy. PMID:24250924

Measuring Science Instructional Practice: A Survey Tool for the Age of NGSS

NASA Astrophysics Data System (ADS)

Hayes, Kathryn N.; Lee, Christine S.; DiStefano, Rachelle; O'Connor, Dawn; Seitz, Jeffery C.

2016-03-01

Ambitious efforts are taking place to implement a new vision for science education in the United States, in both Next Generation Science Standards (NGSS)-adopted states and those states creating their own, often related, standards. In-service and pre-service teacher educators are involved in supporting teacher shifts in practice toward the new standards. With these efforts, it will be important to document shifts in science instruction toward the goals of NGSS and broader science education reform. Survey instruments are often used to capture instructional practices; however, existing surveys primarily measure inquiry based on previous definitions and standards and with a few exceptions, disregard key instructional practices considered outside the scope of inquiry. A comprehensive survey and a clearly defined set of items do not exist. Moreover, items specific to the NGSS Science and Engineering practices have not yet been tested. To address this need, we developed and validated a Science Instructional Practices survey instrument that is appropriate for NGSS and other related science standards. Survey construction was based on a literature review establishing key areas of science instruction, followed by a systematic process for identifying and creating items. Instrument validity and reliability were then tested through a procedure that included cognitive interviews, expert review, exploratory and confirmatory factor analysis (using independent samples), and analysis of criterion validity. Based on these analyses, final subscales include: Instigating an Investigation, Data Collection and Analysis, Critique, Explanation and Argumentation, Modeling, Traditional Instruction, Prior Knowledge, Science Communication, and Discourse.

Development, sensibility, and reliability of the Toronto Axial Spondyloarthritis Questionnaire in inflammatory bowel disease.

PubMed

Alnaqbi, Khalid A; Touma, Zahi; Passalent, Laura; Johnson, Sindhu R; Tomlinson, George A; Carty, Adele; Inman, Robert D

2013-10-01

There is an unacceptable delay in the diagnosis of axial spondyloarthritis (axSpA) in its early stages among patients at high risk, in particular those with inflammatory bowel disease (IBD). Our objectives were to develop a sensible and reliable questionnaire to identify undetected axSpA among patients with IBD. Literature was reviewed for item generation in the Toronto axSpA Questionnaire on IBD (TASQ-IBD). Sensibility of the questionnaire was assessed among healthcare professionals and patients. This assessment was related to purpose and framework (clinical function, clinical justification, and clinical applicability), face validity, comprehensiveness [oligo-variability (limiting the questionnaire to important items) and transparency], replicability, content validity, and feasibility. The test-retest reliability study was administered to 77 patients with established IBD and axSpA. Kappa agreement coefficients and absolute agreement were calculated for items. Three domains included IBD, inflammatory back symptoms, and extraaxial features. The entry criterion required a patient to have IBD and back pain or stiffness that ever persisted for ≥ 3 months. Iterative sensibility assessment involved 16 items and a diagram of the back. Kappa coefficients ranged from 0.81-1.00 for each item. Absolute agreement across all items ranged from 91% to 100%. TASQ-IBD is a newly developed, sensible, and reliable case-finding questionnaire to be administered to patients with IBD who have ever had chronic back pain or stiffness persisting for ≥ 3 months. It should facilitate identification and timely referral of patients with IBD to rheumatologists and minimize the delay in diagnosis of axSpA. Consequently, it should assess the prevalence of axSpA in IBD.

Measuring factors affecting implementation of health innovations: a systematic review of structural, organizational, provider, patient, and innovation level measures

PubMed Central

2013-01-01

Background Two of the current methodological barriers to implementation science efforts are the lack of agreement regarding constructs hypothesized to affect implementation success and identifiable measures of these constructs. In order to address these gaps, the main goals of this paper were to identify a multi-level framework that captures the predominant factors that impact implementation outcomes, conduct a systematic review of available measures assessing constructs subsumed within these primary factors, and determine the criterion validity of these measures in the search articles. Method We conducted a systematic literature review to identify articles reporting the use or development of measures designed to assess constructs that predict the implementation of evidence-based health innovations. Articles published through 12 August 2012 were identified through MEDLINE, CINAHL, PsycINFO and the journal Implementation Science. We then utilized a modified five-factor framework in order to code whether each measure contained items that assess constructs representing structural, organizational, provider, patient, and innovation level factors. Further, we coded the criterion validity of each measure within the search articles obtained. Results Our review identified 62 measures. Results indicate that organization, provider, and innovation-level constructs have the greatest number of measures available for use, whereas structural and patient-level constructs have the least. Additionally, relatively few measures demonstrated criterion validity, or reliable association with an implementation outcome (e.g., fidelity). Discussion In light of these findings, our discussion centers on strategies that researchers can utilize in order to identify, adapt, and improve extant measures for use in their own implementation research. In total, our literature review and resulting measures compendium increases the capacity of researchers to conceptualize and measure implementation-related constructs in their ongoing and future research. PMID:23414420

Spanish translation, cross-cultural adaptation, and validation of the Questionnaire for Diabetes-Related Foot Disease (Q-DFD)

PubMed Central

Castillo-Tandazo, Wilson; Flores-Fortty, Adolfo; Feraud, Lourdes; Tettamanti, Daniel

2013-01-01

Purpose To translate, cross-culturally adapt, and validate the Questionnaire for Diabetes-Related Foot Disease (Q-DFD), originally created and validated in Australia, for its use in Spanish-speaking patients with diabetes mellitus. Patients and methods The translation and cross-cultural adaptation were based on international guidelines. The Spanish version of the survey was applied to a community-based (sample A) and a hospital clinic-based sample (samples B and C). Samples A and B were used to determine criterion and construct validity comparing the survey findings with clinical evaluation and medical records, respectively; while sample C was used to determine intra- and inter-rater reliability. Results After completing the rigorous translation process, only four items were considered problematic and required a new translation. In total, 127 patients were included in the validation study: 76 to determine criterion and construct validity and 41 to establish intra- and inter-rater reliability. For an overall diagnosis of diabetes-related foot disease, a substantial level of agreement was obtained when we compared the Q-DFD with the clinical assessment (kappa 0.77, sensitivity 80.4%, specificity 91.5%, positive likelihood ratio [LR+] 9.46, negative likelihood ratio [LR−] 0.21); while an almost perfect level of agreement was obtained when it was compared with medical records (kappa 0.88, sensitivity 87%, specificity 97%, LR+ 29.0, LR− 0.13). Survey reliability showed substantial levels of agreement, with kappa scores of 0.63 and 0.73 for intra- and inter-rater reliability, respectively. Conclusion The translated and cross-culturally adapted Q-DFD showed good psychometric properties (validity, reproducibility, and reliability) that allow its use in Spanish-speaking diabetic populations. PMID:24039434

Psychometric validation of a condom self-efficacy scale in Korean.

PubMed

Cha, EunSeok; Kim, Kevin H; Burke, Lora E

2008-01-01

When an instrument is translated for use in cross-cultural research, it needs to account for cultural factors without distorting the psychometric properties of the instrument. To validate the psychometric properties of the condom self-efficacy scale (CSE) originally developed for American adolescents and young adults after translating the scale to Korean (CSE-K) to determine its suitability for cross-cultural research among Korean college students. A cross-sectional, correlational design was used with an exploratory survey methodology through self-report questionnaires. A convenience sample of 351 students, aged 18 to 25 years, were recruited at a university in Seoul, Korea. The participants completed the CSE-K and the intention of condom use scales after they were translated from English to Korean using a combined translation technique. A demographic and sex history questionnaire, which included an item to assess actual condom usage, was also administered. Mean, variance, reliability, criterion validity, and factorial validity using confirmatory factor analysis were assessed in the CSE-K. Norms for the CSE-K were similar, but not identical, to norms for the English version. The means of all three subscales were lower for the CSE-K than for the original CSE; however, the obtained variance in CSE-K was roughly similar with the original CSE. The Cronbach's alpha coefficient for the total scale was higher for the CSE-K (.91) than that for either the CSE (.85) or CSE in Thai (.85). Criterion validity and construct validity of the CSE-K were confirmed. The CSE-K was a reliable and valid scale in measuring condom self-efficacy among Korean college students. The findings suggest that the CSE was an appropriate instrument to conduct cross-cultural research on sexual behavior in adolescents and young adults.

Translation, Cross-cultural Adaptation and Psychometric Validation of the Korean-Language Cardiac Rehabilitation Barriers Scale (CRBS-K)

PubMed Central

2017-01-01

Objective To perform a translation and cross-cultural adaptation of the Cardiac Rehabilitation Barriers Scale (CRBS) for use in Korea, followed by psychometric validation. The CRBS was developed to assess patients' perception of the degree to which patient, provider and health system-level barriers affect their cardiac rehabilitation (CR) participation. Methods The CRBS consists of 21 items (barriers to adherence) rated on a 5-point Likert scale. The first phase was to translate and cross-culturally adapt the CRBS to the Korean language. After back-translation, both versions were reviewed by a committee. The face validity was assessed in a sample of Korean patients (n=53) with history of acute myocardial infarction that did not participate in CR through semi-structured interviews. The second phase was to assess the construct and criterion validity of the Korean translation as well as internal reliability, through administration of the translated version in 104 patients, principle component analysis with varimax rotation and cross-referencing against CR use, respectively. Results The length, readability, and clarity of the questionnaire were rated well, demonstrating face validity. Analysis revealed a six-factor solution, demonstrating construct validity. Cronbach's alpha was greater than 0.65. Barriers rated highest included not knowing about CR and not being contacted by a program. The mean CRBS score was significantly higher among non-attendees (2.71±0.26) than CR attendees (2.51±0.18) (p<0.01). Conclusion The Korean version of CRBS has demonstrated face, content and criterion validity, suggesting it may be useful for assessing barriers to CR utilization in Korea. PMID:29201826

Design and validation of a three-instrument toolkit for the assessment of competence in electrocardiogram rhythm recognition.

PubMed

Hernández-Padilla, José M; Granero-Molina, José; Márquez-Hernández, Verónica V; Suthers, Fiona; López-Entrambasaguas, Olga M; Fernández-Sola, Cayetano

2017-06-01

Rapid and accurate interpretation of cardiac arrhythmias by nurses has been linked with safe practice and positive patient outcomes. Although training in electrocardiogram rhythm recognition is part of most undergraduate nursing programmes, research continues to suggest that nurses and nursing students lack competence in recognising cardiac rhythms. In order to promote patient safety, nursing educators must develop valid and reliable assessment tools that allow the rigorous assessment of this competence before nursing students are allowed to practise without supervision. The aim of this study was to develop and psychometrically evaluate a toolkit to holistically assess competence in electrocardiogram rhythm recognition. Following a convenience sampling technique, 293 nursing students from a nursing faculty in a Spanish university were recruited for the study. The following three instruments were developed and psychometrically tested: an electrocardiogram knowledge assessment tool (ECG-KAT), an electrocardiogram skills assessment tool (ECG-SAT) and an electrocardiogram self-efficacy assessment tool (ECG-SES). Reliability and validity (content, criterion and construct) of these tools were meticulously examined. A high Cronbach's alpha coefficient demonstrated the excellent reliability of the instruments (ECG-KAT=0.89; ECG-SAT=0.93; ECG-SES=0.98). An excellent context validity index (scales' average content validity index>0.94) and very good criterion validity were evidenced for all the tools. Regarding construct validity, principal component analysis revealed that all items comprising the instruments contributed to measure knowledge, skills or self-efficacy in electrocardiogram rhythm recognition. Moreover, known-groups analysis showed the tools' ability to detect expected differences in competence between groups with different training experiences. The three-instrument toolkit developed showed excellent psychometric properties for measuring competence in electrocardiogram rhythm recognition.

Evidence for the Criterion Validity and Clinical Utility of the Pathological Narcissism Inventory

ERIC Educational Resources Information Center

Thomas, Katherine M.; Wright, Aidan G. C.; Lukowitsky, Mark R.; Donnellan, M. Brent; Hopwood, Christopher J.

2012-01-01

In this study, the authors evaluated aspects of criterion validity and clinical utility of the grandiosity and vulnerability components of the Pathological Narcissism Inventory (PNI) using two undergraduate samples (N = 299 and 500). Criterion validity was assessed by evaluating the correlations of narcissistic grandiosity and narcissistic…

Development and validation of a beverage and snack questionnaire for use in evaluation of school nutrition policies.

PubMed

Neuhouser, Marian L; Lilley, Sonya; Lund, Anne; Johnson, Donna B

2009-09-01

School nutrition policies limiting access to sweetened beverages, candy, and salty snacks have the potential to improve the health of children. To effectively evaluate policy success, appropriate and validated dietary assessment instruments are needed. The objective of this study was to develop and validate a beverage and snack questionnaire suitable for use among young adolescents. A new 19-item Beverage and Snack Questionnaire (BSQ) was administered to middle school students on two occasions, 2 weeks apart, to measure test-retest reliability. The questionnaire inquired about frequency of consumption, both at school and away from school, of soft drinks, salty snacks, sweets, milk, and fruits and vegetables. Students also completed 4-day food records. To assess validity, food-record data were compared with BSQ data. Forty-six students of diverse backgrounds from metropolitan Seattle, WA, participated in this study. Participants answered the BSQ during class time and completed the food record at home. Pearson correlation coefficients assessed test-retest reliability and validity. Using frequency per week data, the test-retest reliability coefficients were r=0.85 for fruits and vegetables consumed at school and r=0.74 and r=0.72 for beverages and sweets/snacks, respectively, consumed at school. Correlations ranged from r=0.73 to 0.77 for foods consumed outside of school. Compared with the criterion food record, validity coefficients were very good: r=0.69 to 0.71 for foods consumed at school and r=0.63 to 0.70 for foods consumed away from school. The validity coefficients for the 19 individual food items ranged from r=0.56 to 0.87. This easy-to-administer 19-item questionnaire captures data on sugar-sweetened beverages, salty snacks, sweets, milk, and fruit and vegetables as well as a more lengthy and expensive food record does. The BSQ can be used by nutrition researchers and practitioners to accurately evaluate student consumption of foods that are the focus of school nutrition policies.

The development of indonesian online game addiction questionnaire.

PubMed

Jap, Tjibeng; Tiatri, Sri; Jaya, Edo Sebastian; Suteja, Mekar Sari

2013-01-01

Online game is an increasingly popular source of entertainment for all ages, with relatively prevalent negative consequences. Addiction is a problem that has received much attention. This research aims to develop a measure of online game addiction for Indonesian children and adolescents. The Indonesian Online Game Addiction Questionnaire draws from earlier theories and research on the internet and game addiction. Its construction is further enriched by including findings from qualitative interviews and field observation to ensure appropriate expression of the items. The measure consists of 7 items with a 5-point Likert Scale. It is validated by testing 1,477 Indonesian junior and senior high school students from several schools in Manado, Medan, Pontianak, and Yogyakarta. The validation evidence is shown by item-total correlation and criterion validity. The Indonesian Online Game Addiction Questionnaire has good item-total correlation (ranging from 0.29 to 0.55) and acceptable reliability (α = 0.73). It is also moderately correlated with the participant's longest time record to play online games (r = 0.39; p<0.01), average days per week in playing online games (ρ = 0.43; p<0.01), average hours per days in playing online games (ρ = 0.41; p<0.01), and monthly expenditure for online games (ρ = 0.30; p<0.01). Furthermore, we created a clinical cut-off estimate by combining criteria and population norm. The clinical cut-off estimate showed that the score of 14 to 21 may indicate mild online game addiction, and the score of 22 and above may indicate online game addiction. Overall, the result shows that Indonesian Online Game Addiction Questionnaire has sufficient psychometric property for research use, as well as limited clinical application.

The Development of Indonesian Online Game Addiction Questionnaire

PubMed Central

Jap, Tjibeng; Tiatri, Sri; Jaya, Edo Sebastian; Suteja, Mekar Sari

2013-01-01

Online game is an increasingly popular source of entertainment for all ages, with relatively prevalent negative consequences. Addiction is a problem that has received much attention. This research aims to develop a measure of online game addiction for Indonesian children and adolescents. The Indonesian Online Game Addiction Questionnaire draws from earlier theories and research on the internet and game addiction. Its construction is further enriched by including findings from qualitative interviews and field observation to ensure appropriate expression of the items. The measure consists of 7 items with a 5-point Likert Scale. It is validated by testing 1,477 Indonesian junior and senior high school students from several schools in Manado, Medan, Pontianak, and Yogyakarta. The validation evidence is shown by item-total correlation and criterion validity. The Indonesian Online Game Addiction Questionnaire has good item-total correlation (ranging from 0.29 to 0.55) and acceptable reliability (α = 0.73). It is also moderately correlated with the participant's longest time record to play online games (r = 0.39; p<0.01), average days per week in playing online games (ρ = 0.43; p<0.01), average hours per days in playing online games (ρ = 0.41; p<0.01), and monthly expenditure for online games (ρ = 0.30; p<0.01). Furthermore, we created a clinical cut-off estimate by combining criteria and population norm. The clinical cut-off estimate showed that the score of 14 to 21 may indicate mild online game addiction, and the score of 22 and above may indicate online game addiction. Overall, the result shows that Indonesian Online Game Addiction Questionnaire has sufficient psychometric property for research use, as well as limited clinical application. PMID:23560113

Developing a scale to measure "attachment to the local community" in late middle aged individuals.

PubMed

Sakai, Taichi; Omori, Junko; Takahashi, Kazuko; Mitsumori, Yasuko; Kobayashi, Maasa; Ono, Wakanako; Miyazaki, Toshie; Anzai, Hitomi; Saito, Mika

2016-01-01

Objectives This study was conducted to develop a scale for measuring "attachment to the local community" for its use in health services. The scale is also intended to nurture new social relationships in late middle-aged individuals.Methods Thirty items were initially planned to be included in the scale to measure "attachment to the local community", according to a previous study that identified the concept. The study subjects were late middle-aged residents of City B in Prefecture A, located in Tokyo suburbs. From the basic resident register data, 1,000 individuals (local residents in the 50-69 year age group) were selected by a multi-stage random sampling technique, on the basis of their residential area, age, and sex (while maintaining the male to female ratio). An unsigned self-administered questionnaire was distributed to the subjects, and the responses were collected by postal mail. The collected data was analyzed using psychometric study of scale.Results Valid responses were obtained from 583 subjects, and the response rate was 58.3%. In an item analysis, none of the items were rejected. In a subsequent factor analysis, 7 items were eliminated. These items included 2 items with a factor loading of <0.40, 3 items loading on multiple factors and showing a factor loading of ≥0.40, and 2 items with a low factor correlation (0.04-0.16). These items included factors that related to only these 2 items. Consequently, 23 items in the following 4-factor structure were selected as the scale items: "Source of vitality to live life," "Intention to cherish ties with people," "Place where one can be oneself," and "Pride of being a resident." Cronbach's coefficient α for the entire scale of "attachment to the local community" was 0.95, demonstrating internal consistency. We then examined the correlation with an existing scale to measure social support; the results revealed a statistically significant correlation and confirmed criterion-related validity (P<0.001). In addition, the fit indices in a covariance structure analysis showed adequate values.Conclusions The developed scale was considered reliable and appropriate for measuring "attachment to the local community."

Reliability and validity of the Chinese versions of self-efficacy and outcome expectations for osteoporosis medication adherence scales in Chinese immigrants.

PubMed

Qi, Bing-Bing; Resnick, Barbara

2014-01-01

To assess the psychometric properties of Chinese versions self-efficacy and outcome expectations on osteoporosis medication adherence (SEOMA-C and OEOMA-C) scales. Back-translated tools were assessed by internal consistency and R2 by structured equation modeling, confirmatory factor analyses, hypothesis testing, and criterion-related validity among 110 (81 females, 29 males) Mandarin-speaking immigrants (mean age = 63.44, SD = 9.63). The Cronbach's alpha for SEOMA-C and OEOMA-C is .904 and .937, respectively. There was fair and good fit of the measurement model to the data. Previous bone mineral density (BMD) testing, calcaneus BMD, self-efficacy for exercise, and osteoporosis medication adherence were positively related to SEOMA-C scores. These scales constitute some preliminary validity and reliability. Further refined and cultural sensitive items could be explored and added.

Assessment of Fearless Dominance and Impulsive Antisociality via Normal Personality Measures: Convergent Validity, Criterion Validity, and Developmental Change

PubMed Central

Witt, Edward A.; Donnellan, M. Brent; Blonigen, Daniel M.; Krueger, Robert F.; Conger, Rand D.

2009-01-01

This report provides evidence for the reliability, validity, and developmental course of the psychopathic personality traits of Fearless Dominance (FD) and Impulsive Antisociality (IA) as assessed by items from Multidimensional Personality Questionnaire (MPQ; Patrick, Curtin, & Tellegen, 2002). In Study 1, MPQ-based measures of FD and IA were strongly correlated with their corresponding composite scores from the Psychopathic Personality Inventory-Revised (Lilienfeld & Widows, 2005). In Study 2, FD and IA had relatively distinct associations with measures of normal and maladaptive personality traits. In Study 3, FD and IA had substantial retest coefficients during the transition to adulthood and both traits showed average declines with an especially substantial drop in IA. In Study 4, FD and IA were correlated with measures of internalizing and externalizing problems in ways consistent with previous research and theory. Collectively, these results provide important information about the assessment of FD and IA. PMID:19365767

COMFORT scale: a reliable and valid method to measure the amount of stress of ventilated preterm infants.

PubMed

Wielenga, J M; De Vos, R; de Leeuw, R; De Haan, R J

2004-01-01

Assessment of clinimetric properties and diagnostic quality of a stress measurement scale (COMFORT scale). Sample of an open population. Neonatology department (Neonatal Intensive Care Unit), Academic Medical Centre/Emma Children's Hospital, Amsterdam, The Netherlands. One clinical expert and 9 observers observed ventilated premature born babies simultaneously. Criterion validity was assessed by correlating the COMFORT scale with the clinical judgment regarding the amount of stress. Interobserver reliability was assessed on the clinical judgment as well as on the COMFORT scale. Diagnostic qualities were evaluated with a ROC curve. On 19 ventilated prematurely born babies (mean gestational age 30 weeks, mean birth weight 1385 gm), one clinical expert and 9 observers made 30 paired observations. The criterion validity of the COMFORT scale was good (Pearson's r of 0.84). The interobserver reliability of the clinical judgment was very good (weighted Kappa 0.84). The interobserver reliability of each item varied from good to almost perfect (weighted Kappa of 0.64 for muscle tone to 1.00 on heart rate). The reliability of the total COMFORT scale score was satisfying (intra-class correlation coefficient of 0.94). The diagnostic quality of the COMFORT scale was excellent, at a cut-off point of 20 the sensitivity was 100 percent, the specificity was 77 percent, and the area under the curve (AUC) of 0.95. In this first evaluation, the COMFORT scale appears to be a valid and reliable measurement tool to assess the stress of ventilated prematurely born babies.

Psychometric Properties of a 36-Item Version of the “Stress Management Competency Indicator Tool”

PubMed Central

Toderi, Stefano; Sarchielli, Guido

2016-01-01

The development of supervisors’ behaviours has been proposed as an innovative approach for the reduction of employees’ work stress. The UK Health and Safety Executive (HSE) developed the “Stress Management Competency Indicator Tool” (SMCIT), designed to be used within a learning and development intervention. However, its psychometric properties have never been evaluated, and the length of the questionnaire (66 items) limits its practical applicability. We developed a brief 36-item version of the questionnaire, assessed its psychometric properties and studied the relationship with the employees’ psychosocial work environment. 353 employees filled in the brief SMCIT and the “Stress Management Indicator Tool”. The latter is a self-report questionnaire developed by the UK HSE, measuring workers’ perceptions of seven dimensions of the psychosocial work environment that if not properly managed can lead to harm. Data were analysed with structural equation modelling and multiple regressions. The results confirmed the factorial structure of the brief SMCIT questionnaire and mainly supported the convergent validity and internal consistency of the scales. Furthermore, with few exceptions, the relations hypothesized between supervisors’ competencies and the psychosocial work environment were confirmed, supporting the criterion validity of the revised questionnaire and the UK HSE framework. We conclude that the brief 36-item version of the SMCIT represents an important step toward the development of interventions directed at supervisors and we discuss the practical implications for work stress prevention. PMID:27827940

Psychometric assessment of scales for a Model of Goal Directed Vegetable Parenting Practices (MGDVPP)

PubMed Central

2013-01-01

Background Vegetable intake has been related to lower risk of chronic illnesses in the adult years. The habit of vegetable intake should be established early in life, but many parents of preschoolers report not being able to get their child to eat vegetables. The Model of Goal Directed Behavior (MGDB) has been employed to understand vegetable parenting practices (VPP) to encourage a preschool child’s vegetable intake. The Model of Goal Directed Vegetable Parenting Practices (MGDVPP) provides possible determinants and may help explain why parents use effective or ineffective VPP. Scales to measure effective and ineffective vegetable parenting practices have previously been validated. This manuscript presents the psychometric characteristics and factor structures of new scales to measure the constructs in MGDVPP. Methods Participants were 307 parents of preschool (i.e. 3 to 5 year old) children, used for both exploratory (EFA) and confirmatory factor analyses (CFA). Data were collected via an internet survey. First, EFA were conducted using the scree plot criterion for factor extraction. Next, CFA assessed the fit of the exploratory derived factors. Then, classical test theory procedures were employed with all scales. Finally, Pearson correlations were calculated between each scale and composite effective and ineffective VPP as a test of scale predictive validity. Results Twenty-nine subscales (164 items) within 11 scales were extracted. The number of items per subscale ranged from 2 to 13, with three subscales having 10 or more items and 12 subscales having 4 items or less. Cronbach’s alphas varied from 0.13 to 0.92, with 17 being 0.70 or higher. Most alphas <0.70 had only three or four items. Twenty-five of the 29 subscales significantly bivariately correlated with the composite effective or ineffective VPP scales. Discussion This was the initial examination of the factor structure and psychometric assessment of MGDVPP scales. Most of the scales displayed acceptable to desirable psychometric characteristics. Research is warranted to add items to those subscales with small numbers of items, test their validity and reliability, and characterize the model’s influence on child vegetable consumption. PMID:24053779

Psychometric assessment of scales for a Model of Goal Directed Vegetable Parenting Practices (MGDVPP).

PubMed

Baranowski, Tom; Beltran, Alicia; Chen, Tzu-An; Thompson, Debbe; O'Connor, Teresia; Hughes, Sheryl; Diep, Cassandra; Baranowski, Janice

2013-09-22

Vegetable intake has been related to lower risk of chronic illnesses in the adult years. The habit of vegetable intake should be established early in life, but many parents of preschoolers report not being able to get their child to eat vegetables. The Model of Goal Directed Behavior (MGDB) has been employed to understand vegetable parenting practices (VPP) to encourage a preschool child's vegetable intake. The Model of Goal Directed Vegetable Parenting Practices (MGDVPP) provides possible determinants and may help explain why parents use effective or ineffective VPP. Scales to measure effective and ineffective vegetable parenting practices have previously been validated. This manuscript presents the psychometric characteristics and factor structures of new scales to measure the constructs in MGDVPP. Participants were 307 parents of preschool (i.e. 3 to 5 year old) children, used for both exploratory (EFA) and confirmatory factor analyses (CFA). Data were collected via an internet survey. First, EFA were conducted using the scree plot criterion for factor extraction. Next, CFA assessed the fit of the exploratory derived factors. Then, classical test theory procedures were employed with all scales. Finally, Pearson correlations were calculated between each scale and composite effective and ineffective VPP as a test of scale predictive validity. Twenty-nine subscales (164 items) within 11 scales were extracted. The number of items per subscale ranged from 2 to 13, with three subscales having 10 or more items and 12 subscales having 4 items or less. Cronbach's alphas varied from 0.13 to 0.92, with 17 being 0.70 or higher. Most alphas <0.70 had only three or four items. Twenty-five of the 29 subscales significantly bivariately correlated with the composite effective or ineffective VPP scales. This was the initial examination of the factor structure and psychometric assessment of MGDVPP scales. Most of the scales displayed acceptable to desirable psychometric characteristics. Research is warranted to add items to those subscales with small numbers of items, test their validity and reliability, and characterize the model's influence on child vegetable consumption.

Developing and evaluating an instrument to measure Recovery After INtensive care: the RAIN instrument.

PubMed

Bergbom, Ingegerd; Karlsson, Veronika; Ringdal, Mona

2018-01-01

Measuring and evaluating patients' recovery, following intensive care, is essential for assessing their recovery process. By using a questionnaire, which includes spiritual and existential aspects, possibilities for identifying appropriate nursing care activities may be facilitated. The study describes the development and evaluation of a recovery questionnaire and its validity and reliability. A questionnaire consisting of 30 items on a 5-point Likert scale was completed by 169 patients (103 men, 66 women), 18 years or older (m=69, SD 12.5) at 2, 6, 12 or 24 months following discharge from an ICU. An exploratory factor analysis, including a principal component analysis with orthogonal varimax rotation, was conducted. Ten initial items, with loadings below 0.40, were removed. The internal item/scale structure obtained in the principal component analysis was tested in relation to convergent and discrimination validity with a multi-trait analysis. Items consistency and reliability were assessed by Cronbach's alpha and internal item consistency. Test of scale quality, the proportion of missing values and respondents' scoring at maximum and minimum levels were also conducted. A total of 20 items in six factors - forward looking, supporting relations, existential ruminations, revaluation of life, physical and mental strength and need of social support were extracted with eigen values above one. Together, they explained 75% of the variance. The half-scale criterion showed that the proportion of incomplete scale scores ranged from 0% to 4.3%. When testing the scale's ability to differentiate between levels of the assessed concept, we found that the observed range of scale scores covered the theoretical range. Substantial proportions of respondents, who scored at the ceiling for forward looking and supporting relations and at floor for the need of social support, were found. These findings should be further investigated. The factor analysis, including discriminant validity and the mean value for the item correlations, was found to be excellent. The RAIN instrument could be used to assess recovery following intensive care. It could provide post-ICU clinics and community/primary healthcare nurses with valuable information on which areas patients may need more support.

Development of an opioid-related Overdose Risk Behavior Scale (ORBS).

PubMed

Pouget, Enrique R; Bennett, Alex S; Elliott, Luther; Wolfson-Stofko, Brett; Almeñana, Ramona; Britton, Peter C; Rosenblum, Andrew

2017-01-01

Drug overdose has emerged as the leading cause of injury-related death in the United States, driven by prescription opioid (PO) misuse, polysubstance use, and use of heroin. To better understand opioid-related overdose risks that may change over time and across populations, there is a need for a more comprehensive assessment of related risk behaviors. Drawing on existing research, formative interviews, and discussions with community and scientific advisors an opioid-related Overdose Risk Behavior Scale (ORBS) was developed. Military veterans reporting any use of heroin or POs in the past month were enrolled using venue-based and chain referral recruitment. The final scale consisted of 25 items grouped into 5 subscales eliciting the number of days in the past 30 during which the participant engaged in each behavior. Internal reliability, test-retest reliability and criterion validity were assessed using Cronbach's alpha, intraclass correlations (ICC) and Pearson's correlations with indicators of having overdosed during the past 30 days, respectivelyInternal reliability, test-retest reliability and criterion validity were assessed using Cronbach's alpha, intraclass correlations (ICC) and Pearson's correlations with indicators of having overdosed during the past 30 days, respectively. Data for 220 veterans were analyzed. The 5 subscales-(A) Adherence to Opioid Dosage and Therapeutic Purposes; (B) Alternative Methods of Opioid Administration; (C) Solitary Opioid Use; (D) Use of Nonprescribed Overdose-associated Drugs; and (E) Concurrent Use of POs, Other Psychoactive Drugs and Alcohol-generally showed good internal reliability (alpha range = 0.61 to 0.88), test-retest reliability (ICC range = 0.81 to 0.90), and criterion validity (r range = 0.22 to 0.66). The subscales were internally consistent with each other (alpha = 0.84). The scale mean had an ICC value of 0.99, and correlations with validators ranged from 0.44 to 0.56. These results constitute preliminary evidence for the reliability and validity of the new scale. If further validated, it could help improve overdose prevention and response research and could help improve the precision of overdose education and prevention efforts.

An Efficiency Balanced Information Criterion for Item Selection in Computerized Adaptive Testing

ERIC Educational Resources Information Center

Han, Kyung T.

2012-01-01

Successful administration of computerized adaptive testing (CAT) programs in educational settings requires that test security and item exposure control issues be taken seriously. Developing an item selection algorithm that strikes the right balance between test precision and level of item pool utilization is the key to successful implementation…

Assessment of radiation-induced xerostomia: validation of the Italian version of the xerostomia questionnaire in head and neck cancer patients.

PubMed

Pellegrino, Federica; Groff, Elena; Bastiani, Luca; Fattori, Bruno; Sotti, Guido

2015-04-01

Xerostomia is the most common acute and late side effect of radiation treatment for head and neck cancer. Affecting taste perception, chewing, swallowing and speech, xerostomia is also the major cause of decreased quality of life. The aims of this study were to validate the Italian translation of the self-reported eight-item xerostomia questionnaire (XQ) and determine its psychometric properties in patients treated with radiotherapy for head and neck cancer. An observational cross-sectional study was conducted in the Radiotherapy Unit of the Veneto Institute of Oncology - IOV in Padua. The XQ was translated according to international guidelines and filled out by 102 patients. Construct validity was assessed using principal component analysis, internal consistency using Cronbach's α coefficient and test-retest reliability at 1-month interval using the intraclass correlation coefficient (ICC). Criterion-related validity was evaluated to compare the Italian version of XQ with the European Organization for Research and Treatment of Cancer (EORTC) Core Quality-of-Life Questionnaire (QLQ-C30) and its Head and Neck Cancer Module (QLQ-H&N35). Cronbach's α for the Italian version of XQ was strong at α = 0.93, test-retest reliability was also strong (0.79) and factor analysis confirmed that the questionnaire was one-dimensional. Criterion-related validity was excellent with high association with the EORTC QLQ-H&N35 xerostomia and sticky saliva scales. The Italian version of XQ has excellent psychometric properties and can be used to evaluate the impact of emerging radiation delivery techniques aiming at preventing xerostomia.

[Toward a deeper understanding of motivation towards exercise: measurement of integrated regulation in the Spanish context].

PubMed

González-Cutre, David; Sicilia, Álvaro; Fernández, Alberto

2010-11-01

The purpose of this study was to validate the Behavioural Regulation in Exercise Questionnaire in the Spanish context, including items to measure integrated regulation. Participants were 524 exercisers, mean age 29.59 years. The results revealed acceptable fit indices in the confirmatory factor analysis and good internal consistency (with a Cronbach alpha of .87 for integrated regulation). The diverse subscales also conformed to a simplex pattern and the factor structure was invariant across gender and age. Integrated regulation reflected high temporal stability over a 4-week period (ICC=.90). The criterion validity analysis of integrated regulation indicated that this variable was positively predicted by satisfaction of the needs for competence and autonomy. The results regarding the importance of measuring integrated regulation in exercise are discussed.

Measuring student learning using initial and final concept test in an STEM course

NASA Astrophysics Data System (ADS)

Kaw, Autar; Yalcin, Ali

2012-06-01

Effective assessment is a cornerstone in measuring student learning in higher education. For a course in Numerical Methods, a concept test was used as an assessment tool to measure student learning and its improvement during the course. The concept test comprised 16 multiple choice questions and was given in the beginning and end of the class for three semesters. Hake's gain index, a measure of learning gains from pre- to post-tests, of 0.36 to 0.41 were recorded. The validity and reliability of the concept test was checked via standard measures such as Cronbach's alpha, content and criterion-related validity, item characteristic curves and difficulty and discrimination indices. The performance of various subgroups such as pre-requisite grades, transfer students, gender and age were also studied.

Development and validation of Trivandrum Development Screening Chart for children aged 0-6 years [TDSC (0-6)].

PubMed

Nair, M K C; Nair, G S Harikumaran; George, Babu; Suma, N; Neethu, C; Leena, M L; Russell, Paul Swamidhas Sudhakar

2013-11-01

To develop and validate a simple screening tool for identifying developmental delay among children of 0-6 y of age in the community. The 51-items of Trivandrum Development Screening Chart for children of 0-6 y [TDSC (0-6 y)], were carefully prepared from the norms in various existing developmental charts/scales, by experts keeping in mind the face validity and content validity. The criterion validity was assessed in a community sample of 1,183 children of 0-6 y with a mean age of 35.38 mo (SD of 19.25) including 597 (50.46%) boys and 586 (49.54%) girls. TDSC (0-6 y) was validated against Denver Developmental Screening Test (DDST) as the 'Reference Standard'. When one item delay in TDSC (0-6 y) was considered as 'TDSC delay' (test positive), the sensitivity and specificity of TDSC (0-6 y) was found to be 84.62% (95% CI: 71.92-93.12) and 90.8% (95% CI: 88.97-92.43) respectively with a Negative Predictive Value of 99.23% (95% CI: 98.48-99.67) and LR (negative) of 0.17(95% CI: 0.09-0.32). The test-retest and inter-rater reliability [an interclass correlation (ICC) of 0.77 for test-retest and ICC of 0.97 for inter-rater] were good and acceptable. TDSC (0-6 y) is a simple, reliable and valid screening tool for use in the community to identify children between 0 and 6 y with developmental delay, enabling early intervention practices.

Concurrent criterion validity of the safe driving behavior measure: a predictor of on-road driving outcomes.

PubMed

Classen, Sherrilene; Wang, Yanning; Winter, Sandra M; Velozo, Craig A; Lanford, Desiree N; Bédard, Michel

2013-01-01

We determined the concurrent criterion validity of the Safe Driving Behavior Measure (SDBM) for on-road outcomes (passing or failing the on-road test as determined by a certified driving rehabilitation specialist) among older drivers and their family members-caregivers. On the basis of ratings from 168 older drivers and 168 family members-caregivers, we calculated receiver operating characteristic curves. The drivers' area under the curve (AUC) was .620 (95% confidence interval [CI] = .514-.725, p = .043). The family members-caregivers' AUC was .726 (95% CI = .622-.829, p ≤ .01). Older drivers' ratings showed statistically significant yet poor concurrent criterion validity, but family members-caregivers' ratings showed good concurrent criterion validity for the criterion on-road driving test. Continuing research with a more representative sample is being pursued to confirm the SDBM's concurrent criterion validity. This screening tool may be useful for generalist practitioners to use in making decisions regarding driving. Copyright © 2013 by the American Occupational Therapy Association, Inc.

Concurrent Criterion Validity of the Safe Driving Behavior Measure: A Predictor of On-Road Driving Outcomes

PubMed Central

Wang, Yanning; Winter, Sandra M.; Velozo, Craig A.; Lanford, Desiree N.; Bédard, Michel

2013-01-01

We determined the concurrent criterion validity of the Safe Driving Behavior Measure (SDBM) for on-road outcomes (passing or failing the on-road test as determined by a certified driving rehabilitation specialist) among older drivers and their family members–caregivers. On the basis of ratings from 168 older drivers and 168 family members–caregivers, we calculated receiver operating characteristic curves. The drivers’ area under the curve (AUC) was .620 (95% confidence interval [CI] = .514–.725, p = .043). The family members–caregivers’ AUC was .726 (95% CI = .622–.829, p ≤ .01). Older drivers’ ratings showed statistically significant yet poor concurrent criterion validity, but family members–caregivers’ ratings showed good concurrent criterion validity for the criterion on-road driving test. Continuing research with a more representative sample is being pursued to confirm the SDBM’s concurrent criterion validity. This screening tool may be useful for generalist practitioners to use in making decisions regarding driving. PMID:23245789

Is adaptation of the word accentuation test of premorbid intelligence necessary for use among older, Spanish-speaking immigrants in the United States?

PubMed

Schrauf, Robert W; Weintraub, Sandra; Navarro, Ellen

2006-05-01

Adaptations of the National Adult Reading Test (NART) for assessing premorbid intelligence in languages other than English requires (a) generating word-items that are rare and do not follow grapheme-to-phoneme mappings common in that language, and (b) subsequent validation against a cognitive battery normed on the population of interest. Such tests exist for Italy, France, Spain, and Argentina, all normed against national versions of the Wechsler Adult Intelligence Scale. Given the varieties of Spanish spoken in the United States, the adaptation of the Spanish Word Accentuation Test (WAT) requires re-validating the original word list, plus possible new items, against a cognitive battery that has been normed on Spanish-speakers from many countries. This study reports the generation of 55 additional words and revalidation in a sample of 80 older, Spanish-dominant immigrants. The Batería Woodcock-Muñoz Revisada (BWM-R), normed on Spanish speakers from six countries and five U.S. states, was used to establish criterion validity. The original WAT word list accounted for 77% of the variance in the BWM-R and 58% of the variance in Ravens Colored Progressive Matrices, suggesting that the unmodified list possesses adequate predictive validity as an indicator of intelligence. Regression equations are provided for estimating BWM-R and Ravens scores from WAT scores.

Is the standard SF-12 health survey valid and equivalent for a Chinese population?

PubMed

Lam, Cindy L K; Tse, Eileen Y Y; Gandek, Barbara

2005-03-01

Chinese is the world's largest ethnic group but few health-related quality of life (HRQoL) measures have been tested on them. The aim of this study was to determine if the standard SF-12 was valid and equivalent for a Chinese population. The SF-36 data of 2410 Chinese adults randomly selected from the general population of Hong Kong (HK) were analysed. The Chinese (HK) specific SF-12 items and scoring algorithm were derived from the HK Chinese population data by multiple regressions. The SF-36 PCS and MCS scores were used as criteria to assess the content and criterion validity of the SF-12. The standard and Chinese (HK) specific SF-12 PCS and MCS scores were compared for equivalence. The standard SF-12 explained 82% and 89% of the variance of the SF-36 PCS and MCS scores, respectively, and the effect size differences between the standard SF-36 and SF-12 scores were less than 0.3. Six of the Chinese (HK) specific SF-12 items were different from those of the standard SF-12, but the effect size differences between the Chinese (HK) specific and standard SF-12 scores were mostly less than 0.3. The standard SF-12 was valid and equivalent for the Chinese, which would enable more Chinese to be included in clinical trials that measure HRQoL.

Aesthetic dermatology and emotional well-being questionnaire.

PubMed

Martínez-González, M Covadonga; Martínez-González, Raquel-Amaya; Guerra-Tapia, Aurora

2014-12-01

In recent years, there has been a great development of esthetic dermatology as a subspecialty of dermatology. It is important to know to which extent the general population regard this branch of medical surgical specialty as being of interest and contributing to emotional well-being. To analyze the technical features of a questionnaire which has been designed to reflect such perception of the general population about esthetic dermatology and its contribution to emotional well-being. Production and psychometric analysis of a self-filled in questionnaire in relation to esthetic dermatology and emotional well-being (DEBIE). This questionnaire is made of 57 items and has been applied to a sample of 770 people within the general population. The drawing-up process of the questionnaire is described to provide content validity. Items analysis was carried out together with exploratory and confirmatory factor analysis to assess the structure and construct validity of the tool. The extent of internal consistency (reliability) and concurrent validity has also been verified. DEBIE questionnaire (Spanish acronym for Aesthetic Dermatology and Emotional Well-being) revolves around six factors explaining 53.91% of the variance; there is a high level of internal consistency (Cronbach's α 0.90) and reasonable criterion validity. DEBIE questionnaire brings together adequate psychometric properties that can be applied to assess the perception that the general population have in relation to esthetic dermatology and its contribution to their emotional well-being. © 2014 Wiley Periodicals, Inc.

Beside the Geriatric Depression Scale: the WHO-Five Well-being Index as a valid screening tool for depression in nursing homes.

PubMed

Allgaier, Antje-Kathrin; Kramer, Dietmar; Saravo, Barbara; Mergl, Roland; Fejtkova, Sabina; Hegerl, Ulrich

2013-11-01

The aim of the study was to compare criterion validities of the WHO-Five Well-being Index (WHO-5) and the Geriatric Depression Scale 15-item version (GDS-15) and 4-item version (GDS-4) as screening instruments for depression in nursing home residents. Data from 92 residents aged 65-97 years without severe cognitive impairment (Mini Mental State Examination ≥15) were analysed. Criterion validities of the WHO-5, the GDS-15 and the GDS-4 were assessed against diagnoses of major and minor depression provided by the Structured Clinical Interview for DSM-IV. Subanalyses were performed for major and minor depression. Areas under the receiver operating curve (AUCs) as well as sensitivities and specificities at optimal cut-off points were computed. Prevalence of depressive disorder was 28.3%. The AUC value of the WHO-5 (0.90) was similar to that of the GDS-15 (0.82). Sensitivity of the WHO-5 (0.92) at its optimal cut-off of ≤12 was significantly higher than that of the GDS-15 (0.69) at its optimal cut-off of ≥7. The WHO-5 was equally sensitive for the subgroups of major and minor depression (0.92), whereas the GDS-15 was sensitive only for major depression (0.85), but not for minor depression (0.54). For specificity, there was no significant difference between WHO-5 (0.79) and GDS-15 (0.88), but both instruments outperformed the GDS-4 (0.53). The WHO-5 demonstrated high sensitivity for major and minor depression. Being shorter than the GDS-15 and superior to the GDS-4, the WHO-5 is a promising screening tool that could help physicians improve low recognition rates of depression in nursing home residents. Copyright © 2013 John Wiley & Sons, Ltd.

Development of the Japanese 15D instrument of health-related quality of life: verification of reliability and validity among elderly people.

PubMed

Okamoto, Nozomi; Hisashige, Akinori; Tanaka, Yuu; Kurumatani, Norio

2013-01-01

The 15D is a self-administered questionnaire for assessment of health-related quality of life, which contains 15 questions with 5 response options each. This study was conducted to evaluate the reliability and validity of the Japanese 15D. The subjects were 430 community-dwelling elderly people. Each item of the 15D was scored on a 5-point Likert scale, with level 1 being the best, score 1. Reliability was assessed by determination of the internal consistency and test-retest reliability. Criterion-based validity was assessed using the Japanese version of the Nottingham Health Profile (NHP) and Tokyo Metropolitan Institute of Gerontology Index of Competence (TMIG index). Acceptability was assessed by inquiring about the time required to complete the questionnaire and the burden felt in responding to it. The answers of 423 individuals who responded to all items were analyzed. The median time required to complete the questionnaire was 5.0 minutes, and the proportion of subjects who indicated that the questionnaire was easy to complete was 98.3%. The Cronbach's alpha coefficients for all 15 items in the 2 surveys were 0.793 and 0.792, respectively. The intraclass correlation coefficients for the 15 items ranged from 0.44 to 0.72. In the relationship between the 15D and the NHP, the correlation coefficients between the corresponding domains were higher than those between non-corresponding domains. The prevalence of disability in higher-level functional capacity was higher in the "level 2 to 5" group than in the "level 1" group. The Japanese version of the 15D showed sufficient internal consistency and moderate repeatability. Because of the short time required to complete the Japanese 15D and the significant relationships between the scores on the 15D and the NHP, and between the 15D and higher-level functional capacity, the acceptability and validity of the Japanese 15D were considered to be sufficient.

Measuring nursing competencies in the operating theatre: instrument development and psychometric analysis using Item Response Theory.

PubMed

Nicholson, Patricia; Griffin, Patrick; Gillis, Shelley; Wu, Margaret; Dunning, Trisha

2013-09-01

Concern about the process of identifying underlying competencies that contribute to effective nursing performance has been debated with a lack of consensus surrounding an approved measurement instrument for assessing clinical performance. Although a number of methodologies are noted in the development of competency-based assessment measures, these studies are not without criticism. The primary aim of the study was to develop and validate a Performance Based Scoring Rubric, which included both analytical and holistic scales. The aim included examining the validity and reliability of the rubric, which was designed to measure clinical competencies in the operating theatre. The fieldwork observations of 32 nurse educators and preceptors assessing the performance of 95 instrument nurses in the operating theatre were used in the calibration of the rubric. The Rasch model, a particular model among Item Response Models, was used in the calibration of each item in the rubric in an attempt at improving the measurement properties of the scale. This is done by establishing the 'fit' of the data to the conditions demanded by the Rasch model. Acceptable reliability estimates, specifically a high Cronbach's alpha reliability coefficient (0.940), as well as empirical support for construct and criterion validity for the rubric were achieved. Calibration of the Performance Based Scoring Rubric using Rasch model revealed that the fit statistics for most items were acceptable. The use of the Rasch model offers a number of features in developing and refining healthcare competency-based assessments, improving confidence in measuring clinical performance. The Rasch model was shown to be useful in developing and validating a competency-based assessment for measuring the competence of the instrument nurse in the operating theatre with implications for use in other areas of nursing practice. Crown Copyright © 2012. Published by Elsevier Ltd. All rights reserved.

Incremental Validity of the Durand Adaptive Psychopathic Traits Questionnaire Above Self-Report Psychopathy Measures in Community Samples.

PubMed

Durand, Guillaume

2018-05-03

Although highly debated, the notion of the existence of an adaptive side to psychopathy is supported by some researchers. Currently, 2 instruments assessing psychopathic traits include an adaptive component, which might not cover the full spectrum of adaptive psychopathic traits. The Durand Adaptive Psychopathic Traits Questionnaire (DAPTQ; Durand, 2017 ) is a 41-item self-reported instrument assessing adaptive traits known to correlate with the psychopathic personality. In this study, I investigated in 2 samples (N = 263 and N = 262) the incremental validity of the DAPTQ over the Psychopathic Personality Inventory-Short Form (PPI-SF) and the Triarchic Psychopathy Measure (TriPM) using multiple criterion measures. Results showed that the DAPTQ significantly increased the predictive validity over the PPI-SF on 5 factors of the HEXACO. Additionally, the DAPTQ provided incremental validity over both the PPI-SF and the TriPM on measures of communication adaptability, perceived stress, and trait anxiety. Overall, these results support the validity of the DAPTQ in community samples. Directions for future studies to further validate the DAPTQ are discussed.

Transcultural and psychometric validation of the Dispositional Resilience Scale (DRS-15) in Chinese adult women.

PubMed

Wong, Janet Yuen-Ha; Fong, Daniel Yee-Tak; Choi, Anna Wai-Man; Chan, Claudia Kor-Yee; Tiwari, Agnes; Chan, Ko Ling; Lai, Vincent; Logan, Tk; Bartone, Paul

2014-11-01

The aim of this study was to report translation and transcultural adaptation of the 15-item Dispositional Resilience Scale in traditional Chinese (C-DRS-15) and evaluate its psychometric properties. The DRS is a self-report instrument that measures psychological hardiness. We followed an international standard of cross-cultural translation and validation of patient-reported outcome measures to create the Chinese version. Then, the translated C-DRS-15 was validated on 542 Chinese women from a population-based sample in Hong Kong. The internal consistency and criterion-related validity were investigated. Exploratory and confirmatory factor analysis revealed that the C-DRS-15 was supported by a modified three-factor structure in our Chinese sample (RMSEA = .06, CFI = .94, TLI = .92, and SRMR = .06). The reliability (Cronbach's α coefficient = .78) and validity were satisfactory. Total resilience score was negatively correlated with depression (p < .001), with non-depressed women scoring higher on the C-DRS-15. The C-DRS-15 was demonstrated to be a reliable and valid measurement to assess hardiness in Chinese women.

Validity and reliability of the Spanish-language version of the self-administered Leeds Assessment of Neuropathic Symptoms and Signs (S-LANSS) pain scale.

PubMed

López-de-Uralde-Villanueva, I; Gil-Martínez, A; Candelas-Fernández, P; de Andrés-Ares, J; Beltrán-Alacreu, H; La Touche, R

2016-12-08

The self-administered Leeds Assessment of Neuropathic Symptoms and Signs (S-LANSS) scale is a tool designed to identify patients with pain with neuropathic features. To assess the validity and reliability of the Spanish-language version of the S-LANSS scale. Our study included a total of 182 patients with chronic pain to assess the convergent and discriminant validity of the S-LANSS; the sample was increased to 321 patients to evaluate construct validity and reliability. The validated Spanish-language version of the ID-Pain questionnaire was used as the criterion variable. All participants completed the ID-Pain, the S-LANSS, and the Numerical Rating Scale for pain. Discriminant validity was evaluated by analysing sensitivity, specificity, and the area under the receiver operating characteristic curve (AUC). Construct validity was assessed with factor analysis and by comparing the odds ratio of each S-LANSS item to the total score. Convergent validity and reliability were evaluated with Pearson's r and Cronbach's alpha, respectively. The optimal cut-off point for S-LANSS was ≥12 points (AUC=.89; sensitivity=88.7; specificity=76.6). Factor analysis yielded one factor; furthermore, all items contributed significantly to the positive total score on the S-LANSS (P<.05). The S-LANSS showed a significant correlation with ID-Pain (r=.734, α=.71). The Spanish-language version of the S-LANSS is valid and reliable for identifying patients with chronic pain with neuropathic features. Copyright © 2016 Sociedad Española de Neurología. Publicado por Elsevier España, S.L.U. All rights reserved.

PubMed

Steagall, Paulo V M; Monteiro, Beatriz P; Lavoie, Anne-Marie; Frank, Diane; Troncy, Eric; Luna, Stelio P L; Brondani, Juliana T

2017-01-01

Validation of the French version of the UNESP-Botucatu multidimensional composite pain scale for assessing postoperative pain in cats. The aim of this study was to validate the French version of the UNESP-Botucatu multidimensional composite pain scale (MCPS-Fr) to assess postoperative pain in cats. Two veterinarians and one DVM student identified three domains of behavior based on video analyses: "psychomotor change", "protection of the painful area" and "physiological variables". Internal consistency was excellent (Cronbach's alpha coefficient of 0.94, 0.90 and 0.61, respectively). Criterion validity was good to very good when evaluations from the three observers were compared with a "gold standard". Inter- and intra-rater reliability for each scale item were good to very good. The optimal cut-off point identified with a ROC curve was > 7 (scale range 0-30 points), with a sensitivity of 97.8% and specificity of 99.1%. The MCPS-Fr is a valid, reliable and responsive instrument for assessing acute pain in cats undergoing ovariohysterectomy.(Translated by Dr. Beatriz Monteiro).

The Illusory Beliefs Inventory: a new measure of magical thinking and its relationship with obsessive compulsive disorder.

PubMed

Kingdon, Bianca L; Egan, Sarah J; Rees, Clare S

2012-01-01

Magical thinking has been proposed to have an aetiological role in obsessive compulsive disorder (OCD). To address the limitations of existing measures of magical thinking we developed and validated a new 24-item measure of magical thinking, the Illusory Beliefs Inventory (IBI). The validation sample comprised a total of 1194 individuals across two samples recruited via an Internet based survey. Factor analysis identified three subscales representing domains relevant to the construct of magical thinking: Magical Beliefs, Spirituality, and Internal State and Thought Action Fusion. The scale had excellent internal consistency and evidence of convergent and discriminant validity. Evidence of criterion-related concurrent validity confirmed that magical thinking is a cognitive domain associated with OCD and is largely relevant to neutralizing, obsessing and hoarding symptoms. It is important for future studies to extend the evidence of the psychometric properties of the IBI in new populations and to conduct longitudinal studies to examine the aetiological role of magical thinking.

The Youth Psychopathic Traits Inventory: Measurement Invariance and Psychometric Properties among Portuguese Youths

PubMed Central

Pechorro, Pedro; Ribeiro da Silva, Diana; Andershed, Henrik; Rijo, Daniel; Abrunhosa Gonçalves, Rui

2016-01-01

The aim of the present study was to examine the psychometric properties of the Youth Psychopathic Traits Inventory (YPI) among a mixed-gender sample of 782 Portuguese youth (M = 15.87 years; SD = 1.72), in a school context. Confirmatory factor analysis revealed the expected three-factor first-order structure. Cross-gender measurement invariance and cross-sample measurement invariance using a forensic sample of institutionalized males were also confirmed. The Portuguese version of the YPI demonstrated generally adequate psychometric properties of internal consistency, mean inter-item correlation, convergent validity, discriminant validity, and criterion-related validity of statistically significant associations with conduct disorder symptoms, alcohol abuse, drug use, and unprotected sex. In terms of known-groups validity, males scored higher than females, and males from the school sample scored lower than institutionalized males. The use of the YPI among the Portuguese male and female youth population is psychometrically justified, and it can be a useful measure to identify adolescents with high levels of psychopathic traits. PMID:27571095

Changing abilities vs. changing tasks: Examining validity degradation with test scores and college performance criteria both assessed longitudinally.

PubMed

Dahlke, Jeffrey A; Kostal, Jack W; Sackett, Paul R; Kuncel, Nathan R

2018-05-03

We explore potential explanations for validity degradation using a unique predictive validation data set containing up to four consecutive years of high school students' cognitive test scores and four complete years of those students' college grades. This data set permits analyses that disentangle the effects of predictor-score age and timing of criterion measurements on validity degradation. We investigate the extent to which validity degradation is explained by criterion dynamism versus the limited shelf-life of ability scores. We also explore whether validity degradation is attributable to fluctuations in criterion variability over time and/or GPA contamination from individual differences in course-taking patterns. Analyses of multiyear predictor data suggest that changes to the determinants of performance over time have much stronger effects on validity degradation than does the shelf-life of cognitive test scores. The age of predictor scores had only a modest relationship with criterion-related validity when the criterion measurement occasion was held constant. Practical implications and recommendations for future research are discussed. (PsycINFO Database Record (c) 2018 APA, all rights reserved).

The Autonomic Symptom Profile: a new instrument to assess autonomic symptoms

NASA Technical Reports Server (NTRS)

Suarez, G. A.; Opfer-Gehrking, T. L.; Offord, K. P.; Atkinson, E. J.; O'Brien, P. C.; Low, P. A.

1999-01-01

OBJECTIVE: To develop a new specific instrument called the Autonomic Symptom Profile to measure autonomic symptoms and test its validity. BACKGROUND: Measuring symptoms is important in the evaluation of quality of life outcomes. There is no validated, self-completed questionnaire on the symptoms of patients with autonomic disorders. METHODS: The questionnaire is 169 items concerning different aspects of autonomic symptoms. The Composite Autonomic Symptom Scale (COMPASS) with item-weighting was established; higher scores indicate more or worse symptoms. Autonomic function tests were performed to generate the Composite Autonomic Scoring Scale (CASS) and to quantify autonomic deficits. We compared the results of the COMPASS with the CASS derived from the Autonomic Reflex Screen to evaluate validity. RESULTS: The instrument was tested in 41 healthy controls (mean age 46.6 years), 33 patients with nonautonomic peripheral neuropathies (mean age 59.5 years), and 39 patients with autonomic failure (mean age 61.1 years). COMPASS scores correlated well with the CASS, demonstrating an acceptable level of content and criterion validity. The mean (+/-SD) overall COMPASS score was 9.8 (+/-9) in controls, 25.9 (+/-17.9) in the patients with nonautonomic peripheral neuropathies, and 52.3 (+/-24.2) in the autonomic failure group. Scores of symptoms of orthostatic intolerance and secretomotor dysfunction best predicted the CASS on multiple stepwise regression analysis. CONCLUSIONS: We describe a questionnaire that measures autonomic symptoms and present evidence for its validity. The instrument shows promise in assessing autonomic symptoms in clinical trials and epidemiologic studies.

The intelligibility in Context Scale: validity and reliability of a subjective rating measure.

PubMed

McLeod, Sharynne; Harrison, Linda J; McCormack, Jane

2012-04-01

To describe a new measure of functional intelligibility, the Intelligibility in Context Scale (ICS), and evaluate its validity, reliability, and sensitivity using 3 clinical measures of severity of speech sound disorder: (a) percentage of phonemes correct (PPC), (b) percentage of consonants correct (PCC), and (c) percentage of vowels correct (PVC). Speech skills of 120 preschool children (109 with parent-/teacher-identified concern about how they talked and made speech sounds and 11 with no identified concern) were assessed with the Diagnostic Evaluation of Articulation and Phonology (Dodd, Hua, Crosbie, Holm, & Ozanne, 2002). Parents completed the 7-item ICS, which rates the degree to which children's speech is understood by different communication partners (parents, immediate family, extended family, friends, acquaintances, teachers, and strangers) on a 5-point scale. Parents' ratings showed that most children were always (5) or usually (4) understood by parents, immediate family, and teachers, but only sometimes (3) by strangers. Factor analysis confirmed the internal consistency of the ICS items; therefore, ratings were averaged to form an overall intelligibility score. The ICS had high internal reliability (α = .93), sensitivity, and construct validity. Criterion validity was established through significant correlations between the ICS and PPC (r = .54), PCC (r = .54), and PVC (r = .36). The ICS is a promising new measure of functional intelligibility. These data provide initial support for the ICS as an easily administered, valid, and reliable estimate of preschool children's intelligibility when speaking with people of varying levels of familiarity and authority.

Unavoidable Pressure Ulcers: Development and Testing of the Indiana University Health Pressure Ulcer Prevention Inventory.

PubMed

Pittman, Joyce; Beeson, Terrie; Terry, Colin; Dillon, Jill; Hampton, Charity; Kerley, Denise; Mosier, Judith; Gumiela, Ellen; Tucker, Jessica

2016-01-01

Despite prevention strategies, hospital-acquired pressure ulcers (HAPUs) continue to occur in the acute care setting. The purpose of this study was to develop an operational definition of and an instrument for identifying avoidable/unavoidable HAPUs in the acute care setting. The Indiana University Health Pressure Ulcer Prevention Inventory (PUPI) was developed and psychometric testing was performed. A retrospective pilot study of 31 adult hospitalized patients with an HAPU was conducted using the PUPI. Overall content validity index of 0.99 and individual item content validity index scores (0.9-1.0) demonstrated excellent content validity. Acceptable PUPI criterion validity was demonstrated with no statistically significant differences between wound specialists' and other panel experts' scoring. Construct validity findings were acceptable with no statistically significant differences among avoidable or unavoidable HAPU patients and their Braden Scale total scores. Interrater reliability was acceptable with perfect agreement on the total PUPI score between raters (κ = 1.0; P = .025). Raters were in total agreement 93% (242/260) of the time on all 12 individual PUPI items. No risk factors were found to be significantly associated with unavoidable HAPUs. An operational definition of and an instrument for identifying avoidable/unavoidable HAPUs in the acute care setting were developed and tested. The instrument provides an objective and structured method for identifying avoidable/unavoidable HAPUs. The PUPI provides an additional method that could be used in root-cause analyses and when reporting adverse pressure ulcer events.

[Reliability and Validity of the Behavioral Check List for Preschool Children to Measure Attention Deficit Hyperactivity Behaviors].

PubMed

Tsuno, Kanami; Yoshimasu, Kouichi; Hayashi, Takashi; Tatsuta, Nozomi; Ito, Yuki; Kamijima, Michihiro; Nakai, Kunihiko

2018-01-01

Nowadays, attention deficit hyperactivity (ADH) problems are observed commonly among school-age children. However, questionnaires specific to ADH behaviors among preschool children are very few. The aim of this study was to investigate the reliability and validity of the 25-item Behavioral Check List (BCL), which was developed from interviews of parents with children who were diagnosed as having Attention-deficit/hyperactivity disorder (ADHD) and measures ADH behaviors in preschool age. We recruited 22 teachers from 10 nurseries/kindergartens in Miyagi Prefecture, Japan. A total of 138 preschool children were assessed using the BCL. To investigate inter-rater reliability, two teachers from each facility assess seven to twenty children in their class, and intraclass correlation coefficients (ICCs) were calculated. The teachers additionally answered questions in the 1/5-5 Caregiver-Teacher Report Form (C-TRF) to investigate the criterion validity of the BCL. To investigate structural validity, exploratory factor analysis with promax rotation and confirmatory factor analysis were performed. The internal consistency reliability of the BCL was good (α = 0.92) and correlation analyses also confirmed its excellent criterion validity. Although exploratory factor analysis for the BCL yielded a five-factor model that consisted of a factor structure different from that of the original one, the results were similar to the original six factors. The ICCs of the BCL were 0.38-0.99 and it was not high enough for inter-rater reliability in some facilities. However, there is a possibility to improve it by giving raters adequate explanations when using BCL. The present study showed acceptable levels of reliability and validity of the BCL among Japanese preschool children.

Objective Assessment of Activity Limitation in Glaucoma with Smartphone Virtual Reality Goggles: A Pilot Study.

PubMed

Goh, Rachel L Z; Kong, Yu Xiang George; McAlinden, Colm; Liu, John; Crowston, Jonathan G; Skalicky, Simon E

2018-01-01

To evaluate the use of smartphone-based virtual reality to objectively assess activity limitation in glaucoma. Cross-sectional study of 93 patients (54 mild, 22 moderate, 17 severe glaucoma). Sociodemographics, visual parameters, Glaucoma Activity Limitation-9 and Visual Function Questionnaire - Utility Index (VFQ-UI) were collected. Mean age was 67.4 ± 13.2 years; 52.7% were male; 65.6% were driving. A smartphone placed inside virtual reality goggles was used to administer the Virtual Reality Glaucoma Visual Function Test (VR-GVFT) to participants, consisting of three parts: stationary, moving ball, driving. Rasch analysis and classical validity tests were conducted to assess performance of VR-GVFT. Twenty-four of 28 stationary test items showed acceptable fit to the Rasch model (person separation 3.02, targeting 0). Eleven of 12 moving ball test items showed acceptable fit (person separation 3.05, targeting 0). No driving test items showed acceptable fit. Stationary test person scores showed good criterion validity, differentiating between glaucoma severity groups ( P = 0.014); modest convergence validity, with mild to moderate correlation with VFQ-UI, better eye (BE) mean deviation, BE pattern deviation, BE central scotoma, worse eye (WE) visual acuity, and contrast sensitivity (CS) in both eyes ( R = 0.243-0.381); and suboptimal divergent validity. Multivariate analysis showed that lower WE CS ( P = 0.044) and greater age ( P = 0.009) were associated with worse stationary test person scores. Smartphone-based virtual reality may be a portable objective simulation test of activity limitation related to glaucomatous visual loss. The use of simulated virtual environments could help better understand the activity limitations that affect patients with glaucoma.

Inter-agency communication and operations capabilities during a hospital functional exercise: reliability and validity of a measurement tool.

PubMed

Savoia, Elena; Biddinger, Paul D; Burstein, Jon; Stoto, Michael A

2010-01-01

As proxies for actual emergencies, drills and exercises can raise awareness, stimulate improvements in planning and training, and provide an opportunity to examine how different components of the public health system would combine to respond to a challenge. Despite these benefits, there remains a substantial need for widely accepted and prospectively validated tools to evaluate agencies' and hospitals' performance during such events. Unfortunately, to date, few studies have focused on addressing this need. The purpose of this study was to assess the validity and reliability of a qualitative performance assessment tool designed to measure hospitals' communication and operational capabilities during a functional exercise. The study population included 154 hospital personnel representing nine hospitals that participated in a functional exercise in Massachusetts in June 2008. A 25-item questionnaire was developed to assess the following three hospital functional capabilities: (1) inter-agency communication; (2) communication with the public; and (3) disaster operations. Analyses were conducted to examine internal consistency, associations among scales, the empirical structure of the items, and inter-rater agreement. Twenty-two questions were retained in the final instrument, which demonstrated reliability with alpha coefficients of 0.83 or higher for all scales. A three-factor solution from the principal components analysis accounted for 57% of the total variance, and the factor structure was consistent with the original hypothesized domains. Inter-rater agreement between participants' self reported scores and external evaluators' scores ranged from moderate to good. The resulting 22-item performance measurement tool reliably measured hospital capabilities in a functional exercise setting, with preliminary evidence of concurrent and criterion-related validity.

Objective Assessment of Activity Limitation in Glaucoma with Smartphone Virtual Reality Goggles: A Pilot Study

PubMed Central

Goh, Rachel L. Z.; McAlinden, Colm; Liu, John; Crowston, Jonathan G.; Skalicky, Simon E.

2018-01-01

Purpose To evaluate the use of smartphone-based virtual reality to objectively assess activity limitation in glaucoma. Methods Cross-sectional study of 93 patients (54 mild, 22 moderate, 17 severe glaucoma). Sociodemographics, visual parameters, Glaucoma Activity Limitation-9 and Visual Function Questionnaire – Utility Index (VFQ-UI) were collected. Mean age was 67.4 ± 13.2 years; 52.7% were male; 65.6% were driving. A smartphone placed inside virtual reality goggles was used to administer the Virtual Reality Glaucoma Visual Function Test (VR-GVFT) to participants, consisting of three parts: stationary, moving ball, driving. Rasch analysis and classical validity tests were conducted to assess performance of VR-GVFT. Results Twenty-four of 28 stationary test items showed acceptable fit to the Rasch model (person separation 3.02, targeting 0). Eleven of 12 moving ball test items showed acceptable fit (person separation 3.05, targeting 0). No driving test items showed acceptable fit. Stationary test person scores showed good criterion validity, differentiating between glaucoma severity groups (P = 0.014); modest convergence validity, with mild to moderate correlation with VFQ-UI, better eye (BE) mean deviation, BE pattern deviation, BE central scotoma, worse eye (WE) visual acuity, and contrast sensitivity (CS) in both eyes (R = 0.243–0.381); and suboptimal divergent validity. Multivariate analysis showed that lower WE CS (P = 0.044) and greater age (P = 0.009) were associated with worse stationary test person scores. Conclusions Smartphone-based virtual reality may be a portable objective simulation test of activity limitation related to glaucomatous visual loss. Translational Relevance The use of simulated virtual environments could help better understand the activity limitations that affect patients with glaucoma. PMID:29372112

The development and psychometrical evaluation of a set of instruments to evaluate the effectiveness of diabetes patient education.

PubMed

Duprez, Veerle; De Pover, Marleen; De Spiegelaere, Marc; Beeckman, Dimitri

2014-02-01

To develop a set of psychometrically sound instruments to assess knowledge, self-management and self-efficacy of diabetic patients. Furthermore, a survey to evaluate the satisfaction about diabetes education for patients was developed and tested. Treatment and secondary prevention of diabetes require a complex combination of care components. Patients' education has been accepted to improve diabetes knowledge, self-management and self-efficacy. Psychometrically sound instruments are needed to measure these patient-centred outcomes. Psychometric instrument validation. The first phase included a systematic literature review to develop the instruments. Content validity was evaluated using a two-round Delphi procedure involving diabetes experts. The content validity of the instruments was excellent. In a second phase, a convenience sample of 188 diabetic patients in two hospitals in one specific care region in Belgium participated in the psychometric evaluation. The criterion-related validity and internal consistency reliability were evaluated. The study produced a 21-item knowledge instrument, reflecting knowledge about 'glycemic control' and 'medico-social management aspects'. The self-management instrument included 32 statements, reflecting 'treatment and compliance' and 'general lifestyle'. The self-efficacy instrument included 30 items, reflecting 'nutrition', 'treatment' and 'regimen'. The patient satisfaction survey included 36 items, reflecting satisfaction about the relationship among the diabetes specialist, the diabetes educator, podiatrist and dietician. An instrument set with sound psychometric characteristics was developed to assess knowledge, self-management and self-efficacy of diabetic patients. Future studies should focus on the association between the instrument outcomes and clinical patient outcomes. The current instrument can support the design of educational interventions and training programmes and reduce inconsistencies in the information that patients receive. Furthermore, the instruments can be used for benchmarking the quality of diabetic patient education. © 2013 Blackwell Publishing Ltd.

Use of the recognition heuristic depends on the domain's recognition validity, not on the recognition validity of selected sets of objects.

PubMed

Pohl, Rüdiger F; Michalkiewicz, Martha; Erdfelder, Edgar; Hilbig, Benjamin E

2017-07-01

According to the recognition-heuristic theory, decision makers solve paired comparisons in which one object is recognized and the other not by recognition alone, inferring that recognized objects have higher criterion values than unrecognized ones. However, success-and thus usefulness-of this heuristic depends on the validity of recognition as a cue, and adaptive decision making, in turn, requires that decision makers are sensitive to it. To this end, decision makers could base their evaluation of the recognition validity either on the selected set of objects (the set's recognition validity), or on the underlying domain from which the objects were drawn (the domain's recognition validity). In two experiments, we manipulated the recognition validity both in the selected set of objects and between domains from which the sets were drawn. The results clearly show that use of the recognition heuristic depends on the domain's recognition validity, not on the set's recognition validity. In other words, participants treat all sets as roughly representative of the underlying domain and adjust their decision strategy adaptively (only) with respect to the more general environment rather than the specific items they are faced with.

A Student Assessment Tool for Standardized Patient Simulations (SAT-SPS): Psychometric analysis.

PubMed

Castro-Yuste, Cristina; García-Cabanillas, María José; Rodríguez-Cornejo, María Jesús; Carnicer-Fuentes, Concepción; Paloma-Castro, Olga; Moreno-Corral, Luis Javier

2018-05-01

The evaluation of the level of clinical competence acquired by the student is a complex process that must meet various requirements to ensure its quality. The psychometric analysis of the data collected by the assessment tools used is a fundamental aspect to guarantee the student's competence level. To conduct a psychometric analysis of an instrument which assesses clinical competence in nursing students at simulation stations with standardized patients in OSCE-format tests. The construct of clinical competence was operationalized as a set of observable and measurable behaviors, measured by the newly-created Student Assessment Tool for Standardized Patient Simulations (SAT-SPS), which was comprised of 27 items. The categories assigned to the items were 'incorrect or not performed' (0), 'acceptable' (1), and 'correct' (2). 499 nursing students. Data were collected by two independent observers during the assessment of the students' performance at a four-station OSCE with standardized patients. Descriptive statistics were used to summarize the variables. The difficulty levels and floor and ceiling effects were determined for each item. Reliability was analyzed using internal consistency and inter-observer reliability. The validity analysis was performed considering face validity, content and construct validity (through exploratory factor analysis), and criterion validity. Internal reliability and inter-observer reliability were higher than 0.80. The construct validity analysis suggested a three-factor model accounting for 37.1% of the variance. These three factors were named 'Nursing process', 'Communication skills', and 'Safe practice'. A significant correlation was found between the scores obtained and the students' grades in general, as well as with the grades obtained in subjects with clinical content. The assessment tool has proven to be sufficiently reliable and valid for the assessment of the clinical competence of nursing students using standardized patients. This tool has three main components: the nursing process, communication skills, and safety management. Copyright © 2018 Elsevier Ltd. All rights reserved.

Patient experiences questionnaire for interdisciplinary treatment for substance dependence (PEQ-ITSD): reliability and validity following a national survey in Norway.

PubMed

Haugum, Mona; Iversen, Hilde Hestad; Bjertnaes, Oyvind; Lindahl, Anne Karin

2017-02-20

Patient experiences are an important aspect of health care quality, but there is a lack of validated instruments for their measurement in the substance dependence literature. A new questionnaire to measure inpatients' experiences of interdisciplinary treatment for substance dependence has been developed in Norway. The aim of this study was to psychometrically test the new questionnaire, using data from a national survey in 2013. The questionnaire was developed based on a literature review, qualitative interviews with patients, expert group discussions and pretesting. Data were collected in a national survey covering all residential facilities with inpatients in treatment for substance dependence in 2013. Data quality and psychometric properties were assessed, including ceiling effects, item missing, exploratory factor analysis, and tests of internal consistency reliability, test-retest reliability and construct validity. The sample included 978 inpatients present at 98 residential institutions. After correcting for excluded patients (n = 175), the response rate was 91.4%. 28 out of 33 items had less than 20.5% of missing data or replies in the "not applicable" category. All but one item met the ceiling effect criterion of less than 50.0% of the responses in the most favorable category. Exploratory factor analysis resulted in three scales: "treatment and personnel", "milieu" and "outcome". All scales showed satisfactory internal consistency reliability (Cronbach's alpha ranged from 0.75-0.91) and test-retest reliability (ICC ranged from 0.82-0.85). 17 of 18 significant associations between single variables and the scales supported construct validity of the PEQ-ITSD. The content validity of the PEQ-ITSD was secured by a literature review, consultations with an expert group and qualitative interviews with patients. The PEQ-ITSD was used in a national survey in Norway in 2013 and psychometric testing showed that the instrument had satisfactory internal consistency reliability and construct validity.

Developing a tool to measure satisfaction among health professionals in sub-Saharan Africa

PubMed Central

2013-01-01

Background In sub-Saharan Africa, lack of motivation and job dissatisfaction have been cited as causes of poor healthcare quality and outcomes. Measurement of health workers’ satisfaction adapted to sub-Saharan African working conditions and cultures is a challenge. The objective of this study was to develop a valid and reliable instrument to measure satisfaction among health professionals in the sub-Saharan African context. Methods A survey was conducted in Senegal and Mali in 2011 among 962 care providers (doctors, midwives, nurses and technicians) practicing in 46 hospitals (capital, regional and district). The participation rate was very high: 97% (937/962). After exploratory factor analysis (EFA), construct validity was assessed through confirmatory factor analysis (CFA). The discriminant validity of our subscales was evaluated by comparing the average variance extracted (AVE) for each of the constructs with the squared interconstruct correlation (SIC), and finally for criterion validity, each subscale was tested with two hypotheses. Two dimensions of reliability were assessed: internal consistency with Cronbach’s alpha subscales and stability over time using a test-retest process. Results Eight dimensions of satisfaction encompassing 24 items were identified and validated using a process that combined psychometric analyses and expert opinions: continuing education, salary and benefits, management style, tasks, work environment, workload, moral satisfaction and job stability. All eight dimensions demonstrated significant discriminant validity. The final model showed good performance, with a root mean square error of approximation (RMSEA) of 0.0508 (90% CI: 0.0448 to 0.0569) and a comparative fit index (CFI) of 0.9415. The concurrent criterion validity of the eight dimensions was good. Reliability was assessed based on internal consistency, which was good for all dimensions but one (moral satisfaction < 0.70). Test-retest showed satisfactory temporal stability (intra class coefficient range: 0.60 to 0.91). Conclusions Job satisfaction is a complex construct; this study provides a multidimensional instrument whose content, construct and criterion validities were verified to ensure its suitability for the sub-Saharan African context. When using these subscales in further studies, the variability of the reliability of the subscales should be taken in to account for calculating the sample sizes. The instrument will be useful in evaluative studies which will help guide interventions aimed at improving both the quality of care and its effectiveness. PMID:23826720

Cultural adaptation and validation of Stroke Impact Scale 3.0 version in Uganda: A small-scale study

PubMed Central

Kamwesiga, Julius T; von Koch, Lena; Kottorp, Anders; Guidetti, Susanne

2016-01-01

Background: Knowledge is scarce about the impact of stroke in Uganda, and culturally adapted, psychometrically tested patient-reported outcome measures are lacking. The Stroke Impact Scale 3.0 is recommended, but it has not been culturally adapted and validated in Uganda. Objective: To culturally adapt and determine the psychometric properties of the Stroke Impact Scale 3.0 in the Ugandan context on a small scale. Method: The Stroke Impact Scale 3.0 was culturally adapted to form Stroke Impact Scale 3.0 Uganda (in English) by involving 25 participants in three different expert committees. Subsequently, Stroke Impact Scale 3.0 Uganda from English to Luganda language was done in accordance with guidelines. The first language in Uganda is English and Luganda is the main spoken language in Kampala city and its surroundings. Translation of Stroke Impact Scale 3.0 Uganda (both in English and Luganda) was then tested psychometrically by applying a Rasch model on data collected from 95 participants with stroke. Results: Overall, 10 of 59 (17%) items in the eight domains of the Stroke Impact Scale 3.0 were culturally adapted. The majority were 6 of 10 items in the domain Activities of Daily Living, 2 of 9 items in the domain Mobility, and 2 of 5 items in the domain Hand function. Only in two domains, all items demonstrated acceptable goodness of fit to the Rasch model. There were also more than 5% person misfits in the domains Participation and Emotion, while the Communication, Mobility, and Hand function domains had the lowest proportions of person misfits. The reliability coefficient was equal or larger than 0.90 in all domains except the Emotion domain, which was below the set criterion of 0.80 (0.75). Conclusion: The cultural adaptation and translation of Stroke Impact Scale 3.0 Uganda provides initial evidence of validity of the Stroke Impact Scale 3.0 when used in this context. The results provide support for several aspects of validity and precision but also point out issues for further adaptation and improvement of the Stroke Impact Scale. PMID:27746913

Cultural adaptation and validation of Stroke Impact Scale 3.0 version in Uganda: A small-scale study.

PubMed

Kamwesiga, Julius T; von Koch, Lena; Kottorp, Anders; Guidetti, Susanne

2016-01-01

Knowledge is scarce about the impact of stroke in Uganda, and culturally adapted, psychometrically tested patient-reported outcome measures are lacking. The Stroke Impact Scale 3.0 is recommended, but it has not been culturally adapted and validated in Uganda. To culturally adapt and determine the psychometric properties of the Stroke Impact Scale 3.0 in the Ugandan context on a small scale. The Stroke Impact Scale 3.0 was culturally adapted to form Stroke Impact Scale 3.0 Uganda ( in English ) by involving 25 participants in three different expert committees. Subsequently, Stroke Impact Scale 3.0 Uganda from English to Luganda language was done in accordance with guidelines. The first language in Uganda is English and Luganda is the main spoken language in Kampala city and its surroundings. Translation of Stroke Impact Scale 3.0 Uganda ( both in English and Luganda ) was then tested psychometrically by applying a Rasch model on data collected from 95 participants with stroke. Overall, 10 of 59 (17%) items in the eight domains of the Stroke Impact Scale 3.0 were culturally adapted. The majority were 6 of 10 items in the domain Activities of Daily Living, 2 of 9 items in the domain Mobility, and 2 of 5 items in the domain Hand function. Only in two domains, all items demonstrated acceptable goodness of fit to the Rasch model. There were also more than 5% person misfits in the domains Participation and Emotion, while the Communication, Mobility, and Hand function domains had the lowest proportions of person misfits. The reliability coefficient was equal or larger than 0.90 in all domains except the Emotion domain, which was below the set criterion of 0.80 (0.75). The cultural adaptation and translation of Stroke Impact Scale 3.0 Uganda provides initial evidence of validity of the Stroke Impact Scale 3.0 when used in this context. The results provide support for several aspects of validity and precision but also point out issues for further adaptation and improvement of the Stroke Impact Scale.

Absenteeism screening questionnaire (ASQ): a new tool for predicting long-term absenteeism among workers with low back pain.

PubMed

Truchon, Manon; Schmouth, Marie-Ève; Côté, Denis; Fillion, Lise; Rossignol, Michel; Durand, Marie-José

2012-03-01

Over the last decades, psychosocial factors were identified by many studies as significant predictive variables in the development of disability related to common low back disorders, which thus contributed to the development of biopsychosocial prevention interventions. Biopsychosocial interventions were supposed to be more effective than usual interventions in improving different outcomes. Unfortunately, most of these interventions show inconclusive results. The use of screening questionnaires was proposed as a solution to improve their efficacy. The aim of this study was to validate a new screening questionnaire to identify workers at risk of being absent from work for more than 182 cumulative days and who are more susceptible to benefit from prevention interventions. Injured workers receiving income replacement benefits from the Quebec Compensation Board (n = 535) completed a 67-item questionnaire in the sub-acute stage of pain and provided information about work-related events 6 and 12 months later. Reliability and validity of the 67-item questionnaire were determined respectively by test-retest reliability and internal consistency analysis, as well as by construct validity analyses. The Cox regression model and the maximum likelihood method were used to fix a model allowing calculation of a probability of absence of more than 182 days. Criterion validity and discriminative capacity of this model were calculated. Sub-sections from the 67-item questionnaire were moderately to highly correlated 2 weeks later (r = 0.52-0.80) and showed moderate to good internal consistency (0.70-0.94). Among the 67-item questionnaire, six sub-sections and variables (22 items) were predictive of long-term absence from work: fear-avoidance beliefs related to work, return to work expectations, annual family income before-taxes, last level of education attained, work schedule and work concerns. The area under the ROC curve was 73%. The significant predictive variables of long-term absence from work were dominated by workplace conditions and individual perceptions about work. In association with individual psychosocial variables, these variables could contribute to identify potentially useful prevention interventions and to reduce the significant costs associated with LBP long-term absenteeism.

Have infant gross motor abilities changed in 20 years? A re-evaluation of the Alberta Infant Motor Scale normative values

PubMed Central

Darrah, Johanna; Bartlett, Doreen; Maguire, Thomas O; Avison, William R; Lacaze-Masmonteil, Thierry

2014-01-01

Aim To compare the original normative data of the Alberta Infant Motor Scale (AIMS) (n=2202) collected 20 years ago with a contemporary sample of Canadian infants. Method This was a cross-sectional cohort study of 650 Canadian infants (338 males, 312 females; mean age 30.9wks [SD 15.5], range 2wks–18mo) assessed once on the AIMS. Assessments were stratified by age, and infants proportionally represented the ethnic diversity of Canada. Logistic regression was used to place AIMS items on an age scale representing the age at which 50% of the infants passed an item on the contemporary data set and the original data set. Forty-three items met the criterion for stable regression results in both data sets. Results The correlation coefficient between the age locations of items on the original and contemporary data sets was 0.99. The mean age difference between item locations was 0.7 weeks. Age values from the original data set when converted to the contemporary scale differed by less than 1 week. Interpretation The sequence and age at emergence of AIMS items has remained similar over 20 years and current normative values remain valid. Concern that the ‘back to sleep’ campaign has influenced the age at emergence of gross motor abilities is not supported. PMID:24684556

Development and psychometric evaluation of a new measure to assess pregaming motives in Spanish-speaking young adults.

PubMed

Pilatti, Angelina; Read, Jennifer P

2018-06-01

The present study was divided into two different stages that sought to develop (Stage 1) and validate (Stage 2) the Argentinean-version of the Pregaming Motives Questionnaire (PMQ-Arg), a new, ecologically valid measure to assess pregaming (i.e., the consumption of alcohol prior to attending a social/sporting event where alcohol may or may not be available) motives among Spanish-speaking youth. Two separate samples of Argentinian young adults (all last-year pregamers) were recruited by disseminating an invitation through online social networks and e-mail listings. In Stage 1, a total of 635 participants answered an open-ended question about their reasons for pregaming. In Stage 2 (n=361), exploratory factor analysis was conducted with the preliminary set of high-quality, high-frequency pregaming motives that were obtained in Stage 1, yielding a final 23-item measure that was grouped in four factors: (i) Intoxication and Fun, (ii) Gathering and Social Enhancement, (iii) Going with the Flow, and (iv) Beverage Preference. Despite some broad similarities with measures that were developed with U.S. young adults, the present results indicated that the narrow content of some items of the PMQ-Arg were somewhat unique, possibly reflecting cultural differences between the United States and Argentina. The findings supported the adequate reliability, discriminant validity, convergent validity, and criterion-related validity of PMQ-Arg scores. The findings suggest that the PMQ-Arg meets the psychometric requirements of validity and reliability for its use to assess reasons for pregaming among Spanish-speaking youth. Copyright © 2018 Elsevier Ltd. All rights reserved.

Making and Executing Decisions for Safe and Independent Living (MED-SAIL): Development and Validation of a Brief Screening Tool

PubMed Central

Mills, Whitney L.; Regev, Tziona; Kunik, Mark E.; Wilson, Nancy L.; Moye, Jennifer; McCullough, Laurence B.; Naik, Aanand D.

2017-01-01

Objectives Older adults prefer to remain in their own homes for as long as possible. The purpose of this article is to describe the development and preliminary validation of Making and Executing Decisions for Safe and Independent Living (MED-SAIL), a brief screening tool for capacity to live safely and independently in the community. Design Prospective preliminary validation study. Setting Outpatient geriatrics clinic located in a community-based hospital. Participants Forty-nine community-dwelling older adults referred to the clinic for a comprehensive capacity assessment. Measurements We examined internal consistency, criterion-based validity, concurrent validity, and accuracy of classification for MED-SAIL. Results The items included in MED-SAIL demonstrated internal consistency (5 items; α = 0.85). MED-SAIL was significantly correlated with the Independent Living Scales (r = 0.573, p ≤ 0.001) and instrumental activities of daily living (r = 0.440, p ≤ 0.01). The Mann-Whitney U test revealed significant differences between the no capacity and partial/full capacity classifications on MED-SAIL (U(48) = 60.5, Z = −0.38, p <0.0001). The area under the curve was 0.864 (95% confidence interval: 0.84–0.99). Conclusions This study demonstrated the validity of MED-SAIL as a brief screening tool to identify older adults with impaired capacity for remaining safe and independent in their current living environment. MED-SAIL is useful tool for health and social service providers in the community for the purpose of referral for definitive capacity evaluation. PMID:23567420

Validation of the Inventaire du Milieu Familial Questionnaire (French version of the Infant/Toddler HOME) into the Brazilian Portuguese language.

PubMed

Sudbrack, Simone; Barbosa, Fernanda P; Mattiello, Rita; Booij, Linda; Estorgato, Geovana R; Dutra, Moisés S; Assunção, Fabiana D de; Nunes, Magda L

2018-04-22

To validate the Brazilian Portuguese version of the Family Environment Assessment questionnaire (Inventaire du Milieu Familial). The validation process was carried out in two stages. First, translation and back-translation were performed, and in the second phase, the questionnaire was applied in 72 families of children between 0 and 24 months for the validation process. The tool consists of the following domains: mother's communication ability; behavior; organization of the physical and temporal environment; collection/quantity of toys; maternal attitude of constant attention toward her baby; diversification of stimuli; baby's behavior. The following was performed for the scale validation: 1 - content analysis (judgment); 2 - construct analysis (factorial analysis - Kaiser-Meyer-Olkin, Bartlett, and Pearson's correlation tests); 3 - criterion analysis (calculation of Cronbach's alpha coefficient, intraclass correlations, and split-half correlations). The mean age of the children was 9±6.7 months, and of these, 35 (48.6%) were males. Most correlations between items and domains were significant. In the factorial analysis of the scale, Kaiser-Meyer-Olkin values were 0.76, Bartlett's test showed a p-value<0.001, and correlation between items and domains showed a p-value<0.01. Regarding the validity, Cronbach's alpha was 0.92 (95% CI: 0.89-0.94). The intraclass correlation among the evaluators was 0.97 (0.96-0.98) and split-half correlations, r: 0.60, with p<0.01. The Portuguese version of the Inventaire du Milieu Familial showed good to excellent performance regarding the assessed psychometric properties. Copyright © 2018. Published by Elsevier Editora Ltda.

Validation of the urgency questionnaire in Portuguese: A new instrument to assess overactive bladder syndrome.

PubMed

Moraes, Rodolfo Pacheco de; Silva, Jonas Lopes da; Calado, Adriano Almeida; Cavalcanti, Geraldo de Aguiar

2018-01-01

Overactive Bladder (OAB) is a clinical condition characterized by symptoms reported by patients. Therefore, measurement instruments based on reported information are important for understanding its impact and treatment benefits. The aim of this study was to translate, culturally adapt and validate the Urgency Questionnaire (UQ) in Portuguese. Initially, the UQ was translated and culturally adapted to Portuguese. Sixty-three volunteers were enrolled in the study and were interviewed for responding the Portuguese version of the UQ and the validated Portuguese version of the Overactive Bladder Questionnaire short-form (OABq-SF), used as the gold standard measurement for the validation process. Psychometric properties such as criterion validity, stability, and reliability were tested. Forty-six subjects were included in the symptomatic group (presence of "urgency"), and seventeen were included in the asymptomatic group (control group). There was difference between symptomatic and asymptomatic subjects on all of the subscales (p≤0.001). The UQ subscales correlated with the OABq-SF subscales (p≤0.01), except the subscale "time to control urgency" and the item "impact" from the visual analog scales (VAS). However, these scales correlated with the OABq-SF - Symptom Bother Scale. The UQ subscales demonstrated stability over time (p<0.05), but the subscale "fear of incontinence" and the item "severity" of the VAS did not. All of the UQ subscales showed internal consistencies that were considered to be good or excellent. The Portuguese version of the UQ proved to be a valid tool for the evaluation of OAB in individuals whose native language is Portuguese. Copyright® by the International Brazilian Journal of Urology.

First evidence on the validity and reliability of the Safety Organizing Scale-Nursing Home version (SOS-NH).

PubMed

Ausserhofer, Dietmar; Anderson, Ruth A; Colón-Emeric, Cathleen; Schwendimann, René

2013-08-01

The Safety Organizing Scale is a valid and reliable measure on safety behaviors and practices in hospitals. This study aimed to explore the psychometric properties of the Safety Organizing Scale-Nursing Home version (SOS-NH). In a cross-sectional analysis of staff survey data, we examined validity and reliability of the 9-item Safety SOS-NH using American Educational Research Association guidelines. This substudy of a larger trial used baseline survey data collected from staff members (n = 627) in a variety of work roles in 13 nursing homes (NHs) in North Carolina and Virginia. Psychometric evaluation of the SOS-NH revealed good response patterns with low average of missing values across all items (3.05%). Analyses of the SOS-NH's internal structure (eg, comparative fit indices = 0.929, standardized root mean square error of approximation = 0.045) and consistency (composite reliability = 0.94) suggested its 1-dimensionality. Significant between-facility variability, intraclass correlations, within-group agreement, and design effect confirmed appropriateness of the SOS-NH for measurement at the NH level, justifying data aggregation. The SOS-NH showed discriminate validity from one related concept: communication openness. Initial evidence regarding validity and reliability of the SOS-NH supports its utility in measuring safety behaviors and practices among a wide range of NH staff members, including those with low literacy. Further psychometric evaluation should focus on testing concurrent and criterion validity, using resident outcome measures (eg, patient fall rates). Copyright © 2013 American Medical Directors Association, Inc. All rights reserved.

Testing the PROMIS® Depression measures for monitoring depression in a clinical sample outside the US.

PubMed

Vilagut, G; Forero, C G; Adroher, N D; Olariu, E; Cella, D; Alonso, J

2015-09-01

The Patient Reported Outcomes Measurement Information System (PROMIS) was devised to facilitate assessment of patient self-reported health status, taking advantage of Item Response Theory. We aimed to assess measurement properties of the PROMIS Depression item bank and an 8-item static short form in a Spanish clinical sample. A three-month follow-up study of patients with active mood/anxiety symptoms (n = 218) was carried out. We assessed model unidimensionality (Confirmatory Item Factor Analysis), reliability (internal consistency and Item Information Curves), and validity (convergent-discriminant with correlations; known-groups with comparison of means and effect sizes; and criterion validity with Receiver operating Characteristics (ROC) analysis). We also assessed 3-month responsiveness to change (Cohen's effect sizes (d) in stable and recovered patients). The unidimensional model showed adequate fit (CFI = 0.97, RMSEA = 0.08). Information Curves had reliabilities over 0.90 throughout most of the score continuum. As expected, we observed high correlations with external self-reported depression, and moderate with self-reported anxiety and clinical measures. The item bank showed an increasing severity gradient from no disorder (mean = 48, SE = 0.6) to depression with comorbid anxiety (mean = 55.8, SE = 0.4). PROMIS detected depression disorder with great accuracy according to the area under the curve (AUC = 0.89). Both formats, item bank and short form, were highly responsive to change in recovered patients (d > 0.7) and had small changes in stable patients (d < 0.2). The good metric properties of the Spanish PROMIS Depression measures provide further evidence of their adequacy for monitoring depression levels of patients in clinical settings. This double check of quality (within countries and populations) supports the ability of PROMIS measures for guaranteeing fair comparisons across languages and countries in specific clinical populations. Copyright © 2015 Elsevier Ltd. All rights reserved.

Patient health questionnaire for school-based depression screening among Chinese adolescents.

PubMed

Tsai, Fang-Ju; Huang, Yu-Hsin; Liu, Hui-Ching; Huang, Kuo-Yang; Huang, Yen-Hsun; Liu, Shen-Ing

2014-02-01

The aim of this study was to determine the reliability and validity of a Chinese version of the Patient Health Questionnaire-9 item (PHQ-9) and its 2 subscales (1 item and 2 items) for the screening of major depressive disorder (MDD) among adolescents in Taiwan. A total of 2257 adolescents were recruited from high schools in Taipei. The participants completed assessments including demographic information, the Chinese version of the PHQ-9, and the Rosenberg Self-Esteem Scale, and data on the number of physical illnesses and mental health service utilizations were recorded. Among them, 430 were retested using the PHQ-9 within 2 weeks. Child psychiatrists interviewed a subsample of the adolescents (n = 165) using the Kiddie-Schedule for Affective Disorder and Schizophrenia Epidemiological Version as the criterion standard. The PHQ-9 had good internal consistency (α = 0.84) and acceptable test-retest reliability (0.80). The participants with higher PHQ-9 scores were more likely to have MDD. Principal component factor analysis of the PHQ-9 yielded a 1-factor structure, which accounted for 45.3% of the variance. A PHQ-9 score ≥15 had a sensitivity of 0.72 and a specificity of 0.95 for recognizing MDD. The area under the receiver operating characteristic curve was 0.90. The screening accuracy of the 2 subscales was also satisfactory, with a Patient Health Questionnaire-2 item cutoff of ≥3 being 94.4% sensitive and 82.5% specific and a Patient Health Questionnaire-1 item cutoff of ≥2 being 61.1% sensitive and 87.7% specific. The PHQ-9 and its 2 subscales appear to be reliable and valid for detecting MDD among ethnic Chinese adolescents in Taiwan.

Home food and activity assessment. Development and validation of an instrument for diverse families of young children.

PubMed

Boles, Richard E; Burdell, Alexandra; Johnson, Susan L; Gavin, William J; Davies, Patricia L; Bellows, Laura L

2014-09-01

The purpose of this study was to refine and psychometrically test an instrument measuring the home food and activity environment of geographically and economically diverse families of preschool aged children. Caregivers of preschool aged children (n = 83) completed a modified self-report questionnaire. Reliably trained researchers conducted independent observations on 25 randomly selected homes. Agreement statistics were conducted at the item level (154 total items) to determine reliability. Frequency counts were calculated to identify item availability. Results showed Kappa statistics were high (.67-1.00) between independent researchers but varied between researchers and parents resulting in 85 items achieving criterion validity (Kappa >.60). Analyses of reliable items revealed the presence in the home of a high frequency of unhealthy snack foods, high fat milk and low frequency of availability of fruits/vegetables and low fat milk. Fifty-two percent of the homes were arranged with a television in the preschool child's bedroom. Physical Activity devices also were found to have high frequency availability. Families reporting lower education reported higher levels of sugar sweetened beverages and less low-fat dairy (p < .05) compared with higher education families. Low-income families (<$27K per year) reported significantly fewer Physical Activity devices (p < .001) compared with higher income families. Hispanic families reported significantly higher numbers of Sedentary Devices (p < .05) compared with non-Hispanic families. There were no significant differences between demographic comparisons on available fruits/vegetables, meats, whole grains, and regular fat dairy. A modified home food and activity instrument was found to reliably identify foods and activity devices with geographically and economically diverse families. Copyright © 2014 Elsevier Ltd. All rights reserved.

Diagnostic accuracy of a two-item screen for drug use developed from the alcohol, smoking and substance involvement screening test (ASSIST).

PubMed

Tiet, Quyen Q; Leyva, Yani; Moos, Rudolf H; Smith, Brandy

2016-07-01

The Alcohol, Smoking and Substance Involvement Screening Test (ASSIST) is a screening instrument to detect substance use in primary care (PC). To screen for illicit substances (excluding tobacco and alcohol), the ASSIST consists of 8-57 questions and requires complicated scoring. To improve the efficiency of screening of drug misuse in PC, this study constructed and validated a two-item screen for drug use from the ASSIST. Guided by previous reviews, the ASSIST was revised. Patients were recruited in VA primary care clinics (N=1283). Half of the sample was used to develop the ASSIST-Drug; the other half was used to validate it. The Mini International Neuropsychiatric Interview (MINI) and the Inventory of Drug Use Consequences were the criterion measures. A brief, two-item ASSIST-Drug was constructed. Based on the development sample, the ASSIST-Drug was 94.1% sensitive and 89.6% specific for drug use disorders. Based on the validation sample, it was 95.4% sensitive and 87.8% specific. The ASSIST-Drug also had comparable sensitivity and specificity to identify drug use negative consequences, as well as for diverse subgroups of patients in terms of gender, age, race/ethnicity, marital status, educational levels, and post traumatic stress disorder status. The ASSIST-Drug may be a useful screening tool for PC settings. It is reliable, brief, and easy to remember, administer and score. It is sensitive and specific for drug use disorders and drug use negative consequences, and the predictive properties are consistent across subgroup of patients. Published by Elsevier Ireland Ltd.

Development of HomeSTEAD's physical activity and screen time physical environment inventory.

PubMed

Hales, Derek; Vaughn, Amber E; Mazzucca, Stephanie; Bryant, Maria J; Tabak, Rachel G; McWilliams, Christina; Stevens, June; Ward, Dianne S

2013-12-05

The home environment has a significant influence on children's physical activity, sedentary behavior, dietary intake, and risk for obesity and chronic disease. Our understanding of the most influential factors and how they interact and impact child behavior is limited by current measurement tools, specifically the lack of a comprehensive instrument. HomeSTEAD (the Home Self-administered Tool for Environmental assessment of Activity and Diet) was designed to address this gap. This new tool contains four sections: home physical activity and media equipment inventory, family physical activity and screen time practices, home food inventory, and family food practices. This paper will describe HomeSTEAD's development and present reliability and validity evidence for the first section. The ANGELO framework guided instrument development, and systematic literature reviews helped identify existing items or scales for possible inclusion. Refinement of items was based on expert review and cognitive interviews. Parents of children ages 3-12 years (n = 125) completed the HomeSTEAD survey on three separate occasions over 12-18 days (Time 1, 2, and 3). The Time 1 survey also collected demographic information and parent report of child behaviors. Between Time 1 and 2, staff conducted an in-home observation and measured parent and child BMI. Kappa and intra-class correlations were used to examine reliability (test-retest) and validity (criterion and construct). Reliability and validity was strong for most items (97% having ICC > 0.60 and 72% having r > 0.50, respectively). Items with lower reliability generally had low variation between people. Lower validity estimates (r < 0.30) were more common for items that assessed usability and accessibility, with observers generally rating usability and accessibility lower than parents. Small to moderate, but meaningful, correlations between physical environment factors and BMI, outside time, and screen time were observed (e.g., amount of child portable play equipment in good condition and easy to access was significantly associated with child BMI: r = -0.23), providing evidence of construct validity. The HomeSTEAD instrument represents a clear advancement in the measurement of factors in the home environment related to child weight and weight-related behaviors. HomeSTEAD, in its entirety, represents a useful tool for researchers from which they can draw particular scales of greatest interest and highest relevance to their research questions.

Validity, Responsiveness, Minimal Detectable Change, and Minimal Clinically Important Change of the Pediatric Motor Activity Log in Children with Cerebral Palsy

ERIC Educational Resources Information Center

Lin, Keh-chung; Chen, Hui-fang; Chen, Chia-ling; Wang, Tien-ni; Wu, Ching-yi; Hsieh, Yu-wei; Wu, Li-ling

2012-01-01

This study examined criterion-related validity and clinimetric properties of the Pediatric Motor Activity Log (PMAL) in children with cerebral palsy. Study participants were 41 children (age range: 28-113 months) and their parents. Criterion-related validity was evaluated by the associations between the PMAL and criterion measures at baseline and…

The Cognitive Abilities Scale--Second Edition Preschool Form: Studies of Concurrent Criterion-Related, Construct, and Predictive Criterion-Related Validity

ERIC Educational Resources Information Center

Swanson, Jennifer R.; Bradley-Johnson, Sharon; Johnson, C. Merle; O'Dell, Anna Rubenaker

2009-01-01

Three studies examine the validity of the Preschool Form of the Cognitive Abilities Scale--Second Edition (CAS-2). Significant high concurrent criterion-related validity correlations, corrected for restricted range, are found between the CAS-2 and the Detroit Test of Learning Ability--Primary: Third Edition for 26 three-year-olds (r[subscript c] =…

Assessing the Quality of Mobile Exercise Apps Based on the American College of Sports Medicine Guidelines: A Reliable and Valid Scoring Instrument.

PubMed

Guo, Yi; Bian, Jiang; Leavitt, Trevor; Vincent, Heather K; Vander Zalm, Lindsey; Teurlings, Tyler L; Smith, Megan D; Modave, François

2017-03-07

Regular physical activity can not only help with weight management, but also lower cardiovascular risks, cancer rates, and chronic disease burden. Yet, only approximately 20% of Americans currently meet the physical activity guidelines recommended by the US Department of Health and Human Services. With the rapid development of mobile technologies, mobile apps have the potential to improve participation rates in exercise programs, particularly if they are evidence-based and are of sufficient content quality. The goal of this study was to develop and test an instrument, which was designed to score the content quality of exercise program apps with respect to the exercise guidelines set forth by the American College of Sports Medicine (ACSM). We conducted two focus groups (N=14) to elicit input for developing a preliminary 27-item scoring instruments based on the ACSM exercise prescription guidelines. Three reviewers who were no sports medicine experts independently scored 28 exercise program apps using the instrument. Inter- and intra-rater reliability was assessed among the 3 reviewers. An expert reviewer, a Fellow of the ACSM, also scored the 28 apps to create criterion scores. Criterion validity was assessed by comparing nonexpert reviewers' scores to the criterion scores. Overall, inter- and intra-rater reliability was high with most coefficients being greater than .7. Inter-rater reliability coefficients ranged from .59 to .99, and intra-rater reliability coefficients ranged from .47 to 1.00. All reliability coefficients were statistically significant. Criterion validity was found to be excellent, with the weighted kappa statistics ranging from .67 to .99, indicating a substantial agreement between the scores of expert and nonexpert reviewers. Finally, all apps scored poorly against the ACSM exercise prescription guidelines. None of the apps received a score greater than 35, out of a possible maximal score of 70. We have developed and presented valid and reliable scoring instruments for exercise program apps. Our instrument may be useful for consumers and health care providers who are looking for apps that provide safe, progressive general exercise programs for health and fitness. ©Yi Guo, Jiang Bian, Trevor Leavitt, Heather K Vincent, Lindsey Vander Zalm, Tyler L Teurlings, Megan D Smith, François Modave. Originally published in the Journal of Medical Internet Research (http://www.jmir.org), 07.03.2017.

Turkish translation and adaptation of Champion's Health Belief Model Scales for breast cancer mammography screening.

PubMed

Yilmaz, Meryem; Sayin, Yazile Yazici

2014-07-01

To examine the translation and adaptation process from English to Turkish and the validity and reliability of the Champion's Health Belief Model Scales for Mammography Screening. Its aim (1) is to provide data about and (2) to assess Turkish women's attitudes and behaviours towards mammography. The proportion of women who have mammography is lower in Turkey. The Champion's Health Belief Model Scales for Mammography Screening-Turkish version can be helpful to determine Turkish women's health beliefs, particularly about mammography. Cross-sectional design was used to collect survey data from Turkish women: classical measurement method. The Champion's Health Belief Model Scales for Mammography Screening was translated from English to Turkish. Again, it was back translated into English. Later, the meaning and clarity of the scale items were evaluated by a bilingual group representing the culture of the target population. Finally, the tool was evaluated by two bilingual professional researchers in terms of content validity, translation validity and psychometric estimates of the validity and reliability. The analysis included a total of 209 Turkish women. The validity of the scale was confirmed by confirmatory factor analysis and criterion-related validity testing. The Champion's Health Belief Model Scales for Mammography Screening aligned to four factors that were coherent and relatively independent of each other. There was a statistically significant relationship among all of the subscale items: the positive and high correlation of the total item test score and high Cronbach's α. The scale has a strong stability over time: the Champion's Health Belief Model Scales for Mammography Screening demonstrated acceptable preliminary values of reliability and validity. The Champion's Health Belief Model Scales for Mammography Screening is both a reliable and valid instrument that can be useful in measuring the health beliefs of Turkish women. It can be used to provide data about healthcare practices required for mammography screening and breast cancer prevention. This scale will show nurses that nursing intervention planning is essential for increasing Turkish women's participation in mammography screening. © 2013 John Wiley & Sons Ltd.

Development of the reasons for living inventory for young adults.

PubMed

Gutierrez, Peter M; Osman, Augustine; Barrios, Francisco X; Kopper, Beverly A; Baker, Monty T; Haraburda, Cheryl M

2002-04-01

Assessment of the reliability, validity, and predictive power of a new measure, the Reasons for Living Inventory for Young Adults (RFL-YA) is described. A series of three studies was conducted at two Midwestern universities to develop initial items for this new measure, refine item selection, and demonstrate the psychometric properties of the RFL-YA. The theoretical differences between the RFL-YA and the College Student Reasons for Living Inventory (CS-RFL) are discussed. Although the two measures were not directly compared, it appears that the RFL-YA has greater specificity for exploring aspects of the protective construct and may be more parsimonious than the CS-RFL. Principal-axis factor analysis yielded a five-factor solution for the RFL-YA accounting for 61.5% of the variance. This five-factor oblique model was confirmed in the final phase of investigation. Alpha estimates for the five subscales ranged from.89 to.94. Concurrent, convergent-discriminant, and criterion validity also were demonstrated. The importance of assessing protective factors in addition to negative risk factors for suicidality is discussed. Directions for future research with the RFL-YA also are discussed. Copyright 2002 Wiley Periodicals, Inc.

Validity of the CAGE questionnaire for men who have sex with men (MSM) in China.

PubMed

Chen, Yen-Tyng; Ibragimov, Umedjon; Nehl, Eric J; Zheng, Tony; He, Na; Wong, Frank Y

2016-03-01

Detection of heavy drinking among men who have sex with men (MSM) is crucial for both intervention and treatment. The CAGE questionnaire is a popular screening instrument for alcohol use problems. However, the validity of CAGE for Chinese MSM is unknown. Data were from three waves of cross-sectional assessments among general MSM (n=523) and men who sell sex to other men ("money boys" or MBs, n=486) in Shanghai, China. Specifically, participants were recruited using respondent-driven, community popular opinion leader, and venue-based sampling methods. The validity of the CAGE was examined for different cutoff scores and individual CAGE items using self-reported heavy drinking (≥14 drinks in the past week) as a criterion. In the full sample, 75 (7.4%) of participants were classified as heavy drinkers. 32 (6.1%) of general MSM and 43 (8.9%) of MBs were heavy drinkers. The area under curve statistics for overall sample was 0.7 (95% CI: 0.36-0.77). Overall, the sensitivities (ranging from 18.7 to 66.7%), specificities (ranging from 67.5 to 95.8%), and positive predictive values (ranging from 14.1 to 26.4%) for different cutoff scores were inadequate using past week heavy drinking as the criterion. The ability of CAGE to discriminate heavy drinkers from non-heavy drinkers was limited. Our findings showed the inadequate validity of CAGE as a screening instrument for current heavy drinking in Chinese MSM. Further research using a combination of validity criteria is needed to determine the applicability of CAGE for this population. Copyright © 2016 Elsevier Ireland Ltd. All rights reserved.

Validity of the occupational sitting and physical activity questionnaire.

PubMed

Chau, Josephine Y; Van Der Ploeg, Hidde P; Dunn, Scott; Kurko, John; Bauman, Adrian E

2012-01-01

Sitting at work is an emerging occupational health risk. Few instruments designed for use in population-based research measure occupational sitting and standing as distinct behaviors. This study aimed to develop and validate brief measure of occupational sitting and physical activity. A convenience sample (n = 99, 61% female) was recruited from two medium-sized workplaces and by word-of-mouth in Sydney, Australia. Participants completed the newly developed Occupational Sitting and Physical Activity Questionnaire (OSPAQ) and a modified version of the MONICA Optional Study on Physical Activity Questionnaire (modified MOSPA-Q) twice, 1 wk apart. Participants also wore an ActiGraph accelerometer for the 7 d in between the test and retest. Analyses determined test-retest reliability with intraclass correlation coefficients and assessed criterion validity against accelerometers using the Spearman ρ. The test-retest intraclass correlation coefficients for occupational sitting, standing, and walking for OSPAQ ranged from 0.73 to 0.90, while that for the modified MOSPA-Q ranged from 0.54 to 0.89. Comparison of sitting measures with accelerometers showed higher Spearman correlations for the OSPAQ (r = 0.65) than for the modified MOSPA-Q (r = 0.52). Criterion validity correlations for occupational standing and walking measures were comparable for both instruments with accelerometers (standing: r = 0.49; walking: r = 0.27-0.29). The OSPAQ has excellent test-retest reliability and moderate validity for estimating time spent sitting and standing at work and is comparable to existing occupational physical activity measures for assessing time spent walking at work. The OSPAQ brief instrument measures sitting and standing at work as distinct behaviors and would be especially suitable in national health surveys, prospective cohort studies, and other studies that are limited by space constraints for questionnaire items.

Validity and reliability of the Japanese version of the Newest Vital Sign: a preliminary study.

PubMed

Kogure, Takamichi; Sumitani, Masahiko; Suka, Machi; Ishikawa, Hirono; Odajima, Takeshi; Igarashi, Ataru; Kusama, Makiko; Okamoto, Masako; Sugimori, Hiroki; Kawahara, Kazuo

2014-01-01

Health literacy (HL) refers to the ability to obtain, process, and understand basic health information and services, and is thus needed to make appropriate health decisions. The Newest Vital Sign (NVS) is comprised of 6 questions about an ice cream nutrition label and assesses HL numeracy skills. We developed a Japanese version of the NVS (NVS-J) and evaluated the validity and reliability of the NVS-J in patients with chronic pain. The translation of the original NVS into Japanese was achieved as per the published guidelines. An observational study was subsequently performed to evaluate the validity and reliability of the NVS-J in 43 Japanese patients suffering from chronic pain. Factor analysis with promax rotation, using the Kaiser criterion (eigenvalues ≥1.0), and a scree plot revealed that the main component of the NVS-J consists of three determinative factors, and each factor consists of two NVS-J items. The criterion-related validity of the total NVS-J score was significantly correlated with the total score of Ishikawa et al.'s self-rated HL Questionnaire, the clinical global assessment of comprehensive HL level, cognitive function, and the Brinkman index. In addition, Cronbach's coefficient for the total score of the NVS-J was adequate (alpha = 0.72). This study demonstrated that the NVS-J has good validity and reliability. Further, the NVS-J consists of three determinative factors: "basic numeracy ability," "complex numeracy ability," and "serious-minded ability." These three HL abilities comprise a 3-step hierarchical structure. Adequate HL should be promoted in chronic pain patients to enable coping, improve functioning, and increase activities of daily living (ADLs) and quality of life (QOL).

Cross-cultural adaptation and clinimetric property of Korean version of the Chronic Pain Coping Inventory-42 in patients with chronic low back pain.

PubMed

Ko, Young-Mi; Park, Won-Beom; Lim, Jae-Young

2010-03-15

Validation of a translated, culturally adapted questionnaire. We developed a Korean version of the Chronic Pain Coping Inventory-42 (CPCI-42) by performing a cross-cultural adaptation, and evaluated its reliability and validity. The CPCI is widely used and validated instruments for measuring coping strategies in chronic pain. However, no validated and culturally adapted version was available in Asian countries. We assessed 142 patients with chronic low back pain using the CPCI-42 and measures of physical disability, pain, and quality of life. Results for 93 of the 142 patients exhibited test-retest reliability. The interval time of collecting retest data varied from 2 weeks to 1 month. Criterion validity was evaluated using correlations between the CPCI-42 and the Oswestry Disability Index, the Brief Pain Inventory, and the Short Form 36-item Health Survey (version 2.0). Construct validity was computed using exploratory factor analysis. The Korean version of the CPCI-42 had a high internal consistency (Cronbach's alpha >0.70) with the exception of results for task persistence and relaxation. Illness-focused coping (guarding, resting, asking for assistance) and other-focused coping (seeking social support) were most significantly correlated with Oswestry Disability Index, Brief Pain Inventory, and Short Form 36-item Health Survey, respectively. Outcomes for task persistence were contrary to other subscales in wellness-focused coping. Construct validity by factor analysis produced similar results to the original CPCI subscale. However, several factors showed cross-loading in 8 factor solutions. Despite linguistic and cultural differences, the Korean version of the CPCI-42 is overall a meaningful tool, and produces results sufficiently similar to the original CPCI-42.

Development and Validation of the Online Social Support for Smokers Scale

PubMed Central

Papandonatos, George D; Kang, Hakmook; Moreno, Jose L; Abrams, David B

2011-01-01

Background Social networks play an important role in smoking. Provision of social support during cessation is a cornerstone of treatment. Online social networks for cessation are ubiquitous and represent a promising modality for smokers to receive and provide the support necessary for cessation. There are no existing measures specific to online social support for smoking cessation. Objective The objective was to develop a measure of social support to be used in online smoking cessation treatment research. Methods Initial items for the Online Social Support for Smokers Scale (OS4) were based on existing theory and scales delineated in various taxonomies. Preliminary field analysis (N = 73) was conducted on 23 initial items to optimize the scale. Further development was conducted on a refined 15-item scale in the context of a large randomized trial of Internet and telephone cessation treatment with follow-ups at 3, 6, 12, and 18 months. In all, 1326 participants were randomized to an enhanced Internet arm that included a large online social network; psychometric analyses employed 3-month follow-up data from those reporting use of the enhanced Internet intervention at least once (n = 873). Items were subjected to a factor analysis, and the internal consistency reliability of the scale was examined along with construct and criterion validity. Other measures used in the study included demographics, nicotine dependence, partner support for cessation, general social support, social integration, stress, depression, health status, online community use, Internet use behaviors, intervention satisfaction, and 30-day point prevalence abstinence. Results The final 12-item OS4 scale demonstrated high internal consistency reliability (Cronbach alphas .86-.89) across demographic and smoking strata of interest. The OS4 also demonstrated good construct and criterion validity, with the directionality of the observed associations providing support for most a priori hypotheses. Significant Pearson correlations were observed between the OS4 and the Partner Interaction Questionnaire (PIQ) Positive subscale (ρ = .24, P < .001). As hypothesized, participants with the highest OS4 scores were more likely to have actively participated in the enhanced Internet community and to have high levels of satisfaction with the enhanced Internet intervention. In logistic regression analyses, the OS4 was highly predictive of 30-day point-prevalence abstinence at 6, 12, and 18 months (all P values <.001). The odds of abstinence at 6 months rose by 48% for each standard unit increase in online social support (95% confidence interval [CI] 1.17 - 1.71), dropping only slightly to 37% at 12 and 18 months (95% CI 1.17 - 1.59). Conclusions The OS4 is a brief, reliable, and valid instrument for measuring online social support for smoking cessation. Results should be replicated and extended, but this study suggests the OS4 can be used to advance theory, understand mechanisms, and potentially help to improve the tailoring of Internet-based smoking cessation treatments. It can also inspire development of similar measures for other online health-related intervention research. Trial registration Clinicaltrials.gov #NCT00282009; http://clinicaltrials.gov/ct2/show/NCT00282009 (Archived by WebCite at http://www.webcitation.org/60XNj3xM6) PMID:21955465

Preequating with Empirical Item Characteristic Curves: An Observed-Score Preequating Method

ERIC Educational Resources Information Center

Zu, Jiyun; Puhan, Gautam

2014-01-01

Preequating is in demand because it reduces score reporting time. In this article, we evaluated an observed-score preequating method: the empirical item characteristic curve (EICC) method, which makes preequating without item response theory (IRT) possible. EICC preequating results were compared with a criterion equating and with IRT true-score…

The Development and Management of Banks of Performance Based Test Items.

ERIC Educational Resources Information Center

Curtis, H. A., Ed.

Symposium papers presented at an Annual Meeting of the National Council on Measurement in Education (Chicago, 1972), all of which concern banks of test items for use in constructing criterion referenced tests, comprise this document. The first paper, "Locally Produced Item Banks" by Thomas J. Slocum, presents information on the…

A Five-Year Evaluation of Examination Structure in a Cardiovascular Pharmacotherapy Course

PubMed Central

Kolar, Claire; Janke, Kristin K.

2015-01-01

Objective. To evaluate the composition and effectiveness as an assessment tool of a criterion-referenced examination comprised of clinical cases tied to practice decisions, to examine the effect of varying audience response system (ARS) questions on student examination preparation, and to articulate guidelines for structuring examinations to maximize evaluation of student learning. Design. Multiple-choice items developed over 5 years were evaluated using Bloom’s Taxonomy classification, point biserial correlation, item difficulty, and grade distribution. In addition, examination items were classified into categories based on similarity to items used in ARS preparation. Assessment. As the number of items directly tied to clinical practice rose, Bloom’s Taxonomy level and item difficulty also rose. In examination years where Bloom’s levels were high but preparation was minimal, average grade distribution was lower compared with years in which student preparation was higher. Conclusion. Criterion-referenced examinations can benefit from systematic evaluation of their composition and effectiveness as assessment tools. Calculated design and delivery of classroom preparation is an asset in improving examination performance on rigorous, practice-relevant examinations. PMID:27168611

Criterion and content validity of a novel structured haggling contingent valuation question format versus the bidding game and binary with follow-up format.

PubMed

Onwujekwe, Obinna

2004-02-01

Contingent valuation question formats that will be used to elicit willingness to pay for goods and services need to be relevant to the area they will be used in order for responses to be valid. A novel contingent valuation question format called the "structured haggling technique" (SH) that resembles the bargaining system in Nigerian markets was designed and its criterion and content validity compared with those of the bidding game (BG) and binary-with-follow-up (BWFU) technique. This was achieved by determining the willingness to pay (WTP) for insecticide-treated nets (ITNs) in Southeast Nigeria. Content validity was determined through observation of actual trading of untreated nets together with interviews with sellers and consumers. Criterion validity was determined by comparing stated and actual WTP. Stated WTP was determined using a questionnaire administered to 810 household heads and actual WTP was determined by offering the nets for sale to all respondents one month later. The phi (correlation) coefficient was used to compare criterion validity across question formats. The phi coefficients were SH (0.60: 95% C.I. 0.50-0.71), BG (0.42: 95% C.I. 0.29-0.54) and the BWFU (0.32: 95% C.I. 0.20-0.44), implying that the BG and SH had similar levels of criterion-validity while the BWFU was the least criterion-valid. However, the SH was the most content-valid. It is necessary to validate the findings in other areas where haggling is common. Future studies should establish the content validity of question formats in the contexts in which they will be used before administering questionnaires.

A Graphical Approach to Item Analysis. Research Report. ETS RR-04-10

ERIC Educational Resources Information Center

Livingston, Samuel A.; Dorans, Neil J.

2004-01-01

This paper describes an approach to item analysis that is based on the estimation of a set of response curves for each item. The response curves show, at a glance, the difficulty and the discriminating power of the item and the popularity of each distractor, at any level of the criterion variable (e.g., total score). The curves are estimated by…

[Mokken scaling of the Cognitive Screening Test].

PubMed

Diesfeldt, H F A

2009-10-01

The Cognitive Screening Test (CST) is a twenty-item orientation questionnaire in Dutch, that is commonly used to evaluate cognitive impairment. This study applied Mokken Scale Analysis, a non-parametric set of techniques derived from item response theory (IRT), to CST-data of 466 consecutive participants in psychogeriatric day care. The full item set and the standard short version of fourteen items both met the assumptions of the monotone homogeneity model, with scalability coefficient H = 0.39, which is considered weak. In order to select items that would fulfil the assumption of invariant item ordering or the double monotonicity model, the subjects were randomly partitioned into a training set (50% of the sample) and a test set (the remaining half). By means of an automated item selection eleven items were found to measure one latent trait, with H = 0.67 and item H coefficients larger than 0.51. Cross-validation of the item analysis in the remaining half of the subjects gave comparable values (H = 0.66; item H coefficients larger than 0.56). The selected items involve year, place of residence, birth date, the monarch's and prime minister's names, and their predecessors. Applying optimal discriminant analysis (ODA) it was found that the full set of twenty CST items performed best in distinguishing two predefined groups of patients of lower or higher cognitive ability, as established by an independent criterion derived from the Amsterdam Dementia Screening Test. The chance corrected predictive value or prognostic utility was 47.5% for the full item set, 45.2% for the fourteen items of the standard short version of the CST, and 46.1% for the homogeneous, unidimensional set of selected eleven items. The results of the item analysis support the application of the CST in cognitive assessment, and revealed a more reliable 'short' version of the CST than the standard short version (CST14).

Development of Reliable and Validated Tools to Evaluate Technical Resuscitation Skills in a Pediatric Simulation Setting: Resuscitation and Emergency Simulation Checklist for Assessment in Pediatrics.

PubMed

Faudeux, Camille; Tran, Antoine; Dupont, Audrey; Desmontils, Jonathan; Montaudié, Isabelle; Bréaud, Jean; Braun, Marc; Fournier, Jean-Paul; Bérard, Etienne; Berlengi, Noémie; Schweitzer, Cyril; Haas, Hervé; Caci, Hervé; Gatin, Amélie; Giovannini-Chami, Lisa

2017-09-01

To develop a reliable and validated tool to evaluate technical resuscitation skills in a pediatric simulation setting. Four Resuscitation and Emergency Simulation Checklist for Assessment in Pediatrics (RESCAPE) evaluation tools were created, following international guidelines: intraosseous needle insertion, bag mask ventilation, endotracheal intubation, and cardiac massage. We applied a modified Delphi methodology evaluation to binary rating items. Reliability was assessed comparing the ratings of 2 observers (1 in real time and 1 after a video-recorded review). The tools were assessed for content, construct, and criterion validity, and for sensitivity to change. Inter-rater reliability, evaluated with Cohen kappa coefficients, was perfect or near-perfect (>0.8) for 92.5% of items and each Cronbach alpha coefficient was ≥0.91. Principal component analyses showed that all 4 tools were unidimensional. Significant increases in median scores with increasing levels of medical expertise were demonstrated for RESCAPE-intraosseous needle insertion (P = .0002), RESCAPE-bag mask ventilation (P = .0002), RESCAPE-endotracheal intubation (P = .0001), and RESCAPE-cardiac massage (P = .0037). Significantly increased median scores over time were also demonstrated during a simulation-based educational program. RESCAPE tools are reliable and validated tools for the evaluation of technical resuscitation skills in pediatric settings during simulation-based educational programs. They might also be used for medical practice performance evaluations. Copyright © 2017 Elsevier Inc. All rights reserved.

DREEM on, dentists! Students' perceptions of the educational environment in a German dental school as measured by the Dundee Ready Education Environment Measure.

PubMed

Ostapczuk, M S; Hugger, A; de Bruin, J; Ritz-Timme, S; Rotthoff, T

2012-05-01

The educational climate in which future doctors are trained is an important aspect of medical education. In contrast to human medicine, it has been rather neglected in dental educational research. The aim of the study was to supplement this lack by applying and validating the Dundee Ready Education Environment Measure (DREEM) for the first time in a German-speaking sample of dental students. All dental students at the Medical Faculty of Heinrich-Heine-University Düsseldorf were asked to complete a German adaptation of the DREEM and the Düsseldorf Mission Statement Questionnaire (DMSQ) in a paper-pencil survey. Data from 205 participants were analysed. Psychometric validation included analysis of item homogeneity and discrimination, test reliability, criterion and construct validity (convergent, factorial). DREEM item parameters were satisfactory, reliability (α = 0.87) and convergent validity (r = 0.66 with DMSQ) were also high. Factor analyses, however, yielded dimensions which did not fully correspond to the original DREEM subscales. Overall perception of the educational environment was positive (DREEM total score = 122.95 ± 15.52). Students in the clinical part of course rated the atmosphere more negatively, but their academic self-perception more positively than preclinical students. Showing satisfactory psychometric properties, DREEM proved suitable for assessing educational environments among dental students. Given the right circumstances, e.g., small and early clinically oriented classes, traditional curricula can generate positive environments. © 2011 John Wiley & Sons A/S.

Measuring Diversity and Inclusion in Academic Medicine: The Diversity Engagement Survey (DES)

PubMed Central

Person, Sharina D.; Jordan, C. Greer; Allison, Jeroan J.; Fink Ogawa, Lisa M.; Castillo-Page, Laura; Conrad, Sarah; Nivet, Marc A.; Plummer, Deborah L.

2018-01-01

Purpose To produce a physician and scientific workforce capable of delivering high quality, culturally competent health care and research, academic medical centers must assess their capacity for diversity and inclusion and respond to identified opportunities. Thus, the Diversity Engagement Survey (DES) is presented as a diagnostic and benchmarking tool. Method The 22-item DES connects workforce engagement theory with inclusion and diversity constructs. Face and content validity were established based on decades of previous work to promote institutional diversity. The survey was pilot tested at a single academic medical center and subsequently administered at 13 additional academic medical centers. Cronbach alphas assessed internal consistency and Confirmatory Factor Analysis (CFA) established construct validity. Criterion validity was assessed by observed separation in scores for groups traditionally recognized to have less workforce engagement. Results The sample consisted of 13,694 individuals at 14 medical schools from across the U.S. who responded to the survey administered between 2011– 2012. The Cronbach alphas for inclusion and engagement factors (range: 0.68 to 0.85), CFA fit indices, and item correlations with latent constructs, indicated an acceptable model fit and that questions measured the intended concepts. DES scores clearly distinguished higher and lower performing institutions. The DES detected important disparities for black, women, and those who did not have heterosexual orientation. Conclusions This study demonstrated that the DES is a reliable and valid instrument for internal assessment and evaluation or external benchmarking of institutional progress in building inclusion and engagement. PMID:26466376

Assessment of the Validity of the Research Diagnostic Criteria for Temporomandibular Disorders: Overview and Methodology

PubMed Central

Schiffman, Eric L.; Truelove, Edmond L.; Ohrbach, Richard; Anderson, Gary C.; John, Mike T.; List, Thomas; Look, John O.

2011-01-01

AIMS The purpose of the Research Diagnostic Criteria for Temporomandibular Disorders (RDC/TMD) Validation Project was to assess the diagnostic validity of this examination protocol. An overview is presented, including Axis I and II methodology and descriptive statistics for the study participant sample. This paper details the development of reliable methods to establish the reference standards for assessing criterion validity of the Axis I RDC/TMD diagnoses. Validity testing for the Axis II biobehavioral instruments was based on previously validated reference standards. METHODS The Axis I reference standards were based on the consensus of 2 criterion examiners independently performing a comprehensive history, clinical examination, and evaluation of imaging. Intersite reliability was assessed annually for criterion examiners and radiologists. Criterion exam reliability was also assessed within study sites. RESULTS Study participant demographics were comparable to those of participants in previous studies using the RDC/TMD. Diagnostic agreement of the criterion examiners with each other and with the consensus-based reference standards was excellent with all kappas ≥ 0.81, except for osteoarthrosis (moderate agreement, k = 0.53). Intrasite criterion exam agreement with reference standards was excellent (k ≥ 0.95). Intersite reliability of the radiologists for detecting computed tomography-disclosed osteoarthrosis and magnetic resonance imaging-disclosed disc displacement was good to excellent (k = 0.71 and 0.84, respectively). CONCLUSION The Validation Project study population was appropriate for assessing the reliability and validity of the RDC/TMD Axis I and II. The reference standards used to assess the validity of Axis I TMD were based on reliable and clinically credible methods. PMID:20213028

A Criterion-Referenced Approach to Student Ratings of Instruction

ERIC Educational Resources Information Center

Meyer, J. Patrick; Doromal, Justin B.; Wei, Xiaoxin; Zhu, Shi

2017-01-01

We developed a criterion-referenced student rating of instruction (SRI) to facilitate formative assessment of teaching. It involves four dimensions of teaching quality that are grounded in current instructional design principles: Organization and structure, Assessment and feedback, Personal interactions, and Academic rigor. Using item response…

Testing whether the DSM-5 personality disorder trait model can be measured with a reduced set of items: An item response theory investigation of the Personality Inventory for DSM-5.

PubMed

Maples, Jessica L; Carter, Nathan T; Few, Lauren R; Crego, Cristina; Gore, Whitney L; Samuel, Douglas B; Williamson, Rachel L; Lynam, Donald R; Widiger, Thomas A; Markon, Kristian E; Krueger, Robert F; Miller, Joshua D

2015-12-01

The fifth edition of the Diagnostic and Statistical Manual of Mental Disorders (DSM-5) includes an alternative model of personality disorders (PDs) in Section III, consisting in part of a pathological personality trait model. To date, the 220-item Personality Inventory for DSM-5 (PID-5; Krueger, Derringer, Markon, Watson, & Skodol, 2012) is the only extant self-report instrument explicitly developed to measure this pathological trait model. The present study used item response theory-based analyses in a large sample (n = 1,417) to investigate whether a reduced set of 100 items could be identified from the PID-5 that could measure the 25 traits and 5 domains. This reduced set of PID-5 items was then tested in a community sample of adults currently receiving psychological treatment (n = 109). Across a wide range of criterion variables including NEO PI-R domains and facets, DSM-5 Section II PD scores, and externalizing and internalizing outcomes, the correlational profiles of the original and reduced versions of the PID-5 were nearly identical (rICC = .995). These results provide strong support for the hypothesis that an abbreviated set of PID-5 items can be used to reliably, validly, and efficiently assess these personality disorder traits. The ability to assess the DSM-5 Section III traits using only 100 items has important implications in that it suggests these traits could still be measured in settings in which assessment-related resources (e.g., time, compensation) are limited. (c) 2015 APA, all rights reserved).

Do measures of depressive symptoms function differently in people with spinal cord injury versus primary care patients: the CES-D, PHQ-9, and PROMIS®-D.

PubMed

Cook, Karon F; Kallen, Michael A; Bombardier, Charles; Bamer, Alyssa M; Choi, Seung W; Kim, Jiseon; Salem, Rana; Amtmann, Dagmar

2017-01-01

To evaluate whether items of three measures of depressive symptoms function differently in persons with spinal cord injury (SCI) than in persons from a primary care sample. This study was a retrospective analysis of responses to the Patient Health Questionnaire depression scale, the Center for Epidemiological Studies Depression scale, and the National Institutes of Health Patient-Reported Outcomes Measurement Information System (PROMIS ® ) version 1.0 eight-item depression short form 8b (PROMIS-D). The presence of differential item function (DIF) was evaluated using ordinal logistic regression. No items of any of the three target measures were flagged for DIF based on standard criteria. In a follow-up sensitivity analyses, the criterion was changed to make the analysis more sensitive to potential DIF. Scores were corrected for DIF flagged under this criterion. Minimal differences were found between the original scores and those corrected for DIF under the sensitivity criterion. The three depression screening measures evaluated in this study did not perform differently in samples of individuals with SCI compared to general and community samples. Transdiagnostic symptoms did not appear to spuriously inflate depression severity estimates when administered to people with SCI.

Measuring workplace social support for workers with disability.

PubMed

Lysaght, Rosemary; Fabrigar, Leandre; Larmour-Trode, Sherrey; Stewart, Jeremy; Friesen, Margaret

2012-09-01

Social support in the workplace has been has been demonstrated to serve as a contributor to a worker's ability to manage work demands and to manage stress. Research in the area of disability management indicates that interpersonal factors play an important role in the success of return-to-work interventions. The role of workplace support has received limited attention in rehabilitation, despite the salience of support to the disability management process. Prior to this study, there existed no validated quantitative measure of social support for workers who re-enter the workplace following injury or disability. A support measure prototype, the Support for Workers with Disability Scale, was tested with 152 workers in accommodated work situations. Four validation tools were used to assess criterion validity. Factor analysis was used to validate the content structure and reduce the total number of response items. Additional analysis was conducted to determine the ability of the measure to discriminate between groups, and to provide insight into how social support operates in workplaces. Based on analysis, a reduced measure consisting of 41 items and measuring supervisor, co-worker, and non-work supports was created. Secondary analysis disclosed information concerning the nature of supports in the workplace. Higher levels of support were identified for workers with fewer work role limitations and for those with one versus multiple injury claims. This tool provides a validated outcome measure for research examining the social aspects of workplace disability. It can also serve as a quality management tool for human resource professionals engaged in continuous improvement of disability management programs.

Psychometric properties of the Brunel Mood Scale in Chinese adolescents and adults.

PubMed

Zhang, Chun-Qing; Si, Gangyan; Chung, Pak-Kwong; Du, Mengmeng; Terry, Peter C

2014-01-01

Building on the work of Terry and colleagues (Terry, P. C., Lane, A. M., Lane, H. J., & Keohane, L. (1999). Development and validation of a mood measure for adolescents. Journal of Sports Sciences, 17, 861-872; Terry, P. C., Lane, A. M., & Fogarty, G. J. (2003). Construct validity of the Profile of Mood States-Adolescents for use with adults. Psychology of Sport & Exercise, 4, 125-139.), the present study examined the validity and internal consistency reliability of the Chinese version of the Brunel Mood Scale (BRUMS-C) among 2,548 participants, comprising adolescent athletes (n = 520), adult athletes (n = 434), adolescent students (n = 673), and adult students (n = 921). Both adolescent and adult athletes completed the BRUMS-C before, during, or after regular training and both adolescent and adult students completed the BRUMS-C in a classroom setting. Confirmatory factor analyses (CFAs) provided support for the factorial validity of a 23-item six-factor model, with one item removed from the hypothesised measurement model. Internal consistency reliabilities were satisfactory for all subscales across each of the four samples. Criterion validity was supported with strong relationships between the BRUMS-C, abbreviated POMS, and Chinese Affect Scale consistent with theoretical predictions. Multi-sample CFAs showed the BRUMS-C to be invariant at the configural, metric, strong, and structural levels for all samples. Furthermore, latent mean difference analyses showed that athletes reported significantly higher levels of fatigue than students while maintaining almost the same levels of vigour, and adolescent students reported significantly higher levels of depressed mood than the other three samples.

An Application of Practical Strategies in Assessing the Criterion-Related Validity of Credentialing Examinations.

ERIC Educational Resources Information Center

Fidler, James R.

1993-01-01

Criterion-related validities of 2 laboratory practitioner certification examinations for medical technologists (MTs) and medical laboratory technicians (MLTs) were assessed for 81 MT and 70 MLT examinees. Validity coefficients are presented for both measures. Overall, summative ratings yielded stronger validity coefficients than ratings based on…

Extending Structural Analyses of the Rosenberg Self-Esteem Scale to Consider Criterion-Related Validity: Can Composite Self-Esteem Scores Be Good Enough?

PubMed

Donnellan, M Brent; Ackerman, Robert A; Brecheen, Courtney

2016-01-01

Although the Rosenberg Self-Esteem Scale (RSES) is the most widely used measure of global self-esteem in the literature, there are ongoing disagreements about its factor structure. This methodological debate informs how the measure should be used in substantive research. Using a sample of 1,127 college students, we test the overall fit of previously specified models for the RSES, including a newly proposed bifactor solution (McKay, Boduszek, & Harvey, 2014 ). We extend previous work by evaluating how various latent factors from these structural models are related to a set of criterion variables frequently studied in the self-esteem literature. A strict unidimensional model poorly fit the data, whereas models that accounted for correlations between negatively and positively keyed items tended to fit better. However, global factors from viable structural models had similar levels of association with criterion variables and with the pattern of results obtained with a composite global self-esteem variable calculated from observed scores. Thus, we did not find compelling evidence that different structural models had substantive implications, thereby reducing (but not eliminating) concerns about the integrity of the self-esteem literature based on overall composite scores for the RSES.

The Japanese Criminal Thinking Inventory: Development, Reliability, and Initial Validation of a New Scale for Assessing Criminal Thinking in a Japanese Offender Population.

PubMed

Kishi, Kaori; Takeda, Fumi; Nagata, Yuko; Suzuki, Junko; Monma, Takafumi; Asanuma, Tohru

2015-11-01

Using a sample of 116 Japanese men who had been placed under parole/probationary supervision or released from prison, the present study examined standardization, reliability, and validation of the Japanese Criminal Thinking Inventory (JCTI) that was based on the short form of the Psychological Inventory of Criminal Thinking Styles (PICTS), a self-rating instrument designed to evaluate cognitive patterns specific to criminal conduct. An exploratory factor analysis revealed that four dimensions adequately captured the structure of the JCTI, and the resultant 17-item JCTI demonstrated high internal consistency. Compared with the Japanese version of the Buss-Perry Aggression Questionnaire (BAQ), the JCTI showed a favorable pattern of criterion-related validity. Prior criminal environment and drug abuse as the most recent offense also significantly correlated with the JCTI total score. Overall, the JCTI possesses an important implication for offender rehabilitation as it identifies relevant cognitive targets and assesses offender progress. © The Author(s) 2014.

Development and initial validation of a measure of work, family, and school conflict.

PubMed

Olson, Kristine J

2014-01-01

This study reports the development and initial validation of a theoretically based measure of conflict between work, family, and college student roles. The measure was developed through the assessment of construct definitions and an assessment of measurement items by subject matter experts. Then, the measurement items were assessed with data from 500 college students who were engaged in work and family responsibilities. The results indicate that conflict between work, family, and school are effectively measured by 12 factors assessing the direction of conflict (e.g., work-to-school conflict, and school-to-work conflict) as well as the form of conflict (i.e., time, strain, and behavior based conflict). Sets of exploratory and confirmatory factor analyses demonstrated that the 12 factors of the new measure are distinct from the 6 factors of the Carlson, Kacmar, and Williams (2000) work-family conflict measure. Criterion validity of the measure was established through a series of regression analyses testing hypothesized relationships between antecedent and outcome variables with role conflict. Results indicate that role demand was a robust predictor of role conflict. To extend the literature, core self-evaluations and emotional stability were established as predictors of role conflict. Further, work, family, and school role satisfaction were significantly impacted with the presence of role conflict between work, family, and school. PsycINFO Database Record (c) 2014 APA, all rights reserved.

Criterion-Related Validity: Assessing the Value of Subscores

ERIC Educational Resources Information Center

Davison, Mark L.; Davenport, Ernest C., Jr.; Chang, Yu-Feng; Vue, Kory; Su, Shiyang

2015-01-01

Criterion-related profile analysis (CPA) can be used to assess whether subscores of a test or test battery account for more criterion variance than does a single total score. Application of CPA to subscore evaluation is described, compared to alternative procedures, and illustrated using SAT data. Considerations other than validity and reliability…

Validation of the TTM processes of change measure for physical activity in an adult French sample.

PubMed

Bernard, Paquito; Romain, Ahmed-Jérôme; Trouillet, Raphael; Gernigon, Christophe; Nigg, Claudio; Ninot, Gregory

2014-04-01

Processes of change (POC) are constructs from the transtheoretical model that propose to examine how people engage in a behavior. However, there is no consensus about a leading model explaining POC and there is no validated French POC scale in physical activity This study aimed to compare the different existing models to validate a French POC scale. Three studies, with 748 subjects included, were carried out to translate the items and evaluate their clarity (study 1, n = 77), to assess the factorial validity (n = 200) and invariance/equivalence (study 2, n = 471), and to analyze the concurrent validity by stage × process analyses (study 3, n = 671). Two models displayed adequate fit to the data; however, based on the Akaike information criterion, the fully correlated five-factor model appeared as the most appropriate to measure POC in physical activity. The invariance/equivalence was also confirmed across genders and student status. Four of the five existing factors discriminated pre-action and post-action stages. These data support the validation of the POC questionnaire in physical activity among a French sample. More research is needed to explore the longitudinal properties of this scale.

Optimizing the Use of Response Times for Item Selection in Computerized Adaptive Testing

ERIC Educational Resources Information Center

Choe, Edison M.; Kern, Justin L.; Chang, Hua-Hua

2018-01-01

Despite common operationalization, measurement efficiency of computerized adaptive testing should not only be assessed in terms of the number of items administered but also the time it takes to complete the test. To this end, a recent study introduced a novel item selection criterion that maximizes Fisher information per unit of expected response…

Validity of the posttraumatic stress disorders (PTSD) checklist in pregnant women.

PubMed

Gelaye, Bizu; Zheng, Yinnan; Medina-Mora, Maria Elena; Rondon, Marta B; Sánchez, Sixto E; Williams, Michelle A

2017-05-12

The PTSD Checklist-civilian (PCL-C) is one of the most commonly used self-report measures of PTSD symptoms, however, little is known about its validity when used in pregnancy. This study aims to evaluate the reliability and validity of the PCL-C as a screen for detecting PTSD symptoms among pregnant women. A total of 3372 pregnant women who attended their first prenatal care visit in Lima, Peru participated in the study. We assessed the reliability of the PCL-C items using Cronbach's alpha. Criterion validity and performance characteristics of PCL-C were assessed against an independent, blinded Clinician-Administered PTSD Scale (CAPS) interview using measures of sensitivity, specificity and receiver operating characteristics (ROC) curves. We tested construct validity using exploratory and confirmatory factor analytic approaches. The reliability of the PCL-C was excellent (Cronbach's alpha =0.90). ROC analysis showed that a cut-off score of 26 offered optimal discriminatory power, with a sensitivity of 0.86 (95% CI: 0.78-0.92) and a specificity of 0.63 (95% CI: 0.62-0.65). The area under the ROC curve was 0.75 (95% CI: 0.71-0.78). A three-factor solution was extracted using exploratory factor analysis and was further complemented with three other models using confirmatory factor analysis (CFA). In a CFA, a three-factor model based on DSM-IV symptom structure had reasonable fit statistics with comparative fit index of 0.86 and root mean square error of approximation of 0.09. The Spanish-language version of the PCL-C may be used as a screening tool for pregnant women. The PCL-C has good reliability, criterion validity and factorial validity. The optimal cut-off score obtained by maximizing the sensitivity and specificity should be considered cautiously; women who screened positive may require further investigation to confirm PTSD diagnosis.

[Reliability and validity analysis of simplified Chinese version of QOL questionnaire of olfactory disorders].

PubMed

Jin, X F; Wang, J; Li, Y J; Liu, J F; Ni, D F

2016-09-20

Objective: To cross-culturally translate the questionnaire of olfactory disorders(QOD)into a simplified Chinese version, and evaluate its reliability and validity in clinical. Method: A simplified Chinese version of the QOD was evaluated in test-retest reliability, split-half reliability and internal consistency.Then it was evaluated in validity test including content validity, criterion-related validity, responsibility. Criterion-related validity was using the medical outcome study's 36-item short rorm health survey(SF-36) and the World Health Organization quality of life-brief (WHOQOL-BREF) for comparison. Result: A total of 239 patients with olfactory dysfunction were enrolled and tested, in which 195 patients completed all three surveys(QOD, SF-36, WHOQOL-BREF). The test-retest reliabilities of the QOD-parosmia statements(QOD-P), QOD-quality of life(QOD-QoL), and the QOD-visual simulation(QOD-VAS)sections were 0.799( P <0.01),0.781( P <0.01),0.488( P <0.01), respectively, and the Cronbach' s α coefficients reliability were 0.477,0.812,0.889,respectively.The split-half reliability of QOD-QoL was 0.89. There was no correlation between the QOD-P section and the SF-36, but there were statistically significant correlations between the QOD-QoL and QOD-VAS sections with the SF-36. There was no correlation between the QOD-P section and the WHOQOL-BREF, but there were statistically significant correlations between the QOD-QoL and QOD-VAS sections with the SF-36 in most sections. Conclusion: The simplified Chinese version of the QOD was testified to be a reliable and valid questionnaire for evaluating patients with olfactory dysfunction living in mainland of China.The QOD-P section needs further modifications to properly adapt patients with Chinese cultural and knowledge background. Copyright© by the Editorial Department of Journal of Clinical Otorhinolaryngology Head and Neck Surgery.

The Research Diagnostic Criteria for Temporomandibular Disorders. I: overview and methodology for assessment of validity.

PubMed

Schiffman, Eric L; Truelove, Edmond L; Ohrbach, Richard; Anderson, Gary C; John, Mike T; List, Thomas; Look, John O

2010-01-01

The purpose of the Research Diagnostic Criteria for Temporomandibular Disorders (RDC/TMD) Validation Project was to assess the diagnostic validity of this examination protocol. The aim of this article is to provide an overview of the project's methodology, descriptive statistics, and data for the study participant sample. This article also details the development of reliable methods to establish the reference standards for assessing criterion validity of the Axis I RDC/TMD diagnoses. The Axis I reference standards were based on the consensus of two criterion examiners independently performing a comprehensive history, clinical examination, and evaluation of imaging. Intersite reliability was assessed annually for criterion examiners and radiologists. Criterion examination reliability was also assessed within study sites. Study participant demographics were comparable to those of participants in previous studies using the RDC/TMD. Diagnostic agreement of the criterion examiners with each other and with the consensus-based reference standards was excellent with all kappas > or = 0.81, except for osteoarthrosis (moderate agreement, k = 0.53). Intrasite criterion examiner agreement with reference standards was excellent (k > or = 0.95). Intersite reliability of the radiologists for detecting computed tomography-disclosed osteoarthrosis and magnetic resonance imaging-disclosed disc displacement was good to excellent (k = 0.71 and 0.84, respectively). The Validation Project study population was appropriate for assessing the reliability and validity of the RDC/TMD Axis I and II. The reference standards used to assess the validity of Axis I TMD were based on reliable and clinically credible methods.

The reliability and validity of a child and adolescent participation in decision-making questionnaire.

PubMed

O'Hare, L; Santin, O; Winter, K; McGuinness, C

2016-09-01

There is a growing impetus across the research, policy and practice communities for children and young people to participate in decisions that affect their lives. Furthermore, there is a dearth of general instruments that measure children and young people's views on their participation in decision-making. This paper presents the reliability and validity of the Child and Adolescent Participation in Decision-Making Questionnaire (CAP-DMQ) and specifically looks at a population of looked-after children, where a lack of participation in decision-making is an acute issue. The participants were 151 looked after children and adolescents between 10-23 years of age who completed the 10 item CAP-DMQ. Of the participants 113 were in receipt of an advocacy service that had an aim of increasing participation in decision-making with the remaining participants not having received this service. The results showed that the CAP-DMQ had good reliability (Cronbach's alpha = 0.94) and showed promising uni-dimensional construct validity through an exploratory factor analysis. The items in the CAP-DMQ also demonstrated good content validity by overlapping with prominent models of child and adolescent participation (Lundy 2007) and decision-making (Halpern 2014). A regression analysis showed that age and gender were not significant predictors of CAP-DMQ scores but receipt of advocacy was a significant predictor of scores (effect size d = 0.88), thus showing appropriate discriminant criterion validity. Overall, the CAP-DMQ showed good reliability and validity. Therefore, the measure has excellent promise for theoretical investigation in the area of child and adolescent participation in decision-making and equally shows empirical promise for use as a measure in evaluating services, which have increasing the participation of children and adolescents in decision-making as an intended outcome. © 2016 John Wiley & Sons Ltd.

Validation of a questionnaire to measure sexual health knowledge and understanding (Sexual Health Questionnaire) in Nepalese secondary school: A psychometric process.

PubMed

Acharya, Dev Raj; Thomas, Malcolm; Cann, Rosemary

2016-01-01

School-based sex education has the potential to prevent unwanted pregnancy and to promote positive sexual health at the individual, family and community level. To develop and validate a sexual health questionnaire to measure young peoples' sexual health knowledge and understanding (SHQ) in Nepalese secondary school. Secondary school students (n = 259, male = 43.63%, female = 56.37%) and local experts (n = 9, male = 90%, female = 10%) were participated in this study. Evaluation processes were; content validity (>0.89), plausibility check (>95), item-total correlation (>0.3), factor loading (>0.4), principal component analysis (4 factors Kaiser's criterion), Chronbach's alpha (>0.65), face validity and internal consistency using test-retest reliability (P > 0.05). The principal component analysis revealed four factors to be extracted; sexual health norms and beliefs, source of sexual health information, sexual health knowledge and understanding, and level of sexual awareness. Kaiser-Meyer-Olkin (KMO) measure of sampling adequacy demonstrated that the patterns of correlations are relatively compact (>0.80). Chronbach's alpha for each factors were above the cut-off point (0.65). Face validity indicated that the questions were clear to the majority of the respondent. Moreover, there were no significant differences (P > 0.05) in the responses to the items at two time points at seven weeks later. The finding suggests that SHQ is a valid and reliable instrument to be used in schools to measure sexual health knowledge and understanding. Further analysis such as structured equation modelling (SEM) and confirmatory factor analysis could make the questionnaire more robust and applicable to the wider school population.

Validation of a questionnaire to measure sexual health knowledge and understanding (Sexual Health Questionnaire) in Nepalese secondary school: A psychometric process

PubMed Central

Acharya, Dev Raj; Thomas, Malcolm; Cann, Rosemary

2016-01-01

Background: School-based sex education has the potential to prevent unwanted pregnancy and to promote positive sexual health at the individual, family and community level. Objectives: To develop and validate a sexual health questionnaire to measure young peoples’ sexual health knowledge and understanding (SHQ) in Nepalese secondary school. Materials and Methods: Secondary school students (n = 259, male = 43.63%, female = 56.37%) and local experts (n = 9, male = 90%, female = 10%) were participated in this study. Evaluation processes were; content validity (>0.89), plausibility check (>95), item-total correlation (>0.3), factor loading (>0.4), principal component analysis (4 factors Kaiser's criterion), Chronbach's alpha (>0.65), face validity and internal consistency using test-retest reliability (P > 0.05). Results: The principal component analysis revealed four factors to be extracted; sexual health norms and beliefs, source of sexual health information, sexual health knowledge and understanding, and level of sexual awareness. Kaiser-Meyer-Olkin (KMO) measure of sampling adequacy demonstrated that the patterns of correlations are relatively compact (>0.80). Chronbach's alpha for each factors were above the cut-off point (0.65). Face validity indicated that the questions were clear to the majority of the respondent. Moreover, there were no significant differences (P > 0.05) in the responses to the items at two time points at seven weeks later. Conclusions: The finding suggests that SHQ is a valid and reliable instrument to be used in schools to measure sexual health knowledge and understanding. Further analysis such as structured equation modelling (SEM) and confirmatory factor analysis could make the questionnaire more robust and applicable to the wider school population. PMID:27500171

[Development And Validation Of A Breastfeeding Knowledge And Skills Questionnaire].

PubMed

Gómez Fernández-Vegue, M; Menéndez Orenga, M

2015-12-01

Pediatricians play a key role in the onset and duration of breastfeeding. Although it is known that they lack formal education on this subject, there are currently no validated tools available to assess pediatrician knowledge regarding breastfeeding. To develop and validate a Breastfeeding Knowledge and Skills Questionnaire for Pediatricians. Once the knowledge areas were defined, a representative sample of pediatricians was chosen to carry out the survey. After pilot testing, non-discriminating questions were removed. Content validity was assessed by 14 breastfeeding experts, who examined the test, yielding 22 scorable items (maximum score: 26 points). To approach criterion validity, it was hypothesized that a group of pediatricians with a special interest in breastfeeding (1) would obtain better results than pediatricians from a hospital without a maternity ward (2), and the latter would obtain a higher score than the medical residents of Pediatrics training in the same hospital (3). The questionnaire was also evaluated before and after a basic course in breastfeeding. Breastfeeding experts have an index of agreement of >.90 for each item. The 3 groups (n=82) were compared, finding significant differences between group (1) and the rest. Moreover, an improvement was observed in the participants who attended the breastfeeding course (n=31), especially among those with less initial knowledge. Regarding reliability, internal consistency (KR-20=.87), interobserver agreement, and temporal stability were examined, with satisfactory results. A practical and self-administered tool is presented to assess pediatrician knowledge regarding breastfeeding, with a documented validity and reliability. Copyright © 2014 Asociación Española de Pediatría. Published by Elsevier España, S.L.U. All rights reserved.

Have infant gross motor abilities changed in 20 years? A re-evaluation of the Alberta Infant Motor Scale normative values.

PubMed

Darrah, Johanna; Bartlett, Doreen; Maguire, Thomas O; Avison, William R; Lacaze-Masmonteil, Thierry

2014-09-01

To compare the original normative data of the Alberta Infant Motor Scale (AIMS) (n=2202) collected 20 years ago with a contemporary sample of Canadian infants. This was a cross-sectional cohort study of 650 Canadian infants (338 males, 312 females; mean age 30.9 wks [SD 15.5], range 2 wks-18 mo) assessed once on the AIMS. Assessments were stratified by age, and infants proportionally represented the ethnic diversity of Canada. Logistic regression was used to place AIMS items on an age scale representing the age at which 50% of the infants passed an item on the contemporary data set and the original data set. Forty-three items met the criterion for stable regression results in both data sets. The correlation coefficient between the age locations of items on the original and contemporary data sets was 0.99. The mean age difference between item locations was 0.7 weeks. Age values from the original data set when converted to the contemporary scale differed by less than 1 week. The sequence and age at emergence of AIMS items has remained similar over 20 years and current normative values remain valid. Concern that the 'back to sleep' campaign has influenced the age at emergence of gross motor abilities is not supported. © 2014 The Authors. Developmental Medicine & Child Neurology published by John Wiley & Sons Ltd on behalf of Mac Keith Press.

[Development of an evaluation instrument for service quality in nursing homes].

PubMed

Lee, Jia; Ji, Eun Sun

2011-08-01

The purposes of this study were to identify the factors influencing service quality in nursing homes, and to develop an evaluation instrument for service quality. A three-phase process was employed for the study. 1) The important factors to evaluate the service quality in nursing homes were identified through a literature review, panel discussion and focus group interview, 2) the evaluation instrument was developed, and 3) validity and reliability of the study instrument were tested by factor analysis, Pearson correlation coefficient, Cronbach's α and Cohen's Kappa. Factor analysis showed that the factors influencing service quality in nursing homes were healthcare, diet/assistance, therapy, environment and staff. To improve objectivity of the instrument, quantitative as well as qualitative evaluation approaches were adopted. The study instrument was developed with 30 items and showed acceptable construct validity. The criterion-related validity was a Pearson correlation coefficient of .85 in 151 care facilities. The internal consistency was Cronbach's α=.95. The instrument has acceptable validity and a high degree of reliability. Staff in nursing homes can continuously improve and manage their services using the results of the evaluation instrument.

Development and validation of the Parents' Perceived Self-Efficacy to Manage Children's Internet Use Scale for parents of adolescents with attention-deficit/hyperactivity disorder.

PubMed

Hsieh, Yi-Ping; Chou, Wen-Jiun; Wang, Peng-Wei; Yen, Cheng-Fang

2017-12-01

Background and aims This study developed and validated the Parents' Perceived Self-Efficacy to Manage Children's Internet Use Scale (PSMIS) in the parents of children with attention-deficit/hyperactivity disorder (ADHD). Methods In total, 231 parents of children with ADHD were invited to complete the PSMIS, followed by the Chen Internet Addiction Scale and the short version of Swanson, Nolan, and Pelham, Version IV Scale - Chinese version for analyzing Internet addiction severity and ADHD symptoms, respectively. Results The results of exploratory and confirmatory factor analyses confirmed the four-factor structure of the 18-item PSMIS. The significant difference in the levels of parents' perceived self-efficacy between the parents of children with and without Internet addiction supported the criterion-related validity of the PSMIS. The internal consistency and 1-month test-retest reliability were acceptable. Conclusion The results indicate that the PSMIS has acceptable validity and reliability and can be used for measuring parents' perceived self-efficacy to manage children's Internet use among parents of children with ADHD.

A child chronic cough-specific quality of life measure: development and validation.

PubMed

Newcombe, Peter A; Sheffield, Jeanie K; Petsky, Helen L; Marchant, Julie M; Willis, Carol; Chang, Anne B

2016-08-01

Quality of life (QoL) measures are an important patient-relevant outcome measure for clinical studies. Cough is the most common symptom that results in new medical consultations. Although adult and parent-proxy cough-specific QoL instruments have been shown to be a useful cough outcome measure, no suitable cough-specific QoL measure for children with chronic cough exists. We report on the statistical properties of a chronic cough-specific QoL (CC-QoL) questionnaire for children. 130 children (median age 10 years, IQR 8-12 years; 65 girls) participated. A preliminary 37-item version was developed from conversations with children with chronic cough (>4 weeks). Children also completed generic QoL questionnaires (Pediatric QoL Inventory 4.0 (PedsQL4.0), Spence Children's Anxiety Scale (SCAS)) and cough diary scores. The clinical impact method of item reduction resulted in 16 items that had excellent internal consistency (Cronbach's α=0.94) among these items and also within each domain. Evidence for construct and criterion validity was established with significant correlations between CC-QoL subscales with cough scores, PedsQL and SCAS scores. CC-QoL scores were sensitive to change following an intervention and significant differences were noted between those children coughing and those who had ceased coughing. Minimum important difference (MID) for overall and domain CC-QoL ranged from 0.37-1.36 (distribution-based approach) to 1.11-1.58 (anchor-based approach). Chronic cough significantly impacts the QoL of children. The CC-QoL is a reliable, valid and sensitive to change outcome measure that assesses QoL from the child's perspective. Pending data from a confirmatory cohort, a MID for the CC-QoL of 1.1 is recommended when evaluating health status change. Published by the BMJ Publishing Group Limited. For permission to use (where not already granted under a licence) please go to http://www.bmj.com/company/products-services/rights-and-licensing/

Validity of the Eating Attitudes Test and the Eating Disorders Inventory in Bulimia Nervosa.

ERIC Educational Resources Information Center

Gross, Janet; And Others

1986-01-01

Assessed criterion and concurrent validity of the Eating Attitudes Test and the Eating Disorder Inventory in 82 women with bulimia nervosa. Both tests demonstrated criterion validity by discriminating bulimia nervosa subjects from normals. Only weak support was found for concurrent validity within bulimia subjects. Recommends combination of…

An Introduction to the Minnesota Multiphasic Personality Inventory-Adolescent-Restructured Form (MMPI-A-RF).

PubMed

Handel, Richard W

2016-12-01

The Minnesota Multiphasic Personality Inventory-Adolescent-Restructured Form (MMPI-A-RF; Archer, Handel, Ben-Porath, & Tellegen, 2016) is a new broadband measure of adolescent psychopathology and personality. The MMPI-A-RF is the adolescent counterpart of the MMPI-2-RF (Ben-Porath & Tellegen, 2008/2011). The goal of the MMPI-2-RF development project was to capture the clinically significant substance of the MMPI-2 item pool with a psychometrically sound measure linked to contemporary models of personality and psychopathology (Ben-Porath & Tellegen, 2008/2011). Using the MMPI-2-RF scales and development methods as models, Archer et al. (2016) developed a 241-item adolescent self-report inventory-in contrast to the 478-items of the MMPI-A-that includes 48 new and revised scales. In this manuscript, I provide an overview of the rationale for the development of the MMPI-A-RF, an abbreviated review of its development process, brief descriptions of its 48 scales, and a subset of analyses bearing on reliability and validity. As with the MMPI-2-RF, one of our primary goals was to develop scales with improved discriminant validity relative to the heterogeneous Clinical Scales of the MMPI-2 and MMPI-A. The MMPI-A-RF development process employed a large sample of 15,128 adolescents (9,286 boys and 5,842 girls) drawn from a variety of settings. In addition to the development sample, subsequent validation analyses were conducted in multiple independent samples including numerous external criterion measures. The MMPI-A-RF is designed to provide a comprehensive assessment of adolescent psychopathology and personality in a wide array of clinical and forensic settings.

An Evaluation of Available Models for Estimating the Reliability and Validity of Criterion Referenced Measures.

ERIC Educational Resources Information Center

Oakland, Thomas

New strategies for evaluation criterion referenced measures (CRM) are discussed. These strategies examine the following issues: (1) the use of normed referenced measures (NRM) as CRM and then estimating the reliability and validity of such measures in terms of variance from an arbitrarily specified criterion score, (2) estimation of the…

Scoring and setting pass/fail standards for an essay certification examination in nurse-midwifery.

PubMed

Fullerton, J T; Greener, D L; Gross, L J

1992-03-01

Examination for certification or licensure of health professionals (credentialing) in the United States is almost exclusively of the multiple choice format. The certification examination for entry into the practice of the profession of nurse-midwifery has, however, used a modified essay format throughout its twenty-year history. The examination has recently undergone a revision in the method for score interpretation and for pass/fail decision-making. The revised method, described in this paper, has important implications for all health professional credentialing agencies which use modified essay, oral or practical methods of competency assessment. This paper describes criterion-referenced scoring, the process of constructing the essay items, the methods for assuring validity and reliability for the examination, and the manner of standard setting. In addition, two alternative methods for increasing the validity of the pass/fail decision are evaluated, and the rationale for decision-making about marginal candidates is described.

Methodology Series Module 9: Designing Questionnaires and Clinical Record Forms - Part II.

PubMed

Setia, Maninder Singh

2017-01-01

This article is a continuation of the previous module on designing questionnaires and clinical record form in which we have discussed some basic points about designing the questionnaire and clinical record forms. In this section, we will discuss the reliability and validity of questionnaires. The different types of validity are face validity, content validity, criterion validity, and construct validity. The different types of reliability are test-retest reliability, inter-rater reliability, and intra-rater reliability. Some of these parameters are assessed by subject area experts. However, statistical tests should be used for evaluation of other parameters. Once the questionnaire has been designed, the researcher should pilot test the questionnaire. The items in the questionnaire should be changed based on the feedback from the pilot study participants and the researcher's experience. After the basic structure of the questionnaire has been finalized, the researcher should assess the validity and reliability of the questionnaire or the scale. If an existing standard questionnaire is translated in the local language, the researcher should assess the reliability and validity of the translated questionnaire, and these values should be presented in the manuscript. The decision to use a self- or interviewer-administered, paper- or computer-based questionnaire depends on the nature of the questions, literacy levels of the target population, and resources.

Methodology Series Module 9: Designing Questionnaires and Clinical Record Forms – Part II

PubMed Central

Setia, Maninder Singh

2017-01-01

This article is a continuation of the previous module on designing questionnaires and clinical record form in which we have discussed some basic points about designing the questionnaire and clinical record forms. In this section, we will discuss the reliability and validity of questionnaires. The different types of validity are face validity, content validity, criterion validity, and construct validity. The different types of reliability are test-retest reliability, inter-rater reliability, and intra-rater reliability. Some of these parameters are assessed by subject area experts. However, statistical tests should be used for evaluation of other parameters. Once the questionnaire has been designed, the researcher should pilot test the questionnaire. The items in the questionnaire should be changed based on the feedback from the pilot study participants and the researcher's experience. After the basic structure of the questionnaire has been finalized, the researcher should assess the validity and reliability of the questionnaire or the scale. If an existing standard questionnaire is translated in the local language, the researcher should assess the reliability and validity of the translated questionnaire, and these values should be presented in the manuscript. The decision to use a self- or interviewer-administered, paper- or computer-based questionnaire depends on the nature of the questions, literacy levels of the target population, and resources. PMID:28584367

Reliability and Validity of the Chinese Version of FACIT-AI, a New Tool for Assessing Quality of Life in Patients with Malignant Ascites.

PubMed

Lou, Yanni; Lu, Linghui; Li, Yuan; Liu, Meng; Bredle, Jason M; Jia, Liqun

2015-10-01

The study objective was to determine the reliability and validity of the Chinese version of the Functional Assessment of Chronic Illness Therapy - Ascites Index (FACIT-AI). A forward-backward translation procedure was adopted to develop the Chinese version of the FACIT-AI, which was tested in 69 patients with malignant ascites. Cronbach's α, split-half reliability, and test-retest reliability were used to assess the reliability of the scale. The content validity index was used to assess the content validity, while factor analysis was used for construct validity and correlation analysis was used for criterion validity. The Cronbach's α was 0.772 for the total scale, and the split-half reliability was 0.693. The test-retest correlation was 0.972. The content validity index for the scale was 0.8-1.0. Four factors were extracted by factor analysis, and these contributed 63.51% of the total variance. Item-total correlations ranged from 0.591 to 0.897, and these were correlated with visual analog scale scores (correlation coefficient, 0.889; P<0.01). The Chinese version of the FACIT-AI has good reliability and validity and can be used as a tool to measure quality of life in Chinese patients with malignant ascites.

Nurses' Empowerment Scale for ICU patients' families: an instrument development study.

PubMed

Li, Hong; Liu, Ya-Lan; Qiu, Li; Chen, Qiao-Ling; Wu, Jing-Bing; Chen, Li-Li; Li, Na

2016-09-01

Family members provide essential support for ICU patients, contributing to their mental and physical recovery. Empowering ICU patients' families may help them overcome inadequacies and meet their own and patients' acknowledged needs. Nursing should understand and address patients' families' empowerment status. To develop a tool, the Nurses' Empowerment Scale for Intensive Care Unit (ICU) Patients' Families (NESIPF), to help ICU nursing staff assess the empowerment status of patients' families. Four-phase instrument development study. A 19-item instrument was initially generated based on literature review and interviews with family members of ICU patients. The Delphi research method was applied to gain expert opinion and consensus via rounds of questionnaires. A panel of 27 experts experienced in critical care medicine, nursing and psychology participated in two Delphi rounds and their input helped formulate an 18-item pretest instrument. Families of 20 patients were recruited to examine instrument readability. After a 2-week interval, another 20 patients' families were recruited to examine test-retest reliability. Two hundred questionnaires were then administered and analysed to examine the instrument's construct validity, criterion-related validity and internal consistency. Expert authority coefficients of two Delphi rounds reached 0·89 and 0·91. Kendall' W coefficients of 0·113 (P < 0·001) in round 1 and 0·220 (P < 0·001) in round 2 indicated slight to fair agreement among experts. Content validity index (CVI) reached 1·0 for 12 items; the CVI for item 13 was <0·7 so it was excluded. Cronbach's α coefficient was 0·92, indicating acceptable internal consistency reliability. The coefficient of internal consistency of each dimension was 0·717-0·921. The Pearson correlation coefficient >0·9 (P < 0·05) showed an acceptable test-retest reliability. The instrument has acceptable reliability and validity and can assess the empowerment status of families of critically ill patients. Knowledge of families' empowerment status may help to address their psychological needs and their ability to provide family support. © 2014 British Association of Critical Care Nurses.

Trial-to-trial carry-over of item- and relational-information in auditory short-term memory

PubMed Central

Visscher, Kristina M.; Kahana, Michael J.; Sekuler, Robert

2009-01-01

Using a short-term recognition memory task we evaluated the carry-over across trials of two types of auditory information: the characteristics of individual study sounds (item information), and the relationships between the study sounds (relational information). On each trial, subjects heard two successive broadband study sounds and then decided whether a subsequently presented probe sound had been in the study set. On some trials, the probe item's similarity to stimuli presented on the preceding trial was manipulated. This item information interfered with recognition, increasing false alarms from 0.4% to 4.4%. Moreover, the interference was tuned so that only stimuli very similar to each other interfered. On other trials, the relationship among stimuli was manipulated in order to alter the criterion subjects used in making recognition judgments. The effect of this manipulation was confined to the very trial on which the criterion change was generated, and did not affect the subsequent trial. These results demonstrate the existence of a sharply-tuned carry-over of auditory item information, but no carry-over of relational information. PMID:19210080

Validity and reliability of the semi-quantitative self-report Home Food Availability Inventory Checklist (HFAI-C) in White and South Asian populations.

PubMed

Bryant, Maria; LeCroy, Madison; Sahota, Pinki; Cai, Jianwen; Stevens, June

2016-05-04

Despite interest in the importance of the home food environment and its potential influence on children's diets and social norms, there remain few self-report checklist methods that have been validated against the gold standard of researcher-conducted inventories. This study aimed to assess the criterion validity and reliability of the 'Home Food Availability Inventory Checklist' (HFAI-C), a 39-item checklist including categories of fruit, vegetables, snacks and drinks. The HFAI-C was completed by 97 participants of White and Pakistani origin in the UK. Validity was determined by comparing participant-reported HFAI-C responses to data from researcher observations of home food availability using PABAK and weighted kappa statistics. The validity of measuring the amount of items (in addition to presence/absence) available was also determined. Test-retest reliability compared repeated administrations of the HFAI-C using intra-class correlation coefficients. Validity and reliability was fair to moderate overall. For validity, the average category-level PABAK ranged from 0.31 (95% CI: 0.25, 0.37) for vegetables to 0.44 (95% CI: 0.40, 0.49) for fruits. Assessment of the presence/absence of items demonstrated higher validity compared to quantity measurements. Reliability was increased when the HFAI-C was repeated close to the time of the first administration. For example, ICCs for reliability of the measurement of fruits were 0.52 (95%CI: 0.47, 0.56) if re-administered within 5 months, 0.58 (95% CI: 0.51, 0.64) within 30 days and 0.97 (95%CI: 0.94, 1.00) if re-administered on the same day. Overall, the HFAI-C demonstrated fair to moderate validity and reliability in a population of White and South Asian participants. This evaluation is consistent with previous work on other checklists in less diverse, more affluent populations. Our research supports the use of the HFAI-C as a useful, albeit imperfect, representation of researcher-conducted inventories. The feasibility of collecting information using the HFAI-C in large, multi-ethnic samples can facilitate examination of home food availability in relation to exposures such as ethnicity and outcomes including behavioural, social and health outcomes. Future work using the HFAI-C could provide important insights into a modifiable influence with potential to impact health.

Development of a Work Sample Criterion for General Vehicle Mechanic.

ERIC Educational Resources Information Center

Engel, John D.

A work sample criterion test was developed for General Vehicle Repairman, MOS 63C30 and 63C40. Test items covered three task categories: troubleshooting, corrective action, and preventive maintenance. Thirty-eight organizational mechanics were tested at Fort Knox, Kentucky. Data were also collected on the quality of performance, for example, use…

Assessing generalized anxiety disorder in elderly people using the GAD-7 and GAD-2 scales: results of a validation study.

PubMed

Wild, Beate; Eckl, Anne; Herzog, Wolfgang; Niehoff, Dorothea; Lechner, Sabine; Maatouk, Imad; Schellberg, Dieter; Brenner, Hermann; Müller, Heiko; Löwe, Bernd

2014-10-01

The aim of this study was to evaluate the validity of the seven-item Generalized Anxiety Disorder scale (GAD-7) and its two core items (GAD-2) for detecting GAD in elderly people. A criterion-standard study was performed between May and December of 2010 on a general elderly population living at home. A subsample of 438 elderly persons (ages 58-82) of the large population-based German ESTHER study was included in the study. The GAD-7 was administered to participants as part of a home visit. A telephone-administered structured clinical interview was subsequently conducted by a blinded interviewer. The structured clinical (SCID) interview diagnosis of GAD constituted the criterion standard to determine sensitivity and specificity of the GAD-7 and the GAD-2 scales. Twenty-seven participants met the Diagnostic and Statistical Manual of Mental Disorders, Fourth Edition criteria for current GAD according to the SCID interview (6.2%; 95% confidence interval [CI]: 3.9%-8.2%). For the GAD-7, a cut point of five or greater appeared to be optimal for detecting GAD. At this cut point the sensitivity of the GAD-7 was 0.63 and the specificity was 0.9. Correspondingly, the optimal cut point for the GAD-2 was two or greater with a sensitivity of 0.67 and a specificity of 0.90. The areas under the curve were 0.88 (95% CI: 0.83-0.93) for the GAD-7 and 0.87 (95% CI: 0.80-0.94) for the GAD-2. The increased scores on both GAD scales were strongly associated with mental health related quality of life (p <0.0001). Our results establish the validity of both the GAD-7 and the GAD-2 in elderly persons. Results of this study show that the recommended cut points of the GAD-7 and the GAD-2 for detecting GAD should be lowered for the elderly general population. Copyright © 2014 American Association for Geriatric Psychiatry. Published by Elsevier Inc. All rights reserved.

Cross-Cultural Validity of the Ruminative Responses Scale in Argentina and the United States.

PubMed

Arana, Fernán G; Rice, Kenneth G

2017-09-01

Although frequently used in the United States, the Ruminative Response Scale (RRS) has not been extensively studied in cross-cultural samples. The present study evaluated the factor structure of Treynor et al.'s 10-item version of the RRS in samples from Argentina ( N = 308) and the United States ( N = 371). In addition to testing measurement invariance between the countries, we evaluated whether the maladaptive implications of rumination were weaker for the Argentinians than for the U.S. group. Self-critical perfectionism was the criterion in those tests. Partial scalar invariance supported an 8-item version of the RRS. There were no differences in factor means or factor correlations in RRS dimensions between countries. Brooding and Reflection were positively correlated with self-critical perfectionism in both countries, with no significant differences in the sizes of these relations between the two samples. Results are discussed in terms of psychometric and cross-cultural implications for rumination.

Adaptation and psychometric properties of the ISPCAN Child Abuse Screening Tool for use in trials (ICAST-Trial) among South African adolescents and their primary caregivers.

PubMed

Meinck, Franziska; Boyes, Mark E; Cluver, Lucie; Ward, Catherine L; Schmidt, Peter; DeStone, Sachin; Dunne, Michael P

2018-05-31

Child abuse prevention research has been hampered by a lack of validated multi-dimensional non-proprietary instruments, sensitive enough to measure change in abuse victimization or behavior. This study aimed to adapt the ICAST child abuse self-report measure (parent and child) for use in intervention studies and to investigate the psychometric properties of this substantially modified tool in a South African sample. First, cross-cultural and sensitivity adaptation of the original ICAST tools resulted in two preliminary measures (ICAST-Trial adolescents: 27 items, ICAST-Trial caregivers: 19 items). Second, ICAST-Trial data from a cluster randomized trial of a parenting intervention for families with adolescents (N = 1104, 552 caregiver-adolescent dyads) was analyzed. Confirmatory factor analysis established the hypothesized 6-factor (adolescents) and 4-factor (caregivers) structure. Removal of two items for adolescents and five for caregivers resulted in adequate model fit. Concurrent criterion validity analysis confirmed hypothesized relationships between child abuse and adolescent and caregiver mental health, adolescent behavior, discipline techniques and caregiver childhood abuse history. The resulting ICAST-Trial measures have 25 (adolescent) and 14 (caregiver) items respectively and measure physical, emotional and contact sexual abuse, neglect (both versions), and witnessing intimate partner violence and sexual harassment (adolescent version). The study established that both tools are sensitive to measuring change over time in response to a parenting intervention. The ICAST-Trial should have utility for evaluating the effectiveness of child abuse prevention efforts in similar socioeconomic contexts. Further research is needed to replicate these findings and examine cultural appropriateness, barriers for disclosure, and willingness to engage in child abuse research. Copyright © 2018 The Authors. Published by Elsevier Ltd.. All rights reserved.

Validation of the Headache Impact Test (HIT-6) in patients with chronic migraine.

PubMed

Rendas-Baum, Regina; Yang, Min; Varon, Sepideh F; Bloudek, Lisa M; DeGryse, Ronald E; Kosinski, Mark

2014-08-01

The Headache Impact Test (HIT)-6 was developed and has been validated in patients with various types of headache. The objective of this study was to report the psychometric properties of the HIT-6 among patients with chronic migraine. Data came from two international, multicenter, randomized, double-blind, placebo-controlled clinical trials of chronic migraine patients (N = 1,384) undergoing prophylaxis therapy. Confirmatory factor analysis and differential item functioning (DIF) analysis were used to test the latent structure and cross-cultural comparability of the HIT-6. Reliability, construct validity, and responsiveness were assessed. Two sets of criterion groups were used: (1) 28-day headache frequency: <10, 10-14, and ≥15 days; (2) sample quartiles of the total cumulative hours of headache: <140, 140 to <280, 280 to <420, and ≥420 hours. Two sets of responsiveness categories were defined as reduction of <30%, 30% to <50%, or ≥50% in (1) number of headache days and (2) cumulative hours of headache. Measurement invariance tests supported the stability of the HIT-6 latent structure across studies. DIF analysis supported cross-cultural comparability. Good reliability was observed across studies (Cronbach's α: 0.75-0.92; intraclass correlation coefficient: 0.76-0.80). HIT-6 scores correlated strongly (-0.86 to -0.59) with scores of the Migraine-Specific Quality-of-Life Questionnaire. Analysis of variance indicated that HIT-6 scores discriminated across both types of criterion groups (P<0.001), across studies and time points. HIT-6 change scores were significantly higher in magnitude in groups experiencing greater improvement (P<0.001). All measurement properties were consistently verified across the two studies, supporting the validity of the HIT-6 among chronic migraine patients. NCT00156910 and NCT00168428 on www.ClinicalTrials.gov.

Criterion-Related Validity of the TOEFL iBT Listening Section. TOEFL iBT Research Report. RR-09-02

ERIC Educational Resources Information Center

Sawaki, Yasuyo; Nissan, Susan

2009-01-01

The study investigated the criterion-related validity of the "Test of English as a Foreign Language"[TM] Internet-based test (TOEFL[R] iBT) Listening section by examining its relationship to a criterion measure designed to reflect language-use tasks that university students encounter in everyday academic life: listening to academic…

Examining the psychometric properties of the Barratt Impulsiveness Scale-Brief Form in justice-involved samples.

PubMed

Fields, Sherecce; Edens, John F; Smith, Shannon Toney; Rulseh, Allison; Donnellan, M Brent; Ruiz, Mark A; McDermott, Barbara E; Douglas, Kevin S

2015-12-01

Impulsivity is an important component of many forms of psychopathology. Though widely used as an index of this construct, the 30-item Barratt Impulsiveness Scale-11 (BIS-11) has demonstrated questionable psychometric properties in several research reports. An 8-item shortened version has recently been proposed, the Barratt Impulsiveness Scale-Brief (BIS-Brief) form, which was designed to overcome some of the limitations of the longer scale. In this report, we examine the internal structure and theoretically relevant external correlates of this new short form in large archival samples of individuals involved in the criminal justice system (prison inmates, substance abusers in mandatory treatment, and forensic inpatients). Confirmatory factor analysis of the BIS-Brief indicates adequate fit following a relatively minor modification. Correlations between the BIS-Brief and an array of criterion measures-other self-report scales, interview-based measures, and behavioral outcomes-are consistent with predictions and show relatively little or no decrement in predictive validity when compared with the 30-item BIS-11. Our results suggest that the BIS-Brief is a promising brief measure of impulsivity that evinces good psychometric properties across a range of offender samples. (c) 2015 APA, all rights reserved).

Evaluation of Measurement Instrument Criterion Validity in Finite Mixture Settings

ERIC Educational Resources Information Center

Raykov, Tenko; Marcoulides, George A.; Li, Tenglong

2016-01-01

A method for evaluating the validity of multicomponent measurement instruments in heterogeneous populations is discussed. The procedure can be used for point and interval estimation of criterion validity of linear composites in populations representing mixtures of an unknown number of latent classes. The approach permits also the evaluation of…

Evaluation of Validity and Reliability for Hierarchical Scales Using Latent Variable Modeling

ERIC Educational Resources Information Center

Raykov, Tenko; Marcoulides, George A.

2012-01-01

A latent variable modeling method is outlined, which accomplishes estimation of criterion validity and reliability for a multicomponent measuring instrument with hierarchical structure. The approach provides point and interval estimates for the scale criterion validity and reliability coefficients, and can also be used for testing composite or…

Development and content validity of a screening instrument for gaming addiction in adolescents: the Gaming Addiction Identification Test (GAIT).

PubMed

Vadlin, Sofia; Åslund, Cecilia; Nilsson, Kent W

2015-08-01

This study describes the development of a screening tool for gaming addiction in adolescents - the Gaming Addiction Identification Test (GAIT). Its development was based on the research literature on gaming and addiction. An expert panel comprising professional raters (n = 7), experiential adolescent raters (n = 10), and parent raters (n = 10) estimated the content validity of each item (I-CVI) as well as of the whole scale (S-CVI/Ave), and participated in a cognitive interview about the GAIT scale. The mean scores for both I-CVI and S-CVI/Ave ranged between 0.97 and 0.99 compared with the lowest recommended I-CVI value of 0.78 and the S-CVI/Ave value of 0.90. There were no sex differences and no differences between expert groups regarding ratings in content validity. No differences in the overall evaluation of the scale emerged in the cognitive interviews. Our conclusions were that GAIT showed good content validity in capturing gaming addiction. The GAIT needs further investigation into its psychometric properties of construct validity (convergent and divergent validity) and criterion-related validity, as well as its reliability in both clinical settings and in community settings with adolescents. © 2015 Scandinavian Psychological Associations and John Wiley & Sons Ltd.

Scales for assessing self-efficacy of nurses and assistants for preventing falls

PubMed Central

Dykes, Patricia C.; Carroll, Diane; McColgan, Kerry; Hurley, Ann C.; Lipsitz, Stuart R.; Colombo, Lisa; Zuyev, Lyubov; Middleton, Blackford

2011-01-01

Aim This paper is a report of the development and testing of the Self-Efficacy for Preventing Falls Nurse and Assistant scales. Background Patient falls and fall-related injuries are traumatic ordeals for patients, family members and providers, and carry a toll for hospitals. Self-efficacy is an important factor in determining actions persons take and levels of performance they achieve. Performance of individual caregivers is linked to the overall performance of hospitals. Scales to assess nurses and certified nursing assistants’ self-efficacy to prevent patients from falling would allow for targeting resources to increase SE, resulting in improved individual performance and ultimately decreased numbers of patient falls. Method Four phases of instrument development were carried out to (1) generate individual items from eight focus groups (four each nurse and assistant conducted in October 2007), (2) develop prototype scales, (3) determine content validity during a second series of four nurse and assistant focus groups (January 2008) and (4) conduct item analysis, paired t-tests, Student’s t-tests and internal consistency reliability to refine and confirm the scales. Data were collected during February–December, 2008. Results The 11-item Self-Efficacy for Preventing Falls Nurse had an alpha of 0·89 with all items in the range criterion of 0·3–0·7 for item total correlation. The 8-item Self-Efficacy for Preventing Falls Assistant had an alpha of 0·74 and all items had item total correlations in the 0·3–0·7 range. Conclusions The Self-Efficacy for Preventing Falls Nurse and Self-Efficacy for Preventing Falls Assistant scales demonstrated psychometric adequacy and are recommended to measure bedside staff’s self-efficacy beliefs in preventing patient falls. PMID:21073506

The latent structure of personality functioning: Investigating criterion a from the alternative model for personality disorders in DSM-5.

PubMed

Zimmermann, Johannes; Böhnke, Jan R; Eschstruth, Rhea; Mathews, Alessa; Wenzel, Kristin; Leising, Daniel

2015-08-01

The alternative model for the classification of personality disorders (PD) in the Diagnostic and Statistical Manual of Mental Disorders (5th ed.; DSM-5) Section III comprises 2 major components: impairments in personality functioning (Criterion A) and maladaptive personality traits (Criterion B). In this study, we investigated the latent structure of Criterion A (a) within subdomains, (b) across subdomains, and (c) in conjunction with the Criterion B trait facets. Data were gathered as part of an online study that collected other-ratings by 515 laypersons and 145 therapists. Laypersons were asked to assess 1 of their personal acquaintances, whereas therapists were asked to assess 1 of their patients, using 135 items that captured features of Criteria A and B. We were able to show that (a) the structure within the Criterion A subdomains can be appropriately modeled using generalized graded unfolding models, with results suggesting that the items are indeed related to common underlying constructs but often deviate from their theoretically expected severity level; (b) the structure across subdomains is broadly in line with a model comprising 2 strongly correlated factors of self- and interpersonal functioning, with some notable deviations from the theoretical model; and (c) the joint structure of the Criterion A subdomains and the Criterion B facets broadly resembles the expected model of 2 plus 5 factors, albeit the loading pattern suggests that the distinction between Criteria A and B is somewhat blurry. Our findings provide support for several major assumptions of the alternative DSM-5 model for PD but also highlight aspects of the model that need to be further refined. (c) 2015 APA, all rights reserved).

Development of the Parent Responses to School Functioning Questionnaire.

PubMed

Barber Garcia, Brittany N; Gray, Laura S; Simons, Laura E; Logan, Deirdre E

2017-10-01

Parents play an important role in supporting school functioning in youth with chronic pain, but no validated tools exists to assess parental responses to child and adolescent pain behaviors in the school context. Such a tool would be useful in identifying targets of change to reduce pain-related school impairment. The goal of this study was to develop and preliminarily validate the Parent Responses to School Functioning Questionnaire (PRSF), a parent self-report measure of this construct. After initial expert review and pilot testing, the measure was administered to 418 parents of children (ages 6-17 years) seen for initial multidisciplinary chronic pain clinic evaluation. The final 16-item PRSF showed evidence of good internal consistency (α = .82) and 2-week test-retest reliability (intraclass correlation coefficient = .87). Criterion validity was demonstrated by significant correlations with school absence rates and overall school functioning, and construct validity was demonstrated by correlations with general parental responses to pain. Three subscales emerged capturing parents' personal distress, parents' level of distrust of the school, and parents' expectations and behaviors related to their child's management of challenging school situations. These results provide preliminary support for the PRSF as a psychometrically sound tool to assess parents' responses to child pain in the school setting. The 16-item PRSF measures parental responses to their child's chronic pain in the school context. The clinically useful measure can inform interventions aimed reducing functional disability in children with chronic pain by enhancing parents' ability to respond adaptively to child pain behaviors. Copyright © 2017 American Pain Society. Published by Elsevier Inc. All rights reserved.

Validation and reliability of the Malaysian English version of the psychosocial impact of dental aesthetics questionnaire for adolescents.

PubMed

Wan Hassan, Wan Nurazreena; Yusof, Zamros Yuzadi Mohd; Makhbul, Mohd Zambri Mohamed; Shahidan, Siti Safuraa Zahirah; Mohd Ali, Siti Farhana; Burhanudin, Rashidah; Gere, Maria Jirom

2017-03-21

The Malay version of the Psychosocial Impact of Dental Aesthetics Questionnaire has been validated for use by Malaysian adolescents. Although Malay is their national language, English is widely used as the lingua franca among Malaysians of different ethnicities. This study aimed to validate an English version of the PIDAQ adapted for use by Malaysian adolescents to optimize data capture from adolescents who prefer English as the medium for communication. The published English version of PIDAQ was pilot tested on 12- to 17-year-old adolescents, resulting in a few modifications to suit the Malaysian variety of English. Psychometric properties were tested on 393 adolescents who attended orthodontic practices and selected schools. Malocclusion was assessed using the Malocclusion Index, an aggregation of Perception of Occlusion Scale and the Aesthetic Component of the Index of Orthodontic Treatment Need, by the subjects (MI-S) and investigators (MI-D). Data were analysed for internal consistency and age-associated invariance, discriminant, construct and criterion validities, reproducibility and floor and ceiling effects using AMOS v.20 and SPSS v.20. The item Don't like own teeth on video of the Aesthetic Concern (AC) subscale was not relevant to a large proportion of participants (11.7%). Therefore, it was removed and the Malaysian English PIDAQ was analysed based on 22 items instead of 23 items. Confirmatory factor analysis showed good fit statistics (comparative fit index: 0.902, root-mean-square error of approximation: 0.066). Internal consistency was good for the Dental Self-Confidence, Social Impact and Psychological Impact subscales (Cronbach's alpha: 0.70-0.95) but lower (0.52-0.62) though acceptable for the AC subscale as it consisted of only 2 items. The reproducibility test was acceptable (intra-class correlations: 0.53-0.78). For all PIDAQ subscales, the MI-S and MI-D scores of those with severe malocclusion differed significantly from those with no or slight malocclusion. There were significant associations between the PIDAQ subscales with ranking of perceived dental appearance, need for braces and impact of malocclusion on daily activities. There were no floor or ceiling effects. The adapted Malaysian English PIDAQ demonstrated adequate psychometric properties that are valid and reliable for assessment of psychological impacts of dental aesthetics among Malaysian adolescents.

Vegetable behavioral tool demonstrates validity with MyPlate vegetable cups and carotenoid and inflammatory biomarkers.

PubMed

Townsend, Marilyn S; Shilts, Mical K; Styne, Dennis M; Drake, Christiana; Lanoue, Louise; Woodhouse, Leslie; Allen, Lindsay H

2016-12-01

Young children are not meeting recommendations for vegetable intake. Our objective is to provide evidence of validity and reliability for a pictorial vegetable behavioral assessment for use by federally funded community nutrition programs. Parent/child pairs (n=133) from Head Start and the Special Supplemental Nutrition Program for Women, Infants and Children [WIC] provided parent-administered vegetable tools, three child 24-hour diet recalls, child blood sample and measured heights/weights. The 10-item Focus on Veggies scale, with an alpha of .83 and a stability reliability coefficient of .74, was positively related to vegetables in cup equivalents [p≤.05]; dietary intakes of folate, vitamin C, β-carotene, potassium and magnesium [p≤.05-.01]; and soluble fiber [p≤.001]. The child vegetable scores were related to the parent's mediators [p≤.00001] and vegetable behaviors [p≤.00001]. Children's plasma inflammatory markers were negatively related to the 10 item scale [p≤.05] and are indicators of the child's health status. The positive relationship between the serum carotenoid index and a sub-scale of child vegetable behaviors offered additional support for criterion validity [p≤.05]. Finally, the inverse relationship of BMI-for-age percentile one year post baseline and a sub-scale of child vegetable behaviors supported the predictive validity [p≤.05]. Focus on Veggies, a simple assessment tool, can inform practitioners about the child's health status. A child with a high score, shows a healthful profile with a lower inflammation index, higher carotenoid index, lower BMI and higher vegetable intake. In conclusion, validity of Focus on Veggies has been demonstrated using vegetable cup equivalents and micronutrient intakes, anthropometry and blood biomarkers. Copyright © 2016 Elsevier Ltd. All rights reserved.

Development and psychometric validation of a brief comprehensive health status assessment scale in older patients with hematological malignancies: The GAH Scale.

PubMed

Bonanad, S; De la Rubia, J; Gironella, M; Pérez Persona, E; González, B; Fernández Lago, C; Arnan, M; Zudaire, M; Hernández Rivas, J A; Soler, A; Marrero, C; Olivier, C; Altés, A; Valcárcel, D; Hernández, M T; Oiartzabal, I; Fernández Ordoño, R; Arnao, M; Esquerra, A; Sarrá, J; González-Barca, E; González, J; Calvo, X; Nomdedeu, M; García Guiñón, A; Ramírez Payer, A; Casado, A; López, S; Durán, M; Marcos, M; Cruz-Jentoft, A J

2015-09-01

The purpose of this study was to develop a new brief, comprehensive geriatric assessment scale for older patients diagnosed with different hematological malignancies, the Geriatric Assessment in Hematology (GAH scale), and to determine its psychometric properties. The 30-item GAH scale was designed through a multi-step process to cover 8 relevant dimensions. This is an observational study conducted in 363 patients aged≥65years, newly diagnosed with different hematological malignancies (myelodysplasic syndrome/acute myeloblastic leukemia, multiple myeloma, or chronic lymphocytic leukemia), and treatment-naïve. The scale psychometric validation process included the analyses of feasibility, floor and ceiling effect, validity and reliability criteria. Mean time taken to complete the GAH scale was 11.9±4.7min that improved through a learning-curve effect. Almost 90% of patients completed all items, and no floor or ceiling effects were identified. Criterion validity was supported by reasonable correlations between the GAH scale dimensions and three contrast variables (global health visual analogue scale, ECOG and Karnofsky), except for comorbidities. Factor analysis (supported by the scree plot) revealed nine factors that explained almost 60% of the total variance. Moderate internal consistency reliability was found (Cronbach's α: 0.610), and test-retest was excellent (ICC coefficients, 0.695-0.928). Our study suggests that the GAH scale is a valid, internally reliable and a consistent tool to assess health status in older patients with different hematological malignancies. Future large studies should confirm whether the GAH scale may be a tool to improve clinical decision-making in older patients with hematological malignancies. Copyright © 2015 Elsevier Inc. All rights reserved.

Are attitudes toward peace and war the two sides of the same coin? Evidence to the contrary from a French validation of the Attitudes Toward Peace and War Scale

PubMed Central

Van der Linden, Nicolas; Leys, Christophe; Klein, Olivier

2017-01-01

Bizumic et al. (2013) have recently shown that attitudes towards peace and war reflect two distinct constructs rather than two poles of a single dimension. We present an attempt at validating the French version of their 16-item Attitudes toward Peace and War Scale (APWS) on five distinct (mainly Belgian) French-speaking samples (total N = 808). Confirmatory factor and criterion validity analyses confirmed that attitudes toward peace and war, although negatively related, are distinct in terms of their antecedents and consequences. On the one hand, antecedents of attitudes toward peace included egalitarian ideological beliefs and empathic concern for others, and consequences included intentions to engage in pro-peace behaviors. On the other hand, antecedents of attitudes toward war included national identification and authoritarian ideological beliefs, and consequences included intentions to engage in pro-war behaviors. Furthermore, both attitudes toward peace and war were, respectively, negatively and positively related to (a right-wing) political orientation. Unexpectedly however, attitudes toward war were positively related to nonegalitarian ideological beliefs and were not related to personal distress. Scores on the translated scale were unrelated to socially desirable responding. In terms of known-groups validity, men had, respectively, more and less positive attitudes toward war and peace than women. Finally, based on exploratory factor analyses, the inclusion of some items for the factorial structure of the measure is questioned and a shortened form of the measure is validated. Overall, these findings are in line with Bizumic et al. and suggest that attitudes toward peace and war also reflect two distinct constructs in a French-speaking population. PMID:28892500

Are attitudes toward peace and war the two sides of the same coin? Evidence to the contrary from a French validation of the Attitudes Toward Peace and War Scale.

PubMed

Van der Linden, Nicolas; Leys, Christophe; Klein, Olivier; Bouchat, Pierre

2017-01-01

Bizumic et al. (2013) have recently shown that attitudes towards peace and war reflect two distinct constructs rather than two poles of a single dimension. We present an attempt at validating the French version of their 16-item Attitudes toward Peace and War Scale (APWS) on five distinct (mainly Belgian) French-speaking samples (total N = 808). Confirmatory factor and criterion validity analyses confirmed that attitudes toward peace and war, although negatively related, are distinct in terms of their antecedents and consequences. On the one hand, antecedents of attitudes toward peace included egalitarian ideological beliefs and empathic concern for others, and consequences included intentions to engage in pro-peace behaviors. On the other hand, antecedents of attitudes toward war included national identification and authoritarian ideological beliefs, and consequences included intentions to engage in pro-war behaviors. Furthermore, both attitudes toward peace and war were, respectively, negatively and positively related to (a right-wing) political orientation. Unexpectedly however, attitudes toward war were positively related to nonegalitarian ideological beliefs and were not related to personal distress. Scores on the translated scale were unrelated to socially desirable responding. In terms of known-groups validity, men had, respectively, more and less positive attitudes toward war and peace than women. Finally, based on exploratory factor analyses, the inclusion of some items for the factorial structure of the measure is questioned and a shortened form of the measure is validated. Overall, these findings are in line with Bizumic et al. and suggest that attitudes toward peace and war also reflect two distinct constructs in a French-speaking population.

Measuring skin aging using optical coherence tomography in vivo: a validation study

NASA Astrophysics Data System (ADS)

Trojahn, Carina; Dobos, Gabor; Richter, Claudia; Blume-Peytavi, Ulrike; Kottner, Jan

2015-04-01

Dermal and epidermal structures in human skin change during intrinsic and extrinsic aging. Epidermal thickness is one of the most often reported parameters for the assessment of skin aging in cross-sectional images captured by optical coherence tomography (OCT). We aimed to identify further parameters for the noninvasive measurement of skin aging of sun-exposed and sun-protected areas utilizing OCT. Based on a literature review, seven parameters were inductively developed. Three independent raters assessed these parameters using four-point scales on images of female subjects of two age groups. All items could be detected and quantified in our sample. Interrater agreement ranged between 25.0% and 83.3%. The item scores "stratum corneum reflectivity," "upper dermal reflectivity," and "dermoepidermal contrast" showed significant differences between age groups on the volar and dorsal forearm indicating that they were best able to measure changes during skin aging. "Surface unevenness" was associated with the skin roughness parameters, Rz and Rmax, on the inner upper arm and volar forearm supporting the criterion validity of this parameter on sun-protected skin areas. Based on the interrater agreement and the ability to differentiate between age groups, these four parameters are being considered as the best candidates for measuring skin aging in OCT images.

Measuring skin aging using optical coherence tomography in vivo: a validation study.

PubMed

Trojahn, Carina; Dobos, Gabor; Richter, Claudia; Blume-Peytavi, Ulrike; Kottner, Jan

2015-04-01

Dermal and epidermal structures in human skin change during intrinsic and extrinsic aging. Epidermal thickness is one of the most often reported parameters for the assessment of skin aging in cross-sectional images captured by optical coherence tomography (OCT). We aimed to identify further parameters for the noninvasive measurement of skin aging of sun-exposed and sun-protected areas utilizing OCT. Based on a literature review, seven parameters were inductively developed. Three independent raters assessed these parameters using four-point scales on images of female subjects of two age groups. All items could be detected and quantified in our sample. Interrater agreement ranged between 25.0% and 83.3%. The item scores “stratum corneum reflectivity,” “upper dermal reflectivity,” and “dermoepidermal contrast” showed significant differences between age groups on the volar and dorsal forearm indicating that they were best able to measure changes during skin aging. “Surface unevenness” was associated with the skin roughness parameters, Rz and Rmax, on the inner upper arm and volar forearm supporting the criterion validity of this parameter on sun-protected skin areas. Based on the interrater agreement and the ability to differentiate between age groups, these four parameters are being considered as the best candidates for measuring skin aging in OCT images.

Behaviour change counselling--how do I know if I am doing it well? The development of the Behaviour Change Counselling Scale (BCCS).

PubMed

Vallis, Michael

2013-02-01

The purpose of this article is to operationalize behaviour change counselling skills (motivation enhancement, behaviour modification, emotion management) that facilitate self-management support activities and evaluate the psychometric properties of an expert rater scale, the Behaviour Change Counselling Scale (BCCS). Twenty-one healthcare providers with varying levels of behaviour change counselling training interviewed a simulated patient. Videotapes were independently rated by 3 experts on 2 occasions over 6 months. Data on item/subscale characteristics, interrater and test-retest reliability, preliminary data on construct reliability, were reported. All items of the BCCS performed well with the exception of 3 that were dropped due to infrequent endorsement. Most subscales showed strong psychometric properties. Interrater and test-retest reliability coefficients were uniformly high. Competency scores improved significantly from pre- to posttraining. Behaviour change counselling skills to guide lifestyle interventions can be operationalized and assessed in a reliable and valid manner. The BCCS can be used to guide clinical training in lifestyle counselling by operationalizing the component skills and providing feedback on skill achieved. Further research is needed to establish cut scores for competency and scale construct and criterion validity. Copyright © 2013 Canadian Diabetes Association. Published by Elsevier Inc. All rights reserved.

Assessing practice-based influences on adolescent psychosocial development in sport: the activity context in youth sport questionnaire.

PubMed

García Bengoechea, Enrique; Sabiston, Catherine M; Wilson, Philip M

2017-01-01

The aim of this study was to provide initial evidence of validity and reliability of scores derived from the Activity Context in Youth Sport Questionnaire (ACYSQ), an instrument designed to offer a comprehensive assessment of the activities adolescents take part in during sport practices. Two studies were designed for the purposes of item development and selection, and to provide evidence of structural and criterion validity of ACYSQ scores, respectively (N = 334; M age = 14.93, SD = 1.76 years). Confirmatory factor analysis (CFA) supported the adequacy of a 20-item ACYSQ measurement model, which was invariant across gender, and comprised the following dimensions: (1) stimulation; (2) usefulness-value; (3) authenticity; (4) repetition-boredom; and (5) ineffectiveness. Internal consistency reliability estimates and composite reliability estimates for ACYSQ subscale scores ranged from 0.72 to 0.91. In regression analyses, stimulation predicted enjoyment and perceived competence, ineffectiveness was significantly associated with perceived competence and authenticity emerged as a predictor of commitment in sport. These findings indicate that the ACYSQ displays adequate psychometric properties and the use of the instrument may be useful for studying selected activity-based features of the practice environment and their motivational consequences in youth sport.

Reliability and validity of 12-item Short-Form health survey (SF-12) for the health status of Chinese community elderly population in Xujiahui district of Shanghai.

PubMed

Shou, Juan; Ren, Limin; Wang, Haitang; Yan, Fei; Cao, Xiaoyun; Wang, Hui; Wang, Zhiliang; Zhu, Shanzhu; Liu, Yao

2016-04-01

The 12-item Short-Form Health Survey (SF-12) is the abridged practical version of SF-36. This cross-sectional study was aimed to assess the reliability and validity of SF-12 for the health status of Chinese community elderly population. The Chinese community elderly people in Xujiahui district of Shanghai were investigated. The internal consistency reliability was assessed using Cronbach's alpha and split-half reliability coefficients. Construct validity was analyzed using exploratory factor analysis (EFA) and confirmatory factor analysis (CFA). Spearman's correlation coefficient (ρ) was used for the evaluation of criterion, convergent, and discriminant validity with Spearman's ρ ≥ 0.4 as satisfactory. Comparisons of the SF-12 summary scores among populations that differed in demographics were performed for discriminant validity. Total 1343 individuals aged ≥60 and <85 years old (response rate: 91.3 %) were analyzed. The Cronbach's α value (0.910) and the split-half reliability coefficient (0.812) reflected satisfactory internal consistency reliability of SF-12. EFA extracted a two-factor model (physical and mental health). About 60.7 % of the total variance was explained by the two factors. CFA showed that the two-factor solution provided a good fit to the data. Good convergent validity and discriminant validity of SF-12 were proved by the correction analyses (Spearman's ρ > 0.4) and the comparisons of the SF-12 summary scores among populations (P < 0.05). SF-12 summary scores were significantly correlated with the SF-36 summary scores (Spearman's ρ > 0.4, P < 0.05). In conclusion, SF-12 had satisfactory reliability and validity in measuring health status of Chinese community elderly population in Xujiahui district of Shanghai.

The Validation of a Case-Based, Cumulative Assessment and Progressions Examination

PubMed Central

Coker, Adeola O.; Copeland, Jeffrey T.; Gottlieb, Helmut B.; Horlen, Cheryl; Smith, Helen E.; Urteaga, Elizabeth M.; Ramsinghani, Sushma; Zertuche, Alejandra; Maize, David

2016-01-01

Objective. To assess content and criterion validity, as well as reliability of an internally developed, case-based, cumulative, high-stakes third-year Annual Student Assessment and Progression Examination (P3 ASAP Exam). Methods. Content validity was assessed through the writing-reviewing process. Criterion validity was assessed by comparing student scores on the P3 ASAP Exam with the nationally validated Pharmacy Curriculum Outcomes Assessment (PCOA). Reliability was assessed with psychometric analysis comparing student performance over four years. Results. The P3 ASAP Exam showed content validity through representation of didactic courses and professional outcomes. Similar scores on the P3 ASAP Exam and PCOA with Pearson correlation coefficient established criterion validity. Consistent student performance using Kuder-Richardson coefficient (KR-20) since 2012 reflected reliability of the examination. Conclusion. Pharmacy schools can implement internally developed, high-stakes, cumulative progression examinations that are valid and reliable using a robust writing-reviewing process and psychometric analyses. PMID:26941435

Creation and Initial Validation of the International Dysphagia Diet Standardisation Initiative Functional Diet Scale

PubMed Central

Steele, Catriona M.; Namasivayam-MacDonald, Ashwini M.; Guida, Brittany T.; Cichero, Julie A.; Duivestein, Janice; MRSc; Hanson, Ben; Lam, Peter; Riquelme, Luis F.

2018-01-01

Objective To assess consensual validity, interrater reliability, and criterion validity of the International Dysphagia Diet Standardisation Initiative Functional Diet Scale, a new functional outcome scale intended to capture the severity of oropharyngeal dysphagia, as represented by the degree of diet texture restriction recommended for the patient. Design Participants assigned International Dysphagia Diet Standardisation Initiative Functional Diet Scale scores to 16 clinical cases. Consensual validity was measured against reference scores determined by an author reference panel. Interrater reliability was measured overall and across quartile subsets of the dataset. Criterion validity was evaluated versus Functional Oral Intake Scale (FOIS) scores assigned by survey respondents to the same case scenarios. Feedback was requested regarding ease and likelihood of use. Setting Web-based survey. Participants Respondents (NZ170) from 29 countries. Interventions Not applicable. Main Outcome Measures Consensual validity (percent agreement and Kendall t), criterion validity (Spearman rank correlation), and interrater reliability (Kendall concordance and intraclass coefficients). Results The International Dysphagia Diet Standardisation Initiative Functional Diet Scale showed strong consensual validity, criterion validity, and interrater reliability. Scenarios involving liquid-only diets, transition from nonoral feeding, or trial diet advances in therapy showed the poorest consensus, indicating a need for clear instructions on how to score these situations. The International Dysphagia Diet Standardisation Initiative Functional Diet Scale showed greater sensitivity than the FOIS to specific changes in diet. Most (>70%) respondents indicated enthusiasm for implementing the International Dysphagia Diet Standardisation Initiative Functional Diet Scale. Conclusions This initial validation study suggests that the International Dysphagia Diet Standardisation Initiative Functional Diet Scale has strong consensual and criterion validity and can be used reliably by clinicians to capture diet texture restriction and progression in people with dysphagia. PMID:29428348

Creation and Initial Validation of the International Dysphagia Diet Standardisation Initiative Functional Diet Scale.

PubMed

Steele, Catriona M; Namasivayam-MacDonald, Ashwini M; Guida, Brittany T; Cichero, Julie A; Duivestein, Janice; Hanson, Ben; Lam, Peter; Riquelme, Luis F

2018-05-01

To assess consensual validity, interrater reliability, and criterion validity of the International Dysphagia Diet Standardisation Initiative Functional Diet Scale, a new functional outcome scale intended to capture the severity of oropharyngeal dysphagia, as represented by the degree of diet texture restriction recommended for the patient. Participants assigned International Dysphagia Diet Standardisation Initiative Functional Diet Scale scores to 16 clinical cases. Consensual validity was measured against reference scores determined by an author reference panel. Interrater reliability was measured overall and across quartile subsets of the dataset. Criterion validity was evaluated versus Functional Oral Intake Scale (FOIS) scores assigned by survey respondents to the same case scenarios. Feedback was requested regarding ease and likelihood of use. Web-based survey. Respondents (N=170) from 29 countries. Not applicable. Consensual validity (percent agreement and Kendall τ), criterion validity (Spearman rank correlation), and interrater reliability (Kendall concordance and intraclass coefficients). The International Dysphagia Diet Standardisation Initiative Functional Diet Scale showed strong consensual validity, criterion validity, and interrater reliability. Scenarios involving liquid-only diets, transition from nonoral feeding, or trial diet advances in therapy showed the poorest consensus, indicating a need for clear instructions on how to score these situations. The International Dysphagia Diet Standardisation Initiative Functional Diet Scale showed greater sensitivity than the FOIS to specific changes in diet. Most (>70%) respondents indicated enthusiasm for implementing the International Dysphagia Diet Standardisation Initiative Functional Diet Scale. This initial validation study suggests that the International Dysphagia Diet Standardisation Initiative Functional Diet Scale has strong consensual and criterion validity and can be used reliably by clinicians to capture diet texture restriction and progression in people with dysphagia. Copyright © 2018 American Congress of Rehabilitation Medicine. Published by Elsevier Inc. All rights reserved.

Analyses related to the development of DSM-5 criteria for substance use related disorders: 1. Toward amphetamine, cocaine and prescription drug use disorder continua using Item Response Theory.

PubMed

Saha, Tulshi D; Compton, Wilson M; Chou, S Patricia; Smith, Sharon; Ruan, W June; Huang, Boji; Pickering, Roger P; Grant, Bridget F

2012-04-01

Prior research has demonstrated the dimensionality of alcohol, nicotine and cannabis use disorders criteria. The purpose of this study was to examine the unidimensionality of DSM-IV cocaine, amphetamine and prescription drug abuse and dependence criteria and to determine the impact of elimination of the legal problems criterion on the information value of the aggregate criteria. Factor analyses and Item Response Theory (IRT) analyses were used to explore the unidimensionality and psychometric properties of the illicit drug use criteria using a large representative sample of the U.S. population. All illicit drug abuse and dependence criteria formed unidimensional latent traits. For amphetamines, cocaine, sedatives, tranquilizers and opioids, IRT models fit better for models without legal problems criterion than models with legal problems criterion and there were no differences in the information value of the IRT models with and without the legal problems criterion, supporting the elimination of that criterion. Consistent with findings for alcohol, nicotine and cannabis, amphetamine, cocaine, sedative, tranquilizer and opioid abuse and dependence criteria reflect underlying unitary dimensions of severity. The legal problems criterion associated with each of these substance use disorders can be eliminated with no loss in informational value and an advantage of parsimony. Taken together, these findings support the changes to substance use disorder diagnoses recommended by the American Psychiatric Association's DSM-5 Substance and Related Disorders Workgroup. Published by Elsevier Ireland Ltd.

Validation of the Chinese version of functional assessment of anorexia-cachexia therapy (FAACT) scale for measuring quality of life in cancer patients with cachexia.

PubMed

Zhou, Ting; Yang, Kaixiang; Thapa, Sudip; Fu, Qiang; Jiang, Yongsheng; Yu, Shiying

2017-04-01

The assessment of quality of life (QOL) is an important part of cachexia management for cancer patients. Functional assessment of anorexia-cachexia therapy (FAACT), a specific QOL instrument for cachexia patients, has not been validated in Chinese population. The aim of this study was to validate the FAACT scale in Chinese cancer patients for its future use. Eligible cancer patients were included in our study. Patients' demographic and clinical characteristics were collected from the electronic medical records. Patients were asked to complete the Chinese version of FAACT scale and the MD Anderson symptom inventory (MDASI), and then the reliability and validity were analyzed. A total of 285 patients were enrolled in our study, data of 241 patients were evaluated. Coefficients of Cronbach's alpha, test-retest and split-half analyses were all greater than 0.8, which indicated an excellent reliability for FAACT scale. In item-subscale correlation analysis and factor analysis, good construct validity for FAACT scale was found. The correlation between FAACT and MDASI interference subscale showed reasonable criterion-related validity, and for further clinical validation, the FAACT scale showed excellent discriminative validity for distinguishing patients in different cachexia status and in different performance status. The Chinese version of FAACT scale has good reliability and validity and is suitable for measuring QOL of cachexia patients in Chinese population.

The development of two postnatal health instruments: one for mothers (M-PHI) and one for fathers (F-PHI) to measure health during the first year of parenting.

PubMed

Jones, G L; Morrell, C J; Cooke, J M; Speier, D; Anumba, D; Stewart-Brown, S

2011-09-01

To develop and psychometrically evaluate two questionnaires measuring both positive and negative postnatal health of mothers (M-PHI) and fathers (F-PHI) during the first year of parenting. The M-PHI and the F-PHI were developed in four stages. Stage 1: Postnatal women's focus group (M-PHI) and postnatal fathers' postal questionnaire (F-PHI); Stage 2: Qualitative interviews; Stage 3: Pilot postal survey and main postal survey; and Stage 4: Test-retest postal survey. The M-PHI consisted of a 29-item core questionnaire with six main scales and five conditional scales. The F-PHI consisted of a 27-item questionnaire with six main scales. All scales achieved good internal reliability (Cronbach's α 0.66-0.87 for M-PHI, 0.72-0.90 for F-PHI). Intraclass correlation coefficients demonstrated high test-retest reliability (0.60-0.88). Correlation coefficients supported the criterion validity of the M-PHI and the F-PHI when tested against the Short-Form-12 (SF-12), Edinburgh Postnatal Depression Scale (EPDS) and the Warwick and Edinburgh Mental Well-Being Scale (WEMWBS). The M-PHI and F-PHI are valid, reliable, parent-generated instruments. These unique instruments will be invaluable for practitioners wishing to promote family-centred care and for trialists and other researchers requiring a validated instrument to measure both positive and negative health during the first postnatal year, as to date no such measurement has existed.

Physiologic Screening Test for Eating Disorders/Disordered Eating Among Female Collegiate Athletes.

PubMed

Black, David R.; Larkin, Laurie J.S.; Coster, Daniel C.; Leverenz, Larry J.; Abood, Doris A.

2003-12-01

OBJECTIVE: To develop and evaluate a physiologic screening test specifically designed for collegiate female athletes engaged in athletic competition or highly athletic performances in order to detect eating disorders/disordered eating. No such physiologically based test currently exists. METHODS: Subjects included 148 (84.5%) of 175 volunteer, National Collegiate Athletic Association Division I (n = 92), club (n = 15), and dance team (n = 41) athletes 18 to 25 years old who attended a large, Midwestern university. Participants completed 4 tests: 2 normed for the general population (Eating Disorders Inventory-2 and Bulimia Test-Revised); a new physiologic test, developed and pilot tested by the investigators, called the Physiologic Screening Test; and the Eating Disorder Exam 12.0D, a structured, validated, diagnostic interview used for criterion validity. RESULTS: The 18-item Physiologic Screening Test produced the highest sensitivity (87%) and specificity (78%) and was superior to the Eating Disorders Inventory-2 (sensitivity = 62%, specificity = 74%) and Bulimia Test-Revised (sensitivity = 27%, specificity = 99%). A substantial number (n = 51, 35%) of athletes were classified as eating disordered/disordered eating. CONCLUSIONS: The Physiologic Screening Test should be considered for screening athletes for eating disorders/disordered eating. The Physiologic Screening Test seems to be a viable alternative to existing tests because it is specifically designed for female athletes, it is brief (4 measurements and 14 items), and validity is enhanced and response bias is lessened because the purpose is less obvious, especially when included as part of a mandatory preparticipation examination.

Adaptation study of the Turkish version of the Gambling-Related Cognitions Scale (GRCS-T).

PubMed

Arcan, K; Karanci, A N

2015-03-01

This study aimed to adapt and to test the validity and the reliability of the Turkish version of the Gambling-Related Cognitions Scale (GRCS-T) that was developed by Raylu and Oei (Addiction 99(6):757-769, 2004a). The significance of erroneous cognitions in the development and the maintenance of gambling problems, the importance of promoting gambling research in different cultures, and the limited information about the gambling individuals in Turkey due to limited gambling research interest inspired the present study. The sample consisted of 354 voluntary male participants who were above age 17 and betting on sports and horse races selected through convenience sampling in betting terminals. The results of the confirmatory factor analysis following the original scale's five factor structure indicated a good fit for the data. The analyses were carried out with 21 items due to relatively inadequate psychometric properties of two GRCS-T items. Correlational analyses and group comparison tests supported the concurrent and the criterion validity of the GRCS-T. Cronbach's alpha coefficient for the whole scale was 0.84 whereas the coefficients ranged between 0.52 and 0.78 for the subscales of GRCS-T. The findings suggesting that GRCS-T is a valid and reliable instrument to identify gambling cognitions in Turkish samples are discussed considering the possible influence of the sample make-up and cultural texture within the limitations of the present study and in the light of the relevant literature.

Food Service Supervisor. Dietetic Support Personnel Achievement Test.

ERIC Educational Resources Information Center

Oklahoma State Dept. of Vocational and Technical Education, Stillwater.

This guide contains a series of multiple-choice items and guidelines to assist instructors in composing criterion-referenced tests for use in the food service supervisor component of Oklahoma's Dietetic Support Personnel training program. Test items addressing each of the following occupational duty areas are provided: human relations; nutrient…

Food Production Worker. Dietetic Support Personnel Achievement Test.

ERIC Educational Resources Information Center

Oklahoma State Dept. of Vocational and Technical Education, Stillwater.

This guide contains a series of multiple-choice items and guidelines to assist instructors in composing criterion-referenced tests for use in the food production worker component of Oklahoma's Dietetic Support Personnel training program. Test items addressing each of the following occupational duty areas are provided: human relations; hygiene and…

Food Service Worker. Dietetic Support Personnel Achievement Test.

ERIC Educational Resources Information Center

Oklahoma State Dept. of Vocational and Technical Education, Stillwater.

This guide contains a series of multiple-choice items and guidelines to assist instructors in composing criterion-referenced tests for use in the food service worker component of Oklahoma's Dietetic Support Personnel training program. Test items addressing each of the following occupational duty areas are provided: human relations; personal…

The Counselor Evaluation Rating Scale: A Valid Criterion of Counselor Effectiveness?

ERIC Educational Resources Information Center

Jones, Lawrence K.

1974-01-01

The validity of recent recommendations regarding the use of certain factors of the 16 Personality Factor Questionnaire (16PF) to select persons for counselor training programs, where the CERS was the criterion measure, is challenged. (Author)

The COSMIN checklist for assessing the methodological quality of studies on measurement properties of health status measurement instruments: an international Delphi study.

PubMed

Mokkink, Lidwine B; Terwee, Caroline B; Patrick, Donald L; Alonso, Jordi; Stratford, Paul W; Knol, Dirk L; Bouter, Lex M; de Vet, Henrica C W

2010-05-01

Aim of the COSMIN study (COnsensus-based Standards for the selection of health status Measurement INstruments) was to develop a consensus-based checklist to evaluate the methodological quality of studies on measurement properties. We present the COSMIN checklist and the agreement of the panel on the items of the checklist. A four-round Delphi study was performed with international experts (psychologists, epidemiologists, statisticians and clinicians). Of the 91 invited experts, 57 agreed to participate (63%). Panel members were asked to rate their (dis)agreement with each proposal on a five-point scale. Consensus was considered to be reached when at least 67% of the panel members indicated 'agree' or 'strongly agree'. Consensus was reached on the inclusion of the following measurement properties: internal consistency, reliability, measurement error, content validity (including face validity), construct validity (including structural validity, hypotheses testing and cross-cultural validity), criterion validity, responsiveness, and interpretability. The latter was not considered a measurement property. The panel also reached consensus on how these properties should be assessed. The resulting COSMIN checklist could be useful when selecting a measurement instrument, peer-reviewing a manuscript, designing or reporting a study on measurement properties, or for educational purposes.

An appraisal of the psychometric properties of the Clinician version of the Apathy Evaluation Scale (AES-C).

PubMed

Clarke, Diana E; Van Reekum, Robert; Patel, Jigisha; Simard, Martine; Gomez, Everlyne; Streiner, David L

2007-01-01

This article examines the psychometric properties of the clinician version of the Apathy Evaluation Scale (AES-C) to determine its ability to characterize, quantify and differentiate apathy. Critical appraisals of the item-reduction processes, effectiveness of the administration, coding and scoring procedures, and the reliability and validity of the scale were carried out. For training, administration and rating of the AES-C, clearer guidelines, including a more standardized list of verbal and non-verbal apathetic cues, are needed. There is evidence of high internal consistency for the scale across studies. In addition, the original study reported good test-retest and inter-rater reliability coefficients. However, there is a lack of replication on these more stable and informative measures of reliability and as such they warrant further investigation. The research evidence confirms that the AES-C shows good discriminant, convergent and criterion validity. However, evidence of its predictive validity is limited. As this aspect of validity refers to the scale's ability to predict future outcomes, which is important for treatment and rehabilitation planning, further assessment of the predictive validity of the AES-C is needed. In conclusion, the AES-C is a reliable and valid measure for the characterization and quantification of apathy. Copyright (c) 2007 John Wiley & Sons, Ltd.

Development and validation of safety climate scales for mobile remote workers using utility/electrical workers as exemplar.

PubMed

Huang, Yueng-Hsiang; Zohar, Dov; Robertson, Michelle M; Garabet, Angela; Murphy, Lauren A; Lee, Jin

2013-10-01

The objective of this study was to develop and test the reliability and validity of a new scale designed for measuring safety climate among mobile remote workers, using utility/electrical workers as exemplar. The new scale employs perceived safety priority as the metric of safety climate and a multi-level framework, separating the measurement of organization- and group-level safety climate items into two sub-scales. The question of the emergence of shared perceptions among remote workers was also examined. For the initial survey development, several items were adopted from a generic safety climate scale and new industry-specific items were generated based on an extensive literature review, expert judgment, 15-day field observations, and 38 in-depth individual interviews with subject matter experts (i.e., utility industry electrical workers, trainers and supervisors of electrical workers). The items were revised after 45 cognitive interviews and a pre-test with 139 additional utility/electrical workers. The revised scale was subsequently implemented with a total of 2421 workers at two large US electric utility companies (1560 participants for the pilot company and 861 for the second company). Both exploratory (EFA) and confirmatory factor analyses (CFA) were adopted to finalize the items and to ensure construct validity. Reliability of the scale was tested based on Cronbach's α. Homogeneity tests examined whether utility/electrical workers' safety climate perceptions were shared within the same supervisor group. This was followed by an analysis of the criterion-related validity, which linked the safety climate scores to self-reports of safety behavior and injury outcomes (i.e., recordable incidents, missing days due to work-related injuries, vehicle accidents, and near misses). Six dimensions (Safety pro-activity, General training, Trucks and equipment, Field orientation, Financial Investment, and Schedule flexibility) with 29 items were extracted from the EFA to measure the organization-level safety climate. Three dimensions (Supervisory care, Participation encouragement, and Safety straight talk) with 19 items were extracted to measure the group-level safety climate. Acceptable ranges of internal consistency statistics for the sub-scales were observed. Whether or not to aggregate these multi-dimensions of safety climate into a single higher-order construct (overall safety climate) was discussed. CFAs confirmed the construct validity of the developed safety climate scale for utility/electrical workers. Homogeneity tests showed that utility/electrical workers' safety climate perceptions were shared within the same supervisor group. Both the organization- and group-level safety climate scores showed a statistically significant relationship with workers' self-reported safety behaviors and injury outcomes. A valid and reliable instrument to measure the essential elements of safety climate for utility/electrical workers in the remote working situation has been introduced. The scale can provide an in-depth understanding of safety climate based on its key dimensions and show where improvements can be made at both group and organization levels. As such, it may also offer a valuable starting point for future safety interventions. Copyright © 2013 Elsevier Ltd. All rights reserved.

The validity and reliability of a dynamic neuromuscular stabilization-heel sliding test for core stability.

PubMed

Cha, Young Joo; Lee, Jae Jin; Kim, Do Hyun; You, Joshua Sung H

2017-10-23

Core stabilization plays an important role in the regulation of postural stability. To overcome shortcomings associated with pain and severe core instability during conventional core stabilization tests, we recently developed the dynamic neuromuscular stabilization-based heel sliding (DNS-HS) test. The purpose of this study was to establish the criterion validity and test-retest reliability of the novel DNS-HS test. Twenty young adults with core instability completed both the bilateral straight leg lowering test (BSLLT) and DNS-HS test for the criterion validity study and repeated the DNS-HS test for the test-retest reliability study. Criterion validity was determined by comparing hip joint angle data that were obtained from BSLLT and DNS-HS measures. The test-retest reliability was determined by comparing hip joint angle data. Criterion validity was (ICC2,3) = 0.700 (p< 0.05), suggesting a good relationship between the two core stability measures. Test-retest reliability was (ICC3,3) = 0.953 (p< 0.05), indicating excellent consistency between the repeated DNS-HS measurements. Criterion validity data demonstrated a good relationship between the gold standard BSLLT and DNS-HS core stability measures. Test-retest reliability data suggests that DNS-HS core stability was a reliable test for core stability. Clinically, the DNS-HS test is useful to objectively quantify core instability and allow early detection and evaluation.

Comparing the Construct and Criterion-Related Validity of Ability-Based and Mixed-Model Measures of Emotional Intelligence

ERIC Educational Resources Information Center

Livingstone, Holly A.; Day, Arla L.

2005-01-01

Despite the popularity of the concept of emotional intelligence(EI), there is much controversy around its definition, measurement, and validity. Therefore, the authors examined the construct and criterion-related validity of an ability-based EI measure (Mayer Salovey Caruso Emotional Intelligence Test [MSCEIT]) and a mixed-model EI measure…

Validity and reliability of the Movement Assessment Battery for Children-2 Checklist for children with and without motor impairments.

PubMed

Schoemaker, Marina M; Niemeijer, Anuschka S; Flapper, Boudien C T; Smits-Engelsman, Bouwien C M

2012-04-01

The aim of this study was to investigate the validity and reliability of the Movement Assessment Battery for Children-2 Checklist (MABC-2). Teachers completed the Checklist for 383 children (age range 5-8y; mean age 6y 9mo; 190 males; 193 females) and the parents of 130 of these children completed the Developmental Disorder Coordination Questionnaire 2007 (DCDQ'07). All children were assessed with the MABC-2 Test. The internal consistency of the 30 items of the Checklist was determined to measure reliability. Construct validity was investigated using factor analysis and discriminative validity was assessed by comparing the scores of children with and without movement difficulties. Concurrent validity was measured by calculating correlations between the Checklist, Test, and the DCDQ'07. Incremental validity was assessed to determine whether the Checklist was a better predictor of motor impairment than the DCDQ'07. Sensitivity and specificity were investigated using the MABC-2 Test as reference standard (cut-off 15th centile). The Checklist items measure the same construct. Six factors were obtained after factor analysis. This implies that a broad range of functional activities can be assessed with the Checklist, which renders the Checklist useful for assessing criterion B of the diagnostic criteria for DCD. The mean Checklist scores for children with and without motor impairments significantly differed (p<0.001). The scores for the Checklist/Test and DCDQ'07 were significantly correlated (r(S) =-0.38 and p<0.001, and r(S) =-0.36 and p<0.001, respectively). The Checklist better predicted motor impairment than the DCDQ'07. Overall, the sensitivity was low (41%) and the specificity was acceptable (88%). The Checklist meets standards for validity and reliability. © The Authors. Developmental Medicine & Child Neurology © 2012 Mac Keith Press.

Reliability and criterion validity of an observation protocol for working technique assessments in cash register work.

PubMed

Palm, Peter; Josephson, Malin; Mathiassen, Svend Erik; Kjellberg, Katarina

2016-06-01

We evaluated the intra- and inter-observer reliability and criterion validity of an observation protocol, developed in an iterative process involving practicing ergonomists, for assessment of working technique during cash register work for the purpose of preventing upper extremity symptoms. Two ergonomists independently assessed 17 15-min videos of cash register work on two occasions each, as a basis for examining reliability. Criterion validity was assessed by comparing these assessments with meticulous video-based analyses by researchers. Intra-observer reliability was acceptable (i.e. proportional agreement >0.7 and kappa >0.4) for 10/10 questions. Inter-observer reliability was acceptable for only 3/10 questions. An acceptable inter-observer reliability combined with an acceptable criterion validity was obtained only for one working technique aspect, 'Quality of movements'. Thus, major elements of the cashiers' working technique could not be assessed with an acceptable accuracy from short periods of observations by one observer, such as often desired by practitioners. Practitioner Summary: We examined an observation protocol for assessing working technique in cash register work. It was feasible in use, but inter-observer reliability and criterion validity were generally not acceptable when working technique aspects were assessed from short periods of work. We recommend the protocol to be used for educational purposes only.

The Use of Rasch Competency Bands for Reporting Criterion-Referenced Feedback and Curriculum-Standards Attainment

ERIC Educational Resources Information Center

Combrinck, Celeste; Scherman, Vanessa; Maree, David

2016-01-01

This study describes how criterion-referenced feedback was produced from English language, mathematics and natural sciences monitoring assessments. The assessments were designed for grades 8 to 11 to give an overall indication of curriculum-standards attained in a given subject over the course of a year (N = 1113). The Rasch Item Map method was…

The Kings Cross fire: psychological reactions.

PubMed

Turner, S W; Thompson, J; Rosser, R M

1995-07-01

The psychological reactions of 50 survivors of the King's Cross fire, which hit London's underground railway system on the 18th day of November 1987, are described. Results are presented for the Impact of Event scale, the General Health Questionnaire (28-item version), the Eysenck Personality Questionnaire and a King's Cross Event Schedule. These are investigated in relation to (a) validity measures, (b) relationships between exposure and personality, and (c) spontaneous de-briefing. Two thirds of the sample had significant levels of psychological distress (meeting the "caseness" criterion on the GHQ). Both personality (neuroticism and L-scale) and degree of trauma exposure were related to subsequent reaction. Spontaneous debriefing was associated with subjective benefit. Transportation disasters present particular problems in relation to research and service delivery.

Development of a theory-based questionnaire to assess structure and control in parent feeding (SCPF).

PubMed

Savage, Jennifer S; Rollins, Brandi Y; Kugler, Kari C; Birch, Leann L; Marini, Michele E

2017-01-26

Parents shape children's eating environments and act as powerful socialization agents, impacting young children's behavioral controls of food intake. Most feeding measures assess parents' use of control to manage children's intake of energy dense foods. The Structure and Control in Parent Feeding (SCPF) questionnaire was developed to assess more positive aspects of feeding practices with their young children -setting limits, providing routines-that promote self-regulation, as well as controlling feeding practices. A mixed method approach was used to develop the SCPF. In 2013, cognitive interviews informed the modification, deletion and/or replacement of items. In 2014, the survey was distributed statewide to mothers of toddlers aged 12 to 36 months participating in the Women, Infants, and Children program. In 2016, exploratory factor analyses was conducted to test our theoretical parenting model and content validity and criterion validity were assessed (n = 334). Exploratory factor analysis (EFA) and second-order EFA revealed a 2-factor, 22-item Structure model and a 2-factor, 12-item Control model. Internal consistencies for all factors exceeded 0.70. As predicted, the Structure superfactor was positivity associated with responsiveness, whereas the Control superfactor was positively associated with demandingness on the Caregiver's Feeding Styles Questionnaire. The Structure subscales were also positively associated with mealtime behaviors and Control subscales were positively associated with control-oriented feeding measures from the Control in Parent Feeding Practices questionnaire. The SCPF questionnaire is a reliable tool that can be used to assess aspects of structure- and control-based feeding practices to better understand how parents feed their toddlers.

Perceived barriers to walking for physical activity.

PubMed

Dunton, Genevieve F; Schneider, Margaret

2006-10-01

Although the health benefits of walking for physical activity have received increasing research attention, barriers specific to walking are not well understood. In this study, questions to measure barriers to walking for physical activity were developed and tested among college students. The factor structure, test-retest and internal consistency reliability, and discriminant and criterion validity of the perceived barriers were evaluated. A total of 305 undergraduate students participated. Participants had a mean age (+/- SD) of 20.6 (+/- 3.02) years, and 70.3% were female. Participants responded to a questionnaire assessing barriers specific to walking for physical activity. Perceived barriers to vigorous exercise, walking for transportation and recreation, and participation in lifestyle activities (such as taking the stairs instead of the elevator) were also assessed. Subsamples completed the walking barriers instrument a second time after 5 days in order to determine test-retest reliability (n = 104) and wore an accelerometer to measure moderate-intensity physical activity (n = 85). Factor analyses confirmed the existence of three factors underlying the perceived barriers to walking questions: appearance (four items), footwear (three items), and situation (three items). Appearance and situational barriers demonstrated acceptable reliability, discriminant validity, and relations with physical activity criteria. After we controlled for barriers to vigorous exercise, appearance and situational barriers to walking explained additional variation in objectively-measured moderate physical activity. The prediction of walking for physical activity, especially walking that is unstructured and spontaneous, may be improved by considering appearance and situational barriers. Assessing barriers specific to walking may have important implications for interventions targeting walking as means for engaging in physical activity.

Development of the Exam of GeoloGy Standards, EGGS, to Measure Students' Conceptual Understanding of Geology Concepts

NASA Astrophysics Data System (ADS)

Guffey, S. K.; Slater, T. F.; Slater, S. J.

2017-12-01

Discipline-based geoscience education researchers have considerable need for criterion-referenced, easy-to-administer and easy-to-score, conceptual diagnostic surveys for undergraduates taking introductory science survey courses in order for faculty to better be able to monitor the learning impacts of various interactive teaching approaches. To support ongoing discipline-based science education research to improve teaching and learning across the geosciences, this study establishes the reliability and validity of a 28-item, multiple-choice, pre- and post- Exam of GeoloGy Standards, hereafter simply called EGGS. The content knowledge EGGS addresses is based on 11 consensus concepts derived from a systematic, thematic analysis of the overlapping ideas presented in national science education reform documents including the Next Generation Science Standards, the AAAS Benchmarks for Science Literacy, the Earth Science Literacy Principles, and the NRC National Science Education Standards. Using community agreed upon best-practices for creating, field-testing, and iteratively revising modern multiple-choice test items using classical item analysis techniques, EGGS emphasizes natural student language over technical scientific vocabulary, leverages illustrations over students' reading ability, specifically targets students' misconceptions identified in the scholarly literature, and covers the range of topics most geology educators expect general education students to know at the end of their formal science learning experiences. The current version of EGGS is judged to be valid and reliable with college-level, introductory science survey students based on both standard quantitative and qualitative measures, including extensive clinical interviews with targeted students and systematic expert review.

Development of a Short Form of the Five-Factor Narcissism Inventory: the FFNI-SF.

PubMed

Sherman, Emily D; Miller, Joshua D; Few, Lauren R; Campbell, W Keith; Widiger, Thomas A; Crego, Cristina; Lynam, Donald R

2015-09-01

The Five-Factor Narcissism Inventory (FFNI; Glover, Miller, Lynam, Crego, & Widiger, 2012) is a 148-item self-report inventory of 15 traits designed to assess the basic elements of narcissism from the perspective of a 5-factor model. The FFNI assesses both vulnerable (i.e., cynicism/distrust, need for admiration, reactive anger, and shame) and grandiose (i.e., acclaim seeking, arrogance, authoritativeness, entitlement, exhibitionism, exploitativeness, grandiose fantasies, indifference, lack of empathy, manipulativeness, and thrill seeking) variants of narcissism. The present study reports the development of a short-form version of the FFNI in 4 diverse samples (i.e., 2 undergraduate samples, a sample recruited from MTurk, and a clinical community sample) using item response theory. The validity of the resultant 60-item short form was compared against the validity of the full scale in the 4 samples at both the subscale level and the level of the grandiose and vulnerable composites. Results indicated that the 15 subscales remain relatively reliable, possess a factor structure identical to the structure of the long-form scales, and manifest correlational profiles highly similar to those of the long-form scales in relation to a variety of criterion measures, including basic personality dimensions, other measures of grandiose and vulnerable narcissism, and indicators of externalizing and internalizing psychopathology. Grandiose and vulnerable composites also behave almost identically across the short- and long-form versions. It is concluded that the FFNI-Short Form (FFNI-SF) offers a well-articulated assessment of the basic traits comprising grandiose and vulnerable narcissism, particularly when assessment time is limited. (c) 2015 APA, all rights reserved.

Psychometric evaluation of the Orofacial Pain Scale for Non-Verbal Individuals as a screening tool for orofacial pain in people with dementia.

PubMed

Delwel, Suzanne; Perez, Roberto S G M; Maier, Andrea B; Hertogh, Cees M P M; de Vet, Henrica C W; Lobbezoo, Frank; Scherder, Erik J A

2018-04-29

The aim of this study was to describe the psychometric evaluation of the Orofacial Pain Scale for Non-Verbal Individuals (OPS-NVI) as a screening tool for orofacial pain in people with dementia. The OPS-NVI has recently been developed and needs psychometric evaluation for clinical use in people with dementia. The pain self-report is imperative as a reference standard and can be provided by people with mild-to-moderate cognitive impairment. The presence of orofacial pain during rest, drinking, chewing and oral hygiene care was observed in people with mild cognitive impairment (MCI) and dementia using the OPS-NVI. Participants who were considered to present a reliable self-report were asked about pain presence, and in all participants, the oral health was examined by a dentist for the presence of potential painful conditions. After item-reduction, inter-rater reliability and criterion validity were determined. The presence of orofacial pain in this population was low (0%-10%), resulting in an average Positive Agreement of 0%-100%, an average Negative Agreement of 77%-100%, a sensitivity of 0%-100% and a specificity of 66%-100% for the individual items of the OPS-NVI. At the same time, the presence of oral problems, such as ulcers, tooth root remnants and caries was high (64.5%). The orofacial pain presence in this MCI and dementia population was low, resulting in low scores for average Positive Agreement and sensitivity and high scores for average Negative Agreement and specificity. Therefore, the OPS-NVI in its current form cannot be recommended as a screening tool for orofacial pain in people with MCI and dementia. However, the inter-rater reliability and criterion validity of the individual items in this study provide more insight for the further adjustment of the OPS-NVI for diagnostic use. Notably, oral health problems were frequently present, although no pain was reported or observed, indicating that oral health problems cannot be used as a new reference standard for orofacial pain, and a regular oral examination by care providers and oral hygiene care professionals remains indispensable. © 2018 The Authors Gerodontology published by British Society of Gerodontology, European College of Gerodontology and Geriatric Oral Research Group and John Wiley & Sons Ltd.

Validity of proposed DSM-5 diagnostic criteria for nicotine use disorder: results from 734 Israeli lifetime smokers

PubMed Central

Shmulewitz, D.; Wall, M.M.; Aharonovich, E.; Spivak, B.; Weizman, A.; Frisch, A.; Grant, B. F.; Hasin, D.

2013-01-01

Background The fifth edition of the Diagnostic and Statistical Manual of Mental Disorders (DSM-5) proposes aligning nicotine use disorder (NUD) criteria with those for other substances, by including the current DSM fourth edition (DSM-IV) nicotine dependence (ND) criteria, three abuse criteria (neglect roles, hazardous use, interpersonal problems) and craving. Although NUD criteria indicate one latent trait, evidence is lacking on: (1) validity of each criterion; (2) validity of the criteria as a set; (3) comparative validity between DSM-5 NUD and DSM-IV ND criterion sets; and (4) NUD prevalence. Method Nicotine criteria (DSM-IV ND, abuse and craving) and external validators (e.g. smoking soon after awakening, number of cigarettes per day) were assessed with a structured interview in 734 lifetime smokers from an Israeli household sample. Regression analysis evaluated the association between validators and each criterion. Receiver operating characteristic analysis assessed the association of the validators with the DSM-5 NUD set (number of criteria endorsed) and tested whether DSM-5 or DSM-IV provided the most discriminating criterion set. Changes in prevalence were examined. Results Each DSM-5 NUD criterion was significantly associated with the validators, with strength of associations similar across the criteria. As a set, DSM-5 criteria were significantly associated with the validators, were significantly more discriminating than DSM-IV ND criteria, and led to increased prevalence of binary NUD (two or more criteria) over ND. Conclusions All findings address previous concerns about the DSM-IV nicotine diagnosis and its criteria and support the proposed changes for DSM-5 NUD, which should result in improved diagnosis of nicotine disorders. PMID:23312475

Validity of the modified back-saver sit-and-reach test: a comparison with other protocols.

PubMed

Hui, S S; Yuen, P Y

2000-09-01

Studies have shown that the classical sit-and-reach (CSR) test, the modified sit-and-reach (MSR), and the newly developed back-saver sit-and-reach (BS) test have poor criterion-related validity in estimating low-back flexibility but yielded moderate criterion-related validity in hamstring flexibility. The V sit-and-reach (VSR) test was found to be practical but the validity has not been established. The purpose of this study was to propose a modified back-saver sit-and-reach (MBS) test, which incorporated all advantages of the various protocols, and to compare the criterion-related validity and reliability of all these tests. 158 college students (F = 96, and M = 62; age = 20.77 +/- 2.51) performed CSR, VSR, BS (left and right leg), and MBS (left and right leg) tests in a randomized order. Scores from each test were then correlated with the criterion measures. For all sit-reach tests, intraclass reliability (single trial) was very high (r = 0.89-0.98). MBS yielded significant and highest r with low-back and hamstring criterion for men (r = 0.47-0.67) and women (r = 0.23-0.54). The low-back and right hamstring validity of MBS for men were significantly (P < 0.01) higher than those from BS and CSR, whereas no differences in criterion-related validity were found between the MBS and other protocols in women. The ratings of perceived comfort among the sit-and-reach protocols were significantly different (P < 0.001) from each other. The rating for MBS was observed the most comfortable test as compared with other protocols. The MBS test is not only a reliable test for hamstring and low-back flexibility, it is also a more practical with improved validity for hamstring and low-back flexibility in men than previous protocols.

Self-stigma among concealable minorities in Hong Kong: conceptualization and unified measurement.

PubMed

Mak, Winnie W S; Cheung, Rebecca Y M

2010-04-01

Self-stigma refers to the internalized stigma that individuals may have toward themselves as a result of their minority status. Not only can self-stigma dampen the mental health of individuals, it can deter them from seeking professional help lest disclosing their minority status lead to being shunned by service providers. No unified instrument has been developed to measure consistently self-stigma that could be applied to different concealable minority groups. The present study presented findings based on 4 studies on the development and validation of the Self-Stigma Scale, conducted in Hong Kong with community samples of mental health consumers, recent immigrants from Mainland China, and sexual minorities. Upon a series of validation procedures, a 9-item Self-Stigma Scale-Short Form was developed. Initial support on its reliability and construct validity (convergent and criterion validities) were found among 3 stigmatized groups. Utility of this unified measure was to establish an empirical basis upon which self-stigma of different concealable minority groups could be assessed under the same dimensions. Health-care professionals could make use of this short scale to assess potential self-stigmatization among concealable minorities, which may hamper their treatment process as well as their overall well-being.