Readability and comprehension of self-report binge eating measures.

PubMed

Richards, Lauren K; McHugh, R Kathryn; Pratt, Elizabeth M; Thompson-Brenner, Heather

2013-04-01

The validity of self-report binge eating instruments among individuals with limited literacy is uncertain. This study aims to evaluate reading grade level and multiple domains of comprehension of 13 commonly used self-report assessments of binge eating for use in low-literacy populations. We evaluated self-report binge eating measures with respect to reading grade levels, measure length, formatting and linguistic problems. All measures were written at a reading grade level higher than is recommended for patient materials (above the 5th to 6th grade level), and contained several challenging elements related to comprehension. Correlational analyses suggested that readability and comprehension elements were distinct contributors to measure difficulty. Individuals with binge eating who have low levels of educational attainment or limited literacy are often underrepresented in measure validation studies. Validity of measures and accurate assessment of symptoms depend on an individual's ability to read and comprehend instructions and items, and these may be compromised in populations with lower levels of literacy. Copyright © 2013 Elsevier Ltd. All rights reserved.

Validity of self-reported weight and height: a cross-sectional study among Malaysian adolescents.

PubMed

Kee, C C; Lim, K H; Sumarni, M G; Teh, C H; Chan, Y Y; Nuur Hafizah, M I; Cheah, Y K; Tee, E O; Ahmad Faudzi, Y; Amal Nasir, M

2017-06-02

Self-reported weight and height are commonly used in lieu of direct measurements of weight and height in large epidemiological surveys due to inevitable constraints such as budget and human resource. However, the validity of self-reported weight and height, particularly among adolescents, needs to be verified as misreporting could lead to misclassification of body mass index and therefore overestimation or underestimation of the burden of BMI-related diseases. The objective of this study was to determine the validity of self-reported weight and height among Malaysian secondary school children. Both self-reported and directly measured weight and height of a subgroup of 663 apparently healthy schoolchildren from the Malaysian Adolescent Health Risk Behaviour (MyAHRB) survey 2013/2014 were analysed. Respondents were required to report their current body weight and height via a self-administrative questionnaire before they were measured by investigators. The validity of self-reported against directly measured weight and height was examined using intraclass correlation coefficient (ICC), the Bland-Altman plot and weighted Kappa statistics. There was very good intraclass correlation between self-reported and directly measured weight [r = 0.96, 95% confidence interval (CI): 0.93, 0.97] and height (r = 0.94, 95% CI: 0.90, 0.96). In addition the Bland-Altman plots indicated that the mean difference between self-reported and direct measurement was relatively small. The mean difference (self-reported minus direct measurements) was, for boys: weight, -2.1 kg; height, -1.6 cm; BMI, -0.44 kg/m 2 and girls: weight, -1.2 kg; height, -0.9 cm; BMI, -0.3 kg/m 2 . However, 95% limits of agreement were wide which indicated substantial discrepancies between self-reported and direct measurements method at the individual level. Nonetheless, the weighted Kappa statistics demonstrated a substantial agreement between BMI status categorised based on self-reported weight and height and the direct measurements (kappa = 0.76, 95% CI: 0.67, 0.84). Our results show that the self-reported weight and height were consistent with direct measurements and therefore can be used in assessing the nutritional status of Malaysian school children from the age of 13 to 17 years old in epidemiological studies and for surveillance purposes when direct measurements are not feasible, but not for assessing nutritional status at the individual level.

Validity of questionnaire self-reports on computer, mouse and keyboard usage during a four-week period.

PubMed

Mikkelsen, Sigurd; Vilstrup, Imogen; Lassen, Christina Funch; Kryger, Ann Isabel; Thomsen, Jane Frølund; Andersen, Johan Hviid

2007-08-01

To examine the validity and potential biases in self-reports of computer, mouse and keyboard usage times, compared with objective recordings. A study population of 1211 people was asked in a questionnaire to estimate the average time they had worked with computer, mouse and keyboard during the past four working weeks. During the same period, a software program recorded these activities objectively. The study was part of a one-year follow-up study from 2000-1 of musculoskeletal outcomes among Danish computer workers. Self-reports on computer, mouse and keyboard usage times were positively associated with objectively measured activity, but the validity was low. Self-reports explained only between a quarter and a third of the variance of objectively measured activity, and were even lower for one measure (keyboard time). Self-reports overestimated usage times. Overestimation was large at low levels and declined with increasing levels of objectively measured activity. Mouse usage time proportion was an exception with a near 1:1 relation. Variability in objectively measured activity, arm pain, gender and age influenced self-reports in a systematic way, but the effects were modest and sometimes in different directions. Self-reported durations of computer activities are positively associated with objective measures but they are quite inaccurate. Studies using self-reports to establish relations between computer work times and musculoskeletal pain could be biased and lead to falsely increased or decreased risk estimates.

Readability of Self-Report Measures of Depression and Anxiety

ERIC Educational Resources Information Center

McHugh, R. Kathryn; Behar, Evelyn

2009-01-01

As the demand for accountability in service provision settings increases, the need for valid methods for assessing clinical outcomes is of particular importance. Self-report measures of functioning are particularly useful in the assessment of psychological functioning, but a vital factor in their validity and transportability is the reading level…

The reliability, validity, and accuracy of self-reported absenteeism from work: a meta-analysis.

PubMed

Johns, Gary; Miraglia, Mariella

2015-01-01

Because of a variety of access limitations, self-reported absenteeism from work is often employed in research concerning health, organizational behavior, and economics, and it is ubiquitous in large scale population surveys in these domains. Several well established cognitive and social-motivational biases suggest that self-reports of absence will exhibit convergent validity with records-based measures but that people will tend to underreport the behavior. We used meta-analysis to summarize the reliability, validity, and accuracy of absence self-reports. The results suggested that self-reports of absenteeism offer adequate test-retest reliability and that they exhibit reasonably good rank order convergence with organizational records. However, people have a decided tendency to underreport their absenteeism, although such underreporting has decreased over time. Also, self-reports were more accurate when sickness absence rather than absence for any reason was probed. It is concluded that self-reported absenteeism might serve as a valid measure in some correlational research designs. However, when accurate knowledge of absolute absenteeism levels is essential, the tendency to underreport could result in flawed policy decisions. PsycINFO Database Record (c) 2014 APA, all rights reserved.

Validity of Self-reported Sexual Behavior Among Adolescents: Where Do We Go from Here?

PubMed

DiClemente, Ralph J

2016-01-01

Adolescents have high rates of sexually transmitted infections (STIs). Adolescents consuming alcohol and using drugs have markedly greater HIV/STI risk and are a priority population for intervention. Accurate measurement of sexual risk behavior is critical for understanding individual's risk for HIV/STI, transmission dynamics of HIV/STI, and evaluating the efficacy of interventions designed reduce HIV/STI risk. However, significant challenges to accurately measuring adolescents' self-reported sexual behavior are well-documented. Recent advances in microbiology, such as the use of less invasive specimen collection for DNA assays, can assist researchers in more accurately measuring adolescents' sexual risk behavior. However, the majority of studies of adolescents' sexual risk rely solely on self-reported behavior; therefore, methods to improve the validity of adolescents' self-reported sexual behavior are needed. In addition, integrating biologic measures to complement self-reported measures are recommended, when appropriate and feasible.

Validation of Self-Reported Cognitive Problems with Objective ...

EPA Pesticide Factsheets

There is a lack of validation of self-reported cognitive problems with objective neuropsychological measures. The validity of four self-reported cognitive items from a health questionnaire (HQ) and the Symptoms Checklist 90-Revised (SCL-90-R) was examined with objective clinical neuropsychological test performance in 147 manganese (Mn) exposed residents. These residents were from two Ohio towns exposed to ambient air-Mn from an industrial source with modeled average air-Mn concentrations of 0.54 µg/m3 (range: 0.01-4.58) and were part of a larger study of cognitive, motor, tremor abnormalities and their relationship to Mn exposure.The primarily white (94.6%) participants (aged 30-64) lived in the towns for at least 10 years (range: 10-64) and had 13.9 years of education, on average. In the last 7 days before testing, 94 (64.4%) participants self-reported concentration problems and 105 (71.8%) self-reported memory problems. After adjusting for age and education, participants who self-reported cognitive problems did not perform worse on the objective neuropsychological measures than those who reported not having problems, except on 1 of 17 neuropsychological tests (Stroop Color). Greater levels of depression and female sex predicted having more self-reported cognitive problems. Higher education was associated with fewer self-reported cognitive problems. Measures of Mn in air, blood, hair, and toenails were not associated with subjective cognitive self-reported p

Measuring Resource Utilization: A Systematic Review of Validated Self-Reported Questionnaires.

PubMed

Leggett, Laura E; Khadaroo, Rachel G; Holroyd-Leduc, Jayna; Lorenzetti, Diane L; Hanson, Heather; Wagg, Adrian; Padwal, Raj; Clement, Fiona

2016-03-01

A variety of methods may be used to obtain costing data. Although administrative data are most commonly used, the data available in these datasets are often limited. An alternative method of obtaining costing is through self-reported questionnaires. Currently, there are no systematic reviews that summarize self-reported resource utilization instruments from the published literature.The aim of the study was to identify validated self-report healthcare resource use instruments and to map their attributes.A systematic review was conducted. The search identified articles using terms like "healthcare utilization" and "questionnaire." All abstracts and full texts were considered in duplicate. For inclusion, studies had to assess the validity of a self-reported resource use questionnaire, to report original data, include adult populations, and the questionnaire had to be publically available. Data such as type of resource utilization assessed by each questionnaire, and validation findings were extracted from each study.In all, 2343 unique citations were retrieved; 2297 were excluded during abstract review. Forty-six studies were reviewed in full text, and 15 studies were included in this systematic review. Six assessed resource utilization of patients with chronic conditions; 5 assessed mental health service utilization; 3 assessed resource utilization by a general population; and 1 assessed utilization in older populations. The most frequently measured resources included visits to general practitioners and inpatient stays; nonmedical resources were least frequently measured. Self-reported questionnaires on resource utilization had good agreement with administrative data, although, visits to general practitioners, outpatient days, and nurse visits had poorer agreement.Self-reported questionnaires are a valid method of collecting data on healthcare resource utilization.

Measuring Educational Outcomes for At-Risk Children and Youth: Issues with the Validity of Self-Reported Data

ERIC Educational Resources Information Center

Teye, Amanda Cleveland; Peaslee, Liliokanaio

2015-01-01

Background: Youth programs often rely on self-reported data without clear evidence as to the accuracy of these reports. Although the validity of self-reporting has been confirmed among some high school and college age students, one area that is absent from extant literature is a serious investigation among younger children. Moreover, there is…

Construct validity of adolescents' self-reported big five personality traits: importance of conceptual breadth and initial validation of a short measure.

PubMed

Morizot, Julien

2014-10-01

While there are a number of short personality trait measures that have been validated for use with adults, few are specifically validated for use with adolescents. To trust such measures, it must be demonstrated that they have adequate construct validity. According to the view of construct validity as a unifying form of validity requiring the integration of different complementary sources of information, this article reports the evaluation of content, factor, convergent, and criterion validities as well as reliability of adolescents' self-reported personality traits. Moreover, this study sought to address an inherent potential limitation of short personality trait measures, namely their limited conceptual breadth. In this study, starting with items from a known measure, after the language-level was adjusted for use with adolescents, items tapping fundamental primary traits were added to determine the impact of added conceptual breadth on the psychometric properties of the scales. The resulting new measure was named the Big Five Personality Trait Short Questionnaire (BFPTSQ). A group of expert judges considered the items to have adequate content validity. Using data from a community sample of early adolescents, the results confirmed the factor validity of the Big Five structure in adolescence as well as its measurement invariance across genders. More important, the added items did improve the convergent and criterion validities of the scales, but did not negatively affect their reliability. This study supports the construct validity of adolescents' self-reported personality traits and points to the importance of conceptual breadth in short personality measures. © The Author(s) 2014.

A meta-analytic review of self-reported, clinician-rated, and performance-based motivation measures in schizophrenia: Are we measuring the same "stuff"?

PubMed

Luther, Lauren; Firmin, Ruth L; Lysaker, Paul H; Minor, Kyle S; Salyers, Michelle P

2018-04-07

An array of self-reported, clinician-rated, and performance-based measures has been used to assess motivation in schizophrenia; however, the convergent validity evidence for these motivation assessment methods is mixed. The current study is a series of meta-analyses that summarize the relationships between methods of motivation measurement in 45 studies of people with schizophrenia. The overall mean effect size between self-reported and clinician-rated motivation measures (r = 0.27, k = 33) was significant, positive, and approaching medium in magnitude, and the overall effect size between performance-based and clinician-rated motivation measures (r = 0.21, k = 11) was positive, significant, and small in magnitude. The overall mean effect size between self-reported and performance-based motivation measures was negligible and non-significant (r = -0.001, k = 2), but this meta-analysis was underpowered. Findings suggest modest convergent validity between clinician-rated and both self-reported and performance-based motivation measures, but additional work is needed to clarify the convergent validity between self-reported and performance-based measures. Further, there is likely more variability than similarity in the underlying construct that is being assessed across the three methods, particularly between the performance-based and other motivation measurement types. These motivation assessment methods should not be used interchangeably, and measures should be more precisely described as the specific motivational construct or domain they are capturing. Copyright © 2018 Elsevier Ltd. All rights reserved.

An implicit non-self-report measure of attitudes to speeding: development and validation.

PubMed

Hatfield, Julie; Fernandes, Ralston; Faunce, Gavin; Job, R F Soames

2008-03-01

Speeding is a major contributor to road trauma and attitudes toward speeding are hypothesised to be a key determinant of the behaviour. Attitudinal research is limited by reliance on self-report measures and the attendant possibility of reporting biases. The Implicit Association Test (IAT) aims to measure attitudes without reliance on self-report, by assessing the association between a target-concept and an evaluation, in terms of reaction time for compatible versus non-compatible pairings. The present research aimed to develop and evaluate an IAT to measure attitudes to speeding. Forty-five licensed drivers completed the speed-related IAT, and drove a driving simulator. Participants also completed a questionnaire that assessed self-reported attitudes to speeding, and several variables theoretically related to attitudes, including speeding behaviour. Observed IAT results suggested that attitudes toward speeding are negative, and were generally consistent with results derived from the simulated driving and self-reported behaviours, beliefs, and attitudes. Thus, the speed-related IAT appears to be a valid measure of attitudes toward speeding, which might be used to measure attitudes in road safety research without reliance on self-report.

Self-report: psychology's four-letter word.

PubMed

Haeffel, Gerald J; Howard, George S

2010-01-01

Self-report continues to be one of the most widely used measurement strategies in psychology despite longstanding concerns about its validity and scientific rigor. In this article, the merits of self-report are examined from a philosophy of science perspective. A framework is also provided for evaluating self-report measures. Specifically, four issues are presented that can be used as a decision aid when making choices about measurement.

Development and preliminary validation of a self-report measure of psychopathic personality traits in noncriminal populations.

PubMed

Lilienfeld, S O; Andrews, B P

1996-06-01

Research on psychopathology has been hindered by persisting difficulties and controversies regarding its assessment. The primary goals of this set of studies were to (a) develop, and initiate the construct validation of, a self-report measure that assesses the major personality traits of psychopathy in noncriminal populations and (b) clarify the nature of these traits via an exploratory approach to test construction. This measure, the Psychopathic Personality Inventory (PPI), was developed by writing items to assess a large number of personality domains relevant to psychopathy and performing successive item-level factor analyses and revisions on three undergraduate samples. The PPI total score and its eight subscales were found to possess satisfactory internal consistency and test-retest reliability. In four studies with undergraduates, the PPI and its subscales exhibited a promising pattern of convergent and discriminant validity with self-report, psychiatric interview, observer rating, and family history data. In addition, the PPI total score demonstrated incremental validity relative to several commonly used self-report psychopathy-related measures. Future construct validation studies, unresolved conceptual issues regarding the assessment of psychopathy, and potential research uses of the PPI are outlined.

Validity of self-reported anthropometry in adult Mexican women.

PubMed

Ortiz-Panozo, Eduardo; Yunes-Díaz, Elsa; Lajous, Martin; Romieu, Isabelle; Monge, Adriana; López-Ridaura, Ruy

2017-01-01

To compare direct and self-reported anthropometry in Mexican women. Women aged 30-72 years, participating in the Mexican Teachers' Cohort, completed a questionnaire with their anthropometric data in 2006-2008. After eleven months (median time), technicians performed anthropometry in 3756 participants. We calculated correlations and multivariable-adjusted mean differences between direct and self-reported anthropometric measures. Correlations between direct and self-reported anthropometric measures ranged from 0.78 (waist circumference) to 0.93 (weight). On average, women over-reported their height by 2.2 cm and underreported their weight, body mass index (BMI) and waist and hip circumferences by 1.3 kg, 1.3 kg/m2, 1.8 cm and 1.9 cm, respectively. Errors in self-reported anthropometry increased with rising measured BMI and were also independently associated with age, education and socioeconomic status. Self-reported anthropometry is sufficiently valid for epidemiological purposes in adult Mexican women. Errors in self-reported anthropometry might result in underestimation of the prevalence of overweight and obesity.

Examining the validity of self-reports on scales measuring students' strategic processing.

PubMed

Samuelstuen, Marit S; Bråten, Ivar

2007-06-01

Self-report inventories trying to measure strategic processing at a global level have been much used in both basic and applied research. However, the validity of global strategy scores is open to question because such inventories assess strategy perceptions outside the context of specific task performance. The primary aim was to examine the criterion-related and construct validity of the global strategy data obtained with the Cross-Curricular Competencies (CCC) scale. Additionally, we wanted to compare the validity of these data with the validity of data obtained with a task-specific self-report inventory focusing on the same types of strategies. The sample included 269 10th-grade students from 12 different junior high schools. Global strategy use as assessed with the CCC was compared with task-specific strategy use reported in three different reading situations. Moreover, relationships between scores on the CCC and scores on measures of text comprehension were examined and compared with relationships between scores on the task-specific strategy measure and the same comprehension measures. The comparison between the CCC strategy scores and the task-specific strategy scores suggested only modest criterion-related validity for the data obtained with the global strategy inventory. The CCC strategy scores were also not related to the text comprehension measures, indicating poor construct validity. In contrast, the task-specific strategy scores were positively related to the comprehension measures, indicating good construct validity. Attempts to measure strategic processing at a global level seem to have limited validity and utility.

Evaluation of the Validity and Response Burden of Patient Self-Report Measures of the Pain Assessment Screening Tool and Outcomes Registry (PASTOR).

PubMed

Cook, Karon F; Kallen, Michael A; Buckenmaier, Chester; Flynn, Diane M; Hanling, Steven R; Collins, Teresa S; Joltes, Kristin; Kwon, Kyung; Medina-Torne, Sheila; Nahavandi, Parisa; Suen, Joshua; Gershon, Richard

2017-07-01

In 2009, the Army Pain Management Task Force was chartered. On the basis of their findings, the Department of Defense recommended a comprehensive pain management strategy that included development of a standardized pain assessment system that would collect patient-reported outcomes data to inform the patient-provider clinical encounter. The result was the Pain Assessment Screening Tool and Outcomes Registry (PASTOR). The purpose of this study was to assess the validity and response burden of the patient-reported outcome measures in PASTOR. Data for analyses were collected from 681 individuals who completed PASTOR at baseline and follow-up as part of their routine clinical care. The survey tool included self-report measures of pain severity and pain interference (measured using the National Institutes of Health Patient-Reported Outcome Measurement Information System [PROMIS] and the Defense and Veterans Pain Rating scale). PROMIS measures of pain correlates also were administered. Validation analyses included estimation of score associations among measures, comparison of scores of known groups, responsiveness, ceiling and floor effects, and response burden. Results of psychometric testing provided substantial evidence for the validity of PASTOR self-report measures in this population. Expected associations among scores largely supported the concurrent validity of the measures. Scores effectively distinguished among respondents on the basis of their self-reported impressions of general health. PROMIS measures were administered using computer adaptive testing and each, on average, required less than 1 minute to administer. Statistical and graphical analyses demonstrated the responsiveness of PASTOR measures over time. Reprint & Copyright © 2017 Association of Military Surgeons of the U.S.

The Children's Report of Sleep Patterns: Validity and Reliability of the Sleep Hygiene Index and Sleep Disturbances Scale in Adolescents

PubMed Central

Meltzer, Lisa J.; Brimeyer, Chasity; Russell, Kathryn; Avis, Kristin T.; Biggs, Sarah; Reynolds, Amy C.; Crabtree, Valerie McLaughlin

2014-01-01

Objective Sleep is critical for adolescent health and well-being. However, there are a limited number of validated self-report measures of sleep for adolescents, and no well-validated measures of sleep that can be used across middle childhood and adolescence. The Children's Report of Sleep Patterns (CRSP) has already been validated in children ages 8-12 years. The purpose of this study was to examine the psychometric properties of the CRSP as a multidimensional, self-report sleep measure for adolescents. Methods Participants included 570 adolescents aged 13 – 18 years, 60% female, recruited from pediatricians’ offices, sleep clinics, children's hospitals, schools, and the general population. A multi-method, multi-reporter approach was used to validate the CRSP. Along with the CRSP, a subset of the sample completed the Adolescent Sleep Hygiene Scale (ASHS), with a different subset of adolescents undergoing polysomnography. Results The CRSP demonstrated good reliability and validity. Group differences on the CRSP were found for adolescents presenting to a sleep or medical clinic (vs. community sample), for older adolescents (vs. younger adolescents), those who regularly napped (vs. infrequently napped), and those with poor sleep quality (vs. good sleep quality). Self-reported sleep quality in adolescents was also associated with higher apnea-hypopnea index scores from polysomnography. Finally, the CRSP Sleep Hygiene Indices were significantly correlated with indices of the ASHS. Conclusions The CRSP is a valid and reliable measure of adolescent sleep hygiene and sleep disturbances. With a parallel version for middle childhood (8-12 years), the CRSP likely provides clinicians and researchers the ability to measure self-reported sleep across development. PMID:25441749

[Measurement properties of self-report questionnaires published in Korean nursing journals].

PubMed

Lee, Eun-Hyun; Kim, Chun-Ja; Kim, Eun Jung; Chae, Hyun-Ju; Cho, Soo-Yeon

2013-02-01

The purpose of this study was to evaluate measurement properties of self-report questionnaires for studies published in Korean nursing journals. Of 424 Korean nursing articles initially identified, 168 articles met the inclusion criteria. The methodological quality of the measurements used in the studies and interpretability were assessed using the COnsensus-based Standards for the selection of health Measurement INstruments (COSMIN) checklist. It consists of items on internal consistency, reliability, measurement error, content validity, construct validity including structural validity, hypothesis testing, cross-cultural validity, and criterion validity, and responsiveness. For each item of the COSMIN checklist, measurement properties are rated on a four-point scale: excellent, good, fair, and poor. Each measurement property is scored with worst score counts. All articles used the classical test theory for measurement properties. Internal consistency (72.6%), construct validity (56.5%), and content validity (38.2%) were most frequently reported properties being rated as 'excellent' by COSMIN checklist, whereas other measurement properties were rarely reported. A systematic review of measurement properties including interpretability of most instruments warrants further research and nursing-focused checklists assessing measurement properties should be developed to facilitate intervention outcomes across Korean studies.

Comparative validation of self-report measures of negative attitudes towards Aboriginal Australians and Torres Strait Islanders.

PubMed

Skinner, Timothy C; Blick, Julie; Coffin, Juli; Dudgeon, Pat; Forrest, Simon; Morrison, David

2013-01-01

This study sought to determine the construct validity of two self-report measures of attitudes towards Aboriginal Australians and Torres Strait Islanders against an implicit measure of attitude. Total of 102 volunteer participants completed the three measures in a randomized order. The explicit measures of prejudice towards Aboriginal Australians were the Modern Racism Scale (MRS) and the Attitudes Towards Indigenous Australians Scale (ATIAS). The implicit attitudes measure was an adaptation of the Implicit Association Test (IAT) and utilised simple drawn head-and-shoulder images of Aboriginal Australians and White Australians as the stimuli. Both explicit measures and implicit measure varied in the extent to which negative prejudicial attitudes were held by participants, and the corresponding construct validities were unimpressive. The MRS was significantly correlated with the IAT, (r =.314;p<.05) where the ATIAS was not significantly correlated with IAT scores (r =.12). Of the two self-report measures of attitudes towards Aboriginal Australians, only the MRS evidenced validity when compared with the use of an implicit attitude measure.

Self-Report Measures of Family Competence.

ERIC Educational Resources Information Center

Green, Robert G.

1987-01-01

Describes and compares two self-report measures of family competence: the Family Awareness Scales (FAS) (Green and Kolevzon, late 1970s) and the Self-Report Family Inventory (SFI) (Beavers, 1983). Discusses reliability and validity. Their focus on the "insider" (family member) is different from the traditional examination of family…

Parent- and Self-Reported Dimensions of Oppositionality in Youth: Construct Validity, Concurrent Validity, and the Prediction of Criminal Outcomes in Adulthood

ERIC Educational Resources Information Center

Aebi, Marcel; Plattner, Belinda; Metzke, Christa Winkler; Bessler, Cornelia; Steinhausen, Hans-Christoph

2013-01-01

Background: Different dimensions of oppositional defiant disorder (ODD) have been found as valid predictors of further mental health problems and antisocial behaviors in youth. The present study aimed at testing the construct, concurrent, and predictive validity of ODD dimensions derived from parent- and self-report measures. Method: Confirmatory…

Examining the Validity of Self-Reports on Scales Measuring Students' Strategic Processing

ERIC Educational Resources Information Center

Samuelstuen, Marit S.; Braten, Ivar

2007-01-01

Background: Self-report inventories trying to measure strategic processing at a global level have been much used in both basic and applied research. However, the validity of global strategy scores is open to question because such inventories assess strategy perceptions outside the context of specific task performance. Aims: The primary aim was to…

Self-Disclosure Between Friends: A Validity Study

ERIC Educational Resources Information Center

Panyard, Christine Marie

1973-01-01

Subjects reported that they had disclosed approximately the same amount of information as they had received. The consensual validation of the amount of personal information exchanged between friends suggested that the Self-Disclosure Questionnaire is a valid measure of self-disclosure to a specific target person. (Author)

Validity of injecting drug users' self report of hepatitis A, B, and C.

PubMed

Schlicting, Erin G; Johnson, Mark E; Brems, Christiane; Wells, Rebecca S; Fisher, Dennis G; Reynolds, Grace

2003-01-01

To test the validity of drug users self-reports of diseases associated with drug use, in this case hepatitis A, B, and C. Injecting drug users (n = 653) were recruited and asked whether they had been diagnosed previously with hepatitis A, B, and/or C. These self-report data were compared to total hepatitis A antibody, hepatitis B core antibody, and hepatitis C antibody seromarkers as a means of determining the validity of the self-reported information. Anchorage, Alaska. Criteria for inclusion included being at least 18-years old; testing positive on urinalysis for cocaine metabolites, amphetamine, or morphine; having visible signs of injection (track marks). Serological testing for hepatitis A, B, and C. Findings indicate high specificity, low sensitivity, and low kappa coefficients for all three self-report measures. Subgroup analyses revealed significant differences in sensitivity associated with previous substance abuse treatment experience for hepatitis B self-report and with gender for hepatitis C self-report. Given the low sensitivity, the validity of drug users, self-reported information on hepatitis should be considered with caution.

Getting precise and pragmatic about the assessment of bullying: the development of the California Bullying Victimization Scale.

PubMed

Felix, Erika D; Sharkey, Jill D; Green, Jennifer Greif; Furlong, Michael J; Tanigawa, Diane

2011-01-01

Accurate assessment of bullying is essential to intervention planning and evaluation. Limitations to many currently available self-report measures of bullying victimization include a lack of psychometric information, use of the emotionally laden term "bullying" in definition-first approaches to self-report surveys, and not assessing all components of the definition of bullying (chronicity, intentionality, and imbalance of power) in behavioral-based self-report methods. To address these limitations, we developed the California Bullying Victimization Scale (CBVS), which is a self-report scale that measures the three-part definition of bullying without the use of the term bully. We examined test-retest reliability and the concurrent and predictive validity of the CBVS across students in Grades 5-12 in four central California schools. Concurrent validity was assessed by comparing the CBVS with a common, definition-based bullying victimization measure. Predictive validity was examined through the co-administration of measures of psychological well-being. Analysis by grade and gender are included. Results support the test-retest reliability of the CBVS over a 2-week period. The CBVS was significantly, positively correlated with another bullying assessment and was related in expected directions to measures of well-being. Implications for differentiating peer victimization and bullying victimization via self-report measures are discussed. © 2011 Wiley-Liss, Inc.

Evaluating the validity of self-reported smoking in Mexican adolescents

PubMed Central

Valladolid-López, María del Carmen; Barrientos-Gutiérrez, Tonatiuh; Reynales-Shigematsu, Luz Myriam; Thrasher, James F; Peláez-Ballestas, Ingris; Lazcano-Ponce, Eduardo; Hernández-Ávila, Mauricio

2015-01-01

Objectives We aimed to evaluate the validity of the self-reported smoking indicator used in the Global Youth Tobacco Survey (GYTS). Setting 43 middle and high-school classrooms from 26 schools were selected from Mexico City and Cuernavaca, Morelos. Participants A total of 1257 students provided both a questionnaire and a urine sample. Primary and secondary outcome Sensitivity and specificity of self-reported smoking compared to urinary cotinine. Validity indices were evaluated by subgroups of gender, social acceptability of smoking (ie, smoking parents or friends) and smoking frequency. Results Sensitivity and specificity for current smoking were 93.2% and 81.7%, respectively. Validity indices remained stable across gender. Parental smoking status moderated the validity of self-report, which had lower sensitivity in adolescents with non-smoking parents (86.7%) than in adolescents with smoking parents (96.6%). Sensitivity and specificity increased with smoking frequency. Conclusions This first validation study of self-reported current smoking used in the GYTS among Mexican adolescents suggests that self-reported smoking in the past 30 days is a valid and stable indicator of current smoking behaviour. This measure appears suitable for public health research and surveillance. PMID:26453588

Validity of self-reported family history of cancer: A systematic literature review on selected cancers.

PubMed

Fiederling, Jonas; Shams, Ahmad Zia; Haug, Ulrike

2016-10-01

Evidence regarding validity of self-reported family history of cancer (FHC) has been reviewed only for breast, colorectal, prostate, ovarian, endometrial and uterine cancer. We aimed to systematically review studies assessing validity of self-reported family history for the remaining cancer sites. We searched the Medline database for relevant studies published by January 2016. We extracted information on the study design and the positive predictive value (PPV) of self-reported FHC, defined as the proportion of reported cancer diagnoses among relatives that was confirmed by a reference standard (as a measure of over-reporting). We also extracted information on sensitivity of self-reported FHC (as a measure of underreporting). Overall, 21 studies were included that provided information on the PPV of self-reported FHC for relevant cancers and four studies also provided information on sensitivity. The PPV was highest (mostly >70%) for pancreatic, lung, thyroid and urinary system cancers and for leukemia and lymphoma, while it was lowest for stomach and liver cancer. Sensitivity was highest (>70%) for pancreatic cancer, lung cancer, brain cancer, melanoma, leukemia and lymphoma. For several cancers, sample sizes were low and the number of studies limited, particularly regarding sensitivity of self-reported FHC. In conclusion, for some cancers (e.g., pancreatic cancer, lung cancer, leukemia, lymphoma) self-reported FHC can be considered sufficiently valid to be useful, for example, in preventive counseling. For several cancers, it is not sufficiently studied or the pattern is inconsistent. This needs to be taken into account when using self-reported information about FHC in clinical practice or epidemiological research. © 2016 UICC.

Systematic Review of Self-Report Measures of Pain Intensity in 3- and 4-Year-Old Children: Bridging a Period of Rapid Cognitive Development.

PubMed

von Baeyer, Carl L; Jaaniste, Tiina; Vo, Henry L T; Brunsdon, Georgie; Lao, Hsuan-Chih; Champion, G David

2017-09-01

Claims are made for the validity of some self-report pain scales for 3- and 4-year-old children, but little is known about their ability to use such tools. This systematic review identified self-report pain intensity measures used with 3- and/or 4- year-old participants (3-4yo) and considered their reliability and validity within this age span. The search protocol identified research articles that included 3-4yo, reported use of any pain scale, and included self-reported pain intensity ratings. A total of 1,590 articles were screened and 617 articles met inclusion criteria. Of the included studies, 98% aggregated self-report data for 3-4yo with data for older children, leading to overestimates of the reliability and validity of self-report in the younger age group. In the 14 studies that provided nonaggregated data for 3-4yo, there was no evidence for 3-year-old and weak evidence for 4-year-old children being able to use published self-report pain intensity tools in a valid or reliable way. Preschool-age children have been reported to do better with fewer than the 6 response options offered on published faces scales. Simplified tools are being developed for young children; however, more research is needed before these are adopted. Some self-report pain scales have been promoted for use with 3- and 4-year-old children, but this is on the basis of studies that aggregated data for younger and older children, resulting in overestimates of reliability and validity for the preschool-age children. Scales with fewer response options show promise, at least for 4-year-old children. Copyright © 2017 American Pain Society. Published by Elsevier Inc. All rights reserved.

Reply to "Further issues in determining the readability of self-report items: comment on McHugh and Behar (2009)".

PubMed

McHugh, R Kathryn; Behar, Evelyn

2012-12-01

In his commentary on our previously published article "Readability of Self-Report Measures of Depression and Anxiety," J. Schinka (2012) argued for the importance of considering readability of patient materials and highlighted limitations of existing methodologies for this assessment. Schinka's commentary articulately described the weaknesses of readability assessment and emphasized the importance of the development of improved strategies for assessing readability to maximize the validity of self-report measures in applied settings. In our reply, we support and extend Schinka's argument, highlighting the importance of consideration of the range of factors (e.g., use of reverse-scored items) that may increase respondent difficulty with comprehension. Consideration of the readability of self-report symptom measures is critical to the validity of these measures in both clinical practice and research settings.

Maslach Burnout Inventory and a Self-Defined, Single-Item Burnout Measure Produce Different Clinician and Staff Burnout Estimates.

PubMed

Knox, Margae; Willard-Grace, Rachel; Huang, Beatrice; Grumbach, Kevin

2018-06-04

Clinicians and healthcare staff report high levels of burnout. Two common burnout assessments are the Maslach Burnout Inventory (MBI) and a single-item, self-defined burnout measure. Relatively little is known about how the measures compare. To identify the sensitivity, specificity, and concurrent validity of the self-defined burnout measure compared to the more established MBI measure. Cross-sectional survey (November 2016-January 2017). Four hundred forty-four primary care clinicians and 606 staff from three San Francisco Aarea healthcare systems. The MBI measure, calculated from a high score on either the emotional exhaustion or cynicism subscale, and a single-item measure of self-defined burnout. Concurrent validity was assessed using a validated, 7-item team culture scale as reported by Willard-Grace et al. (J Am Board Fam Med 27(2):229-38, 2014) and a standard question about workplace atmosphere as reported by Rassolian et al. (JAMA Intern Med 177(7):1036-8, 2017) and Linzer et al. (Ann Intern Med 151(1):28-36, 2009). Similar to other nationally representative burnout estimates, 52% of clinicians (95% CI: 47-57%) and 46% of staff (95% CI: 42-50%) reported high MBI emotional exhaustion or high MBI cynicism. In contrast, 29% of clinicians (95% CI: 25-33%) and 31% of staff (95% CI: 28-35%) reported "definitely burning out" or more severe symptoms on the self-defined burnout measure. The self-defined measure's sensitivity to correctly identify MBI-assessed burnout was 50.4% for clinicians and 58.6% for staff; specificity was 94.7% for clinicians and 92.3% for staff. Area under the receiver operator curve was 0.82 for clinicians and 0.81 for staff. Team culture and atmosphere were significantly associated with both self-defined burnout and the MBI, confirming concurrent validity. Point estimates of burnout notably differ between the self-defined and MBI measures. Compared to the MBI, the self-defined burnout measure misses half of high-burnout clinicians and more than 40% of high-burnout staff. The self-defined burnout measure has a low response burden, is free to administer, and yields similar associations across two burnout predictors from prior studies. However, the self-defined burnout and MBI measures are not interchangeable.

Mindful attention and awareness: relationships with psychopathology and emotion regulation.

PubMed

Gregório, Sónia; Pinto-Gouveia, José

2013-01-01

The growing interest in mindfulness from the scientific community has originated several self-report measures of this psychological construct. The Mindful Attention and Awareness Scale (MAAS) is a self-report measure of mindfulness at a trait-level. This paper aims at exploring MAAS psychometric characteristics and validating it for the Portuguese population. The first two studies replicate some of the original author's statistical procedures in two different samples from the Portuguese general community population, in particular confirmatory factor analyses. Results from both analyses confirmed the scale single-factor structure and indicated a very good reliability. Moreover, cross-validation statistics showed that this single-factor structure is valid for different respondents from the general community population. In the third study the Portuguese version of the MAAS was found to have good convergent and discriminant validities. Overall the findings support the psychometric validity of the Portuguese version of MAAS and suggest this is a reliable self-report measure of trait-mindfulness, a central construct in Clinical Psychology research and intervention fields.

Measuring Student Motivation in High School Physical Education: Development and Validation of Two Self-Report Questionnaires

ERIC Educational Resources Information Center

Sulz, Lauren; Temple, Viviene; Gibbons, Sandra

2016-01-01

The aim of this research was to develop measures to provide valid and reliable representation of the motivational states and psychological needs proposed by the self-determination theory (Deci & Ryan, 1985, 2000) within a physical education context. Based on theoretical underpinnings of self-determination theory, two questionnaires were…

Development and Validation of the Guided Group Discussion Self-Estimate Inventory (GGD-SEI).

ERIC Educational Resources Information Center

Martin, David; Campbell, Bill

1998-01-01

A 19-item self-report measure was designed to promote increased self-awareness of a group leader's perceived ability to facilitate small group discussion. Results of analysis show high reliability and validity. The instrument, developed for use within education and training settings, provides a useful measure of guided small-group discussion…

A Meta-Analysis of the Convergent Validity of Self-Control Measures

PubMed Central

Duckworth, Angela Lee; Kern, Margaret L.

2011-01-01

There is extraordinary diversity in how the construct of self-control is operationalized in research studies. We meta-analytically examined evidence of convergent validity among executive function, delay of gratification, and self- and informant-report questionnaire measures of self-control. Overall, measures demonstrated moderate convergence (rrandom = .27 [95% CI = .24, .30]; rfixed = .34 [.33, .35], k = 282 samples, N = 33,564 participants), although there was substantial heterogeneity in the observed correlations. Correlations within and across types of self-control measures were strongest for informant-report questionnaires and weakest for executive function tasks. Questionnaires assessing sensation seeking impulses could be distinguished from questionnaires assessing processes of impulse regulation. We conclude that self-control is a coherent but multidimensional construct best assessed using multiple methods. PMID:21643479

The Utility of the Mayo-Portland Adaptability Inventory Participation Index (M2PI) in US Military Veterans With a History of Mild Traumatic Brain Injury.

PubMed

OʼRourke, Justin; Critchfield, Edan; Soble, Jason; Bain, Kathleen; Fullen, Chrystal; Eapen, Blessen

2018-05-31

To examine the utility of the Mayo-Portland Adaptability Inventory-4th Edition Participation Index (M2PI) as a self-report measure of functional outcome following mild traumatic brain injury (mTBI) in US Military veterans. Department of Veterans Affairs Polytrauma Rehabilitation Center specialty hospital. On hundred thirty-nine veterans with a history of self-reported mTBI. Retrospective cross-sectional examination of data collected from regular clinical visits. M2PI, Neurobehavioral Symptoms Inventory with embedded validity measures, Posttraumatic Stress Disorder Checklist-Military Version. Forty-one percent of the sample provided symptom reports that exceeded established cut scores on embedded symptom validity tests. Invalid responders had higher levels of unemployment and endorsed significantly greater functional impairment, posttraumatic stress symptoms, and postconcussive complaints. For valid responders, regression analyses revealed that self-reported functioning was primarily related to posttraumatic stress complaints, followed by postconcussive cognitive complaints. For invalid responders, posttraumatic stress complaints also predicted self-reported functioning. Caution is recommended when utilizing the M2PI to measure functional outcome following mTBI in military veterans, particularly in the absence of symptom validity tests.

Validity of self-reported height and weight in 4808 EPIC-Oxford participants.

PubMed

Spencer, Elizabeth A; Appleby, Paul N; Davey, Gwyneth K; Key, Timothy J

2002-08-01

To assess the validity of self-reported height and weight by comparison with measured height and weight in a sample of middle-aged men and women, and to determine the extent of misclassification of body mass index (BMI) arising from differences between self-reported and measured values. Analysis of self-reported and measured height and weight data from participants in the Oxford cohort of the European Prospective Investigation into Cancer and Nutrition (EPIC-Oxford). Four thousand eight hundred and eight British men and women aged 35-76 years. Spearman rank correlations between self-reported and measured height, weight and BMI were high (r > 0.9, P < 0.0001). Height was overestimated by a mean of 1.23 (95% confidence interval (CI) 1.11-1.34) cm in men and 0.60 (0.51-0.70) cm in women; the extent of overestimation was greater in older men and women, shorter men and heavier women. Weight was underestimated by a mean of 1.85 (1.72-1.99) kg in men and 1.40 (1.31-1.49) kg in women; the extent of underestimation was greater in heavier men and women, but did not vary with age or height. Using standard categories of BMI, 22.4% of men and 18.0% of women were classified incorrectly based on self-reported height and weight. After correcting the self-reported values using predictive equations derived from a 10% sample of subjects, misclassification decreased to 15.2% in men and 13.8% in women. Self-reported height and weight data are valid for identifying relationships in epidemiological studies. In analyses where anthropometric factors are the primary variables of interest, measurements in a representative sample of the study population can be used to improve the accuracy of estimates of height, weight and BMI.

Implicit Sex Guilt Predicts Sexual Behaviors: Evidence for the Validity of the Sex Guilt Implicit Association Test.

PubMed

Totonchi, Delaram A; Derlega, Valerian J; Janda, Louis H

2018-05-14

Self-report measures of sexuality may be influenced by people's conscious concerns about confidentiality and social desirability. Alternatively, non-conscious measures (e.g., implicit association tests; IATs) are designed to minimize these validity concerns. We constructed an IAT measure of sex guilt using 154 male and female university students. The sex guilt IAT demonstrated convergent validity as it correlated with various sexual behaviors and incremental validity as it improved the prediction of several sexual behaviors beyond that provided by the Mosher sex guilt scale. We conclude that a non-conscious measure of sex guilt may complement the use of self-reports in studying sexual behaviors.

Construct Validation in Counseling Psychology Research

ERIC Educational Resources Information Center

Hoyt, William T.; Warbasse, Rosalia E.; Chu, Erica Y.

2006-01-01

Counseling psychology researchers devote little attention to theory-based measurement validation, as evidenced by cursory mention of validity issues in the method and discussion sections of published research reports. Especially, many researchers appear unaware of the limitations of correlations between pairs of self-report measures as evidence of…

Introducing a brief measure of cultural and religious identification in American Jewish identity.

PubMed

Friedlander, Myrna L; Friedman, Michelle L; Miller, Matthew J; Ellis, Michael V; Friedlander, Lee K; Mikhaylov, Vadim G

2010-07-01

The authors conducted 3 studies to develop and investigate the psychometric properties of the American Jewish Identity Scales (AJIS), a brief self-report measure that assesses cultural identification and religious identification. Study 1 assessed the content validity of the item pool using an expert panel. In Study 2, 1,884 Jewish adults completed the initial AJIS and various measures of ethnic identity, collective self-esteem, and religiosity. Using confirmatory factor analyses, the authors selected and cross-validated 33 items that loaded highly and differentially on the 2 theorized latent factors. Study 3 assessed the AJIS's short-term stability and its relation to social desirability. Tests of reliability and construct validity provided initial psychometric support for the measure and confirmed the theorized primary salience of cultural identification. Participants reported significantly more private than public collective self-esteem, and the most Jewish-identified participants reported greater private self-esteem, acculturative stress, and perceived discrimination than did their more assimilated counterparts. (c) 2010 APA, all rights reserved.

Latency-Based and Psychophysiological Measures of Sexual Interest Show Convergent and Concurrent Validity.

PubMed

Ó Ciardha, Caoilte; Attard-Johnson, Janice; Bindemann, Markus

2018-04-01

Latency-based measures of sexual interest require additional evidence of validity, as do newer pupil dilation approaches. A total of 102 community men completed six latency-based measures of sexual interest. Pupillary responses were recorded during three of these tasks and in an additional task where no participant response was required. For adult stimuli, there was a high degree of intercorrelation between measures, suggesting that tasks may be measuring the same underlying construct (convergent validity). In addition to being correlated with one another, measures also predicted participants' self-reported sexual interest, demonstrating concurrent validity (i.e., the ability of a task to predict a more validated, simultaneously recorded, measure). Latency-based and pupillometric approaches also showed preliminary evidence of concurrent validity in predicting both self-reported interest in child molestation and viewing pornographic material containing children. Taken together, the study findings build on the evidence base for the validity of latency-based and pupillometric measures of sexual interest.

Measurement of assertive behavior: construct and predictive validity of self-report, role-playing, and in-vivo measures.

PubMed

Burkhart, B R; Green, S B; Harrison, W H

1979-04-01

Examined the predictive validity and construct equivalence of the three major procedures used to measure assertive behavior: Self-report, behavioral role-playing, and in-vivo assessment. Seventy-five Ss, who spanned the range of assertiveness, completed two self-report measures of assertiveness, the Rathus Assertiveness Scale (RAS) and the College Self-Expression Scale (CSES); two scales from the Endler S-R Inventory of General Trait Anxiousness, the interpersonal and general anxiety scales; eight role-playing situations that involved the expression of positive and negative assertiveness; and a telephone in-vivo task. In general, the study revealed the following: (1) assertiveness measures are task-dependent in that there was more overlap within task than between tasks; (2) there is a moderate degree of correspondence between self-report and role-playing measures, although this was true only for negative assertion; (3) positive and negative assertion do not appear to have the same topography of responding; and (4) there appears to be no consistent relationship between the in-vivo measure and any other type of assertiveness measure.

International development and psychometric properties of the Child and Adolescent Trauma Screen (CATS).

PubMed

Sachser, Cedric; Berliner, Lucy; Holt, Tonje; Jensen, Tine K; Jungbluth, Nathaniel; Risch, Elizabeth; Rosner, Rita; Goldbeck, Lutz

2017-03-01

Systematic screening is a powerful means by which children and adolescents with posttraumatic stress symptoms (PTSS) can be detected. Reliable and valid measures based on current diagnostic criteria are needed. To investigate the internal consistency and construct validity of the Child and Adolescent Trauma Screen (CATS) in three samples of trauma-exposed children in the US (self-reports: n=249; caregiver reports: n=267; pre-school n=190), in Germany (self-reports: n=117; caregiver reports: n=95) and in Norway (self-reports: n=109; caregiver reports: n=62). Internal consistency was calculated using Cronbach's α. Convergent-discriminant validity was investigated using bivariate correlation coefficients with measures of depression, anxiety and externalizing symptoms. CFA was used to investigate the DSM-5 factor structure. In all three language samples the 20 item symptom score of the self-report and the caregiver report proved good to excellent reliability with α ranging between .88 and .94. The convergent-discriminant validity pattern showed medium to strong correlations with measures of depression (r =.62-.82) and anxiety (r =.40-.77) and low to medium correlations with externalizing symptoms (r =-.15-.43) within informants in all language versions. Using CFA the underlying DSM-5 factor structure with four symptom clusters (re-experiencing, avoidance, negative alterations in mood and cognitions, hyperarousal) was supported (n =475 for self-report; n =424 for caregiver reports). The external validation of the CATS with a DSM-5 based semi-structured clinical interview and corresponding determination of cut-points is pending. The CATS has satisfactory psychometric properties. Clinicians may consider the CATS as a screening tool and for symptom monitoring. Copyright © 2016 Elsevier B.V. All rights reserved.

Validity and concordance between self-reported and clinical diagnosis of hypertension among elderly residents in northeastern Brazil.

PubMed

de Menezes, Tarciana Nobre; Oliveira, Elaine Cristina Tôrres; de Sousa Fischer, Milena Abreu Tavares

2014-02-01

Self-reported information has been used as an easy and quick method to estimate the prevalence of systemic hypertension in populations. However, verification of whether self-reports of the disease are consistent with clinical diagnosis is essential for proper use of this information. This study aimed to verify the validity and concordance between self-reported and clinical diagnosis of hypertension in the elderly population of a city in northeastern Brazil. This was a cross-sectional and population-based study. The prevalence of diagnosed and self-reported hypertension and the validity and concordance between self-reported and clinical diagnosis and their distribution according to demographic and socioeconomic variables were assessed. The validity of self-reported hypertension was determined by sensitivity, specificity, and positive and negative predictive value. Overall, 795 elderly patients were evaluated (69.1% women). There was a high prevalence of hypertension among the elderly (diagnosed: 75.1%, 95% confidence interval (CI) = 71.1%-77.9%; self-reported: 59.7%, 95% CI = 56.3%-63.1%). For self-reported hypertension, sensitivity was substantial (77.1%), specificity was excellent (93.4%), positive predictive value was excellent (97.3%), and negative predictive value was moderate (57.2%). There was a moderate concordance between self-reported and clinical diagnosis of hypertension (kappa = 0.59; P < 0.001). Reasonable validity and moderate concordance of self-reported information on hypertension was observed, which reinforces the idea that this information can be used as strategy for detecting the disease prevalence in this population. However, because of nonachievement of excellence in the validity and reliability of the measured blood pressure, this information should be carefully considered for the strategic planning of health services.

Validating the Factor Structure of the Self-Report Psychopathy Scale in a Community Sample

ERIC Educational Resources Information Center

Mahmut, Mehmet K.; Menictas, Con; Stevenson, Richard J.; Homewood, Judi

2011-01-01

Currently, there is no standard self-report measure of psychopathy in community-dwelling samples that parallels the most commonly used measure of psychopathy in forensic and clinical samples, the Psychopathy Checklist. A promising instrument is the Self-Report Psychopathy scale (SRP), which was derived from the original version the Psychopathy…

Validation of self-reported cannabis dose and potency: an ecological study.

PubMed

van der Pol, Peggy; Liebregts, Nienke; de Graaf, Ron; Korf, Dirk J; van den Brink, Wim; van Laar, Margriet

2013-10-01

To assess the reliability and validity of self-reported cannabis dose and potency measures. Cross-sectional study comparing self-reports with objective measures of amount of cannabis and delta-9-tetrahydrocannabinol (THC) concentration. Ecological study with assessments at participants' homes or in a coffee shop. Young adult frequent cannabis users (n = 106) from the Dutch Cannabis Dependence (CanDep) study. The objectively measured amount of cannabis per joint (dose in grams) was compared with self-reported estimates using a prompt card and average number of joints made from 1 g of cannabis. In addition, objectively assessed THC concentration in the participant's cannabis was compared with self-reported level of intoxication, subjective estimate of cannabis potency and price per gram of cannabis. Objective estimates of doses per joint (0.07-0.88 g/joint) and cannabis potency (1.1-24.7%) varied widely. Self-reported measures of dose were imprecise, but at group level, average dose per joint was estimated accurately with the number of joints made from 1 g [limit of agreement (LOA) = -0.02 g, 95% confidence interval (CI) = -0.29; 0.26], whereas the prompt card resulted in serious underestimation (LOA = 0.14 g, 95% CI = -0.10; 0.37). THC concentration in cannabis was associated with subjective potency ['average' 3.77% (P = 0.002) and '(very) strong' 5.13% more THC (P < 0.001) than '(very) mild' cannabis] and with cannabis price (about 1% increase in THC concentration per euro spent on 1 g of cannabis, P < 0.001), but not with level of intoxication. Self-report measures relating to cannabis use appear at best to be associated weakly with objective measures. Of the self-report measures, number of joints per gram, cannabis price and subjective potency have at least some validity. © 2013 Society for the Study of Addiction.

Quality appraisal of generic self-reported instruments measuring health-related productivity changes: a systematic review

PubMed Central

2014-01-01

Background Health impairments can result in disability and changed work productivity imposing considerable costs for the employee, employer and society as a whole. A large number of instruments exist to measure health-related productivity changes; however their methodological quality remains unclear. This systematic review critically appraised the measurement properties in generic self-reported instruments that measure health-related productivity changes to recommend appropriate instruments for use in occupational and economic health practice. Methods PubMed, PsycINFO, Econlit and Embase were systematically searched for studies whereof: (i) instruments measured health-related productivity changes; (ii) the aim was to evaluate instrument measurement properties; (iii) instruments were generic; (iv) ratings were self-reported; (v) full-texts were available. Next, methodological quality appraisal was based on COSMIN elements: (i) internal consistency; (ii) reliability; (iii) measurement error; (iv) content validity; (v) structural validity; (vi) hypotheses testing; (vii) cross-cultural validity; (viii) criterion validity; and (ix) responsiveness. Recommendations are based on evidence syntheses. Results This review included 25 articles assessing the reliability, validity and responsiveness of 15 different generic self-reported instruments measuring health-related productivity changes. Most studies evaluated criterion validity, none evaluated cross-cultural validity and information on measurement error is lacking. The Work Limitation Questionnaire (WLQ) was most frequently evaluated with moderate respectively strong positive evidence for content and structural validity and negative evidence for reliability, hypothesis testing and responsiveness. Less frequently evaluated, the Stanford Presenteeism Scale (SPS) showed strong positive evidence for internal consistency and structural validity, and moderate positive evidence for hypotheses testing and criterion validity. The Productivity and Disease Questionnaire (PRODISQ) yielded strong positive evidence for content validity, evidence for other properties is lacking. The other instruments resulted in mostly fair-to-poor quality ratings with limited evidence. Conclusions Decisions based on the content of the instrument, usage purpose, target country and population, and available evidence are recommended. Until high-quality studies are in place to accurately assess the measurement properties of the currently available instruments, the WLQ and, in a Dutch context, the PRODISQ are cautiously preferred based on its strong positive evidence for content validity. Based on its strong positive evidence for internal consistency and structural validity, the SPS is cautiously recommended. PMID:24495301

Readability of Self-Report Alcohol Misuse Measures

PubMed Central

McHugh, R Kathryn; Sugarman, Dawn E; Kaufman, Julia S; Park, Sara; Weiss, Roger D; Greenfield, Shelly F

2014-01-01

Objective: Self-report measures of alcohol misuse and alcohol use disorders are valuable assessment tools for both research and clinical practice settings. However, readability is often overlooked when establishing the validity of these measures, which may result in measures written at a reading-grade level that is higher than the ability level of many potential respondents. The aim of the current study was to estimate the reading-grade level of validated measures of alcohol misuse and associated problems. Method: A total of 45 measures were identified, and reading-grade level was calculated using three validated readability formulas. Results: The majority of measures were written above the recommended reading-grade level for patient materials (5th–6th grade), with particularly poor readability for measure instructions. Conclusions: Given that many self-report alcohol misuse measures are written at a high reading-grade level, the consideration of readability is important when selecting measures for use in research and practice settings. Moreover, the development or modification of measures to target low-literacy populations may facilitate the broader applicability of these instruments. PMID:24650827

Acquaintance ratings of the Big Five personality traits: incremental validity beyond and interactive effects with self-reports in the prediction of workplace deviance.

PubMed

Kluemper, Donald H; McLarty, Benjamin D; Bing, Mark N

2015-01-01

It is widely established that the Big Five personality traits of conscientiousness, agreeableness, and emotional stability are antecedents to workplace deviance (Berry, Ones, & Sackett, 2007). However, these meta-analytic findings are based on self-reported personality traits. A recent meta-analysis by Oh, Wang, and Mount (2011) identified the value of acquaintance-reported personality in the prediction of job performance. The current investigation extends prior work by comparing the validities of self- and acquaintance-reported personality in the prediction of workplace deviance across 2 studies. We also hypothesized and tested an interactive, value-added integration of self- with acquaintance-reported personality using socioanalytic personality theory (R. T. Hogan, 1991). Both studies assessed self- and acquaintance-rated Big Five traits, along with supervisor-rated workplace deviance. However, the studies varied the measures of workplace deviance, and the 2nd study also included a self-rated workplace deviance criterion for additional comparison. Across both studies, the traits of conscientiousness and agreeableness were strong predictors of workplace deviance, and acquaintance-reported personality provided incremental validity beyond self-reports. Additionally, acquaintance-reported conscientiousness and agreeableness moderated the prediction of workplace deviance by interacting with the corresponding self-reported traits. Implications for personality theory and measurement are discussed along with applications for practice. (c) 2015 APA, all rights reserved.

Measurement of Assertive Behavior: Construct and Predictive Validity of Self-Report, Role-Playing, and In-Vivo Measures.

ERIC Educational Resources Information Center

Burkhart, Barry R.

1979-01-01

Seventy-five subjects, who spanned the range of assertiveness, completed two self-report measures of assertiveness, eight role-playing situations involving positive and negative assertiveness, and a telephone in-vivo task. Correlations between the three measurement methods were examined. (Author/SJL)

Development and validation of a self-report measure of emotional intelligence as a multidimensional trait domain.

PubMed

Tett, Robert P; Fox, Kevin E; Wang, Alvin

2005-07-01

Psychometric review of 33 peer-reviewed studies of six self-report emotional intelligence (EI) measures supports a multidimensional conceptualization of EI. The nature and number of EI facets, however, and their distinctiveness from more established trait domains is unclear. Building on earlier efforts, three studies were undertaken (Ns = 138, 163, 152) to develop self-report measures of 10 facets of EI proposed by Salovey and Mayer (1990). Results support the reliability (internal consistency, test-retest) and validity (content, criterion, construct, structural) of the proposed scales and their distinctiveness among themselves and with respect to more established trait domains (e.g., personality). Specifically, three satisfaction and four cross-cultural adaptability facets were predicted uniquely by 9 of the 10 proposed subscales, controlling for social desirability, the Big Five, positive and negative affect, and self-monitoring. All told, results confirm that trait-EI can be measured using self-report and conceptualized as a distinct multidimensional domain.

Assessment of Psychopathic Traits in an Incarcerated Adolescent Sample: A Methodological Comparison

ERIC Educational Resources Information Center

Fink, Brandi C.; Tant, Adam S.; Tremba, Katherine; Kiehl, Kent A.

2012-01-01

Analyses of convergent validity and group assignment using self-report, caregiver-report and interview-based measures of adolescent psychopathy were conducted in a sample of 160 incarcerated adolescents. Results reveal significant convergent validity between caregiver-report measures of adolescent psychopathy, significant convergent validity…

Comparisons of measured and self-reported anthropometric variables and blood pressure in a sample of Hong Kong female nurses.

PubMed

Xie, Yao Jie; Ho, Suzanne C; Liu, Zhao Min; Hui, Stanley Sai-Chuen

2014-01-01

To assess the validity of self-reported weight, height, body mass index (BMI), waist circumference and blood pressure compared with standardized clinical measurements and to determine the classification accuracy in overweight/obesity and central adiposity. This pilot study was integrated into a life-course study entitled "Hong Kong Women's Health Study" among 1,253 female nurses in Hong Kong who were aged 35 years to 65 years. Data were collected from self-administered questionnaires that were mailed to the respondents. Of these participants, we obtained the standard body measurements of 144 (11.5%) at our research center. We then compared the self-reported anthropometric variables and blood pressure with the measured data to assess validity based on the level of misreporting, percentage of agreement, consistency, sensitivity and specificity. The self-reported and measured values were highly correlated in terms of anthropometry and blood pressure (correlation coefficients ranged from 0.72 to 0.96). Height was overestimated at an average of 0.42 cm, and waist circumference was underestimated at 2.33 cm (both P<0.05), while no significant differences were observed from weight, blood pressure and BMI (all P>0.05). The proportions of overweight, obesity, and central adiposity by self-reported data did not vary greatly from the measured data (all P>0.05). The self-reporting resulted in correct classifications of BMI, waist circumference, and systolic blood pressure in 85%, 78%, and 87% of women, with corresponding Kappa index values of 0.79, 0.55, and 0.82, respectively. Sensitivity and specificity were 84.6% and 95.7%, respectively, with respect to overweight/obesity detection, whereas those for central adiposity detection were 70.6% and 83.8%, respectively. In a sample of female Hong Kong nurses, the self-reported measures of height, weight, BMI, waist circumference and blood pressure were generally valid. Furthermore, the classification accuracies of overweight/obesity and central adiposity were acceptable.

The Patient Assessment Questionnaire: initial validation of a measure of treatment effectiveness for patients with schizophrenia and schizoaffective disorder.

PubMed

Mojtabai, Ramin; Corey-Lisle, Patricia K; Ip, Edward Hak-Sing; Kopeykina, Irina; Haeri, Sophia; Cohen, Lisa Janet; Shumaker, Sally

2012-12-30

Investigation of patients' subjective perspective regarding the effectiveness - as opposed to efficacy - of antipsychotic medication has been hampered by a relative shortage of self-report measures of global clinical outcome. This paper presents data supporting the feasibility, inter-item consistency, and construct validity of the Patient Assessment Questionnaire (PAQ)-a self-report measure of psychiatric symptoms, medication side effects and general wellbeing, ultimately intended to assess effectiveness of interventions for schizophrenia-spectrum patients. The original 53-item instrument was developed by a multidisciplinary team which utilized brainstorming sessions for item generation and content analysis, patient focus groups, and expert panel reviews. This instrument and additional validation measures were administered, via Audio Computer-Assisted Self-Interviewing (ACASI), to 300 stable, medicated outpatients diagnosed with schizophrenia or schizoaffective disorder. Item elimination was based on psychometric properties and Item-Response Theory information functions and characteristic curves. Exploratory factor analysis of the resulting 40-item scale yielded a five factor solution. The five subscales (General Distress, Side Effects, Psychotic Symptoms, Cognitive Symptoms, Sleep) showed robust convergent (β's=0.34-0.75, average β=0.49) and discriminant validity. The PAQ demonstrates feasibility, reliability, and construct validity as a self-report measure of multiple domains pertinent to effectiveness. Future research needs to establish the PAQ's sensitivity to change. Copyright © 2012 Elsevier Ireland Ltd. All rights reserved.

A Self-Report Measure of Assertiveness in Young Adolescents.

ERIC Educational Resources Information Center

Connor, Jane M.; And Others

1982-01-01

Reported a self-report measure of adolescents' assertiveness. Items for the scale were presented to sixth-grade students. Factor analysis revealed factors of submissiveness, aggressiveness, and assertiveness. After the validational study, a small assertiveness training program indicated that training effects were obtained and could be generalized…

Validating a self-report measure of HIV viral suppression: an analysis of linked questionnaire and clinical data from the Canadian HIV Women's Sexual and Reproductive Health Cohort Study.

PubMed

Carter, Allison; de Pokomandy, Alexandra; Loutfy, Mona; Ding, Erin; Sereda, Paul; Webster, Kath; Nicholson, Valerie; Beaver, Kerrigan; Hogg, Robert S; Kaida, Angela

2017-03-24

We assessed the validity of a self-report measure of undetectable viral load (VL) among women with HIV in British Columbia (BC), Canada. Questionnaire data from the Canadian HIV Women's Sexual and Reproductive Health Cohort Study was linked with population-based clinical data from the BC Centre for Excellence in HIV/AIDS. Self-reported undetectable VL was assessed by the question: "What was your most recent VL, undetectable (i.e. <50 copies/mL) or detectable (i.e. ≥50 copies/mL)?" Laboratory measurements of VL <50 copies/mL (closest to/before study visit) were the criterion for validity analyses. We measured positive and negative predictive values (PPV, NPV) and likelihood ratios (LR+, LR-). Of 356 participants, 99% were linked to clinical data. Those unlinked (n = 1), missing self-report VL (n = 18), or missing self-report and laboratory VL (n = 1) were excluded. Among the remaining 336: median age was 44 (IQR 37-51); 96% identified as cis-gender; 84% identified as heterosexual; and 45% identified as Indigenous, 40% White, 8% African, Caribbean, or Black, and 8% other/multiple ethnicities. Overall, 85% self-reported having an undetectable VL while 82% had clinical data indicating viral suppression. The PPV was 93.7 (95% CI 90.2-96.2) indicating that 94% of women who self-reported being undetectable truly were. The NPV was 80.4 (95% CI 66.9-90.2). LR+ was 3.2 (2.1-4.6) and LR- was 0.05 (0.03-0.10). Our self-report measure assessing undetectable VL strongly predicted true viral suppression among Canadian women with HIV. This measure can be used in research settings without laboratory data in regions with high rates of VL testing and suppression.

Clinical validity of the Me and My School questionnaire: a self-report mental health measure for children and adolescents.

PubMed

Patalay, Praveetha; Deighton, Jessica; Fonagy, Peter; Vostanis, Panos; Wolpert, Miranda

2014-01-01

The Me and My School Questionnaire (M&MS) is a self-report measure for children aged eight years and above that measures emotional difficulties and behavioural difficulties, and has been previously validated in a community sample. The present study aimed to assess its clinical sensitivity to justify its utility as a screening tool in schools. Data were collected from service-users (n = 91, 8-15 years) and accompanying parent/carer in outpatient mental health services in England. A matched community sample (N = 91) were used to assess the measure's ability to discriminate between low- and high-risk samples. Receiver operating curves (area under the curve, emotional difficulties = .79; behavioural difficulties = .78), mean comparisons (effect size, emotional difficulties d = 1.17, behavioural difficulties = 1.12) and proportions above clinical thresholds indicate that the measure satisfactorily discriminates between the samples. The scales have good internal reliability (emotional difficulties α = .84; behavioural difficulties α = .82) and cross-informant agreement with parent-reported symptoms is comparable to existing measures (r = .30). The findings of this study indicate that the M&MS sufficiently discriminates between high-risk (clinic) and low-risk (community) samples, has good internal reliability, compares favourably with existing self-report measures of mental health and has comparable levels of agreement between parent-report and self-report to other measures. Alongside existing validation of the M&MS, these findings justify the measures use as a self-report screening tool for mental health problems in community settings for children aged as young as 8 years.

The Minnesota Multiphasic Personality Inventory-2-RF in Treatment-Seeking Veterans with History of Mild Traumatic Brain Injury.

PubMed

Jurick, S M; Crocker, L D; Keller, A V; Hoffman, S N; Bomyea, J; Jacobson, M W; Jak, A J

2018-05-30

This study examined the Minnesota Multiphasic Personality Inventory-Second Edition-Restructured Form (MMPI-2-RF) to better understand symptom presentation in a sample of treatment-seeking Operation Enduring Freedom/Operation Iraqi Freedom (OEF/OIF) Veterans with self-reported history of mild traumatic brain injury (mTBI). Participants underwent a comprehensive clinical neuropsychological battery including performance and symptom validity measures and self-report measures of depressive, posttraumatic, and post-concussive symptomatology. Those with possible symptom exaggeration (SE+) on the MMPI-2-RF were compared with those without (SE-) with regard to injury, psychiatric, validity, and cognitive variables. Between 50% and 87% of participants demonstrated possible symptom exaggeration on one or more MMPI-2-RF validity scales, and a large majority were elevated on content scales related to cognitive, somatic, and emotional complaints. The SE+ group reported higher depressive, posttraumatic, and post-concussive symptomatology, had higher scores on symptom validity measures, and performed more poorly on neuropsychological measures compared with the SE- group. There were no group differences with regard to injury variables or performance validity measures. Participants were more likely to exhibit possible symptom exaggeration on cognitive/somatic compared with traditional psychopathological validity scales. A sizable portion of treatment-seeking OEF/OIF Veterans demonstrated possible symptom exaggeration on MMPI-2-RF validity scales, which was associated with elevated scores on self-report measures and poorer cognitive performance, but not higher rates of performance validity failure, suggesting symptom and performance validity are distinct concepts. These findings have implications for the interpretation of clinical data in the context of possible symptom exaggeration and treatment in Veterans with persistent post-concussive symptoms.

The Reliability and Validity of the Panic Disorder Self-Report: A New Diagnostic Screening Measure of Panic Disorder

ERIC Educational Resources Information Center

Newman, Michelle G.; Holmes, Marilyn; Zuellig, Andrea R.; Kachin, Kevin E.; Behar, Evelyn

2006-01-01

This study examined the Panic Disorder Self-Report (PDSR), a new self-report diagnostic measure of panic disorder based on the 4th edition of the Diagnostic and Statistical Manual of Mental Disorders (American Psychiatric Association, 1994). PDSR diagnoses were compared with structured interview diagnoses of individuals with generalized anxiety…

Comparing the Reliability and Validity of Global Self-Report Measures of Subjective Well-Being With Experiential Day Reconstruction Measures.

PubMed

Hudson, Nathan W; Anusic, Ivana; Lucas, Richard E; Donnellan, M Brent

2017-12-01

Self-report measures of global well-being are thought to reflect the overall quality of people's lives. However, several scholars have argued that people rely on heuristics, such as current mood, when reporting their global well-being. Experiential well-being measures, such as the day reconstruction method (DRM), have been proposed as an alternative technique to obtain a potentially more accurate assessment of well-being. Across two multimethod, short-term longitudinal studies, we compared the psychometric properties of global self-reports and short-form DRM-based assessments of well-being. We evaluated their stability across one month, tested their convergent validity using self-informant agreement, and evaluated correlations with personality traits. Results indicated that global measures of well-being were more stable than DRM-based experiential measures. Self-informant agreement was also either equal across global and DRM measures or higher for global measures. Correlations with personality were similar across approaches. These findings suggest that DRM and global measures of well-being have similar psychometric properties when used to provide an overall assessment of a person's typical level of subjective well-being.

Validating the Patient Experience with Treatment and Self-Management (PETS), a patient-reported measure of treatment burden, in people with diabetes

PubMed Central

Rogers, Elizabeth A; Yost, Kathleen J; Rosedahl, Jordan K; Linzer, Mark; Boehm, Deborah H; Thakur, Azra; Poplau, Sara; Anderson, Roger T; Eton, David T

2017-01-01

Aims To validate a comprehensive general measure of treatment burden, the Patient Experience with Treatment and Self-Management (PETS), in people with diabetes. Methods We conducted a secondary analysis of a cross-sectional survey study with 120 people diagnosed with type 1 or type 2 diabetes and at least one additional chronic illness. Surveys included established patient-reported outcome measures and a 48-item version of the PETS, a new measure comprised of multi-item scales assessing the burden of chronic illness treatment and self-care as it relates to nine domains: medical information, medications, medical appointments, monitoring health, interpersonal challenges, health care expenses, difficulty with health care services, role activity limitations, and physical/mental exhaustion from self-management. Internal reliability of PETS scales was determined using Cronbach’s alpha. Construct validity was determined through correlation of PETS scores with established measures (measures of chronic condition distress, medication satisfaction, self-efficacy, and global well-being), and known-groups validity through comparisons of PETS scores across clinically distinct groups. In an exploratory test of predictive validity, step-wise regressions were used to determine which PETS scales were most associated with outcomes of chronic condition distress, overall physical and mental health, and medication adherence. Results Respondents were 37–88 years old, 59% female, 29% non-white, and 67% college-educated. PETS scales showed good reliability (Cronbach’s alphas ≥0.74). Higher PETS scale scores (greater treatment burden) were correlated with more chronic condition distress, less medication convenience, lower self-efficacy, and worse general physical and mental health. Participants less (versus more) adherent to medications and those with more (versus fewer) health care financial difficulties had higher mean PETS scores. Medication burden was the scale that was most consistently associated with well-being and patient-reported adherence. Conclusion The PETS is a reliable and valid measure for assessing perceived treatment burden in people coping with diabetes. PMID:29184456

Validating the Patient Experience with Treatment and Self-Management (PETS), a patient-reported measure of treatment burden, in people with diabetes.

PubMed

Rogers, Elizabeth A; Yost, Kathleen J; Rosedahl, Jordan K; Linzer, Mark; Boehm, Deborah H; Thakur, Azra; Poplau, Sara; Anderson, Roger T; Eton, David T

2017-01-01

To validate a comprehensive general measure of treatment burden, the Patient Experience with Treatment and Self-Management (PETS), in people with diabetes. We conducted a secondary analysis of a cross-sectional survey study with 120 people diagnosed with type 1 or type 2 diabetes and at least one additional chronic illness. Surveys included established patient-reported outcome measures and a 48-item version of the PETS, a new measure comprised of multi-item scales assessing the burden of chronic illness treatment and self-care as it relates to nine domains: medical information, medications, medical appointments, monitoring health, interpersonal challenges, health care expenses, difficulty with health care services, role activity limitations, and physical/mental exhaustion from self-management. Internal reliability of PETS scales was determined using Cronbach's alpha. Construct validity was determined through correlation of PETS scores with established measures (measures of chronic condition distress, medication satisfaction, self-efficacy, and global well-being), and known-groups validity through comparisons of PETS scores across clinically distinct groups. In an exploratory test of predictive validity, step-wise regressions were used to determine which PETS scales were most associated with outcomes of chronic condition distress, overall physical and mental health, and medication adherence. Respondents were 37-88 years old, 59% female, 29% non-white, and 67% college-educated. PETS scales showed good reliability (Cronbach's alphas ≥0.74). Higher PETS scale scores (greater treatment burden) were correlated with more chronic condition distress, less medication convenience, lower self-efficacy, and worse general physical and mental health. Participants less (versus more) adherent to medications and those with more (versus fewer) health care financial difficulties had higher mean PETS scores. Medication burden was the scale that was most consistently associated with well-being and patient-reported adherence. The PETS is a reliable and valid measure for assessing perceived treatment burden in people coping with diabetes.

The psychometric properties and practicability of self-report instruments to identify medication nonadherence in adult transplant patients: a systematic review.

PubMed

Dobbels, Fabienne; Berben, Lut; De Geest, Sabina; Drent, Gerda; Lennerling, Annette; Whittaker, Clare; Kugler, Christiane

2010-07-27

Nonadherence to immunosuppressive therapy is recognized as a key prognostic indicator for poor posttransplantation long-term outcomes. Several methods aiming to measure medication nonadherence have been suggested in the literature. Although combining measurement methods is regarded as the gold standard for measuring nonadherence, self-report is generally considered a central component of adherence assessment. However, no systematic review currently exists to determine which instrument(s) are most appropriate for use in transplant populations. The transplant360 Task Force first performed a survey of the self-report adherence instruments currently used in European centers. Next, a systematic literature review of self-report instruments assessing medication adherence in chronically ill patients was conducted. Self-report instruments were evaluated to assess those which were: (a) short and easy to score; (b) assessed both the taking and timing of medication intake; and (c) had established reliability and validity. Fourteen instruments were identified from our survey of European centers, of which the Basel Assessment of Adherence Scale for Immunosuppressives met the aforementioned criteria. The systematic review found 20 self-report instruments, of which only two qualified for use in transplantation, that is, the Brief Antiretroviral Adherence Index and the Medication Adherence Self-Report Inventory. The three selected self-report scales may assist transplant professionals in detecting nonadherence. However, these scales were only validated in patients with HIV. Although HIV shares similar characteristics with transplantation, including the importance of taking and timing of medication, further validation in transplant populations is required.

Quality of life and psychological health indicators in the national social life, health, and aging project.

PubMed

Shiovitz-Ezra, Sharon; Leitsch, Sara; Graber, Jessica; Karraker, Amelia

2009-11-01

The National Social Life, Health, and Aging Project (NSHAP) measures seven indicators of quality of life (QoL) and psychological health. The measures used for happiness, self-esteem, depression, and loneliness are well established in the literature. Conversely, measures of anxiety, stress, and self-reported emotional health were modified for their use in this unique project. The purpose of this paper is to provide (a) an overview of NSHAP's QoL assessment and (b) evidence for the adequacy of the modified measures. First, we examined the psychometric properties of the modified measures. Second, the established QoL measures were used to examine the concurrent validity of the modified measures. Finally, gender- and age-group differences were examined for each modified measure. The anxiety index exhibited good internal reliability and concurrent validity. Consistent with the literature, a single-factor structure best fit the data. Stress was satisfactory in terms of concurrent validity but with only fair internal consistency. Self-reported emotional health exhibited good concurrent validity and moderate external validity. The modified indices used in NSHAP tended to exhibit good internal reliability and concurrent validity. These measures can confidently be used in the exploration of QoL and psychological health in later life and its many correlates.

Collateral Report of Psychopathy: Convergent and Divergent Validity of the Psychopathic Personality Inventory-Short Form

PubMed Central

Iyican, Susan; Sommer, Johannah M.; Kini, Sheetal; Babcock, Julia C.

2015-01-01

Psychopathy is a personality syndrome comprised of interpersonal, affective, and behavioral features that has emerged as a correlate of intimate partner violence perpetration. One commonly used self-report measure of psychopathy is the Psychopathic Personality Inventory-Short Form. The current study employed a multi-trait, multi-method approach to test convergent and discriminant validity of the measure in partner-violent couples by comparing males’ self-report of psychopathy to the informant report of their female partner (N = 114). It was hypothesized that the female partner-report of the male’s psychopathy would be highly correlated with the male report of his own psychopathy, thus providing evidence for the construct validity and interrater reliability of the PPI-SF. Analyses found that male and female reports were correlated significantly on the two major factors of the PPI-SF. Furthermore, the female-report explained a significant amount of variance over and above men’s self-report on PAI scales designed to indicate antisocial personality traits. PMID:26213500

The development and psychometric properties of an informant-report form of the personality inventory for DSM-5 (PID-5).

PubMed

Markon, Kristian E; Quilty, Lena C; Bagby, R Michael; Krueger, Robert F

2013-06-01

The current article reports on the development, psychometric properties, and external validity of an informant-report form of the Personality Inventory for DSM-5 (the PID-5-IRF). Using data from two nationally representative samples, as well as an elevated-risk community sample, we report on the PID-5-IRF item characteristics, scale properties, superordinate factor structure, and correlations with other measures. The PID-5-IRF replicates the factor structure of the self-report form and has relationships with other measures (including the PID-5 self-report form and a widely used Big Five measure) that are consistent with previous research and theory. We believe that the PID-5-IRF is a useful measure for a number of scenarios, such as when additional sources of information are desired, where informant measures are expected to provide incremental validity over self-report, where relationships or social perception is a focal interest, or when response bias is a salient concern. Areas for future research are also discussed.

Validity of smoke alarm self-report measures and reasons for over-reporting.

PubMed

Stepnitz, Rebecca; Shields, Wendy; McDonald, Eileen; Gielen, Andrea

2012-10-01

Many residential fire deaths occur in homes with no or non-functioning smoke alarms (SAs). Self-reported SA coverage is high, but studies have found varying validity for self-report measures. The authors aim to: (1) determine over-reporting of coverage, (2) describe socio-demographic correlates of over-reporting and (3) report reasons for over-reporting. The authors surveyed 603 households in a large, urban area about fire safety behaviours and then tested all SAs in the home. 23 participants who over-reported their SA coverage were telephoned and asked about why they had misreported. Full coverage was reported in 70% of households but observed in only 41%, with a low positive predictive value (54.2%) for the self-report measure. Most over-reporters assumed alarms were working because they were mounted or did not think a working alarm in a basement or attic was needed to be fully protected. If alarms cannot be tested, researchers or those counselling residents on fire safety should carefully probe self-reported coverage. Our findings support efforts to equip more homes with hard-wired or 10 year lithium battery alarms to reduce the need for user maintenance.

A Self-Report Measure of Touching Behavior.

ERIC Educational Resources Information Center

Schutte, Nicola S.; And Others

Because touching is an important and often studied construct, and there is need for a valid self-report measure of touching behavior, a measure of touching behaviors was developed. Touching behaviors to be reported were: brief touch on the arm or shoulder, handshake, hug, hand holding, kiss on the cheek, and kiss on the lips. Persons identified as…

The Clitoral Photoplethysmograph: A Pilot Study Examining Discriminant and Convergent Validity.

PubMed

Suschinsky, Kelly D; Shelley, Amanda J; Gerritsen, Jeroen; Tuiten, Adriaan; Chivers, Meredith L

2015-12-01

The clitoral photoplethysmograph (CPP) is a relatively new device used to measure changes in clitoral blood volume (CBV); however, its construct validity has not yet been evaluated. To evaluate the discriminant and convergent validity of the CPP. For discriminant validity, CBV responses should differ between sexual and nonsexual emotional films if the CPP accurately assesses clitoral vasocongestion associated with sexual arousal; for convergent validity, CBV responses should significantly correlate with subjective reports of sexual arousal. Twenty women (M age = 21.2 years, SD = 3.4) watched neutral, anxiety-inducing, exhilarating, and sexual (female-male sex) audiovisual stimuli while their genital responses were measured simultaneously using vaginal and clitoral photoplethysmographs and CPPs. Most of these participants continuously reported sexual arousal throughout each stimulus (n = 16), and all reported their sexual and nonsexual affect before and after each stimulus; subjective responses were recorded via button presses using a keypad. Vaginal pulse amplitude (VPA), CBV, and self-reported sexual arousal and nonsexual affect were used as main outcome measures. CBV demonstrated both discriminant and convergent validity. CBV responses were similar to VPA responses and self-reported sexual arousal; all responses differed significantly as a function of stimulus content, with the sexual stimulus eliciting greater relative changes than nonsexual stimuli. CBV, but not VPA, was significantly (negatively) correlated with continuous self-reported sexual arousal during the shorter sexual stimulus. CBV was significantly negatively correlated with VPA for the shorter sexual stimulus. CBV may be a valid measure of women's genital sexual arousal that provides complementary information to VPA and correlates with self-reported sexual arousal. Given our relatively small sample size, and that this is among the first research to use the CPP, the current findings must be replicated. More research using the CPP and other devices is required for a more comprehensive description of women's physiological sexual arousal. © 2015 International Society for Sexual Medicine.

The Differentiation of Self Inventory: Development and Initial Validation.

ERIC Educational Resources Information Center

Skowron, Elizabeth A.; Friedlander, Myrna L.

The development and initial validation of a new self-report instrument, the Differentiation of Self Inventory (DSI), are presented. The DSI represents the first attempt to create a multidimensional measure of differentiation based on Bowen Theory, focusing specifically on adults (aged over 25 years), their current significant relationships, and…

Preliminary Validity and Reliability of Scores on the "Self-Determination Inventory": Student Report Version

ERIC Educational Resources Information Center

Shogren, Karrie A.; Wehmeyer, Michael L.; Little, Todd D.; Forber-Pratt, Anjali J.; Palmer, Susan B.; Seo, Hyojeong

2017-01-01

The purpose of this article is to describe preliminary psychometric characteristics of a student self-report measure of self-determination, the "Self-Determination Inventory: Student Report" version (SDI-SR), designed for youth with and without disabilities. We administered the draft assessment to 311 youth and examined item functioning…

Validation of the PROMIS® measures of self-efficacy for managing chronic conditions.

PubMed

Gruber-Baldini, Ann L; Velozo, Craig; Romero, Sergio; Shulman, Lisa M

2017-07-01

The Patient-Reported Outcomes Measurement Information System ® (PROMIS ® ) was designed to develop, validate, and standardize item banks to measure key domains of physical, mental, and social health in chronic conditions. This paper reports the calibration and validation testing of the PROMIS Self-Efficacy for Managing Chronic Conditions measures. PROMIS Self-Efficacy for Managing Chronic Conditions item banks comprise five domains, Self-Efficacy for Managing: Daily Activities, Symptoms, Medications and Treatments, Emotions, and Social Interactions. Banks were calibrated in 1087 subjects from two data sources: 837 patients with chronic neurologic conditions (epilepsy, multiple sclerosis, neuropathy, Parkinson disease, and stroke) and 250 subjects from an online Internet sample of adults with general chronic conditions. Scores were compared with one legacy scale: Self-Efficacy for Managing Chronic Disease 6-Item scale (SEMCD6) and five PROMIS short forms: Global Health (Physical and Mental), Physical Function, Fatigue, Depression, and Anxiety. The sample was 57% female, mean age = 53.8 (SD = 14.7), 76% white, 21% African American, 6% Hispanic, and 76% with greater than high school education. Full-item banks were created for each domain. All measures had good internal consistency and correlated well with SEMCD6 (r  = 0.56-0.75). Significant correlations were seen between the Self-Efficacy measures and other PROMIS short forms (r  > 0.38). The newly developed PROMIS Self-Efficacy for Managing Chronic Conditions measures include five domains of self-efficacy that were calibrated across diverse chronic conditions and show good internal consistency and cross-sectional validity.

Towards parsimony in habit measurement: Testing the convergent and predictive validity of an automaticity subscale of the Self-Report Habit Index

PubMed Central

2012-01-01

Background The twelve-item Self-Report Habit Index (SRHI) is the most popular measure of energy-balance related habits. This measure characterises habit by automatic activation, behavioural frequency, and relevance to self-identity. Previous empirical research suggests that the SRHI may be abbreviated with no losses in reliability or predictive utility. Drawing on recent theorising suggesting that automaticity is the ‘active ingredient’ of habit-behaviour relationships, we tested whether an automaticity-specific SRHI subscale could capture habit-based behaviour patterns in self-report data. Methods A content validity task was undertaken to identify a subset of automaticity indicators within the SRHI. The reliability, convergent validity and predictive validity of the automaticity item subset was subsequently tested in secondary analyses of all previous SRHI applications, identified via systematic review, and in primary analyses of four raw datasets relating to energy‐balance relevant behaviours (inactive travel, active travel, snacking, and alcohol consumption). Results A four-item automaticity subscale (the ‘Self-Report Behavioural Automaticity Index’; ‘SRBAI’) was found to be reliable and sensitive to two hypothesised effects of habit on behaviour: a habit-behaviour correlation, and a moderating effect of habit on the intention-behaviour relationship. Conclusion The SRBAI offers a parsimonious measure that adequately captures habitual behaviour patterns. The SRBAI may be of particular utility in predicting future behaviour and in studies tracking habit formation or disruption. PMID:22935297

The Validity of Self-Reported Prevalence, Frequency, and Timing of Arrest: An Evaluation of Data Collected Using a Life Event Calendar

ERIC Educational Resources Information Center

Morris, Nancy A.; Slocum, Lee Ann

2010-01-01

Heightened scholarly interest in stability and change in criminal behavior has increased the demand for longitudinal data. One method that may enhance the quality of retrospective self-reported data, especially reports of timing, is the life event calendar (LEC). Using a sample of incarcerated women, we assess the validity of LEC measures of…

Development and Validation of the Pediatric Diabetes Routines Questionnaire for Adolescents.

PubMed

Pierce, Jessica S; Jordan, Sara S; Arnau, Randolph C

2018-04-06

This study describes the development and psychometric evaluation of an adolescent self-report version of the Pediatric Diabetes Routines Questionnaire (PDRQ:A), a measure of diabetes-specific routines for youth with type 1 diabetes, and further validation of the parent-version (PDRQ:P) in an adolescent sample. Participants included 120 parent-adolescent dyads (ages 12-17) and an additional 24 parents who completed measures of diabetes-specific adolescent routines, general adolescent routines, diabetes self-care, and family support of youth diabetes care. The PDRQ:P/A demonstrated good internal consistency, test-retest reliability, and parent-child agreement, and adequate validity coefficients. Confirmatory factor analysis supported a one-factor model. Promising results were obtained. The PDRQ:P/A is a clinically feasible parent- and self-report measure that can provide valuable information regarding how frequently adolescents engage in their diabetes management tasks in a consistent manner. Addition of an adolescent report format will enhance the utility of the measure for clinical and research use.

Measuring Graduate Students' Teaching and Research Skills through Self-Report: Descriptive Findings and Validity Evidence

ERIC Educational Resources Information Center

Gilmore, Joanna; Feldon, David

2010-01-01

This study extends research on graduate student development by examining descriptive findings and validity of a self-report survey designed to capture graduate students' assessments of their teaching and research skills. Descriptive findings provide some information about areas of growth among graduate students' in the first years of their…

Pooled results from 5 validation studies of dietary self-report instruments using recovery biomarkers for energy and protein intake

USDA-ARS?s Scientific Manuscript database

We pooled data from 5 large validation studies of dietary self-report instruments that used recovery biomarkers as references to clarify the measurement properties of food frequency questionnaires (FFQs) and 24-hour recalls. The studies were conducted in widely differing U.S. adult populations from...

Comparing the Validity of Informant- and Self-reports of Personality Using Laboratory Indices of Emotional Responding as Criterion Variables

PubMed Central

Lieberman, Lynne; Liu, Huiting; Huggins, Ashley A.; Katz, Andrea C.; Zvolensky, Michael J.; Shankman, Stewart A.

2016-01-01

Personality traits relate to risk for psychopathology and can inform predictions about treatment outcome. In an effort to obtain a comprehensive index of personality, informant-reports of personality are sometimes obtained in addition to self-reports of personality. However, there is limited research comparing the validity of self- and informant-reports of personality, particularly among those with internalizing psychopathology. This is important given that informants may provide an additional (and perhaps different) perspective on individuals’ personality. The present study therefore compared how both reports of positive affectivity (PA) and negative affectivity (NA) relate to psychophysiological and subjective measures of emotional responding to positive and negative stimuli. Given that our sample (n = 117) included individuals with no history of psychopathology, as well as individuals with major depressive disorder (MDD) and/or panic disorder (PD), we were also able to explore whether these internalizing diagnoses moderated the association between personality reports and measures of emotional responding. Informant-reported PA predicted physiological responses to positive stimuli (but not negative). Informant reported NA predicted physiological responses to negative stimuli (but not positive). Self-reported personality did not predict physiological responding, but did predict subjectively measured emotional responding (NA for negative responding; PA for positive responding). Diagnoses of internalizing psychopathology (PD or MDD) did not moderate these associations. Results suggest self- and informant-reports of personality may each provide valid indices of an individual’s emotional response tendencies, but predict different aspects of those tendencies. PMID:27273802

Childhood predictors and age 48 outcomes of self-reports and official records of offending

PubMed Central

DUBOW, ERIC F.; HUESMANN, L. ROWELL; BOXER, PAUL; SMITH, CATHY

2014-01-01

Background The key question is: are self-reports and official records equally valid indicators of criminal offending? Aims We examine the correspondence between self-reports and official records of offending, the similarity of childhood and adolescent individual and contextual predictors of both measures of offending, and the similarity of age 48 correlates of both measures of offending. Methods Men (N = 436) from the Columbia County Longitudinal Study, a sample of all 3rd graders in Columbia County, New York, in 1959–60, participated. The youth, their peers and their parents were interviewed when the youth were age 8; the youth were later interviewed at ages 19, 30 and 48. Results We found moderate to high correspondence between self-reports of having been in trouble with the law and official arrest records. Lifetime self-reports and official records of offending were generally predicted by the same childhood and adolescent variables, and were correlated with many of the same adult outcome measures. By age 48, life-course non-offenders defined by either self-reports or official records had better outcomes than offenders. Conclusions The results validate the use of adolescent and adult self-reports of offending, and the early identification of individuals at risk for adult criminal behaviour through childhood parent and peer reports and adolescent self and peer reports. PMID:25294162

Childhood predictors and age 48 outcomes of self-reports and official records of offending.

PubMed

Dubow, Eric F; Huesmann, L Rowell; Boxer, Paul; Smith, Cathy

2014-10-01

The key question is: are self-reports and official records equally valid indicators of criminal offending? We examine the correspondence between self-reports and official records of offending, the similarity of childhood and adolescent individual and contextual predictors of both measures of offending, and the similarity of age 48 correlates of both measures of offending. Men (N=436) from the Columbia County Longitudinal Study, a sample of all 3rd graders in Columbia County, New York, in 1959-60, participated. The youth, their peers and their parents were interviewed when the youth were age 8; the youth were later interviewed at ages 19, 30 and 48. We found moderate to high correspondence between self-reports of having been in trouble with the law and official arrest records. Lifetime self-reports and official records of offending were generally predicted by the same childhood and adolescent variables, and were correlated with many of the same adult outcome measures. By age 48, life-course non-offenders defined by either self-reports or official records had better outcomes than offenders. The results validate the use of adolescent and adult self-reports of offending, and the early identification of individuals at risk for adult criminal behaviour through childhood parent and peer reports and adolescent self and peer reports. Copyright © 2014 John Wiley & Sons, Ltd.

Measuring adolescents' HRQoL via self reports and parent proxy reports: an evaluation of the psychometric properties of both versions of the KINDL-R instrument.

PubMed

Erhart, Michael; Ellert, Ute; Kurth, Bärbel-Maria; Ravens-Sieberer, Ulrike

2009-08-26

Several instruments are available to assess children's health-related quality of life (HRQoL) based on self reports as well as proxy reports from parents. Previous studies have found only low-to-moderate agreement between self and proxy reports, but few studies have explicitly compared the psychometric qualities of both. This study compares the reliability, factorial validity and convergent and known group validity of the self-report and parent-report versions of the HRQoL KINDL-R questionnaire for children and adolescents. Within the nationally representative cross-sectional German Health Interview and Examination Survey for Children and Adolescents (KiGGS), 6,813 children and adolescents aged 11 to 17 years completed the KINDL-R generic HRQoL instrument while their parents answered the KINDL proxy version (both in paper-and-pencil versions). Cronbach's alpha and confirmatory factor-analysis models (linear structural equation model) were obtained. Convergent and discriminant validity were assessed by calculating the Pearson's correlation coefficient for the Strengths and Difficulties Questionnaire. Known-groups differences were examined (ANOVA) for obese children and children with a lower familial socio-economic status. The parent reports achieved slightly higher Cronbach's alpha values for the total score (0.86 vs. 0.83) and most sub-scores. Confirmatory factor analysis revealed an acceptable fit of the six-dimensional measurement model of the KINDL for the parent (RMSEA=0.07) and child reports (RMSEA=0.06). Factorial invariance across the two versions did not hold with regards to the pattern of loadings, the item errors and the covariation between latent concepts. However the magnitude of the differences was rather small. The parent report version achieved slightly higher convergent validity (r=0.44-0.63 vs. r=0.33-0.59) in the Strengths and Difficulties Questionnaire. No clear differences were observed for known-groups validity. Our study showed that parent proxy reports and child self reports on the child's HRQoL slightly differ with regards to how the perceptions, evaluations and possibly the affective resonance of each group are structured and internally consistent. Overall, the parent reports achieved slightly higher reliability and thus are favoured for the examination of small samples. No version was universally superior with regards to the validity of the measurements. Whenever possible, children's HRQoL should be measured via both sources of information.

Are implicit self-esteem measures valid for assessing individual and cultural differences?

PubMed

Falk, Carl F; Heine, Steven J; Takemura, Kosuke; Zhang, Cathy X J; Hsu, Chih-Wei

2015-02-01

Our research utilized two popular theoretical conceptualizations of implicit self-esteem: 1) implicit self-esteem as a global automatic reaction to the self; and 2) implicit self-esteem as a context/domain specific construct. Under this framework, we present an extensive search for implicit self-esteem measure validity among different cultural groups (Study 1) and under several experimental manipulations (Study 2). In Study 1, Euro-Canadians (N = 107), Asian-Canadians (N = 187), and Japanese (N = 112) completed a battery of implicit self-esteem, explicit self-esteem, and criterion measures. Included implicit self-esteem measures were either popular or provided methodological improvements upon older methods. Criterion measures were sampled from previous research on implicit self-esteem and included self-report and independent ratings. In Study 2, Americans (N = 582) completed a shorter battery of these same types of measures under either a control condition, an explicit prime meant to activate the self-concept in a particular context, or prime meant to activate self-competence related implicit attitudes. Across both studies, explicit self-esteem measures far outperformed implicit self-esteem measures in all cultural groups and under all experimental manipulations. Implicit self-esteem measures are not valid for individual or cross-cultural comparisons. We speculate that individuals may not form implicit associations with the self as an attitudinal object. © 2013 Wiley Periodicals, Inc.

Assessing abuse risk beyond self-report: analog task of acceptability of parent-child aggression.

PubMed

Rodriguez, Christina M; Russa, Mary Bower; Harmon, Nancy

2011-03-01

The present investigation reports on the development and initial validation of a new analog task, the Parent-Child Aggression Acceptability Movie Task (P-CAAM), intended to assess respondents' acceptance of parent-child aggression, including both physical discipline and physical abuse. Two independent samples were utilized to develop and evaluate the P-CAAM: an undergraduate sample to initially pilot the task and a separate sample of normative parents for additional assessment of validity. Scores from the P-CAAM were compared to related measures, including measures of self-reported disciplinary attitudes, child abuse potential, harsh parenting style, and use and escalation of physical discipline practices on another analog parenting task. Across the studies, the P-CAAM demonstrated acceptable internal consistency and construct validity, evidencing mild to moderate associations with both self-report and analog measures. Participants demonstrating increased acceptance of physical discipline and physical abuse on the P-CAAM analog task also reported greater approval of physical discipline, greater use of and escalation of physical discipline, harsher parenting styles, and higher child abuse potential on two separate measures. The P-CAAM analog appears to offer a promising alternative and/or supplement to conventional self-report measures, assessing attitudes regarding the acceptability of parent-child aggression in a way that is less likely to be influenced by social desirability. Suggestions for future evaluations with alternative samples, as well as possible implications of the data for disciplinary reactions are discussed. The development of alternatives to self-report measurement may lead to clarification of theoretical models of abuse in ways that lead to improvements in intervention programming; analogs may also provide a useful means to assess intervention programming outcomes. Copyright © 2011 Elsevier Ltd. All rights reserved.

Development and Validation of the Emotional Self-Awareness Questionnaire: A Measure of Emotional Intelligence

ERIC Educational Resources Information Center

Killian, Kyle D.

2012-01-01

This study examined the psychometric characteristics of the Emotional Self-Awareness Questionnaire (ESQ), a self-report measure of emotional intelligence. The ESQ, Emotional Intelligence Scale, and measures of alexithymia, positive negative affect, personality, cognitive ability, life satisfaction, and leadership aspirations were administered to…

Examining the Level of Convergence among Self-Regulated Learning Microanalytic Processes, Achievement, and a Self-Report Questionnaire

ERIC Educational Resources Information Center

Cleary, Timothy J.; Callan, Gregory L.; Malatesta, Jaime; Adams, Tanya

2015-01-01

This study examined the convergent and predictive validity of self-regulated learning (SRL) microanalytic measures. Specifically, theoretically based relations among a set of self-reflection processes, self-efficacy, and achievement were examined as was the level of convergence between a microanalytic strategy measure and a SRL self-report…

Associations between MMPI-2-RF validity scale scores and extra-test measures of personality and psychopathology.

PubMed

Forbey, Johnathan D; Lee, Tayla T C; Ben-Porath, Yossef S; Arbisi, Paul A; Gartland, Diane

2013-08-01

The current study explored associations between two potentially invalidating self-report styles detected by the Validity scales of the Minnesota Multiphasic Personality Inventory-2-Restructured Form (MMPI-2-RF), over-reporting and under-reporting, and scores on the MMPI-2-RF substantive, as well as eight collateral self-report measures administered either at the same time or within 1 to 10 days of MMPI-2-RF administration. Analyses were conducted with data provided by college students, male prisoners, and male psychiatric outpatients from a Veterans Administration facility. Results indicated that if either an over- or under-reporting response style was suggested by the MMPI-2-RF Validity scales, scores on the majority of the MMPI-2-RF substantive scales, as well as a number of collateral measures, were significantly affected in all three groups in the expected directions. Test takers who were identified as potentially engaging in an over- or under-reporting response style by the MMPI-2-RF Validity scales appeared to approach extra-test measures similarly regardless of when these measures were administered in relation to the MMPI-2-RF. Limitations and suggestions for future study are discussed.

Construct validity of the five factor borderline inventory.

PubMed

DeShong, Hilary L; Lengel, Gregory J; Sauer-Zavala, Shannon E; O'Meara, Madison; Mullins-Sweatt, Stephanie N

2015-06-01

The Five Factor Borderline Inventory (FFBI) is a new self-report measure developed to assess traits of borderline personality disorder (BPD) from the perspective of the Five Factor Model of general personality. The current study sought to first replicate initial validity findings for the FFBI and then to further validate the FFBI with predispositional risk factors of the biosocial theory of BPD and with commonly associated features of BPD (e.g., depression, low self-esteem) utilizing two samples of young adults (N = 87; 85) who have engaged in nonsuicidal self-injury. The FFBI showed strong convergent and discriminant validity across two measures of the Five Factor Model and also correlated strongly with measures of impulsivity, emotion dysregulation, and BPD. The FFBI also related to two measures of early childhood emotional vulnerability and parental invalidation and measures of depression, anxiety, and self-esteem. Overall, the results provide support for the FFBI as a measure of BPD. © The Author(s) 2014.

Development of four self-report measures of job stressors and strain: Interpersonal Conflict at Work Scale, Organizational Constraints Scale, Quantitative Workload Inventory, and Physical Symptoms Inventory.

PubMed

Spector, P E; Jex, S M

1998-10-01

Despite the widespread use of self-report measures of both job-related stressors and strains, relatively few carefully developed scales for which validity data exist are available. In this article, we discuss 3 job stressor scales (Interpersonal Conflict at Work Scale, Organizational Constraints Scale, and Quantitative Workload Inventory) and 1 job strain scale (Physical Symptoms Inventory). Using meta-analysis, we combined the results of 18 studies to provide estimates of relations between our scales and other variables. Data showed moderate convergent validity for the 3 job stressor scales, suggesting some objectively to these self-reports. Norms for each scale are provided.

Validation of Self-Reported Anthropometrics in Female College Freshmen.

PubMed

Leone, Ryan J; Morgan, Amy L; Ludy, Mary-Jon

Most investigations concerning the validity of self-reported anthropometrics focus on weight, height, and body mass index. This study extends those investigations by exploring the impact of self-reporting bias on the disease risk indicators of waist circumference and body fat percentage. Female college freshmen (n=128) self-reported weight and height, then underwent measurements for weight, height, waist circumference, and body fat percentage. Self-reporting bias was defined as self-reported minus directly-assessed anthropometric value. Despite no differences in self-reported versus directly-assessed weight or height for the total group, students with high waist circumference and excess fat under-reported their weight by 2.3±4.4 lb (p<0.05). Self-reporting bias was negatively correlated with waist circumference (r=-0.362; p<0.001) and body fat percentage (r=-0.317; p<0.001). Although many female college freshmen accurately represent their weight, those with excess fat and waist circumference under-reported their weight. This may lead to missed opportunities for risk identification, prevention, and intervention.

Priming honesty reduces subjective bias in self-report measures of mind wandering.

PubMed

Vinski, Melaina T; Watter, Scott

2012-03-01

Using self-report as a measure of conscious experience has been a point of contention in mind wandering research. Whereas prior work has focused on the introspective component of self-report validity, the current research introduces an honesty prime task to the current paradigm in order to assess the role of goal states and social factors on self-report accuracy. Findings provide evidence for an inflated report of mind wandering frequency arising from demand characteristics, intensified by the divergent properties of the subjective and behavioural measures and the general deficit in meta-awareness of off task episodes. Copyright © 2011 Elsevier Inc. All rights reserved.

Comparing the validity of different sources of information on emergency department visits: a latent class analysis.

PubMed

Dendukuri, Nandini; McCusker, Jane; Bellavance, François; Cardin, Sylvie; Verdon, Josée; Karp, Igor; Belzile, Eric

2005-03-01

Emergency department (ED) use in Quebec may be measured from varied sources, eg, patient's self-reports, hospital medical charts, and provincial health insurance claims databases. Determining the relative validity of each source is complicated because none is a gold standard. We sought to compare the validity of different measures of ED use without arbitrarily assuming one is perfect. Data were obtained from a nursing liaison intervention study for frail seniors visiting EDs at 4 university-affiliated hospitals in Montreal. The number of ED visits during 2 consecutive follow-up periods of 1 and 4 months after baseline was obtained from patient interviews, from medical charts of participating hospitals, and from the provincial health insurance claims database. Latent class analysis was used to estimate the validity of each source. The impact of the following covariates on validity was evaluated: hospital visited, patient's demographic/clinical characteristics, risk of functional decline, nursing liaison intervention, duration of recall, previous ED use, and previous hospitalization. The patient's self-report was found to be the least accurate (sensitivity: 70%, specificity: 88%). Claims databases had the greatest validity, especially after defining claims made on consecutive days as part of the same ED visit (sensitivity: 98%, specificity: 98%). The validity of the medical chart was intermediate. Lower sensitivity (or under-reporting) on the self-report appeared to be associated with higher age, low comorbidity and shorter length of recall. The claims database is the most valid method of measuring ED use among seniors in Quebec compared with hospital medical charts and patient-reported use.

An Integrative Review of Self-Efficacy Measurement Instruments in Youth with Type 1 Diabetes (T1DM)

PubMed Central

Rasbach, Lisa; Jenkins, Carolyn; Laffel, Lori

2014-01-01

Purpose The purpose of this study is to assess the extant literature on instruments used to measure self-efficacy in youth with type 1 diabetes (T1DM) and their caregivers and to critically evaluate these measurements. Methods An integrative review (2003–2013) was conducted searching PsycINFO, Cumulative Index to Nursing and Allied Health Literature (CINAHL), and U.S. National Library of Medicine PubMed service (PubMed) databases using key words diabetes, type 1 diabetes, and self-efficacy. The authors reviewed the resulting294 references for inclusion criteria of (a) sample of youth with T1DM or sample of caregivers of youth with T1DM, (b) description of the self-efficacy instrument as primary research, and (c) the instrument measured self-efficacy specifically related to diabetes management. Forty-five articles out of the initial 294 met criteria. Results Of the 45 articles, 10 different self-efficacy instruments were identified. The primary theoretical framework used was Bandura’s social cognitive theory and model of self-efficacy. Most participants were white middle class T1DM youth. Evaluations to assess validity often were not reported; however, a majority of studies reported high internal consistency of the instruments. Conclusions Sample homogeneity could limit the applicability of results to certain patient populations. Further psychometric analysis, including validity assessments, should be conducted in more diverse samples. Development of valid and reliable instruments for measuring self-efficacy that are sensitive to change across a wider caregiver base over time is necessary. While this review examined reliable and valid instruments used in research, future opportunities include evaluation of measuring self-efficacy in T1DM youth exposed to recent advances in diabetes management technologies. PMID:25216655

Measuring activities and participation in persons with haemophilia: A systematic review of commonly used instruments.

PubMed

Timmer, M A; Gouw, S C; Feldman, B M; Zwagemaker, A; de Kleijn, P; Pisters, M F; Schutgens, R E G; Blanchette, V; Srivastava, A; David, J A; Fischer, K; van der Net, J

2018-03-01

Monitoring clinical outcome in persons with haemophilia (PWH) is essential in order to provide optimal treatment for individual patients and compare effectiveness of treatment strategies. Experience with measurement of activities and participation in haemophilia is limited and consensus on preferred tools is lacking. The aim of this study was to give a comprehensive overview of the measurement properties of a selection of commonly used tools developed to assess activities and participation in PWH. Electronic databases were searched for articles that reported on reliability, validity or responsiveness of predetermined measurement tools (5 self-reported and 4 performance based measurement tools). Methodological quality of the studies was assessed according to the COSMIN checklist. Best evidence synthesis was used to summarize evidence on the measurement properties. The search resulted in 3453 unique hits. Forty-two articles were included. The self-reported Haemophilia Acitivity List (HAL), Pediatric HAL (PedHAL) and the performance based Functional Independence Score in Haemophilia (FISH) were studied most extensively. Methodological quality of the studies was limited. Measurement error, cross-cultural validity and responsiveness have been insufficiently evaluated. Albeit based on limited evidence, the measurement properties of the PedHAL, HAL and FISH are currently considered most satisfactory. Further research needs to focus on measurement error, responsiveness, interpretability and cross-cultural validity of the self-reported tools and validity of performance based tools which are able to assess limitations in sports and leisure activities. © 2018 The Authors. Haemophilia Published by John Wiley & Sons Ltd.

Characterizing smoking topography of cannabis in heavy users

PubMed Central

Stitzer, Maxine L.; Vandrey, Ryan

2013-01-01

Rationale Little is known about the smoking topography characteristics of heavy cannabis users. Such measures may be able to predict cannabis use-related outcomes and could be used to validate self-reported measures of cannabis use. Objectives The current study was conducted to measure cannabis smoking topography characteristics during periods of ad libitum use and to correlate topography assessments with measures of self-reported cannabis use, withdrawal and craving during abstinence, and cognitive task performance. Methods Participants (N=20) completed an inpatient study in which they alternated between periods of ad libitum cannabis use and abstinence. Measures of self-reported cannabis use, smoking topography, craving, withdrawal, and sleep measures were collected. Results Participants smoked with greater intensity (e.g., greater volume, longer duration) on initial cigarette puffs with a steady decline on subsequent puffs. Smoking characteristics were significantly correlated with severity of withdrawal, notably sleep quality and architecture, and craving during abstinence, suggesting dose-related effects of cannabis use on these outcomes. Smoking characteristics generally were not significantly associated with cognitive performance. Smoking topography measures were significantly correlated with self-reported measures of cannabis use, indicating validity of these assessments, but topography measures were more sensitive than self-report in predicting cannabis-related outcomes. Conclusions A dose–effect relationship between cannabis consumption and outcomes believed to be clinically important was observed. With additional research, smoking topography assessments may become a useful clinical tool. PMID:21922170

The Construct Validity of the German Academic Self-regulation Questionnaire (SRQ-A) within Primary and Secondary School Children.

PubMed

Kröner, Julia; Goussios, Christina; Schaitz, Caroline; Streb, Judith; Sosic-Vasic, Zrinka

2017-01-01

The assessment of students' motivation can be a powerful tool in enhancing and understanding students' learning. One valid and often applied self-report measure is the Academic Self-Regulation Questionnaire (SRQ-A) which is grounded in the self-determination theory. However, to date, there is still no German equivalent to the English version of this questionnaire. Therefore, the aim of the present study was to adapt and validate the SRQ-A on a representative German student sample, consisting of 672 children (327 girls), ages 8-14 from one primary and two secondary German schools. First, the translation-back-translation method was used to ensure the linguistic equivalence of the German questionnaire. Second, item analysis of the generated scores of the German SRQ-A were conducted. Third, the multidimensional factorial structure of the original measure was tested with confirmatory factor analysis (CFA) using maximum likelihood estimation. Last, additional construct validity of the German SRQ-A was tested using correlational analyses with convergent and divergent measures. After conducting CFA, four items were excluded from the original questionnaire, due to loadings lower than 0.40, resulting in 28 items. The German SRQ-A showed good internal consistency for all subscales, with Chronbach's α ranging between 0.75 and 0.88. The simplex-structure of the original measurement could also be confirmed, however, the four-factorial model could not be replicated. The measurement showed good convergent and discriminant validity with other related questionnaires. In summary, the German SRQ-A is a reliable and valid self-report instrument for the assessment of self-determined motivational styles within the school context.

The Construct Validity of the German Academic Self-regulation Questionnaire (SRQ-A) within Primary and Secondary School Children

PubMed Central

Kröner, Julia; Goussios, Christina; Schaitz, Caroline; Streb, Judith; Sosic-Vasic, Zrinka

2017-01-01

The assessment of students' motivation can be a powerful tool in enhancing and understanding students' learning. One valid and often applied self-report measure is the Academic Self-Regulation Questionnaire (SRQ-A) which is grounded in the self-determination theory. However, to date, there is still no German equivalent to the English version of this questionnaire. Therefore, the aim of the present study was to adapt and validate the SRQ-A on a representative German student sample, consisting of 672 children (327 girls), ages 8–14 from one primary and two secondary German schools. First, the translation-back-translation method was used to ensure the linguistic equivalence of the German questionnaire. Second, item analysis of the generated scores of the German SRQ-A were conducted. Third, the multidimensional factorial structure of the original measure was tested with confirmatory factor analysis (CFA) using maximum likelihood estimation. Last, additional construct validity of the German SRQ-A was tested using correlational analyses with convergent and divergent measures. After conducting CFA, four items were excluded from the original questionnaire, due to loadings lower than 0.40, resulting in 28 items. The German SRQ-A showed good internal consistency for all subscales, with Chronbach's α ranging between 0.75 and 0.88. The simplex-structure of the original measurement could also be confirmed, however, the four-factorial model could not be replicated. The measurement showed good convergent and discriminant validity with other related questionnaires. In summary, the German SRQ-A is a reliable and valid self-report instrument for the assessment of self-determined motivational styles within the school context. PMID:28690567

Parents' self-efficacy, outcome expectations, and self-reported task performance when managing atopic dermatitis in children: instrument reliability and validity.

PubMed

Mitchell, Amy E; Fraser, Jennifer A

2011-02-01

Support and education for parents faced with managing a child with atopic dermatitis is crucial to the success of current treatments. Interventions aiming to improve parent management of this condition are promising. Unfortunately, evaluation is hampered by lack of precise research tools to measure change. To develop a suite of valid and reliable research instruments to appraise parents' self-efficacy for performing atopic dermatitis management tasks; outcome expectations of performing management tasks; and self-reported task performance in a community sample of parents of children with atopic dermatitis. The Parents' Eczema Management Scale (PEMS) and the Parents' Outcome Expectations of Eczema Management Scale (POEEMS) were developed from an existing self-efficacy scale, the Parental Self-Efficacy with Eczema Care Index (PASECI). Each scale was presented in a single self-administered questionnaire, to measure self-efficacy, outcome expectations, and self-reported task performance related to managing child atopic dermatitis. Each was tested with a community sample of parents of children with atopic dermatitis, and psychometric evaluation of the scales' reliability and validity was conducted. A community-based convenience sample of 120 parents of children with atopic dermatitis completed the self-administered questionnaire. Participants were recruited through schools across Australia. Satisfactory internal consistency and test-retest reliability was demonstrated for all three scales. Construct validity was satisfactory, with positive relationships between self-efficacy for managing atopic dermatitis and general perceived self-efficacy; self-efficacy for managing atopic dermatitis and self-reported task performance; and self-efficacy for managing atopic dermatitis and outcome expectations. Factor analyses revealed two-factor structures for PEMS and PASECI alike, with both scales containing factors related to performing routine management tasks, and managing the child's symptoms and behaviour. Factor analysis was also applied to POEEMS resulting in a three-factor structure. Factors relating to independent management of atopic dermatitis by the parent, involving healthcare professionals in management, and involving the child in the management of atopic dermatitis were found. Parents' self-efficacy and outcome expectations had a significant influence on self-reported task performance. Findings suggest that PEMS and POEEMS are valid and reliable instruments worthy of further psychometric evaluation. Likewise, validity and reliability of PASECI was confirmed. Copyright © 2010 Elsevier Ltd. All rights reserved.

Examination of the validity and reliability of the French version of the Brief Self-Control Scale

PubMed Central

Brevers, Damien; Foucart, Jennifer; Verbanck, Paul; Turel, Ofir

2017-01-01

This study aims to develop and to validate a French version of the Brief Self-Control Scale (BSCS; Tangney et al., 2004). This instrument is usually applied as a unidimensional self-report measure for assessing trait self-control, which captures one’s dispositional ability to resist short-term temptation in order to reach more valuable long-term goals. Data were collected from two independent samples of French-speaking individuals (n1 = 287; n2 = 160). Results indicated that the French version of the BSCS can be treated as unidimensional, like the original questionnaire. Data also showed consistent acceptable reliability and reasonable test-retest stability. Acceptable external validity of constructs was supported by relationships with self-reported measures of impulsivity (UPPS), including urgency, lack of premeditation, and lack of perseverance. Overall, the findings suggest that the average score of the French version of the BSCS is a viable option for assessing trait self-control in French speaking populations. PMID:29200467

Examination of the validity and reliability of the French version of the Brief Self-Control Scale.

PubMed

Brevers, Damien; Foucart, Jennifer; Verbanck, Paul; Turel, Ofir

2017-10-01

This study aims to develop and to validate a French version of the Brief Self-Control Scale (BSCS; Tangney et al., 2004). This instrument is usually applied as a unidimensional self-report measure for assessing trait self-control, which captures one's dispositional ability to resist short-term temptation in order to reach more valuable long-term goals. Data were collected from two independent samples of French-speaking individuals ( n 1 = 287; n 2 = 160). Results indicated that the French version of the BSCS can be treated as unidimensional, like the original questionnaire. Data also showed consistent acceptable reliability and reasonable test-retest stability. Acceptable external validity of constructs was supported by relationships with self-reported measures of impulsivity (UPPS), including urgency, lack of premeditation, and lack of perseverance. Overall, the findings suggest that the average score of the French version of the BSCS is a viable option for assessing trait self-control in French speaking populations.

A Measure for Pupils' Inconsistency of Response to a Self-Report Instrument of Attitudes toward School.

ERIC Educational Resources Information Center

Darom, Efraim; Rich, Yisrael

1983-01-01

To measure pupils' inconsistency in replying to a self-report questionnaire regarding attitudes toward school, 6,000 elementary and secondary school students participated in a nation-wide project to construct and validate the Israeli Quality of School Life Questionnaire (IQSL). (PN)

DEVELOPMENT AND VALIDATION OF A NEW SELF-REPORT MEASURE OF PAIN BEHAVIORS

PubMed Central

Cook, Karon F.; Keefe, Francis; Jensen, Mark P.; Roddey, Toni S.; Callahan, Leigh F.; Revicki, Dennis; Bamer, Alyssa M.; Kim, Jiseon; Chung, Hyewon; Salem, Rana; Amtmann, Dagmar

2013-01-01

Pain behaviors that are maintained beyond the acute stage post-injury can contribute to subsequent psychosocial and physical disability. Critical to the study of pain behaviors is the availability of psychometrically sound pain behavior measures. In this study we developed a self-report measure of pain behaviors, the Pain Behaviors Self Report (PaB-SR). PaB-SR scores were developed using item response theory and evaluated using a rigorous, multiple-witness approach to validity testing. Participants included: a) 661 survey participants with chronic pain and with multiple sclerosis (MS), back pain, or arthritis; b) 618 survey participants who were significant others of a chronic pain participant; and c) 86 participants in a videotaped pain behavior observation protocol. Scores on the PaB-SR were found to be measurement invariant with respect to clinical condition. PaB-SR scores, observer-reports, and the video-taped protocol yielded distinct, but convergent views of pain behavior, supporting the validity of the new measure. The PaB-SR is expected to be of substantial utility to researchers wishing to explore the relationship between pain behaviors and constructs such as pain intensity, pain interference, and disability. PMID:23994451

Development and Validation of the Behavioral Avoidance Test-Back Pain (BAT-Back) for Patients With Chronic Low Back Pain.

PubMed

Holzapfel, Sebastian; Riecke, Jenny; Rief, Winfried; Schneider, Jessica; Glombiewski, Julia A

2016-11-01

Pain-related fear and avoidance of physical activities are central elements of the fear-avoidance model of musculoskeletal pain. Pain-related fear has typically been measured by self-report instruments. In this study, we developed and validated a Behavioral Avoidance Test (BAT) for chronic low back pain (CLBP) patients with the aim of assessing pain-related avoidance behavior by direct observation. The BAT-Back was administered to a group of CLBP patients (N=97) and pain-free controls (N=31). Furthermore, pain, pain-related fear, disability, catastrophizing, and avoidance behavior were measured using self-report instruments. Reliability was assessed with intraclass correlation coefficient and Cronbach α. Validity was assessed by examining correlation and regression analysis. The intraclass correlation coefficient for the BAT-Back avoidance score was r=0.76. Internal consistency was α=0.95. CLBP patients and controls differed significantly on BAT-Back avoidance scores as well as self-report measures. BAT-Back avoidance scores were significantly correlated with scores on each of the self-report measures (rs=0.27 to 0.54). They were not significantly correlated with general anxiety and depression, age, body mass index, and pain duration. The BAT-Back avoidance score was able to capture unique variance in disability after controlling for other variables (eg, pain intensity and pain-related fear). Results indicate that the BAT-Back is a reliable and valid measure of pain-related avoidance behavior. It may be useful for clinicians in tailoring treatments for chronic pain as well as an outcome measure for exposure treatments.

Measuring Cognitive Load with Electroencephalography and Self-Report: Focus on the Effect of English-Medium Learning for Korean Students

ERIC Educational Resources Information Center

Lee, Hyunjeong

2014-01-01

This study investigated a reliable and valid method for measuring cognitive load during learning through comparing various types of cognitive load measurements: electroencephalography (EEG), self-reporting, and learning outcome. A total of 43 college-level students underwent watching a documentary delivered in English or in Korean. EEG was…

Using the PCL-R to Help Estimate the Validity of Two Self-Report Measures of Psychopathy with Offenders

ERIC Educational Resources Information Center

Poythress, Norman G.; Lilienfeld, Scott O.; Skeem, Jennifer L.; Douglas, Kevin S.; Edens, John F.; Epstein, Monica; Patrick, Christopher J.

2010-01-01

Two self-report measures of psychopathy, Levenson's Primary and Secondary Psychopathy scales (LPSP) and the Psychopathic Personality Inventory (PPI), were administered to a large sample of 1,603 offenders. The most widely researched measure of criminal psychopathy, the Hare Psychopathy Checklist-Revised (PCL-R), served as a provisional referent…

Are self-reports of health and morbidities in developing countries misleading? Evidence from India

PubMed Central

Subramanyam, Malavika A; Selvaraj, Sakthivel; Kawachi, Ichiro

2009-01-01

Self reported measures of poor health and morbidities from developing countries tend to be viewed with considerable skepticism. Examination of the social gradient in self-reported health and morbidity measures provides a useful test of the validity of self-reports of poor-health and morbidities. The prevailing view, in part influenced by Amartya Sen, is that socially disadvantaged individuals will fail to perceive and report the presence of illness or health-deficits because an individual’s assessment of their health is directly contingent on their social experience. In this study, we tested whether the association between self-reported poor-health/morbidities and socioeconomic status (SES) in India follows the expected direction or not. Cross sectional logistic regression analyses were carried out on a nationally representative population based sample from the 1998–99 Indian National Family Health Survey (INFHS); and 1995–96 and 2004 Indian National Sample Survey (INSS). Four binary outcomes were analyzed: any self-reported morbidity; self-reported sickness in the last 15 days; self-reported sickness in the past year; and poor self-rated health. In separate adjusted models, individuals with no education reported higher levels of any self-reported, self-reported sickness in the last 15 days, self-reported sickness in the last year, and poor self-rated health compared to those with most education. Contrary to the prevailing thesis, we find that the use of self-rated ill health has face validity as assessed via its relationship to SES. A less dismissive and pessimistic view of health data obtained through self-reports seems warranted. PMID:19019521

Are self-reports of health and morbidities in developing countries misleading? Evidence from India.

PubMed

Subramanian, S V; Subramanyam, Malavika A; Selvaraj, Sakthivel; Kawachi, Ichiro

2009-01-01

Self-reported measures of poor health and morbidities from developing countries tend to be viewed with considerable skepticism. Examination of the social gradient in self-reported health and morbidity measures provides a useful test of the validity of self-reports of poor health and morbidities. The prevailing view, in part influenced by Amartya Sen, is that socially disadvantaged individuals will fail to perceive and report the presence of illness or health-deficits because an individual's assessment of their health is directly contingent on their social experience. In this study, we tested whether the association between self-reported poor health/morbidities and socioeconomic status (SES) in India follows the expected direction or not. Cross-sectional logistic regression analyses were carried out on a nationally representative population-based sample from the 1998 to 1999 Indian National Family Health Survey (INFHS); and 1995-1996 and 2004 Indian National Sample Survey (INSS). Four binary outcomes were analyzed: any self-reported morbidity; self-reported sickness in the last 15 days; self-reported sickness in the past year; and poor self-rated health. In separate adjusted models, individuals with no education reported higher levels of any self-reported, self-reported sickness in the last 15 days, self-reported sickness in the last year, and poor self-rated health compared to those with most education. Contrary to the prevailing thesis, we find that the use of self-rated ill-health has face validity as assessed via its relationship to SES. A less dismissive and pessimistic view of health data obtained through self-reports seems warranted.

Assessing self-regulation strategies: development and validation of the tempest self-regulation questionnaire for eating (TESQ-E) in adolescents.

PubMed

De Vet, Emely; De Ridder, Denise; Stok, Marijn; Brunso, Karen; Baban, Adriana; Gaspar, Tania

2014-09-02

Applying self-regulation strategies have proven important in eating behaviors, but it remains subject to investigation what strategies adolescents report to use to ensure healthy eating, and adequate measures are lacking. Therefore, we developed and validated a self-regulation questionnaire applied to eating (TESQ-E) for adolescents. Study 1 reports a four-step approach to develop the TESQ-E questionnaire (n = 1097). Study 2 was a cross-sectional survey among adolescents from nine European countries (n = 11,392) that assessed the TESQ-E, eating-related behaviors, dietary intake and background characteristics. In study 3, the TESQ-E was administered twice within four weeks to evaluate test-retest reliability (n = 140). Study 4 was a cross-sectional survey (n = 93) that assessed the TESQ-E and related psychological constructs (e.g., motivation, autonomy, self-control). All participants were aged between 10 and 17 years. Study 1 resulted in a 24-item questionnaire assessing adolescent-reported use of six specific strategies for healthy eating that represent three general self-regulation approaches. Study 2 showed that the easy-to-administer theory-based TESQ-E has a clear factor structure and good subscale reliabilities. The questionnaire was related to eating-related behaviors and dietary intake, indicating predictive validity. Study 3 showed good test-retest reliabilities for the TESQ-E. Study 4 indicated that TESQ-E was related to but also distinguishable from general self-regulation and motivation measures. The TESQ-E provides a reliable and valid measure to assess six theory-based self-regulation strategies that adolescents may use to ensure their healthy eating.

Can you really swim? Validation of self and parental reports of swim skill with an inwater swim test among children attending community pools in Washington State.

PubMed

Mercado, Melissa C; Quan, Linda; Bennett, Elizabeth; Gilchrist, Julie; Levy, Benjamin A; Robinson, Candice L; Wendorf, Kristen; Gangan Fife, Maria Aurora; Stevens, Mark R; Lee, Robin

2016-08-01

Drowning is the second leading cause of unintentional injury death among US children. Multiple studies describe decreased drowning risk among children possessing some swim skills. Current surveillance for this protective factor is self/proxy-reported swim skill rather than observed inwater performance; however, children's self-report or parents' proxy report of swim skill has not been validated. This is the first US study to evaluate whether children or parents can validly report a child's swim skill. It also explores which swim skill survey measure(s) correlate with children's inwater swim performance. For this cross-sectional convenience-based sample, pilot study, child/parent dyads (N=482) were recruited at three outdoor public pools in Washington State. Agreement between measures of self-reports and parental-reports of children's swim skill was assessed via paired analyses, and validated by inwater swim test results. Participants were representative of pool's patrons (ie, non-Hispanic White, highly educated, high income). There was agreement in child/parent dyads' reports of the following child swim skill measures: 'ever taken swim lessons', perceived 'good swim skills' and 'comfort in water over head'. Correlation analyses suggest that reported 'good swim skills' was the best survey measure to assess a child's swim skill-best if the parent was the informant (r=0.25-0.47). History of swim lessons was not significantly correlated with passing the swim test. Reported 'good swim skills' was most correlated with observed swim skill. Reporting 'yes' to 'ever taken swim lessons' did not correlate with swim skill. While non-generalisable, findings can help inform future studies. Published by the BMJ Publishing Group Limited. For permission to use (where not already granted under a licence) please go to http://www.bmj.com/company/products-services/rights-and-licensing/

Using brief self-reports and clinician scales to screen for substance use disorders in psychotic patients.

PubMed

Møller, Turid; Linaker, Olav M

2010-04-01

The aims of this study were to examine evidence for the concurrent validity of two self-report measures and two staff-report measures measuring alcohol and drug problems in seriously mentally ill people and to examine if psychotic patients under-report their alcohol and drug problems in an early intervention clinic. This is a cross-sectional study of 48 patients (26 inpatients and 22 outpatients) from an early intervention clinic for psychosis. To examine the sensitivity and specificity, we compared both the staff-report measures Clinical Alcohol Use Scale (AUS) and Clinical Drug Use Scale (DUS) and the self-report measures Short Michigan Alcohol Screening Test (SMAST-13) and Drug Abuse Screening Test (DAST-20), with the current ICD-10 diagnostic criteria as the gold-standard for alcohol and drug problems. To examine whether the patients under-report their alcohol and drug problems, we also compared the self-report measures SMAST-13 and DAST-20 with the staff-report measures AUS and DUS and ICD-10 consensus substance abuse diagnoses. The results show that the concurrent validity compared with ICD-10 diagnoses was moderate for both the staff-report measures AUS and DUS and for the self-report measures SMAST-13 and DAST-20. Three out of seven patients under-report alcohol problems and one patient out of seven under-report drug use problems according to consensus ICD-10 substance abuse diagnoses. We conclude that the SMAST-13 and DAST-20 in combination with the AUS and DUS, which are easy and quick to perform, are helpful in establishing a common understanding of the patient's alcohol and drug problems in an early intervention clinic.

Development and validation of the Self-Esteem And Relationship (SEAR) questionnaire in erectile dysfunction.

PubMed

Cappelleri, J C; Althof, S E; Siegel, R L; Shpilsky, A; Bell, S S; Duttagupta, S

2004-02-01

Development and validation of a patient-reported measure of psychosocial variables in men with erectile dysfunction (ED) is described. Literature review, focus groups, and medical specialists identified 86 potential items. Redundant, ambiguous, or low item-to-total correlation items were removed. Data from 98 men reporting diagnosed ED and 94 controls assisted in final item selection and psychometric evaluation. Treatment responsiveness was evaluated in 93 men with ED in a 10-week open-label trial of sildenafil citrate (Viagra). The 14 chosen items resolved into two domains: Sexual Relationship (eight items) and Confidence (six items), the latter comprising Self-Esteem (four items) and Overall Relationship (two items) subscales. The resulting Self-Esteem And Relationship (SEAR) questionnaire demonstrated validity and reliability. The intervention study demonstrated responsiveness to beneficial treatment with significant improvement in scores (P=0.0001). The SEAR questionnaire possesses strong psychometric properties that support its validity and reliability for measuring sexual relationship, confidence, and particularly self-esteem.

Self-Rating and Respondent Anonymity

ERIC Educational Resources Information Center

Goh, Jonathan W. P.; Lee, Ong Kim; Salleh, Hairon

2010-01-01

Background: Most empirical investigations in survey research have been conducted using self-reported or self-evaluated item responses. Such measures are common because they are relatively easy to obtain and are often the only feasible way to assess constructs of interest. In order to improve on the validity of self-reports it has become a common…

Subjective quality of life in psychosis: Evidence for an association with real world functioning?

PubMed

Leendertse, Pien; Myin-Germeys, Inez; Lataster, Tineke; Simons, Claudia J P; Oorschot, Margreet; Lardinois, Mariëlle; Schneider, Maude; van Os, Jim; Reininghaus, Ulrich

2018-03-01

Subjective quality of life (SQOL) is an established patient-reported outcome in psychosis. However, current self-report measures of SQOL may be affected by recall bias and may not fully capture dynamic changes in SQOL over time. This study aimed to examine the ecological validity of self-reported and momentary assessment measures of SQOL, and their association with emotional experience, social interaction and activity in real life, in both patients with psychotic disorder (n = 56) and controls (n = 71). Self-reported QOL was assessed with the WHO-QOL, momentary QOL and real life experiences were assessed with the Experience Sampling Method (ESM). Results show that both measures were significantly associated in patients and controls, and associations with emotional experience were most relevant, momentary QOL being a stronger predictor than self-reported QOL. The association between momentary QOL and negative affect was stronger in patients than in controls. Overall, momentary QOL was more consistently associated with affect, social interaction and activity, while self-reported QOL displayed a more narrow association with mostly affect. Concluding, concurrent assessment of self-reported QOL and momentary QOL showed that momentary QOL may enhance the ecological validity of SQOL measurement. Experience sampling research may broaden our perspective on SQOL and its associations with real life functioning. Copyright © 2017 Elsevier B.V. All rights reserved.

Comparing the validity of informant and self-reports of personality using laboratory indices of emotional responding as criterion variables.

PubMed

Lieberman, Lynne; Liu, Huiting; Huggins, Ashley A; Katz, Andrea C; Zvolensky, Michael J; Shankman, Stewart A

2016-09-01

Personality traits relate to risk for psychopathology and can inform predictions about treatment outcome. In an effort to obtain a comprehensive index of personality, informant reports of personality are sometimes obtained in addition to self-reports of personality. However, there is limited research comparing the validity of self- and informant reports of personality, particularly among those with internalizing psychopathology. This is important given that informants may provide an additional (and perhaps different) perspective on individuals' personality. The present study therefore compared how both reports of positive affectivity (PA) and negative affectivity (NA) relate to psychophysiological and subjective measures of emotional responding to positive and negative stimuli. Given that our sample (n = 117) included individuals with no history of psychopathology, as well as individuals with major depressive disorder (MDD) and/or panic disorder (PD), we were also able to explore whether these internalizing diagnoses moderated the association between personality reports and measures of emotional responding. Informant-reported PA predicted physiological responses to positive stimuli (but not negative). Informant-reported NA predicted physiological responses to negative stimuli (but not positive). Self-reported personality did not predict physiological responding, but did predict subjectively measured emotional responding (NA for negative responding, PA for positive responding). Diagnoses of internalizing psychopathology (PD or MDD) did not moderate these associations. Results suggest self- and informant reports of personality may each provide valid indices of an individual's emotional response tendencies, but predict different aspects of those tendencies. © 2016 Society for Psychophysiological Research.

Smartphone-Based Self-Assessment of Stress in Healthy Adult Individuals: A Systematic Review

PubMed Central

Þórarinsdóttir, Helga; Kessing, Lars Vedel

2017-01-01

Background Stress is a common experience in today’s society. Smartphone ownership is widespread, and smartphones can be used to monitor health and well-being. Smartphone-based self-assessment of stress can be done in naturalistic settings and may potentially reflect real-time stress level. Objective The objectives of this systematic review were to evaluate (1) the use of smartphones to measure self-assessed stress in healthy adult individuals, (2) the validity of smartphone-based self-assessed stress compared with validated stress scales, and (3) the association between smartphone-based self-assessed stress and smartphone generated objective data. Methods A systematic review of the scientific literature was reported and conducted according to the Preferred Reporting Items for Systematic Reviews and Meta-Analysis (PRISMA) statement. The scientific databases PubMed, PsycINFO, Embase, IEEE, and ACM were searched and supplemented by a hand search of reference lists. The databases were searched for original studies involving healthy individuals older than 18 years, measuring self-assessed stress using smartphones. Results A total of 35 published articles comprising 1464 individuals were included for review. According to the objectives, (1) study designs were heterogeneous, and smartphone-based self-assessed stress was measured using various methods (e.g., dichotomized questions on stress, yes or no; Likert scales on stress; and questionnaires); (2) the validity of smartphone-based self-assessed stress compared with validated stress scales was investigated in 3 studies, and of these, only 1 study found a moderate statistically significant positive correlation (r=.4; P<.05); and (3) in exploratory analyses, smartphone-based self-assessed stress was found to correlate with some of the reported smartphone generated objective data, including voice features and data on activity and phone usage. Conclusions Smartphones are being used to measure self-assessed stress in different contexts. The evidence of the validity of smartphone-based self-assessed stress is limited and should be investigated further. Smartphone generated objective data can potentially be used to monitor, predict, and reduce stress levels. PMID:28193600

Smartphone-Based Self-Assessment of Stress in Healthy Adult Individuals: A Systematic Review.

PubMed

Þórarinsdóttir, Helga; Kessing, Lars Vedel; Faurholt-Jepsen, Maria

2017-02-13

Stress is a common experience in today's society. Smartphone ownership is widespread, and smartphones can be used to monitor health and well-being. Smartphone-based self-assessment of stress can be done in naturalistic settings and may potentially reflect real-time stress level. The objectives of this systematic review were to evaluate (1) the use of smartphones to measure self-assessed stress in healthy adult individuals, (2) the validity of smartphone-based self-assessed stress compared with validated stress scales, and (3) the association between smartphone-based self-assessed stress and smartphone generated objective data. A systematic review of the scientific literature was reported and conducted according to the Preferred Reporting Items for Systematic Reviews and Meta-Analysis (PRISMA) statement. The scientific databases PubMed, PsycINFO, Embase, IEEE, and ACM were searched and supplemented by a hand search of reference lists. The databases were searched for original studies involving healthy individuals older than 18 years, measuring self-assessed stress using smartphones. A total of 35 published articles comprising 1464 individuals were included for review. According to the objectives, (1) study designs were heterogeneous, and smartphone-based self-assessed stress was measured using various methods (e.g., dichotomized questions on stress, yes or no; Likert scales on stress; and questionnaires); (2) the validity of smartphone-based self-assessed stress compared with validated stress scales was investigated in 3 studies, and of these, only 1 study found a moderate statistically significant positive correlation (r=.4; P<.05); and (3) in exploratory analyses, smartphone-based self-assessed stress was found to correlate with some of the reported smartphone generated objective data, including voice features and data on activity and phone usage. Smartphones are being used to measure self-assessed stress in different contexts. The evidence of the validity of smartphone-based self-assessed stress is limited and should be investigated further. Smartphone generated objective data can potentially be used to monitor, predict, and reduce stress levels. ©Helga Þórarinsdóttir, Lars Vedel Kessing, Maria Faurholt-Jepsen. Originally published in the Journal of Medical Internet Research (http://www.jmir.org), 13.02.2017.

The validity of self-reported vs. measured body weight and height and the effect of self-perception.

PubMed

Gokler, Mehmet Enes; Bugrul, Necati; Sarı, Ahu Ozturk; Metintas, Selma

2018-01-01

The objective was to assess the validity of self-reported body weight and height and the possible influence of self-perception of body mass index (BMI) status on the actual BMI during the adolescent period. This cross sectional study was conducted on 3918 high school students. Accurate BMI perception occurred when the student's self-perception of their BMI status did not differ from their actual BMI based on measured height and weight. Agreement between the measured and self-reported body height and weight and BMI values was determined using the Bland-Altman metod. To determine the effects of "a good level of agreement", hierarchical logistic regression models were used. Among male students who reported their BMI in the normal region, 2.8% were measured as overweight while 0.6% of them were measured as obese. For females in the same group, these percentages were 1.3% and 0.4% respectively. Among male students who perceived their BMI in the normal region, 8.5% were measured as overweight while 0.4% of them were measured as obese. For females these percentages were 25.6% and 1.8% respectively. According to logistic regression analysis, residence and accurate BMI perception were significantly associated with "good agreement" ( p ≤ 0.001). The results of this study demonstrated that in determining obesity and overweight statuses, non-accurate weight perception is a potential risk for students.

THE ADOLESCENT MEASURE OF CONFIDENCE AND MUSCULOSKELETAL PERFORMANCE (AMCAMP): DEVELOPMENT AND INITIAL VALIDATION

PubMed Central

May, Keith H.; Edwards, Michael C.; Goldstein, Marc S.

2016-01-01

Background Although the relationship of self-efficacy to sports performance is well established, little attention has been paid to self-efficacy in the movements or actions that are required to perform daily activities and prepare the individual to resume sports participation following an injury and associated period of rehabilitation. There are no instruments to measure self-confidence in movement validated in an adolescent population. Purpose The purpose of this paper is to report on the development of the AMCaMP, a self-report measure of confidence in movement and provide some initial evidence to support its use as a measure of confidence in movement. Methods The AMCaMP was adapted from OPTIMAL, a self-report instrument that measures confidence in movement, which had been previously designed and validated in an adult population. Data were collected from 1,115 adolescent athletes from 12 outpatient physical therapy clinics in a single healthcare system. Results Exploratory factor analysis of the 22 items of the AMCaMP using a test sample revealed a three factor structure (trunk, lower body, upper body). Confirmatory factor analysis using a validation sample demonstrated a similar model fit with the data. Reliability of scores on each of three clusters of items identified by factor analysis was assessed with coefficient alpha (range = 0.82 to 0.94), Standard Error of Measurement (1.38 to 2.74), and Minimum Detectable Change (3.83 to 7.6). Conclusions AMCaMP has acceptable psychometric properties for use in adolescents (ages 11 to 18) as a patient-centric outcome measure of confidence in movement abilities after rehabilitation. Level of Evidence IV PMID:27757282

Measuring stigma in children receiving mental health treatment: Validation of the Paediatric Self-Stigmatization Scale (PaedS).

PubMed

Kaushik, A; Papachristou, E; Dima, D; Fewings, S; Kostaki, E; Ploubidis, G B; Kyriakopoulos, M

2017-06-01

Research on the impact of stigma associated with mental illness in children is scarce. Considering the known negative effects of stigma associated with mental illness in adults, it is crucial to explore the stigma experienced by children who access mental health treatment. However, no scale measuring self-stigmatization in younger children is available to date. This study aimed to develop and validate such a scale, the Paediatric Self-Stigmatization Scale (PaedS). A total of 156 children (119 receiving outpatient and 37 receiving inpatient treatment), aged 8-12 years, completed the PaedS, the Self-Perception Profile for Children and the Pediatric Quality of Life Inventory (PedsQL - Child Report, ages 8-12). In addition, parents completed the PedsQL (Parent Report for Children, ages 8-12), the Strengths and Difficulties Questionnaire (SDQ) and a modified subscale of the PaedS measuring the children's rejection by others due to their mental health difficulties. A confirmatory factor analysis showed that a four-factor structure, comprising Societal Devaluation, Personal Rejection, Self-Stigma and Secrecy scales, had excellent fit to the data (CFI=0.95; TLI=0.95; RMSEA=0.05). Child-reported PaedS scores were positively correlated with parental-reported PaedS scores and negatively with PedsQL, the SDQ, and 5 out of 6 subscales of the Self-Perception Profile for Children, suggesting adequate convergent validity (all P-values<0.05). The PaedS is a valid instrument, which is hoped to advance the understanding of self-stigmatization in children with mental health difficulties and contribute to its prevention. Copyright © 2017 Elsevier Masson SAS. All rights reserved.

Assessing dependency using self-report and indirect measures: examining the significance of discrepancies.

PubMed

Cogswell, Alex; Alloy, Lauren B; Karpinski, Andrew; Grant, David A

2010-07-01

The present study addressed convergence between self-report and indirect approaches to assessing dependency. We were moderately successful in validating an implicit measure, which was found to be reliable, orthogonal to 2 self-report instruments, and predictive of external criteria. This study also examined discrepancies between scores on self-report and implicit measures, and has implications for their significance. The possibility that discrepancies themselves are pathological was not supported, although discrepancies were associated with particular personality profiles. Finally, this study offered additional evidence for the relation between dependency and depressive symptomatology and identified implicit dependency as contributing unique variance in predicting past major depression.

A Pilot Study of the Validity of Self-reported Ultraviolet Radiation Exposure and Sun Protection Practices Among Lifeguards, Parents and Children

PubMed Central

O’Riordan, David L.; Glanz, Karen; Gies, Peter; Elliott, Tom

2013-01-01

Outdoor recreation settings, such as swimming pools, provide a promising venue to assess UVR exposure and sun protection practices among individuals who are minimally clothed and exposed to potentially high levels of UVR. Most studies assessing sun exposure/protection practices rely on self-reported data, which are subject to bias. The aim of this study was to establish the feasibility of conducting a multimethod study to examine the validity of self-reported measures within a swimming pool setting. Data were collected from 27 lifeguards, children and parents in Hawaii. Each participant filled out a survey and a 4 day sun habits diary. On two occasions, researchers assessed observable sun protection behaviors (wearing hats, shirts, sunglasses), swabbed the skin to detect the presence of sunscreen, and subjects wore polysulphone dosimeters to measure UVR exposure. Overall, observed sun protection behaviors were more highly correlated with diary reports than with survey reports. While lifeguards and children reported spending comparable amounts of time in the sun, dosimeter measures showed that lifeguards received twice as much UVR exposure. This study demonstrated the feasibility of implementing a multimethod validity study within a broader population of swimming pools. PMID:18179624

An empirical comparison of the measurement properties of the EQ-5D-5L, DEMQOL-U and DEMQOL-Proxy-U for older people in residential care.

PubMed

Easton, Tiffany; Milte, Rachel; Crotty, Maria; Ratcliffe, Julie

2018-05-01

This study aimed to empirically compare the measurement properties of self-reported and proxy-reported (in cases of severe cognitive impairment) generic (EQ-5D-5L) and condition-specific (DEMQOL-U and DEMQOL-Proxy-U) preference-based HRQoL instruments in residential care, where the population is characterised by older people with high rates of cognitive impairment, dementia and disability. Participants were recruited from seventeen residential care facilities across four Australian states. One hundred and forty-three participants self-completed the EQ-5D-5L and the DEMQOL-U while three hundred and eight-seven proxy completed (due to the presence of severe dementia) the EQ-5D-5L and DEMQOL-Proxy-U. The convergent validity of the outcome measures and known group validity relative to a series of clinical outcome measures were assessed. Results satisfy convergent validity among the outcome measures. EQ-5D-5L and DEMQOL-U utilities were found to be significantly correlated with each other (p < 0.01) as were EQ-5D-5L and DEMQOL-Proxy-U utilities (p < 0.01). Both self-reported and proxy-reported EQ-5D-5L utilities demonstrated strong known group validity in relation to clinically recognised thresholds of cognition and physical functioning, while in contrast neither DEMQOL-U nor DEMQOL-Proxy-U demonstrated this association. The findings suggest that the EQ-5D-5L, DEMQOL-U and DEMQOL-Proxy-U capture distinct aspects of HRQoL for this population. The measurement and valuation of HRQoL form an essential component of economic evaluation in residential care. However, high levels of cognitive impairment may preclude self-completion for a majority. Further research is needed to determine cognition thresholds beyond which an individual is unable to reliably self-report their own health-related quality of life.

A peer-nomination assessment of electronic forms of aggression and victimization.

PubMed

Badaly, Daryaneh; Duong, Mylien T; Ross, Alexandra C; Schwartz, David

2015-10-01

The perpetration and receipt of electronic aggression have largely been assessed with self-report questionnaires. Using a sample of 573 adolescents, the current study compared the psychometric properties of a peer-nomination measure of electronic aggression and victimization to the more widely used self-report approach. Estimates of the reliability, stability, and concordance of peer- and self-report assessments were adequate, mirroring those from research on aggressive exchanges in school. Analyses of validity and utility revealed that peer-nominations, compared to self-reports, provide overlapping and distinct information on adolescents' social, emotional, and academic adjustment. Overall, these findings provide evidence that peer-nominations are a reliable, valid, and useful means for measuring electronic aggression and victimization. Future work will benefit from their incorporation into multi-method assessments. Copyright © 2015 The Foundation for Professionals in Services for Adolescents. Published by Elsevier Ltd. All rights reserved.

The development and preliminary psychometric evaluation of an attachment Implicit Association Task.

PubMed

Venta, Amanda; Jardin, Charles; Kalpakci, Allison; Sharp, Carla

2016-01-01

The importance of measuring attachment insecurity is underscored by a vast literature tying attachment insecurity to numerous psychological disorders. Self-report measures assess explicit attachment beliefs and experiences, while interview measures, like the Adult Attachment Interview, assess implicit internal working models about the self as worthy of care and others as reliable sources of care. The present study is a preliminary psychometric evaluation of a potentially cost-effective method of assessing implicit internal working models of attachment through the development of an Implicit Association Test (IAT). A racially diverse sample of 104 college females was administered Internet-based versions of three IATs (assessing views of the self, mother, and father) as well as self-report measures of attachment and interpersonal problems. Analyses were conducted to evaluate the (a) internal consistency of each task, (b) correlations among the tasks, (c) concurrent validity, and (d) convergent validity. Adequate internal consistency was noted and correlations among the three IATs were significant. No significant associations were observed between the explicit self-report measures of attachment and the IATs. Two primary areas for future research are discussed. First, future research should utilize an implicit attachment measure alongside an IAT. Second, future research should reevaluate the IAT stimuli used.

The Relation of the Response Distribution to Self-Report Questionnaire Items and Cognitive Ability among School-Aged Children

ERIC Educational Resources Information Center

Stapleton, Laura M.; Reiner, Laura S.; Aluvathingal, Anu J.

2010-01-01

This proposed research is part of an on-going line of research of developing questionnaire instruments for use at the elementary school level. Because field trials often use child self-report as outcome measures and sometimes determine implementation fidelity using such measures, evaluation of the validity of the use of such measures with…

The Development and Validation of the Protective Factors Survey: A Self-Report Measure of Protective Factors against Child Maltreatment

ERIC Educational Resources Information Center

Counts, Jacqueline M.; Buffington, Elenor S.; Chang-Rios, Karin; Rasmussen, Heather N.; Preacher, Kristopher J.

2010-01-01

Objective: The objective of this study was to evaluate the internal structure of a self-report measure of multiple family-level protective factors against abuse and neglect and explore the relationship of this instrument to other measures of child maltreatment. Methods: For the exploratory factor analysis, 11 agencies from 4 states administered…

Development and Validation of a Brief Self-Report Measure of Trauma Exposure: The Trauma History Screen

ERIC Educational Resources Information Center

Carlson, Eve B.; Smith, Steve R.; Palmieri, Patrick A.; Dalenberg, Constance; Ruzek, Josef I.; Kimerling, Rachel; Burling, Thomas A.; Spain, David A.

2011-01-01

Although information about individuals' exposure to highly stressful events such as traumatic stressors is often very useful for clinicians and researchers, available measures are too long and complex for use in many settings. The Trauma History Screen (THS) was developed to provide a very brief and easy-to-complete self-report measure of exposure…

The Impact of Validity Screening on Associations between Self-Reports of Bullying Victimization and Student Outcomes

ERIC Educational Resources Information Center

Jia, Yuane; Konold, Timothy R.; Cornell, Dewey; Huang, Francis

2018-01-01

Self-report surveys are widely used to measure adolescent risk behavior and academic adjustment, with results having an impact on national policy, assessment of school quality, and evaluation of school interventions. However, data obtained from self-reports can be distorted when adolescents intentionally provide inaccurate or careless responses.…

A prospective study of the validity of self-reported use of specific types of dental services.

PubMed

Gilbert, Gregg H; Rose, John S; Shelton, Brent J

2003-01-01

The purpose of this study was to quantify the validity of self-reported receipt of dental services in 10 categories, using information from dental charts as the "gold standard." The Florida Dental Care Study was a prospective cohort study of a diverse sample of adults. In-person interviews were conducted at baseline and at 24 and 48 months following baseline, with telephone interviews at six-month intervals in between. Participants reported new dental visits, reason(s) for the visit(s), and specific service(s) received. For the present study, self-reported data were compared with data from patients' dental charts. Percent concordance between self-report and dental charts ranged from 82% to 100%, while Kappa values ranged from 0.33 to 0.91. Bivariate multiple logistic regressions were performed for each of the service categories, with two outcomes: self-reported service receipt and service receipt determined from the dental chart. Parameter estimate intervals overlapped for each of the four hypothesized predictors of service receipt (age group, sex, "race" defined as non-Hispanic African American vs. non-Hispanic white, and annual household income < 20,000 US dollars vs. > or = 20,000 US dollars), although for five of the 10 service categories, there were differences in conclusions about statistical significance for certain predictors. The validity of self-reported use of dental services ranged from poor to excellent, depending upon the service type. Regression estimates using either the self-reported or chart-validated measure yielded similar results overall, but conclusions about key predictors of service use differed in some instances. Self-reported dental service use is valid for some, but not all, service types.

Construct validity and test-retest reliability of the International Fitness Scale (IFIS) in Colombian children and adolescents aged 9-17.9 years: the FUPRECOL study.

PubMed

Ramírez-Vélez, Robinson; Cruz-Salazar, Sandra Milena; Martínez, Myriam; Cadore, Eduardo L; Alonso-Martinez, Alicia M; Correa-Bautista, Jorge E; Izquierdo, Mikel; Ortega, Francisco B; García-Hermoso, Antonio

2017-01-01

There is a lack of instruments and studies written in Spanish evaluating physical fitness, impeding the determination of the current status of this important health indicator in the Latin population, especially in Colombia. The aim of the study was two-fold: to examine the validity of the International Fitness Scale (IFIS) with a population-based sample of schoolchildren from Bogota, Colombia and to examine the reliability of the IFIS with children and adolescents from Engativa, Colombia. The sample comprised 1,873 Colombian youths (54.5% girls) aged 9-17.9 years. We measured their adiposity markers (waist-to-height ratio, skinfold thickness, percentage of body fat and body mass index), blood pressure, lipids profile, fasting glucose, and physical fitness level (self-reported and measured). A validated cardiometabolic risk index score was also used. An age- and sex-matched subsample of 229 schoolchildren who were not originally included in the sample completed the IFIS twice for reliability purposes. Our data suggest that both measured and self-reported overall physical fitness levels were inversely associated with percentage of body fat indicators and the cardiometabolic risk index score. Overall, schoolchildren who self-reported "good" or "very good" fitness had better measured fitness levels than those who reported "very poor/poor" fitness (all p  < 0.001). The test-retest reliability of the IFIS items was also good, with an average weighted kappa of 0.811. Our findings suggest that self-reported fitness, as assessed by the IFIS, is a valid, reliable, and health-related measure. Furthermore, it can be a good alternative for future use in large studies with Latin schoolchildren from Colombia.

Construct validity and test–retest reliability of the International Fitness Scale (IFIS) in Colombian children and adolescents aged 9–17.9 years: the FUPRECOL study

PubMed Central

Correa-Bautista, Jorge E.; Izquierdo, Mikel

2017-01-01

Background There is a lack of instruments and studies written in Spanish evaluating physical fitness, impeding the determination of the current status of this important health indicator in the Latin population, especially in Colombia. The aim of the study was two-fold: to examine the validity of the International Fitness Scale (IFIS) with a population-based sample of schoolchildren from Bogota, Colombia and to examine the reliability of the IFIS with children and adolescents from Engativa, Colombia. Methods The sample comprised 1,873 Colombian youths (54.5% girls) aged 9–17.9 years. We measured their adiposity markers (waist-to-height ratio, skinfold thickness, percentage of body fat and body mass index), blood pressure, lipids profile, fasting glucose, and physical fitness level (self-reported and measured). A validated cardiometabolic risk index score was also used. An age- and sex-matched subsample of 229 schoolchildren who were not originally included in the sample completed the IFIS twice for reliability purposes. Results Our data suggest that both measured and self-reported overall physical fitness levels were inversely associated with percentage of body fat indicators and the cardiometabolic risk index score. Overall, schoolchildren who self-reported “good” or “very good” fitness had better measured fitness levels than those who reported “very poor/poor” fitness (all p < 0.001). The test-retest reliability of the IFIS items was also good, with an average weighted kappa of 0.811. Discussion Our findings suggest that self-reported fitness, as assessed by the IFIS, is a valid, reliable, and health-related measure. Furthermore, it can be a good alternative for future use in large studies with Latin schoolchildren from Colombia. PMID:28560104

Self-Report and Dry Blood Spot Measurement of Antiretroviral Medications as Markers of Adherence in Pregnant Women in Rural South Africa.

PubMed

Alcaide, Maria L; Ramlagan, Shandir; Rodriguez, Violeta J; Cook, Ryan; Peltzer, Karl; Weiss, Stephen M; Sifunda, Sibusiso; Jones, Deborah L

2017-07-01

Antiretroviral (ARV) adherence is essential to prevent mother-to-child transmission of HIV. This study compared self-reported adherence versus ARV detection in dried blood spots (DBS) among N = 392 HIV-infected pregnant women in South Africa (SA). Women completed two self-reported adherence measures [visual analog scale (VAS), AIDS Clinical Trials Group Adherence (ACTG)]. Adherence was 89% (VAS), 80% (ACTG), and 74% (DBS). Self-report measures marginally agreed with DBS (VAS: Kappa = 0.101, Area under the ROC curve (AUROC) = 0.543; ACTG: Kappa  = 0.081, AUROC = 0.538). Self-reported adherence was overestimated and agreement with DBS was poor. Validation of self-reported ARV adherence among pregnant HIV+ women in SA is needed.

Workplace status: The development and validation of a scale.

PubMed

Djurdjevic, Emilija; Stoverink, Adam C; Klotz, Anthony C; Koopman, Joel; da Motta Veiga, Serge P; Yam, Kai Chi; Chiang, Jack Ting-Ju

2017-07-01

Research suggests that employee status, and various status proxies, relate to a number of meaningful outcomes in the workplace. The advancement of the study of status in organizational settings has, however, been stymied by the lack of a validated workplace status measure. The purpose of this manuscript, therefore, is to develop and validate a measure of workplace status based on a theoretically grounded definition of status in organizations. Subject-matter experts were used to examine the content validity of the measure. Then, 2 separate samples were employed to assess the psychometric properties (i.e., factor structure, reliability, convergent and discriminant validity) and nomological network of a 5-item, self-report Workplace Status Scale (WSS). To allow for methodological flexibility, an additional 3 samples were used to extend the WSS to coworker reports of a focal employee's status, provide additional evidence for the validity and reliability of the WSS, and to demonstrate consensus among coworker ratings. Together, these studies provide evidence of the psychometric soundness of the WSS for assessing employee status using either self-reports or other-source reports. The implications of the development of the WSS for the study of status in organizations are discussed, and suggestions for future research using the new measure are offered. (PsycINFO Database Record (c) 2017 APA, all rights reserved).

Development and Validation of a Multicultural Consciousness Instrument

ERIC Educational Resources Information Center

Dean, Shannon R.

2017-01-01

Developing multiculturally competent citizens is at the forefront of the espoused mission of higher education. The purpose of this study was to develop and validate a self-report instrument to measure traditional-age (18-to 24-year-old) college students' multicultural consciousness (e.g., awareness of self, knowledge of difference, and…

External validity of children's self-reported sleep functioning: associations with academic, social, and behavioral adjustment.

PubMed

Becker, Stephen P

2014-09-01

Several child-report measures of sleep functioning have been developed but very few studies have examined the external validity of child self-reported sleep in relation to daytime functioning. This study examined child-reported sleep in relation to teacher-rated psychopathology symptoms and also tested the hypothesis that child-reported sleep would be associated with poorer child- and teacher-reported functioning after controlling for demographics and psychopathology symptoms that are known to be associated with adjustment. Participants were 175 children (81 boys, 94 girls) in 1st-6th grades (ages 6-13) and their teachers. Children completed the Sleep Self-Report. Teachers completed a measure of attention-deficit/hyperactivity disorder (ADHD), oppositional/conduct, and anxiety/depression symptoms. Children and teachers completed multiple measures of academic, behavioral, and social/peer functioning. Child-reported sleep was significantly associated with teacher-rated inattentive and internalizing symptoms, even after controlling for child demographics, hyperactivity-impulsivity, and conduct problems. Multilevel modeling analyses further indicated that, after controlling for child demographics and psychopathology symptoms, child-reported sleep problems were significantly associated with poorer child- and teacher-reported academic, behavioral, and social functioning (including increased reactive aggression, peer rejection, loneliness, and lower friendship satisfaction and self-worth). Findings provide initial support for the external validity of children's self-reported sleep functioning. Results of this study suggest that it may be clinically useful to screen for sleep problems by assessing for children's own perceptions of their sleep. Future studies should include both child- and parent-reported sleep functioning to further examine the utility of children's ratings of sleep functioning. Copyright © 2014 Elsevier B.V. All rights reserved.

Assessing the validity and reliability of self-report data on contraception use in the MObile Technology for Improved Family Planning (MOTIF) randomised controlled trial.

PubMed

Smith, Chris; Edwards, Phil; Free, Caroline

2018-03-15

A variety of different approaches to measuring contraceptive use have been used or proposed, either to assess current use or adherence over time, using subjective or objective measures. This paper reports an overview of approaches to measuring adherence to the oral contraceptive, intra-uterine device, sub-dermal implant, and injectable and describes how we assessed contraception use in the MObile Technology for Improved Family Planning (MOTIF) trial in Cambodia. We summarise and discuss advantages and disadvantages of different subjective and objective approaches to measuring adherence to the oral contraceptive, intra-uterine device, sub-dermal implant, and injectable such as self-reports, clinic records, electronic monitoring devices, clinical examination and biomarkers. For the MOTIF trial, we did not consider it feasible to measure objective contraception use as many participants lived a long distance from the clinic and we were concerned whether it was appropriate to ask women to return to clinic for a physical examination simply to verify self-report information already provided. We aimed to assess the validity of the four-month data with 50 participants, calculating the sensitivity and specificity of self-reported data compared with objective measurement. For the 46 valid measurements obtained, the sensitivity and specificity was 100% for self-reported contraception use compared to objective measurement but this study had some limitations. To assess reliability of self-report data we compared calendar data collected on effective contraception use at months 1-4 post-abortion, collected separately at four and 12 months. Agreement ranged from 80 to 84% with a kappa statistic ranging from 0·59 to 0·67 indicating fair to good agreement. There is no perfect method of assessing contraception use and researchers designing future studies should give consideration of what to measure, for example current use or detailed patterns of use over time, and remain mindful of what will be feasible and acceptable to the study population. Although self-reported data on contraception use are considered less reliable, and prone to social desirability bias, it is often the standard approach for contraception research and provides data comparable to previous studies. ClinicalTrials.gov Identifier: NCT01823861 . Registered: March 30, 2013.

Ego Development and Conformity: A Construct Validity Study of the Washington University Sentence Completion Test

ERIC Educational Resources Information Center

Hoppe, Carl F.; Loevinger, Jane

1977-01-01

Self and peer evaluations and experimental measures of conformity were given to 107 adolescent private school boys. Student discipline records also indicated the number of demerits. The self-report measures and the demerits showed maximum conformity between the self-protective and conscientious ego stages as measured by the Sentence Completion…

An international prospective cohort study of mobile phone users and health (COSMOS): Factors affecting validity of self-reported mobile phone use.

PubMed

Toledano, Mireille B; Auvinen, Anssi; Tettamanti, Giorgio; Cao, Yang; Feychting, Maria; Ahlbom, Anders; Fremling, Karin; Heinävaara, Sirpa; Kojo, Katja; Knowles, Gemma; Smith, Rachel B; Schüz, Joachim; Johansen, Christoffer; Poulsen, Aslak Harbo; Deltour, Isabelle; Vermeulen, Roel; Kromhout, Hans; Elliott, Paul; Hillert, Lena

2018-01-01

This study investigates validity of self-reported mobile phone use in a subset of 75 993 adults from the COSMOS cohort study. Agreement between self-reported and operator-derived mobile call frequency and duration for a 3-month period was assessed using Cohen's weighted Kappa (κ). Sensitivity and specificity of both self-reported high (≥10 calls/day or ≥4h/week) and low (≤6 calls/week or <30min/week) mobile phone use were calculated, as compared to operator data. For users of one mobile phone, agreement was fair for call frequency (κ=0.35, 95% CI: 0.35, 0.36) and moderate for call duration (κ=0.50, 95% CI: 0.49, 0.50). Self-reported low call frequency and duration demonstrated high sensitivity (87% and 76% respectively), but for high call frequency and duration sensitivity was lower (38% and 56% respectively), reflecting a tendency for greater underestimation than overestimation. Validity of self-reported mobile phone use was lower in women, younger age groups and those reporting symptoms during/shortly after using a mobile phone. This study highlights the ongoing value of using self-report data to measure mobile phone use. Furthermore, compared to continuous scale estimates used by previous studies, categorical response options used in COSMOS appear to improve validity considerably, most likely by preventing unrealistically high estimates from being reported. Copyright © 2017 Elsevier GmbH. All rights reserved.

The Multimedia Activity Recall for Children and Adolescents (MARCA): development and evaluation.

PubMed

Ridley, Kate; Olds, Tim S; Hill, Alison

2006-05-26

Self-report recall questionnaires are commonly used to measure physical activity, energy expenditure and time use in children and adolescents. However, self-report questionnaires show low to moderate validity, mainly due to inaccuracies in recalling activity in terms of duration and intensity. Aside from recall errors, inaccuracies in estimating energy expenditure from self-report questionnaires are compounded by a lack of data on the energy cost of everyday activities in children and adolescents. This article describes the development of the Multimedia Activity Recall for Children and Adolescents (MARCA), a computer-delivered use-of-time instrument designed to address both the limitations of self-report recall questionnaires in children, and the lack of energy cost data in children. The test-retest reliability of the MARCA was assessed using a sample of 32 children (aged 11.8 +/- 0.7 y) who undertook the MARCA twice within 24-h. Criterion validity was assessed by comparing self-reports with accelerometer counts collected on a sample of 66 children (aged 11.6 +/- 0.8 y). Content and construct validity were assessed by establishing whether data collected using the MARCA on 1429 children (aged 11.9 +/- 0.8 y) exhibited relationships and trends in children's physical activity consistent with established findings from a number of previous research studies. Test-retest reliability was high with intra-class coefficients ranging from 0.88 to 0.94. The MARCA demonstrated criterion validity comparable to other self-report instruments with Spearman coefficients ranging from rho = 0.36 to 0.45, and provided evidence of good content and construct validity. The MARCA is a valid and reliable self-report questionnaire, capable of a wide variety of flexible use-of-time analyses related to both physical activity and sedentary behaviour, and offers advantages over existing pen-and-paper questionnaires.

Development and preliminary validation of a behavioral task of negative reinforcement underlying risk taking and its relation to problem alcohol use in college freshmen

PubMed Central

MacPherson, Laura; Calvin, Nicholas T.; Richards, Jessica M.; Guller, Leila; Mayes, Linda C.; Crowley, Michael J.; Daughters, Stacey B.; Lejuez, C.W.

2011-01-01

Background A long line of theoretical and empirical evidence implicates negative reinforcement as a process underlying the etiology and maintenance of risky alcohol use behaviors from adolescence through emerging adulthood. However, the bulk of this literature has relied on self-report measures and there is a notable absence of behavioral modes of assessments of negative reinforcement-based alcohol-related risk-taking. To address this clear gap in the literature, the current study presents the first published data on the reliability and validity of the Maryland Resource for the Behavioral Utilization of the Reinforcement of Negative Stimuli (MRBURNS), which is a modified version of the positive reinforcement-based Balloon Analogue Risk Task (BART). Methods Participants included a convenience sample of 116 college freshmen ever regular drinkers (aged 18–19) who completed both behavioral tasks; self-report measures of negative reinforcement/avoidance constructs and of positive reinforcement/appetitive constructs to examine convergent validity and discriminant validity, respectively; and self-report measures of alcohol use, problems, and motives to examine criterion validity. Results The MRBURNS evidenced sound experimental properties and reliability across task trials. In support of convergent validity, risk taking on the MRBURNS correlated significantly with negative urgency, difficulties in emotion regulation and depressive and anxiety-related symptoms. In support of discriminant validity, performance on the MRBURNS was unrelated to risk taking on the BART, sensation seeking, and trait impulsivity. Finally, pertaining to criterion validity, risk taking on the MRBURNS was related to alcohol-related problems but not heavy episodic alcohol use. Notably, risk taking on the MRBURNS was associated with negative reinforcement-based but not with positive reinforcement-based drinking motives. Conclusions Data from this initial investigation suggest the utility of the MRBURNS as a behavioral measure of negative-reinforcement based risk-taking that can provide a useful compliment to existing self-report measures to improve our understanding of the relationship between avoidant reinforcement processes and risky alcohol use. PMID:22309846

Validation of Self-Reported Anthropometrics in Female College Freshmen

PubMed Central

LEONE, RYAN J.; MORGAN, AMY L.; LUDY, MARY-JON

2016-01-01

Most investigations concerning the validity of self-reported anthropometrics focus on weight, height, and body mass index. This study extends those investigations by exploring the impact of self-reporting bias on the disease risk indicators of waist circumference and body fat percentage. Female college freshmen (n=128) self-reported weight and height, then underwent measurements for weight, height, waist circumference, and body fat percentage. Self-reporting bias was defined as self-reported minus directly-assessed anthropometric value. Despite no differences in self-reported versus directly-assessed weight or height for the total group, students with high waist circumference and excess fat under-reported their weight by 2.3±4.4 lb (p<0.05). Self-reporting bias was negatively correlated with waist circumference (r=−0.362; p<0.001) and body fat percentage (r=−0.317; p<0.001). Although many female college freshmen accurately represent their weight, those with excess fat and waist circumference under-reported their weight. This may lead to missed opportunities for risk identification, prevention, and intervention. PMID:27293506

Validity of self-reported exposure to second-hand smoke in hospitality venues.

PubMed

Galán, Iñaki; Mayo, Elga; López, María J; Pérez-Ríos, Mónica; Fu, Marcela; Martínez-Sánchez, Jose M; Schiaffino, Anna; Moncada, Albert; Montes, Agustín; Nebot, Manel; Fernández, Esteve

2014-08-01

The aim was to assess the validity of self-reported exposure to second-hand smoke (SHS) in 50 hospitality venues of Madrid (Spain) in 2010, taking as a reference vapour-phase nicotine measured by active sampling. The questions posed in the questionnaire permitted distinguishing between the different levels of SHS. However, the moderate relationship found (Spearman׳s correlation=0.387, p<0.001) suggests that intensity of exposure to SHS in hospitality venues, based solely on self-reported information, should be used with caution. Copyright © 2014 Elsevier Inc. All rights reserved.

Can Formal Methods Provide (Necessary and) Sufficient Conditions for Measurement?

ERIC Educational Resources Information Center

Mari, Luca

2017-01-01

In his focus article, "Rethinking Traditional Methods of Survey Validation," published in this issue of "Measurement: Interdisciplinary Research and Perspectives," Andrew Maul introduces and discusses several foundational issues and concludes that self-report measures may be particularly difficult to validate and may fall short…

Reliability and validity of the McDonald Play Inventory.

PubMed

McDonald, Ann E; Vigen, Cheryl

2012-01-01

This study examined the ability of a two-part self-report instrument, the McDonald Play Inventory, to reliably and validly measure the play activities and play styles of 7- to 11-yr-old children and to discriminate between the play of neurotypical children and children with known learning and developmental disabilities. A total of 124 children ages 7-11 recruited from a sample of convenience and a subsample of 17 parents participated in this study. Reliability estimates yielded moderate correlations for internal consistency, total test intercorrelations, and test-retest reliability. Validity estimates were established for content and construct validity. The results suggest that a self-report instrument yields reliable and valid measures of a child's perceived play performance and discriminates between the play of children with and without disabilities. Copyright © 2012 by the American Occupational Therapy Association, Inc.

Development and validation of a new self-report measure of pain behaviors.

PubMed

Cook, Karon F; Keefe, Francis; Jensen, Mark P; Roddey, Toni S; Callahan, Leigh F; Revicki, Dennis; Bamer, Alyssa M; Kim, Jiseon; Chung, Hyewon; Salem, Rana; Amtmann, Dagmar

2013-12-01

Pain behaviors that are maintained beyond the acute stage after injury can contribute to subsequent psychosocial and physical disability. Critical to the study of pain behaviors is the availability of psychometrically sound pain behavior measures. In this study we developed a self-report measure of pain behaviors, the Pain Behaviors Self Report (PaB-SR). PaB-SR scores were developed using item response theory and evaluated using a rigorous, multiple-witness approach to validity testing. Participants included 661 survey participants with chronic pain and with multiple sclerosis, back pain, or arthritis; 618 survey participants who were significant others of a chronic pain participant; and 86 participants in a videotaped pain behavior observation protocol. Scores on the PaB-SR were found to be measurement invariant with respect to clinical condition. PaB-SR scores, observer reports, and the videotaped protocol yielded distinct, but convergent views of pain behavior, supporting the validity of the new measure. The PaB-SR is expected to be of substantial utility to researchers wishing to explore the relationship between pain behaviors and constructs such as pain intensity, pain interference, and disability. Copyright © 2013 International Association for the Study of Pain. Published by Elsevier B.V. All rights reserved.

A novel measure of compulsive food restriction in anorexia nervosa: validation of the Self-Starvation Scale (SS).

PubMed

Godier, Lauren R; Park, Rebecca J

2015-04-01

The characteristic relentless self-starvation behaviour seen in Anorexia Nervosa (AN) has been described as evidence of compulsivity, with increasing suggestion of transdiagnostic parallels with addictive behaviour. There is a paucity of standardised self-report measures of compulsive behaviour in eating disorders (EDs). Measures that index the concept of compulsive self-starvation in AN are needed to explore the suggested parallels with addictions. With this aim a novel measure of self-starvation was developed (the Self-Starvation Scale, SS). 126 healthy participants, and 78 individuals with experience of AN, completed the new measure along with existing measures of eating disorder symptoms, anxiety and depression. Initial validation in the healthy sample indicated good reliability and construct validity, and incremental validity in predicting eating disorder symptoms. The psychometric properties of the SS scale were replicated in the AN sample. The ability of this scale to predict ED symptoms was particularly strong in individuals currently suffering from AN. These results suggest the SS may be a useful index of compulsive food restriction in AN. The concept of 'starvation dependence' in those with eating disorders, as a parallel with addiction, may be of clinical and theoretical importance. Copyright © 2014 Elsevier Ltd. All rights reserved.

The Parent Trauma Response Questionnaire (PTRQ): development and preliminary validation.

PubMed

Williamson, Victoria; Hiller, Rachel M; Meiser-Stedman, Richard; Creswell, Cathy; Dalgleish, Tim; Fearon, Pasco; Goodall, Ben; McKinnon, Anna; Smith, Patrick; Wright, Isobel; Halligan, Sarah L

2018-01-01

Background : Following a child's experience of trauma, parental response is thought to play an important role in either facilitating or hindering their psychological adjustment. However, the ability to investigate the role of parenting responses in the post-trauma period has been hampered by a lack of valid and reliable measures. Objectives : The aim of this study was to design, and provide a preliminary validation of, the Parent Trauma Response Questionnaire (PTRQ), a self-report measure of parental appraisals and support for children's coping, in the aftermath of child trauma. Methods : We administered an initial set of 78 items to 365 parents whose children, aged 2-19 years, had experienced a traumatic event. We conducted principal axis factoring and then assessed the validity of the reduced measure against a standardized general measure of parental overprotection and via the measure's association with child post-trauma mental health. Results : Factor analysis generated three factors assessing parental maladaptive appraisals: (i) permanent change/damage, (ii) preoccupation with child's vulnerability, and (iii) self-blame. In addition, five factors were identified that assess parental support for child coping: (i) behavioural avoidance, (ii) cognitive avoidance, (iii) overprotection, (iv) maintaining pre-trauma routines, and (v) approach coping. Good validity was evidenced against the measure of parental overprotection and child post-traumatic stress symptoms. Good test-retest reliability of the measure was also demonstrated. Conclusions : The PTRQ is a valid and reliable self-report assessment of parenting cognitions and coping in the aftermath of child trauma.

Evaluation of the measurement properties of self-reported health-related work-functioning instruments among workers with common mental disorders.

PubMed

Abma, Femke I; van der Klink, Jac J L; Terwee, Caroline B; Amick, Benjamin C; Bültmann, Ute

2012-01-01

During the past decade, common mental disorders (CMD) have emerged as a major public and occupational health problem in many countries. Several instruments have been developed to measure the influence of health on functioning at work. To select appropriate instruments for use in occupational health practice and research, the measurement properties (eg, reliability, validity, responsiveness) must be evaluated. The objective of this study is to appraise critically and compare the measurement properties of self-reported health-related work-functioning instruments among workers with CMD. A systematic review was performed searching three electronic databases. Papers were included that: (i) mainly focused on the development and/or evaluation of the measurement properties of a self-reported health-related work-functioning instrument; (ii) were conducted in a CMD population; and (iii) were fulltext original papers. Quality appraisal was performed using the consensus-based standards for the selection of health status measurement instruments (COSMIN) checklist. Five papers evaluating measurement properties of five self-reported health-related work-functioning instruments in CMD populations were included. There is little evidence available for the measurement properties of the identified instruments in this population, mainly due to low methodological quality of the included studies. The available evidence on measurement properties is based on studies of poor-to-fair methodological quality. Information on a number of measurement properties, such as measurement error, content validity, and cross-cultural validity is still lacking. Therefore, no evidence-based decisions and recommendations can be made for the use of health-related work functioning instruments. Studies of high methodological quality are needed to properly assess the existing instruments' measurement properties.

Assessing Dependency using Self-report and Indirect Measures: Examining the Significance of Discrepancies

PubMed Central

Cogswell, Alex; Alloy, Lauren B.; Karpinski, Andrew; Grant, David

2011-01-01

The present study addressed convergence between self-report and indirect approaches to assessing dependency. The study was moderately successful in validating an implicit measure, which was found to be reliable, orthogonal to two self-report instruments, and predictive of external criteria. This study also examined discrepancies between scores on self-report and implicit measures, and has implications for their significance. The possibility that discrepancies themselves are pathological was not supported, although discrepancies were associated with particular personality profiles. Finally, this study offered additional evidence for the relation between dependency and depressive symptomatology, and identified implicit dependency as contributing unique variance in predicting past major depression. PMID:20552505

Assessing the Validity of an Annual Survey for Measuring Principal Leadership Practice

ERIC Educational Resources Information Center

Camburn, Eric M.; Huff, Jason T.; Goldring, Ellen B.; May, Henry

2010-01-01

Because research has shown that principals' practices can significantly impact teaching and learning in their schools through multiple avenues, it is critical to understand the validity of tools that measure principal practice. While the field has relied heavily on self-report surveys, little is known about their validity. This study compares…

The TUPA Scale: A Self-Report Measure for the Type A Subcomponent of Time Urgency and Perpetual Activation.

ERIC Educational Resources Information Center

Wright, Logan; And Others

1992-01-01

A self-report measure for the Type A subcomponent of time urgency and perpetual activation (TUPA) was developed using 10 coronary heart disease (CHD) patients and validated with another 48 CHD patients. The internal consistency and test-retest reliabilities indicate that the instrument has clinical and research applications. (SLD)

The Stability of Self-Reported Anxiety in Youth with Autism versus ADHD or Typical Development

ERIC Educational Resources Information Center

Schiltz, Hillary; McIntyre, Nancy; Swain-Lerro, Lindsay; Zajic, Matthew; Mundy, Peter

2017-01-01

Children with autism spectrum disorder (ASD) are at risk for anxiety symptoms. Few anxiety measures are validated for individuals with ASD, and the nature of ASD raises questions about reliability of self-reported anxiety. This study examined longitudinal stability and change of self-reported anxiety in higher functioning youth with ASD (HFASD)…

Incremental Validity of the Durand Adaptive Psychopathic Traits Questionnaire Above Self-Report Psychopathy Measures in Community Samples.

PubMed

Durand, Guillaume

2018-05-03

Although highly debated, the notion of the existence of an adaptive side to psychopathy is supported by some researchers. Currently, 2 instruments assessing psychopathic traits include an adaptive component, which might not cover the full spectrum of adaptive psychopathic traits. The Durand Adaptive Psychopathic Traits Questionnaire (DAPTQ; Durand, 2017 ) is a 41-item self-reported instrument assessing adaptive traits known to correlate with the psychopathic personality. In this study, I investigated in 2 samples (N = 263 and N = 262) the incremental validity of the DAPTQ over the Psychopathic Personality Inventory-Short Form (PPI-SF) and the Triarchic Psychopathy Measure (TriPM) using multiple criterion measures. Results showed that the DAPTQ significantly increased the predictive validity over the PPI-SF on 5 factors of the HEXACO. Additionally, the DAPTQ provided incremental validity over both the PPI-SF and the TriPM on measures of communication adaptability, perceived stress, and trait anxiety. Overall, these results support the validity of the DAPTQ in community samples. Directions for future studies to further validate the DAPTQ are discussed.

Use of the Environment and Policy Evaluation and Observation as a Self-Report Instrument (EPAO-SR) to measure nutrition and physical activity environments in child care settings: validity and reliability evidence.

PubMed

Ward, Dianne S; Mazzucca, Stephanie; McWilliams, Christina; Hales, Derek

2015-09-26

Early care and education (ECE) centers are important settings influencing young children's diet and physical activity (PA) behaviors. To better understand their impact on diet and PA behaviors as well as to evaluate public health programs aimed at ECE settings, we developed and tested the Environment and Policy Assessment and Observation - Self-Report (EPAO-SR), a self-administered version of the previously validated, researcher-administered EPAO. Development of the EPAO-SR instrument included modification of items from the EPAO, community advisory group and expert review, and cognitive interviews with center directors and classroom teachers. Reliability and validity data were collected across 4 days in 3-5 year old classrooms in 50 ECE centers in North Carolina. Center teachers and directors completed relevant portions of the EPAO-SR on multiple days according to a standardized protocol, and trained data collectors completed the EPAO for 4 days in the centers. Reliability and validity statistics calculated included percent agreement, kappa, correlation coefficients, coefficients of variation, deviations, mean differences, and intraclass correlation coefficients (ICC), depending on the response option of the item. Data demonstrated a range of reliability and validity evidence for the EPAO-SR instrument. Reporting from directors and classroom teachers was consistent and similar to the observational data. Items that produced strongest reliability and validity estimates included beverages served, outside time, and physical activity equipment, while items such as whole grains served and amount of teacher-led PA had lower reliability (observation and self-report) and validity estimates. To overcome lower reliability and validity estimates, some items need administration on multiple days. This study demonstrated appropriate reliability and validity evidence for use of the EPAO-SR in the field. The self-administered EPAO-SR is an advancement of the measurement of ECE settings and can be used by researchers and practitioners to assess the nutrition and physical activity environments of ECE settings.

Construct Validity of the SF-12v2 for the Homeless Population with Mental Illness: An Instrument to Measure Self-Reported Mental and Physical Health

PubMed Central

Chum, Antony; Skosireva, Anna; Tobon, Juliana; Hwang, Stephen

2016-01-01

Background Self-reported health measures are important indicators used by clinicians and researchers for the evaluation of health interventions, outcome assessment of clinical studies, and identification of health needs to improve resource allocation. However, the application of self-reported health measures relies on developing reliable and valid instruments that are suitable across diverse populations. The main objective of this study is to evaluate the construct validity of the SF-12v.2, an instrument for measuring self-rated physical and mental health, for homeless adults with mental illness. Various interventions have been aimed at improving the health of homeless people with mental illness, and the development of valid instruments to evaluate these interventions is imperative. Study Design We measured self-rated mental and physical health from a quota sample of 575 homeless people with mental illness using the SF-12v2, EQ-5D, Colorado Symptoms Index, and physical/mental health visual analogue scales. We examined the construct validity of the SF-12v2 through confirmatory factor analyses (CFA), and using ANOVA/correlation analyses to compare the SF-12v2 to the other instruments to ascertain discriminant/convergent validity. Results Our CFA showed that the measurement properties of the original SF-12v2 model had a mediocre fit with our empirical data (χ2 = 193.6, df = 43, p < .0001, CFI = 0.85, NFI = 0.83, RMSEA = 0.08). We demonstrate that changes based on theoretical rationale and previous studies can significantly improve the model, achieving an excellent fit in our final model (χ2 = 160.6, df = 48, p < .0001, CFI = 0.95, NFI = 0.95, RMSEA = 0.06). Our CFA results suggest that an alternative scoring method based on the new model may optimize health status measurement of a homeless population. Despite these issues, convergent and discriminant validity of the SF-12v2 (scored based on the original model) was supported through multiple comparisons with other instruments. Conclusion Our study demonstrates for the first time that the SF-12v2 is generally appropriate as a measure of physical and mental health status for a homeless population with mental illness. PMID:26938990

Construct Validity of the SF-12v2 for the Homeless Population with Mental Illness: An Instrument to Measure Self-Reported Mental and Physical Health.

PubMed

Chum, Antony; Skosireva, Anna; Tobon, Juliana; Hwang, Stephen

2016-01-01

Self-reported health measures are important indicators used by clinicians and researchers for the evaluation of health interventions, outcome assessment of clinical studies, and identification of health needs to improve resource allocation. However, the application of self-reported health measures relies on developing reliable and valid instruments that are suitable across diverse populations. The main objective of this study is to evaluate the construct validity of the SF-12v.2, an instrument for measuring self-rated physical and mental health, for homeless adults with mental illness. Various interventions have been aimed at improving the health of homeless people with mental illness, and the development of valid instruments to evaluate these interventions is imperative. We measured self-rated mental and physical health from a quota sample of 575 homeless people with mental illness using the SF-12v2, EQ-5D, Colorado Symptoms Index, and physical/mental health visual analogue scales. We examined the construct validity of the SF-12v2 through confirmatory factor analyses (CFA), and using ANOVA/correlation analyses to compare the SF-12v2 to the other instruments to ascertain discriminant/convergent validity. Our CFA showed that the measurement properties of the original SF-12v2 model had a mediocre fit with our empirical data (χ2 = 193.6, df = 43, p < .0001, CFI = 0.85, NFI = 0.83, RMSEA = 0.08). We demonstrate that changes based on theoretical rationale and previous studies can significantly improve the model, achieving an excellent fit in our final model (χ2 = 160.6, df = 48, p < .0001, CFI = 0.95, NFI = 0.95, RMSEA = 0.06). Our CFA results suggest that an alternative scoring method based on the new model may optimize health status measurement of a homeless population. Despite these issues, convergent and discriminant validity of the SF-12v2 (scored based on the original model) was supported through multiple comparisons with other instruments. Our study demonstrates for the first time that the SF-12v2 is generally appropriate as a measure of physical and mental health status for a homeless population with mental illness.

Multidimensional Assessment of Self-Regulated Learning with Middle School Math Students

ERIC Educational Resources Information Center

Callan, Gregory L.; Cleary, Timothy J.

2018-01-01

This study examined the convergent and predictive validity of self-regulated learning (SRL) measures situated in mathematics. The sample included 100 eighth graders from a diverse, urban school district. Four measurement formats were examined including, 2 broad-based (i.e., self-report questionnaire and teacher ratings) and 2 task-specific…

Development and validation of self-reported line drawings of the modified Beighton score for the assessment of generalised joint hypermobility.

PubMed

Cooper, Dale J; Scammell, Brigitte E; Batt, Mark E; Palmer, Debbie

2018-01-17

The impracticalities and comparative expense of carrying out a clinical assessment is an obstacle in many large epidemiological studies. The purpose of this study was to develop and validate a series of electronic self-reported line drawing instruments based on the modified Beighton scoring system for the assessment of self-reported generalised joint hypermobility. Five sets of line drawings were created to depict the 9-point Beighton score criteria. Each instrument consisted of an explanatory question whereby participants were asked to select the line drawing which best represented their joints. Fifty participants completed the self-report online instrument on two occasions, before attending a clinical assessment. A blinded expert clinical observer then assessed participants' on two occasions, using a standardised goniometry measurement protocol. Validity of the instrument was assessed by participant-observer agreement and reliability by participant repeatability and observer repeatability using unweighted Cohen's kappa (k). Validity and reliability were assessed for each item in the self-reported instrument separately, and for the sum of the total scores. An aggregate score for generalised joint hypermobility was determined based on a Beighton score of 4 or more out of 9. Observer-repeatability between the two clinical assessments demonstrated perfect agreement (k 1.00; 95% CI 1.00, 1.00). Self-reported participant-repeatability was lower but it was still excellent (k 0.91; 95% CI 0.74, 1.00). The participant-observer agreement was excellent (k 0.96; 95% CI 0.87, 1.00). Validity was excellent for the self-report instrument, with a good sensitivity of 0.87 (95% CI 0.81, 0.91) and excellent specificity of 0.99 (95% CI 0.98, 1.00). The self-reported instrument provides a valid and reliable assessment of the presence of generalised joint hypermobility and may have practical use in epidemiological studies.

The Children's Report of Sleep Patterns (CRSP): A Self-Report Measure of Sleep for School-Aged Children

PubMed Central

Meltzer, Lisa J.; Avis, Kristin T.; Biggs, Sarah; Reynolds, Amy C.; Crabtree, Valerie McLaughlin; Bevans, Katherine B.

2013-01-01

Study Objectives: (1) Present preliminary psychometrics for the Children's Report of Sleep Patterns (CRSP), a three-module measure of Sleep Patterns, Sleep Hygiene, and Sleep Disturbance; and (2) explore whether the CRSP provides information about a child's sleep above and beyond parental report. Methods: A multi-method, multi-reporter approach was used to validate the CRSP with 456 children aged 8-12 years (inclusive). Participants were recruited from pediatricians' offices, sleep clinics/laboratories, children's hospitals, schools, and the general population. Participants completed measures of sleep habits, sleep hygiene, anxiety, and sleepiness, with actigraphy and polysomnography used to provide objective measures of child sleep. Results: The CRSP demonstrated good reliability and validity. Differences in sleep hygiene and sleep disturbances were found for children presenting to a sleep clinic/laboratory (vs. community population); for younger children (vs. older children); and for children who slept less than 8 hours or had a sleep onset later than 22:00 on actigraphy. Further, significant associations were found between the CRSP and child-reported anxiety or sleepiness. Notably, approximately 40% of parents were not aware of child reported difficulties with sleep onset latency, night wakings, or poor sleep quality. Conclusions: The three modules of the CRSP can be used together or independently, providing a reliable and valid self-report measure of sleep patterns, sleep hygiene, and sleep disturbances for children ages 8-12 years. Children not only provide valid information about their sleep, but may provide information that would not be otherwise captured in both clinical and research settings if relying solely on parental report. Citation: Meltzer LJ; Avis KT; Biggs S; Reynolds AC; Crab-tree VM; Bevans KB. The Children's Report of Sleep Patterns (CRSP): a self-report measure of sleep for school-aged children. J Clin Sleep Med 2013;9(3):235-245. PMID:23493949

Do self-report measures of social anxiety reflect cultural bias or real difficulties for Asian American college students?

PubMed

Ho, Lorinda Y; Lau, Anna S

2011-01-01

Construal of the self as independent or interdependent in relation to others has been found to correlate significantly with social anxiety symptom ratings, raising concerns about possible cultural bias in these measures for Asian Americans. To investigate the validity of self-reported social anxiety symptoms, we examined the role of ethnicity in the associations among social anxiety, self-construal, and adaptive social functioning in a sample of 229 Asian- and European American college students. Results revealed that ethnicity moderated the relationship between self-construal and social anxiety such that interdependent self-construal was associated with higher social anxiety only for first generation Asian Americans. However, there were no significant ethnic differences in the associations between social anxiety self-reports and several measures of social functioning.

Accuracy of self-reported sleep parameters compared with actigraphy in young people with mental ill-health.

PubMed

Biddle, Daniel J; Robillard, Rébecca; Hermens, Daniel F; Hickie, Ian B; Glozier, Nicholas

2015-09-01

Validation of self-report assessment of habitual sleep duration and onset time in young people with mental ill-health. Validation sample. Specialized early intervention centers for young people in Sydney, Australia. One hundred and forty-six young people with mental ill-health. N/A. Self-reported habitual sleep duration and onset time were compared against at least 7 days of actigraphy monitoring. Average bias in and calibration of subjective measures were assessed, along with correlation of subjective and objective measures. Differences by age, sex, mental-disorder type, and reported insomnia were also explored. On average, subjective estimates of sleep were unbiased. Overall, each additional hour of objective habitual sleep duration predicted 41 minutes more subjective habitual sleep duration, and each hour later objective habitual sleep onset occurred predicted a 43-minute later subjective habitual sleep onset. There were subgroup differences: subjective habitual sleep duration in self-reported insomnia was shorter than objective duration by 30 minutes (SD = 119), on average. Calibration of habitual sleep duration was worse for those with mood disorders than with other primary diagnoses (t = -2.39, P = .018). Correlation between subjective and objective measures was strong for sleep onset time (Á = .667, P < .001) and moderate for sleep duration (r = .332, P < .001). For the mood disorder group, subjective and objective sleep durations were uncorrelated. Self-reports seem valid for large-scale studies of habitual sleep duration and onset in help-seeking young people, but assessment of habitual sleep duration requires objective measures where individual accuracy is important. Copyright © 2015 National Sleep Foundation. Published by Elsevier Inc. All rights reserved.

Reliability, construct and criterion validity of the KIDSCREEN-10 score: a short measure for children and adolescents’ well-being and health-related quality of life

PubMed Central

Erhart, Michael; Rajmil, Luis; Herdman, Michael; Auquier, Pascal; Bruil, Jeanet; Power, Mick; Duer, Wolfgang; Abel, Thomas; Czemy, Ladislav; Mazur, Joanna; Czimbalmos, Agnes; Tountas, Yannis; Hagquist, Curt; Kilroe, Jean

2010-01-01

Background To assess the criterion and construct validity of the KIDSCREEN-10 well-being and health-related quality of life (HRQoL) score, a short version of the KIDSCREEN-52 and KIDSCREEN-27 instruments. Methods The child self-report and parent report versions of the KIDSCREEN-10 were tested in a sample of 22,830 European children and adolescents aged 8–18 and their parents (n = 16,237). Correlation with the KIDSCREEN-52 and associations with other generic HRQoL measures, physical and mental health, and socioeconomic status were examined. Score differences by age, gender, and country were investigated. Results Correlations between the 10-item KIDSCREEN score and KIDSCREEN-52 scales ranged from r = 0.24 to 0.72 (r = 0.27–0.72) for the self-report version (proxy-report version). Coefficients below r = 0.5 were observed for the KIDSCREEN-52 dimensions Financial Resources and Being Bullied only. Cronbach alpha was 0.82 (0.78), test–retest reliability was ICC = 0.70 (0.67) for the self- (proxy-)report version. Correlations between other children self-completed HRQoL questionnaires and KIDSCREEN-10 ranged from r = 0.43 to r = 0.63 for the KIDSCREEN children self-report and r = 0.22–0.40 for the KIDSCREEN parent proxy report. Known group differences in HRQoL between physically/mentally healthy and ill children were observed in the KIDSCREEN-10 self and proxy scores. Associations with self-reported psychosomatic complaints were r = −0.52 (−0.36) for the KIDSCREEN-10 self-report (proxy-report). Statistically significant differences in KIDSCREEN-10 self and proxy scores were found by socioeconomic status, age, and gender. Conclusions Our results indicate that the KIDSCREEN-10 provides a valid measure of a general HRQoL factor in children and adolescents, but the instrument does not represent well most of the single dimensions of the original KIDSCREEN-52. Test–retest reliability was slightly below a priori defined thresholds. PMID:20668950

Validity and Reliability of Three Self-Report Instruments for Assessing Attainment of Physical Activity Guidelines in University Students

ERIC Educational Resources Information Center

Murphy, Joseph J.; Murphy, Marie H.; MacDonncha, Ciaran; Murphy, Niamh; Nevill, Alan M.; Woods, Catherine B.

2017-01-01

The purpose of this study was to compare the validity and reliability of three short physical activity self-report instruments to determine their potential for use with university student populations. The participants (N = 155; 44.5% male; 22.9 ± 5.13 years) wore an accelerometer for 9 consecutive days and completed a single-item measure, the a…

Validation and calibration of HeadCount, a self-report measure for quantifying heading exposure in soccer players.

PubMed

Catenaccio, E; Caccese, J; Wakschlag, N; Fleysher, R; Kim, N; Kim, M; Buckley, T A; Stewart, W F; Lipton, R B; Kaminski, T; Lipton, M L

2016-01-01

The long-term effects of repetitive head impacts due to heading are an area of increasing concern, and exposure must be accurately measured; however, the validity of self-report of cumulative soccer heading is not known. In order to validate HeadCount, a 2-week recall questionnaire, the number of player-reported headers was compared to the number of headers observed by trained raters for a men's and a women's collegiate soccer teams during an entire season of competitive play using Spearman's correlations and intraclass correlation coefficients (ICCs), and calibrated using a generalized estimating equation. The average Spearman's rho was 0.85 for men and 0.79 for women. The average ICC was 0.75 in men and 0.38 in women. The calibration analysis demonstrated that men tend to report heading accurately while women tend to overestimate. HeadCount is a valid instrument for tracking heading behaviour, but may have to be calibrated in women.

Validity of the Externalizing Spectrum Inventory in a Criminal Offender Sample: Relations with Disinhibitory Psychopathology, Personality, and Psychopathic Features

PubMed Central

Venables, Noah C.; Patrick, Christopher J.

2013-01-01

The Externalizing Spectrum Inventory (ESI; Krueger, Markon, Patrick, Benning, & Kramer, 2007) provides a self-report based method for indexing a range of correlated problem behaviors and traits in the domain of deficient impulse control. The ESI organizes lower-order behaviors and traits of this kind around higher-order factors encompassing general disinhibitory proneness, callous-aggression, and substance abuse. The current study used data from a male prisoner sample (N = 235) to evaluate the validity of ESI total and factor scores in relation to external criterion measures consisting of externalizing disorder symptoms (including child and adult antisocial deviance and substance-related problems) assessed via diagnostic interview, personality traits assessed by self-report, and psychopathic features as assessed by both interview and self-report. Results provide evidence for the validity of the ESI measurement model and point to its potential utility as a referent for research on the neurobiological correlates and etiological bases of externalizing proneness. PMID:21787091

Validity of the Externalizing Spectrum Inventory in a criminal offender sample: relations with disinhibitory psychopathology, personality, and psychopathic features.

PubMed

Venables, Noah C; Patrick, Christopher J

2012-03-01

The Externalizing Spectrum Inventory (ESI; Krueger, Markon, Patrick, Benning, & Kramer, 2007) provides a self-report based method for indexing a range of correlated problem behaviors and traits in the domain of deficient impulse control. The ESI organizes lower order behaviors and traits of this kind around higher order factors encompassing general disinhibitory proneness, callous-aggression, and substance abuse. In the current study, we used data from a male prisoner sample (N = 235) to evaluate the validity of ESI total and factor scores in relation to external criterion measures consisting of externalizing disorder symptoms (including child and adult antisocial deviance and substance-related problems) assessed via diagnostic interviews, personality traits assessed with self-reports, and psychopathic features as assessed with both interviews and self-reports. Results provide evidence for the validity of the ESI measurement model and point to its potential usefulness as a referent for research on the neurobiological correlates and etiological bases of externalizing proneness.

"Not just little adults": qualitative methods to support the development of pediatric patient-reported outcomes.

PubMed

Arbuckle, Rob; Abetz-Webb, Linda

2013-01-01

The US FDA and the European Medicines Agency (EMA) have issued incentives and laws mandating clinical research in pediatrics. While guidances for the development and validation of patient-reported outcomes (PROs) or health-related quality of life (HRQL) measures have been issued by these agencies, little attention has focused on pediatric PRO development methods. With reference to the literature, this article provides an overview of specific considerations that should be made with regard to the development of pediatric PRO measures, with a focus on performing qualitative research to ensure content validity. Throughout the questionnaire development process it is critical to use developmentally appropriate language and techniques to ensure outcomes have content validity, and will be reliable and valid within narrow age bands (0-2, 3-5, 6-8, 9-11, 12-14, 15-17 years). For qualitative research, sample sizes within those age bands must be adequate to demonstrate saturation while taking into account children's rapid growth and development. Interview methods, interview guides, and length of interview must all take developmental stage into account. Drawings, play-doh, or props can be used to engage the child. Care needs to be taken during cognitive debriefing, where repeated questioning can lead a child to change their answers, due to thinking their answer is incorrect. For the PROs themselves, the greatest challenge is in measuring outcomes in children aged 5-8 years. In this age range, while self-report is generally more valid, parent reports of observable behaviors are generally more reliable. As such, 'team completion' or a parent-administered child report is often the best option for children aged 5-8 years. For infants and very young children (aged 0-4 years), patient rating of observable behaviors is necessary, and, for adolescents and children aged 9 years and older, self-reported outcomes are generally valid and reliable. In conclusion, the development of PRO measures for use in children requires careful tailoring of qualitative methods, and performing research within narrow age bands. The best reporter should be carefully considered dependent on the child's age, developmental ability, and the concept being measured, and team completion should be considered alongside self-completion and observer measures.

Relations Between Autonomous Motivation and Leisure-Time Physical Activity Participation: The Mediating Role of Self-Regulation Techniques.

PubMed

Nurmi, Johanna; Hagger, Martin S; Haukkala, Ari; Araújo-Soares, Vera; Hankonen, Nelli

2016-04-01

This study tested the predictive validity of a multitheory process model in which the effect of autonomous motivation from self-determination theory on physical activity participation is mediated by the adoption of self-regulatory techniques based on control theory. Finnish adolescents (N = 411, aged 17-19) completed a prospective survey including validated measures of the predictors and physical activity, at baseline and after one month (N = 177). A subsample used an accelerometer to objectively measure physical activity and further validate the physical activity self-report assessment tool (n = 44). Autonomous motivation statistically significantly predicted action planning, coping planning, and self-monitoring. Coping planning and self-monitoring mediated the effect of autonomous motivation on physical activity, although self-monitoring was the most prominent. Controlled motivation had no effect on self-regulation techniques or physical activity. Developing interventions that support autonomous motivation for physical activity may foster increased engagement in self-regulation techniques and positively affect physical activity behavior.

Using police data to measure children's exposure to neighborhood violence: a new method for evaluating relations between exposure and mental health.

PubMed

Boxer, Paul; Sloan-Power, Elizabeth; Piza, Eric; Schappell, Ashley

2014-01-01

Studies have identified a robust association between children's exposure to violence and their mental health. Yet, most of this research has been based on self-reported exposure and self-reported mental health. In this study, we used a new, map-based method via police data for measuring children's exposure to violent crime and compared it to child self-reports and parent reports of exposure. Results suggest that child self-reports of violence exposure may not be valid except for exposure to murder, but police and parent reports of violent crime can reveal interesting relations between violence and mental health. Children showed higher levels of internalizing problems in the absence of police-reported murder and parent-reported robbery. Discussion emphasizes implications for measurement as well as theory building.

Relation between Direct Observation of Relaxation and Self-Reported Mindfulness and Relaxation States

ERIC Educational Resources Information Center

Hites, Lacey S.; Lundervold, Duane A.

2013-01-01

Forty-four individuals, 18-47 (MN 21.8, SD 5.63) years of age, took part in a study examining the magnitude and direction of the relationship between self-report and direct observation measures of relaxation and mindfulness. The Behavioral Relaxation Scale (BRS), a valid direct observation measure of relaxation, was used to assess relaxed behavior…

Validity Evidence for the Security Scale as a Measure of Perceived Attachment Security in Adolescence

ERIC Educational Resources Information Center

Van Ryzin, Mark J.; Leve, Leslie D.

2012-01-01

In this study, the validity of a self-report measure of children's perceived attachment security (the Kerns Security Scale) was tested using adolescents. With regards to predictive validity, the Security Scale was significantly associated with (1) observed mother-adolescent interactions during conflict and (2) parent- and teacher-rated social…

The Development of a Sexual Harassment Proclivity Scale: Construct Validation and Relationship to Communication Competence.

ERIC Educational Resources Information Center

Bingham, Shereen G.; Burleson, Brant R.

1996-01-01

Develops and assesses the validity of a self-report measure of sexual harassment proclivities in men. Demonstrates the validity of the scale by its moderate correlations with attitude measures relevant to sexual harassment, its nonsignificant correlation with the need to provide socially desirable responses, and by showing that potential victims…

Assessing personal initiative among vocational training students: development and validation of a new measure.

PubMed

Balluerka, Nekane; Gorostiaga, Arantxa; Ulacia, Imanol

2014-11-14

Personal initiative characterizes people who are proactive, persistent and self-starting when facing the difficulties that arise in achieving goals. Despite its importance in the educational field there is a scarcity of measures to assess students' personal initiative. Thus, the aim of the present study was to develop a questionnaire to assess this variable in the academic environment and to validate it for adolescents and young adults. The sample comprised 244 vocational training students. The questionnaire showed a factor structure including three factors (Proactivity-Prosocial behavior, Persistence and Self-Starting) with acceptable indices of internal consistency (ranging between α = .57 and α =.73) and good convergent validity with respect to the Self-Reported Initiative scale. Evidence of external validity was also obtained based on the relationships between personal initiative and variables such as self-efficacy, enterprising attitude, responsibility and control aspirations, conscientiousness, and academic achievement. The results indicate that this new measure is very useful for assessing personal initiative among vocational training students.

Psychological Fitness and Resilience: A Review of Relevant Constructs, Measures, and Links to Well-Being

DTIC Science & Technology

2014-01-01

assessed using self -report instruments. The most widely used instrument is the Rosenberg Self - Esteem Scale ( Rosenberg , 1965), which consists of 10 items...Construct validation of a single-item measure and the Rosenberg self - esteem scale. Personality and Social Psychology Bulletin, 27(2), 151–161. doi...fitness from the scientific literature: self -regulation, positive affect, perceived control, self -efficacy, self - esteem , and optimism. This review

Assessing Students' Emotional Competence in Higher Education: Development and Validation of the Widener Emotional Learning Scale

ERIC Educational Resources Information Center

Wang, Ning; Young, Thomas; Wilhite, Stephen C.; Marczyk, Geoffrey

2011-01-01

This article reports the development and validation studies of the Widener Emotional Learning Scale (WELS), a self-report measure, for assessing students' social and emotional competence in higher education. Conceptual specifications, item development, psychometric properties, and factor structure of the instrument are reported in the article. The…

Validity of covering-up sun-protection habits: Association of observations and self-report

PubMed Central

O'Riordan, David L.; Nehl, Eric; Gies, Peter; Bundy, Lucja; Burgess, Kristen; Davis, Erica; Glanz, Karen

2013-01-01

Background Few studies have reported the accuracy of measures used to assess sun-protection practices. Valid measures are critical to the internal validity and use of skin cancer control research. Objectives We sought to validate self-reported covering-up practices of pool-goers. Methods A total of 162 lifeguards and 201 parent/child pairs from 16 pools in 4 metropolitan regions in the United States completed a survey and a 4-day sun-habits diary. Observations of sun-protective behaviors were conducted on two occasions. Results Agreement between observations and diaries ranged from slight to substantial, with most values in the fair to moderate range. Highest agreement was observed for parent hat use (κ = 0.58–0.70). There was no systematic pattern of over- or under-reporting among the 3 study groups. Limitations Potential reactivity and a relatively affluent sample are limitations. Conclusion There was little over-reporting and no systematic bias, which increases confidence in reliance on verbal reports of these behaviors in surveys and intervention research. PMID:19278750

Validation of Self-Report Impairment Measures for Section III Obsessive-Compulsive and Avoidant Personality Disorders.

PubMed

Liggett, Jacqueline; Carmichael, Kieran L C; Smith, Alexander; Sellbom, Martin

2017-01-01

This study examined the validity of newly developed disorder-specific impairment scales (IS), modeled on the Level of Personality Functioning Scale, for obsessive-compulsive (OCPD) and avoidant (AvPD) personality disorders. The IS focused on content validity (items directly reflected the disorder-specific impairments listed in DSM-5 Section III) and severity of impairment. A community sample of 313 adults completed personality inventories indexing the DSM-5 Sections II and III diagnostic criteria for OCPD and AvPD, as well as measures of impairment in the domains of self- and interpersonal functioning. Results indicated that both impairment measures (for AvPD in particular) showed promise in their ability to measure disorder-specific impairment, demonstrating convergent validity with their respective Section II counterparts and discriminant validity with their noncorresponding Section II disorder and with each other. The pattern of relationships between scores on the IS and scores on external measures of personality functioning, however, did not indicate that it is useful to maintain a distinction between impairment in the self- and interpersonal domains, at least for AvPD and OCPD.

Reliability and validity of the Iranian version of the Pediatric Quality of Life Inventory™ 4.0 Generic Core Scales in adolescents.

PubMed

Amiri, Parisa; M Ardekani, Emad; Jalali-Farahani, Sara; Hosseinpanah, Farhad; Varni, James W; Ghofranipour, Fazlollah; Montazeri, Ali; Azizi, Fereidoun

2010-12-01

The objective of this study was to investigate the reliability and validity of the Iranian version of the Pediatric Quality of Life Inventory™ 4.0 (PedsQL™ 4.0) Generic Core Scales in adolescents After linguistic validation, the Iranian version of the PedsQL™ 4.0 was completed by 848 healthy and 26 chronically ill adolescents aged 13-18 years and their parents. The internal consistency as measured by Cronbach's alpha coefficients exceeded the minimum reliability standard of .70. No floor effects were observed. Ceiling effects detected ranged from 1.5% for adolescent self-report total scale score to 42.2% for self-report social functioning. All monotrait-multimethod correlations were higher than multitrait-multimethod correlations. The intraclass correlation coefficients (ICC) between adolescent self-report and parent proxy-report showed good to excellent agreement. Exploratory factor analysis supported mainly comparable results with the original US English dialect version. The results of the confirmatory factor analysis for 5-factor models for both self-report and proxy-report indicated acceptable fit for the proposed models. Regarding gender and health status, as hypothesized from previous studies, girls reported lower health-related quality of life than boys on the total score, physical and emotional functioning, and healthy adolescents reported significantly higher health-related quality of life than those with chronic illnesses. The findings support the initial reliability and validity of the Iranian version of the PedsQL™ 4.0 as a generic instrument to measure HRQOL of adolescents in Iran.

Self-Reported Emotion Reactivity Among Early-Adolescent Girls: Evidence for Convergent and Discriminant Validity in an Urban Community Sample.

PubMed

Evans, Spencer C; Blossom, Jennifer B; Canter, Kimberly S; Poppert-Cordts, Katrina; Kanine, Rebecca; Garcia, Andrea; Roberts, Michael C

2016-05-01

Emotion reactivity, measured via the self-report Emotion Reactivity Scale (ERS), has shown unique associations with different forms of psychopathology and suicidal thoughts and behaviors; however, this limited body of research has been conducted among adults and older adolescents of predominantly White/European ethnic backgrounds. The present study investigated the validity of ERS scores for measuring emotion reactivity among an urban community sample of middle-school-age girls. Participants (N = 93, ages 11-15, 76% African-American, 18% Latina) completed the ERS and measures of emotion coping, internalizing problems, proactive and reactive aggression, negative life events, and lifetime suicidal ideation and substance use. As hypothesized, ERS scores were significantly associated with internalizing problems, poor emotion coping, negative life events, reactive aggression, and suicidal ideation (evidence for convergent validity), but showed little to no association with proactive aggression or lifetime substance use (evidence for discriminant validity). A series of logistic regressions were conducted to further explore the associations among internalizing problems, emotion reactivity, and suicidal ideation. With depressive symptoms included in the model, emotion reactivity was no longer uniquely predictive of lifetime suicidal ideation, nor did it serve as a moderator of other associations. In conjunction with previous research, these findings offer further support for the construct validity and research utility of the ERS as a self-report measure of emotion reactivity in adolescents. Copyright © 2016. Published by Elsevier Ltd.

An overview of self-administered health literacy instruments.

PubMed

O Neill, Braden; Gonçalves, Daniela; Ricci-Cabello, Ignacio; Ziebland, Sue; Valderas, Jose

2014-01-01

With the increasing recognition of health literacy as a worldwide research priority, the development and refinement of indices to measure the construct is an important area of inquiry. Furthermore, the proliferation of online resources and research means that there is a growing need for self-administered instruments. We undertook a systematic overview to identify all published self-administered health literacy assessment indices to report their content and considerations associated with their administration. A primary aim of this study was to assist those seeking to employ a self-reported health literacy index to select one that has been developed and validated for an appropriate context, as well as with desired administration characteristics. Systematic searches were carried out in four electronic databases, and studies were included if they reported the development and/or validation of a novel health literacy assessment measure. Data were systematically extracted on key characteristics of the instruments: breadth of construct ("generic" vs. "content- or context- specific" health literacy), whether it was an original instrument or a derivative, country of origin, administration characteristics, age of target population (adult vs. pediatric), and evidence for validity. 35 articles met the inclusion criteria. There were 27 original instruments (27/35; 77.1%) and 8 derivative instruments (8/35; 22.9%). 22 indices measured "general" health literacy (22/35; 62.9%) while the remainder measured condition- or context- specific health literacy (13/35; 37.1%). Most health literacy measures were developed in the United States (22/35; 62.9%), and about half had adequate face, content, and construct validity (16/35; 45.7%). Given the number of measures available for many specific conditions and contexts, and that several have acceptable validity, our findings suggest that the research agenda should shift towards the investigation and elaboration of health literacy as a construct itself, in order for research in health literacy measurement to progress.

Preliminary Development and Validation of the Mindful Student Questionnaire

ERIC Educational Resources Information Center

Renshaw, Tyler L.

2017-01-01

Research validating mindfulness-based interventions with youths and in schools is growing, yet research validating measures of youths' mindfulness in schools has received far less empirical attention. The present study makes the case for and reports on the preliminary development and validation of a new, 15-item, multidimensional, self-report…

The exchangeability of self-reports and administrative health care resource use measurements: assessement of the methodological reporting quality.

PubMed

Noben, Cindy Yvonne; de Rijk, Angelique; Nijhuis, Frans; Kottner, Jan; Evers, Silvia

2016-06-01

To assess the exchangeability of self-reported and administrative health care resource use measurements for cost estimation. In a systematic review (NHS EED and MEDLINE), reviewers evaluate, in duplicate, the methodological reporting quality of studies comparing the validation evidence of instruments measuring health care resource use. The appraisal tool Methodological Reporting Quality (MeRQ) is developed by merging aspects form the Guidelines for Reporting Reliability and Agreement Studies and the Standards for Reporting Diagnostic Accuracy. Out of 173 studies, 35 full-text articles are assessed for eligibility. Sixteen articles are included in this study. In seven articles, more than 75% of the reporting criteria assessed by MERQ are considered "good." Most studies score at least "fair" on most of the reporting quality criteria. In the end, six studies score "good" on the minimal criteria for reporting. Varying levels of agreement among the different data sources are found, with correlations ranging from 0.14 up to 0.93 and with occurrences of both random and systematic errors. The validation evidence of the small number of studies with adequate MeRQ cautiously supports the exchangeability of both the self-reported and administrative resource use measurement methods. Copyright © 2016 Elsevier Inc. All rights reserved.

Assessing Self-Regulated Strategies for School Writing: Cross-Cultural Validation of a Triadic Measure

ERIC Educational Resources Information Center

Malpique, Anabela Abreu; Veiga Simão, Ana Margarida

2015-01-01

This study reports on the construction of a questionnaire to assess ninth-grade students' use of self-regulated strategies for school writing tasks. Exploratory and confirmatory factorial analyses were conducted to validate the factor structure of the instrument. The initial factor analytic stage (n = 296) revealed a 13-factor scale, accounting…

Development and Validation of the Minnesota Borderline Personality Disorder Scale

ERIC Educational Resources Information Center

Bornovalova, Marina A.; Hicks, Brian M.; Patrick, Christopher J.; Iacono, William G.; McGue, Matt

2011-01-01

Although large epidemiological data sets can inform research on the etiology and development of borderline personality disorder (BPD), they rarely include BPD measures. In some cases, however, proxy measures can be constructed using instruments already in these data sets. In this study, the authors developed and validated a self-report measure of…

Assessing Irrational Beliefs and Emotional Distress: Evidence and Implications of Limited Discriminant Validity.

ERIC Educational Resources Information Center

Zurawski, Raymond M.; Smith, Timothy W.

1987-01-01

Examined the disciminant validity of measures of irrational beliefs. The Irrational Beliefs Test and the Rational Behavior Inventory were highly correlated but were equally highly correlated with self-report measures of depression and anxiety. Thus, rather than assessing beliefs correlated with emotional distress, the measures may actually assess…

Measuring the Style of Innovative Thinking among Engineering Students

ERIC Educational Resources Information Center

Passig, David; Cohen, Lizi

2014-01-01

Background: Many tools have been developed to measure the ability of workers to innovate. However, all of them are based on self-reporting questionnaires, which raises questions about their validity Purpose: The aim was to develop and validate a tool, called Ideas Generation Implementation (IGI), to objectively measure the style and potential of…

A comparison of four embedded validity indices for the RBANS in a memory disorders clinic.

PubMed

Paulson, Daniel; Horner, Michael David; Bachman, David

2015-05-01

This examination of four embedded validity indices for the Repeated Battery for the Assessment of Neuropsychological Status (RBANS) explores the potential utility of integrating cognitive and self-reported depressive measures. Examined indices include the proposed RBANS Performance Validity Index (RBANS PVI) and the Charleston Revised Index of Effort for the RBANS (CRIER). The CRIER represented the novel integration of cognitive test performance and depression self-report information. The sample included 234 patients without dementia who could be identified as having demonstrated either valid or invalid responding, based on standardized criteria. Sensitivity and specificity for invalid responding varied widely, with the CRIER emerging as the best all-around index (sensitivity = 0.84, specificity = 0.90, AUC = 0.94). Findings support the use of embedded response validity indices, and suggest that the integration of cognitive and self-report depression data may optimize detection of invalid responding among older Veterans. © The Author 2015. Published by Oxford University Press. All rights reserved. For permissions, please e-mail: journals.permissions@oup.com.

A scale for measuring hygiene behavior: development, reliability and validity.

PubMed

Stevenson, Richard J; Case, Trevor I; Hodgson, Deborah; Porzig-Drummond, Renata; Barouei, Javad; Oaten, Megan J

2009-09-01

There is currently no general self-report measure for assessing hygiene behavior. This article details the development and testing of such a measure. In studies 1 to 4, a total of 855 participants were used for scale and subscale development and for reliability and validity testing. The latter involved establishing the relationships between self-reported hygiene behavior and existing measures, hand hygiene behavior, illness rates, and a physiological marker of immune function. In study 5, a total of 507 participants were used to assess the psychometric properties of the final revised version of the scale. The final 23-item scale comprised 5 subscales: general, household, food-related, handwashing technique, and personal hygiene. Studies 1 to 4 confirmed the scale's reliability and validity, and study 5 confirmed the scale's 5-factor structure. The scale is potentially suitable for multiple uses, in various settings, and for experimental and correlational approaches.

A population based validation study of self-reported pensions and benefits: the Nord-Trøndelag health study (HUNT)

PubMed Central

2013-01-01

Background Measures of disability pensions, sickness certification and long-term health related benefits are often self-reported in epidemiological studies. Few studies have examined these measures, and the validity is yet to be established. We aimed to estimate the validity of self-reported disability pension, rehabilitation benefit and retirement pension and to explore the benefit status and basic characteristics of those not responding to these items. A large health survey (HUNT2) containing self-reported questionnaire data on sickness benefits and pensions was linked to a national registry of pensions and benefits, used as “gold standard” for the analysis. We investigated two main sources of bias in self-reported data; misclassification - due to participants answering questions incorrectly, and systematic missing/selection bias - when participants do not respond to the questions. Sensitivity, specificity, positive (PPV) and negative (NPV) predicative value, agreement and Cohen’s Kappa were calculated for each benefit. Co-variables were compared between non-responders and responders. Results In the study-population of 40,633, 9.2% reported receiving disability pension, 1.4% rehabilitation benefits and 6.1% retirement pension. According to the registry, the corresponding numbers were 9.0%, 1.7% and 5.4%. Excluding non-responders, specificity, NPV and agreement were above 98% for all benefits. Sensitivity and PPV were lower. When including non-responders as non-receivers, specificity got higher, sensitivity dropped while the other measures changed less. Between 17.7% and 24.1% did not answer the questions on benefits. Non-responders were older and more likely to be female. They reported more anxiety, more depression, a higher number of somatic diagnoses, less physical activity and lower consumption of alcohol (p < 0.001 for all variables). For disability pension and retirement pension, non-responders were less likely to receive benefits than responders (p < 0.001). For each benefit 2.1% or less of non-responders were receivers. False positive responses were more prevalent than false negative responses. Conclusions The validity of self-reported data on disability pension, rehabilitation benefits and retirement pension is high – it seems that participants’ responses can be trusted. Compared to responders, non-responders are less likely to be receivers. If necessary, power and validity can be kept high by imputing non-responders as non-receivers. PMID:23343185

A population based validation study of self-reported pensions and benefits: the Nord-Trøndelag health study (HUNT).

PubMed

Myrtveit, Solbjørg Makalani; Ariansen, Anja M S; Wilhelmsen, Ingvard; Krokstad, Steinar; Mykletun, Arnstein

2013-01-23

Measures of disability pensions, sickness certification and long-term health related benefits are often self-reported in epidemiological studies. Few studies have examined these measures, and the validity is yet to be established.We aimed to estimate the validity of self-reported disability pension, rehabilitation benefit and retirement pension and to explore the benefit status and basic characteristics of those not responding to these items.A large health survey (HUNT2) containing self-reported questionnaire data on sickness benefits and pensions was linked to a national registry of pensions and benefits, used as "gold standard" for the analysis. We investigated two main sources of bias in self-reported data; misclassification - due to participants answering questions incorrectly, and systematic missing/selection bias - when participants do not respond to the questions.Sensitivity, specificity, positive (PPV) and negative (NPV) predicative value, agreement and Cohen's Kappa were calculated for each benefit. Co-variables were compared between non-responders and responders. In the study-population of 40,633, 9.2% reported receiving disability pension, 1.4% rehabilitation benefits and 6.1% retirement pension. According to the registry, the corresponding numbers were 9.0%, 1.7% and 5.4%. Excluding non-responders, specificity, NPV and agreement were above 98% for all benefits. Sensitivity and PPV were lower. When including non-responders as non-receivers, specificity got higher, sensitivity dropped while the other measures changed less.Between 17.7% and 24.1% did not answer the questions on benefits. Non-responders were older and more likely to be female. They reported more anxiety, more depression, a higher number of somatic diagnoses, less physical activity and lower consumption of alcohol (p < 0.001 for all variables). For disability pension and retirement pension, non-responders were less likely to receive benefits than responders (p < 0.001). For each benefit 2.1% or less of non-responders were receivers. False positive responses were more prevalent than false negative responses. The validity of self-reported data on disability pension, rehabilitation benefits and retirement pension is high - it seems that participants' responses can be trusted. Compared to responders, non-responders are less likely to be receivers. If necessary, power and validity can be kept high by imputing non-responders as non-receivers.

Development and Validation of the Eating Loss of Control Scale

PubMed Central

Blomquist, Kerstin K.; Roberto, Christina A.; Barnes, Rachel D.; White, Marney A.; Masheb, Robin M.; Grilo, Carlos M.

2014-01-01

Recurrent objective bulimic episodes (OBE) are a defining diagnostic characteristic of binge eating disorder (BED) and bulimia nervosa (BN). OBEs are characterized by experiencing loss of control (LOC) while eating an unusually large quantity of food. Despite nosological importance and complex heterogeneity across patients, measurement of LOC has been assessed dichotomously (present/absent). This study describes the development and initial validation of the Eating Loss of Control Scale (ELOCS), a self-report questionnaire that examines the complexity of the LOC construct. Participants were 168 obese treatment-seeking individuals with BED who completed the Eating Disorder Examination interview and self-report measures. Participants rated their LOC-related feelings or behaviors on continuous Likert-type scales and reported the number of LOC episodes in the past 28 days. Principal component analysis identified a single-factor, 18-item scale, which demonstrated good internal reliability (α=0.90). Frequency of LOC episodes was significantly correlated with frequency of OBEs and subjective bulimic episodes. The ELOCS demonstrated good convergent validity and was significantly correlated with greater eating pathology, greater emotion dysregulation, greater depression, and lower self-control, but not with BMI. The findings suggest that the ELOCS is a valid self-report questionnaire that may provide important clinical information regarding experiences of LOC in obese persons with BED. Future research should examine the ELOCS in other eating disorders and non-clinical samples. PMID:24219700

The validation of a self-report measure and physical activity of Australian Aboriginal and Torres Strait Islander and non-Indigenous rural children.

PubMed

Gwynn, Josephine D; Hardy, Louise L; Wiggers, John H; Smith, Wayne T; D'Este, Catherine A; Turner, Nicole; Cochrane, Janine; Barker, Daniel J; Attia, John R

2010-07-01

To validate a self-report measure of physical activity for both Australian Aboriginal and Torres Strait Islander and non-Indigenous rural children, and to describe their physical activity participation. In this cross-sectional study, 84 Aboriginal and Torres Strait Islander and 146 non-Indigenous children aged 10-12 years old completed the Many Rivers Physical Activity Recall Questionnaire (MRPARQ), a modified version of the Adolescent Physical Activity Recall Questionnaire (APARQ). A sub-group (n=86) wore an accelerometer for seven consecutive days in order to validate the instrument. Pearson and Intra Class Correlation coefficients between the survey and acceleromtery for weekdays only are 0.31 and 0.16, respectively, for Aboriginal and Torres Strait Islander children, and 0.38 and 0.31, respectively, for non-Indigenous children, and demonstrate a modest (p<0.05) correlation. Self-reported MVPA for Aboriginal and Torres Strait Islander children is between 162 and 172 minutes/day, and is 125 minutes by accelerometer; for non-Indigenous children MVPA is between 123 and 149 minutes (survey) and 107 minutes (accelerometer). Australian Aboriginal and Torres Strait Islander children's self-report of physical activity is at least as valid as non-Indigenous children, given culturally appropriate support; they tend to be more active than non-Indigenous children. The MRPARQ can be administered with Aboriginal and Torres Strait Islander and non-Indigenous children.

Comparison of Physical Activity Adult Questionnaire results with accelerometer data.

PubMed

Garriguet, Didier; Tremblay, Sylvain; Colley, Rachel C

2015-07-01

Discrepancies between self-reported and objectively measured physical activity are well-known. For the purpose of validation, this study compares a new self-reported physical activity questionnaire with an existing one and with accelerometer data. Data collected at one site of the Canadian Health Measures Survey in 2013 were used for this validation study. The International Physical Activity Questionnaire (IPAQ) was administered to respondents during the household interview, and the new Physical Activity for Adults Questionnaire (PAAQ) was administered during a subsequent visit to a mobile examination centre (MEC). At the MEC, respondents were given an accelerometer to wear for seven days. The analysis pertains to 112 respondents aged 18 to 79 who wore the accelerometer for 10 or more hours on at least four days. Moderate-to-vigorous physical activity (MVPA) measured by accelerometer had higher correlation with data from the PAAQ (r = 0.44) than with data from the IPAQ (r = 0.20). The differences between accelerometer and PAAQ data were greater based on accelerometer-measured physical activity accumulated in 10-minute bouts (30-minute difference in MVPA) than on all minutes (9-minute difference). The percentages of respondents meeting the Canadian Physical Activity Guidelines were 90% based on self-reported IPAQ minutes, 70% based on all accelerometer MVPA minutes, 29% based on accelerometer MVPA minutes accumulated in 10-minute bouts, and 61% based on self-reported PAAQ minutes. The PAAQ demonstrated reasonable validity against the accelerometer criterion. Based on correlations and absolute differences between daily minutes of MVPA and the percentages of respondents meeting the Canadian Physical Activity Guidelines, PAAQ results were closer to accelerometer data than were the IPAQ results for the study sample and previous Statistics Canada self-reported questionnaire findings.

Self-reports of salt intake by 10- to 18-year-olds: relationship to urinary sodium excretion.

PubMed

Murphy, J K; Alpert, B S; Stapleton, F B; Miller, L A; Willey, E S; Walker, S S; Nanney, G C

1990-03-01

Our data indicated that self-reports of consumption of salty foods by children and adolescents were associated with 24-hour urinary sodium excretion. Specifically, youths 10 to 18 years of age who selected a poster depicting high-sodium foods excreted significantly more sodium than youths who selected a poster depicting low-sodium foods. Future research is needed to refine simplified self-report measures, to corroborate the validity of the measures, and to extend the studies to other samples, e.g., younger children.

An exploration of the impact of invalid MMPI-2 protocols on collateral self-report measure scores.

PubMed

Forbey, Johnathan D; Lee, Tayla T C

2011-11-01

Although a number of studies have examined the impact of invalid MMPI-2 (Butcher et al., 2001) response styles on MMPI-2 scale scores, limited research has specifically explored the effects that such response styles might have on conjointly administered collateral self-report measures. This study explored the potential impact of 2 invalidating response styles detected by the Validity scales of the MMPI-2, overreporting and underreporting, on scores of collateral self-report measures administered conjointly with the MMPI-2. The final group of participants included in analyses was 1,112 college students from a Midwestern university who completed all measures as part of a larger study. Results of t-test analyses suggested that if either over- or underreporting was indicated by the MMPI-2 Validity scales, the scores of most conjointly administered collateral measures were also significantly impacted. Overall, it appeared that test-takers who were identified as either over- or underreporting relied on such a response style across measures. Limitations and suggestions for future study are discussed.

Development and Validation of the Diabetes Adolescent Problem Solving Questionnaire

PubMed Central

Mulvaney, Shelagh A.; Jaser, Sarah S.; Rothman, Russell L.; Russell, William; Pittel, Eric J.; Lybarger, Cindy; Wallston, Kenneth A.

2014-01-01

Objective Problem solving is a critical diabetes self-management skill. Because of a lack of clinically feasible measures, our aim was to develop and validate a self-report self-management problem solving questionnaire for adolescents with type 1 diabetes (T1D). Methods A multidisciplinary team of diabetes experts generated questionnaire items that addressed diabetes self-management problem solving. Iterative feedback from parents and adolescents resulted in 27 items. Adolescents from two studies (N=156) aged 13–17 were recruited through a pediatric diabetes clinic and completed measures through an online survey. Glycemic control was measured by HbA1c recorded in the medical record. Results Empirical elimination of items using Principal Components Analyses resulted in a 13-item unidimensional measure, the Diabetes Adolescent Problem Solving Questionnaire (DAPSQ) that explained 57% of the variance. The DAPSQ demonstrated internal consistency (Cronbach’s alpha = 0.92) and was correlated with diabetes self-management (r=0.53, p<.001), self-efficacy (r=0.54, p<.001), and glycemic control (r= −0.24, p<.01). Conclusion The DAPSQ is a brief instrument for assessment of diabetes self-management problem solving in youth with T1D associated with better self-management behaviors and glycemic control. Practice Implications The DAPSQ is a clinically feasible self-report measure that can provide valuable information regarding level of self-management problem solving and guide patient education. PMID:25063715

Development and validation of the diabetes adolescent problem solving questionnaire.

PubMed

Mulvaney, Shelagh A; Jaser, Sarah S; Rothman, Russell L; Russell, William E; Pittel, Eric J; Lybarger, Cindy; Wallston, Kenneth A

2014-10-01

Problem solving is a critical diabetes self-management skill. Because of a lack of clinically feasible measures, our aim was to develop and validate a self-report self-management problem solving questionnaire for adolescents with type 1 diabetes (T1D). A multidisciplinary team of diabetes experts generated questionnaire items that addressed diabetes self-management problem solving. Iterative feedback from parents and adolescents resulted in 27 items. Adolescents from two studies (N=156) aged 13-17 were recruited through a pediatric diabetes clinic and completed measures through an online survey. Glycemic control was measured by HbA1c recorded in the medical record. Empirical elimination of items using principal components analyses resulted in a 13-item unidimensional measure, the diabetes adolescent problem solving questionnaire (DAPSQ) that explained 56% of the variance. The DAPSQ demonstrated internal consistency (Cronbach's alpha=0.92) and was correlated with diabetes self-management (r=0.53, p<.001), self-efficacy (r=0.54, p<.001), and glycemic control (r=-0.24, p<.01). The DAPSQ is a brief instrument for assessment of diabetes self-management problem solving in youth with T1D and is associated with better self-management behaviors and glycemic control. The DAPSQ is a clinically feasible self-report measure that can provide valuable information regarding level of self-management problem solving and guide patient education. Copyright © 2014 Elsevier Ireland Ltd. All rights reserved.

Self-Stigma in Substance Abuse: Development of a New Measure

PubMed Central

Luoma, Jason B.; Nobles, Richard H.; Drake, Chad E.; Hayes, Steven C.; O’Hair, Alyssa; Fletcher, Lindsay; Kohlenberg, Barbara S.

2012-01-01

Little attention has been paid to the examination and measurement of self-stigma in substance misuse. This paper aims to fill this gap by reporting on the development of a new scale to measure self-stigma experienced by people who are misusing substances, the Substance Abuse Self-Stigma Scale. Content validity and item refinement occurred through an iterative process involving a literature search, focus groups, and expert judges. Psychometric properties were examined in a cross-sectional study of individuals (n = 352) receiving treatment for substance misuse. Factor analyses resulted in a 40-item measure with self devaluation, fear of enacted stigma, stigma avoidance, and values disengagement subscales. The measure showed a strong factor structure and good reliability and validity overall, though the values disengagement subscale showed a mixed pattern. Results are discussed in terms of their implications for studies of stigma impact and intervention. PMID:23772099

Automatic personality assessment through social media language.

PubMed

Park, Gregory; Schwartz, H Andrew; Eichstaedt, Johannes C; Kern, Margaret L; Kosinski, Michal; Stillwell, David J; Ungar, Lyle H; Seligman, Martin E P

2015-06-01

Language use is a psychologically rich, stable individual difference with well-established correlations to personality. We describe a method for assessing personality using an open-vocabulary analysis of language from social media. We compiled the written language from 66,732 Facebook users and their questionnaire-based self-reported Big Five personality traits, and then we built a predictive model of personality based on their language. We used this model to predict the 5 personality factors in a separate sample of 4,824 Facebook users, examining (a) convergence with self-reports of personality at the domain- and facet-level; (b) discriminant validity between predictions of distinct traits; (c) agreement with informant reports of personality; (d) patterns of correlations with external criteria (e.g., number of friends, political attitudes, impulsiveness); and (e) test-retest reliability over 6-month intervals. Results indicated that language-based assessments can constitute valid personality measures: they agreed with self-reports and informant reports of personality, added incremental validity over informant reports, adequately discriminated between traits, exhibited patterns of correlations with external criteria similar to those found with self-reported personality, and were stable over 6-month intervals. Analysis of predictive language can provide rich portraits of the mental life associated with traits. This approach can complement and extend traditional methods, providing researchers with an additional measure that can quickly and cheaply assess large groups of participants with minimal burden. (c) 2015 APA, all rights reserved).

Moving beyond Traditional Methods of Survey Validation

ERIC Educational Resources Information Center

Maul, Andrew

2017-01-01

In his focus article, "Rethinking Traditional Methods of Survey Validation," published in this issue of "Measurement: Interdisciplinary Research and Perspectives," Andrew Maul wrote that it is commonly believed that self-report, survey-based instruments can be used to measure a wide range of psychological attributes, such as…

Development and Validation of the Patient Experience with Treatment and Self-Management (PETS): A Patient-Reported Measure of Treatment Burden

PubMed Central

Eton, David T.; Yost, Kathleen J.; Lai, Jin-shei; Ridgeway, Jennifer L.; Egginton, Jason S.; Rosedahl, Jordan K.; Linzer, Mark; Boehm, Deborah H.; Thakur, Azra; Poplau, Sara; Odell, Laura; Montori, Victor M.; May, Carl R.; Anderson, Roger T.

2017-01-01

Purpose The purpose of this study was to develop and validate a new comprehensive patient-reported measure of treatment burden – the Patient Experience with Treatment and Self-Management (PETS). Methods A conceptual framework was used to derive the PETS with items reviewed and cognitively tested with patients. A survey battery, including a pilot version of the PETS, was mailed to 838 multi-morbid patients from two healthcare institutions for validation. Results A total of 332 multi-morbid patients returned completed surveys. Diagnostics supported deletion and consolidation of some items and domains. Confirmatory factor analysis supported a domain model for scaling comprised of 9 factors: medical information, medications, medical appointments, monitoring health, interpersonal challenges, medical/healthcare expenses, difficulty with healthcare services, role/social activity limitations, and physical/mental exhaustion. Scales showed good internal consistency (alpha range: 0.79 – 0.95). Higher PETS scores, indicative of greater treatment burden, were correlated with more distress, less satisfaction with medications, lower self-efficacy, worse physical and mental health, and lower convenience of healthcare (Ps<.001). Patients with lower health literacy, less adherence to medications, and more financial difficulties reported higher PETS scores (Ps<.01). Conclusion A comprehensive patient-reported measure of treatment burden can help to better characterize the impact of treatment and self-management burden on patient well-being and guide care toward minimally disruptive medicine. PMID:27566732

Development and validation of the Patient Experience with Treatment and Self-management (PETS): a patient-reported measure of treatment burden.

PubMed

Eton, David T; Yost, Kathleen J; Lai, Jin-Shei; Ridgeway, Jennifer L; Egginton, Jason S; Rosedahl, Jordan K; Linzer, Mark; Boehm, Deborah H; Thakur, Azra; Poplau, Sara; Odell, Laura; Montori, Victor M; May, Carl R; Anderson, Roger T

2017-02-01

The purpose of this study was to develop and validate a new comprehensive patient-reported measure of treatment burden-the Patient Experience with Treatment and Self-management (PETS). A conceptual framework was used to derive the PETS with items reviewed and cognitively tested with patients. A survey battery, including a pilot version of the PETS, was mailed to 838 multi-morbid patients from two healthcare institutions for validation. A total of 332 multi-morbid patients returned completed surveys. Diagnostics supported deletion and consolidation of some items and domains. Confirmatory factor analysis supported a domain model for scaling comprised of 9 factors: medical information, medications, medical appointments, monitoring health, interpersonal challenges, medical/healthcare expenses, difficulty with healthcare services, role/social activity limitations, and physical/mental exhaustion. Scales showed good internal consistency (α range 0.79-0.95). Higher PETS scores, indicative of greater treatment burden, were correlated with more distress, less satisfaction with medications, lower self-efficacy, worse physical and mental health, and lower convenience of healthcare (Ps < 0.001). Patients with lower health literacy, less adherence to medications, and more financial difficulties reported higher PETS scores (Ps < 0.01). A comprehensive patient-reported measure of treatment burden can help to better characterize the impact of treatment and self-management burden on patient well-being and guide care toward minimally disruptive medicine.

Concordance of the Mini-Psychiatric Assessment Schedule for Adults Who Have Developmental Disabilities (PASADD) and the Brief Symptom Inventory

ERIC Educational Resources Information Center

Beail, N.; Mitchell, K.; Vlissides, N.; Jackson, T.

2015-01-01

Background: When assessing the mental health needs of people who have intellectual disabilities (ID) it is important to use measures that have good validity and reliability to ensure accurate case recognition and reliable and valid outcome data. Measures developed for this purpose tend to be self-report or by informant report. Multi-trait…

Accelerometer-measured versus self-reported physical activity in college students: implications for research and practice.

PubMed

Downs, Andrew; Van Hoomissen, Jacqueline; Lafrenz, Andrew; Julka, Deana L

2014-01-01

To determine the level of moderate-vigorous-intensity physical activity (MVPA) assessed via self-report and accelerometer in the college population, and to examine intrapersonal and contextual variables associated with physical activity (PA). Participants were 77 college students at a university in the northwest sampled between January 2011 and December 2011. Participants completed a validated self-report measure of PA and measures of athletic identity and benefits and barriers to exercise. Participants' PA levels were assessed for 2 weeks via accelerometry. Participants' estimations of their time spent engaged in MVPA were significantly higher when measured via self-report versus accelerometry. Stronger athletic identity, perceived social benefits and barriers, and time-effort barriers were related to PA levels. Estimation of college students' level of PA may require interpretation of data from different measurement methods, as self-report and accelerometry generate different estimations of PA in college students who may be even less active than previously believed.

Reliability and validity of two self-report measures of impairment and disability for MS. North American Research Consortium on Multiple Sclerosis Outcomes Study Group.

PubMed

Schwartz, C E; Vollmer, T; Lee, H

1999-01-01

To describe the results of a multicenter study that validated two new patient-reported measures of neurologic impairment and disability for use in MS clinical research. Self-reported data can provide a cost-effective means to assess patient functioning, and can be useful for screening patients who require additional evaluation. Thirteen MS centers from the United States and Canada implemented a cross-sectional validation study of two new measures of neurologic function. The Symptom Inventory is a measure of neurologic impairment with six subscales designed to correlate with localization of brain lesion. The Performance Scales measure disability in eight domains of function: mobility, hand function, vision, fatigue, cognition, bladder/bowel, sensory, and spasticity. Measures given for comparison included a neurologic examination (Expanded Disability Status Scale, Ambulation Index, Disease Steps) as well as the patient-reported Health Status Questionnaire and the Quality of Well-being Index. Participants included 274 MS patients and 296 healthy control subjects who were matched to patients on age, gender, and education. Both the Symptom Inventory and the Performance Scales showed high test-retest and internal consistency reliability. Correlational analyses supported the construct validity of both measures. Discriminant function analysis reduced the Symptom Inventory to 29 items without sacrificing reliability and increased its discriminant validity. The Performance Scales explained more variance in clinical outcomes and global quality of life than the Symptom Inventory, and there was some evidence that the two measures complemented each other in predicting Quality of Well-being Index scores. The Symptom Inventory and the Performance Scales are reliable and valid measures.

The Perceived Medical Condition Self-Management Scale can be applied to patients with chronic kidney disease.

PubMed

Wild, Marcus G; Wallston, Kenneth A; Green, Jamie A; Beach, Lauren B; Umeukeje, Ebele; Wright Nunes, Julie A; Ikizler, T Alp; Steed, Julia; Cavanaugh, Kerri L

2017-10-01

Chronic Kidney Disease (CKD) is a major burden on patients and the health care system. Treatment of CKD requires dedicated involvement from both caretakers and patients. Self-efficacy, also known as perceived competence, contributes to successful maintenance of patient's CKD self-management behaviors such as medication adherence and dietary regulations. Despite a clear association between self-efficacy and improved CKD outcomes, there remains a lack of validated self-report measures of CKD self-efficacy. To address this gap, the Perceived Kidney/Dialysis Self-Management Scale (PKDSMS) was adapted from the previously validated Perceived Medical Condition Self-Management Scale. We then sought to validate this using data from two separate cohorts: a cross-sectional investigation of 146 patients with end-stage renal disease receiving maintenance hemodialysis and a longitudinal study of 237 patients with CKD not receiving dialysis. The PKDSMS was found to be positively and significantly correlated with self-management behaviors and medication adherence in both patient cohorts. The PKDSMS had acceptable reliability, was internally consistent, and exhibited predictive validity between baseline PKDSMS scores and self-management behaviors across multiple time points. Thus, the PKDSMS is a valid and reliable measure of CKD patient self-efficacy and supports the development of interventions enhancing perceived competence to improve CKD self-management. Copyright © 2017 International Society of Nephrology. Published by Elsevier Inc. All rights reserved.

The validity of tooth grinding measures: etiology of pain dysfunction syndrome revisited.

PubMed

Marbach, J J; Raphael, K G; Dohrenwend, B P; Lennon, M C

1990-03-01

The current study explores the proposition that a treating clinician's etiologic model influences patients' reports of tooth grinding, the validity of, and subsequent research findings relying on these measures. The investigation compares self-reports of tooth grinding and related clinical variables for 151 cases of temporomandibular pain and dysfunction syndrome (TMPDS) treated by a clinician who does not explicitly support the grinding theory of the etiology of TMPDS, and 139 healthy controls. Cases were no more likely than well controls to report ever-grinding, but were actually significantly less likely than well controls to report current grinding. They were also significantly more likely to report that a dentist had told them they ground. Findings suggest that studies using self-report, clinician-report of tooth grinding (or both) are methodologically inadequate for addressing the relationship between tooth grinding and TMPDS.

Validity and test-retest reliability in assessing current body size with figure drawings in Chinese adolescents.

PubMed

Lo, Wing-Sze; Ho, Sai-Yin; Wong, Bonny Yee-Man; Mak, Kwok-Kei; Lam, Tai-Hing

2011-06-01

The reliability and validity of Stunkard's Figure Rating Scale (FRS) as a measure of current body size (CBS) was established in Western adolescent girls but not in non-Western population. We examined the validity and test-retest reliability of Stunkard's FRS in assessing CBS among Chinese adolescents. Methods. In a school-based survey in Hong Kong, 5666 adolescents (boys: 45.1%; mean age 14.7 years) provided data on self-reported height and weight, CBS, perceived weight status, and health-related quality of life using the Medical Outcomes Study Short-Form version 2 (SF-12v2). Height and weight were also objectively measured. Spearman's correlation was used to assess construct validity, concurrent validity and test-retest reliability. Convergent and discriminant validity were good: CBS correlated strongly with weight and self-reported/measured BMI, but only weakly with SF-12v2. CBS correlated strongly with perceived weight status, showing concurrent validity. Spearman's correlation (r) for CBS was 0.78 for girls and 0.72 for boys indicating good test-retest reliability. Validity and reliability results did not differ significantly between senior and junior grade adolescents. Our findings support the use of Stunkard's FRS to measure body size among Chinese adolescents.

Short forms of the Schedule for Nonadaptive and Adaptive Personality (SNAP) for self- and collateral ratings: development, reliability, and validity.

PubMed

Harlan, E; Clark, L A

1999-06-01

Researchers and clinicians alike increasingly seek brief, reliable, and valid measures to obtain personality trait ratings from both selves and peers. We report the development of a paragraph-descriptor short form of a full-length personality assessment instrument, the Schedule for Nonadaptive and Adaptive Personality (SNAP) with both self- and other versions. Reliability and validity data were collected on a sample of 294 college students, from 90 of whom we also obtained parental ratings of their personality. Internal consistency reliability was good in both self- and parent data. The factorial structures of the self-report short and long forms were very similar. Convergence between parental ratings was moderately high. Self-parent convergence was variable, with lower agreement on scales assessing subjective distress than those assessing more observable behaviors; it also was stronger for higher order factors than for scales.

Measuring voice outcomes: state of the science review.

PubMed

Carding, Pau N; Wilson, J A; MacKenzie, K; Deary, I J

2009-08-01

Researchers evaluating voice disorder interventions currently have a plethora of voice outcome measurement tools from which to choose. Faced with such a wide choice, it would be beneficial to establish a clear rationale to guide selection. This article reviews the published literature on the three main areas of voice outcome assessment: (1) perceptual rating of voice quality, (2) acoustic measurement of the speech signal and (3) patient self-reporting of voice problems. We analysed the published reliability, validity, sensitivity to change and utility of the common outcome measurement tools in each area. From the data, we suggest that routine voice outcome measurement should include (1) an expert rating of voice quality (using the Grade-Roughness-Breathiness-Asthenia-Strain rating scale) and (2) a short self-reporting tool (either the Vocal Performance Questionnaire or the Vocal Handicap Index 10). These measures have high validity, the best reported reliability to date, good sensitivity to change data and excellent utility ratings. However, their application and administration require attention to detail. Acoustic measurement has arguable validity and poor reliability data at the present time. Other areas of voice outcome measurement (e.g. stroboscopy and aerodynamic phonatory measurements) require similarly detailed research and analysis.

Development and Validation of Scores from an Instrument Measuring Student Test-Taking Motivation

ERIC Educational Resources Information Center

Eklof, Hanna

2006-01-01

Using the expectancy-value model of achievement motivation as a basis, this study's purpose is to develop, apply, and validate scores from a self-report instrument measuring student test-taking motivation. Sampled evidence of construct validity for the present sample indicates that a number of the items in the instrument could be used as an…

Advancing the Multi-Informant Assessment of Sluggish Cognitive Tempo: Child Self-Report in Relation to Parent and Teacher Ratings of SCT and Impairment.

PubMed

Sáez, Belén; Servera, Mateu; Burns, G Leonard; Becker, Stephen P

2018-04-27

Despite increasing interest in sluggish cognitive tempo (SCT) in children and advancements in its measurement, little research has examined child self-reported SCT. Child self-report of SCT is important for the multi-informant assessment of SCT. The current study used a large, school-based sample of children and a multi-informant design to examine child self-reported SCT using the Child Concentration Inventory - Version 2 (CCI-2) which was recently revised based on meta-analytic findings and parallels the item content of validated parent and teacher rating scales. The study involved 2142 unique children (ages 8-13 years, 50.51% males). Children (n = 1980) completed measures of SCT, loneliness, and preference for solitude. Mothers (n = 1648), fathers (n = 1358), and teachers (n = 1773) completed measures of SCT, attention-deficit/hyperactivity disorder-IN (ADHD-IN), academic impairment, social impairment, and conflicted shyness. Children's self-reported SCT demonstrated good reliability with the 15 SCT symptoms showing moderate to strong loadings on the SCT factor. The child self-report SCT factor also showed moderate convergent validity with mother, father, and teacher ratings of children's SCT. In addition, higher child-reported SCT predicted greater mother, father, and teacher ratings of children's academic impairment even after controlling for mother, father, and teacher ratings of children's SCT and ADHD-IN. Higher child-rated SCT also predicted greater mother ratings of children's social impairment after controlling for mother ratings of children's SCT and ADHD-IN. The present study provides initial empirical support for the reliability and validity of child-reported SCT as part of the multi-informant assessment of SCT. A key direction for future research includes evaluating the unique contributions of different informants and their utility within specific contexts to guide evidence-based recommendations for assessing SCT.

Self-Report Measures of Juvenile Psychopathic Personality Traits: A Comparative Review

ERIC Educational Resources Information Center

Vaughn, Michael G.; Howard, Matthew O.

2005-01-01

The authors evaluated self-report instruments currently being used to assess children and adolescents with psychopathic personality traits with respect to their reliability, validity, and research utility. Comprehensive searches across multiple computerized bibliographic databases were conducted and supplemented with manual searches. A total of 30…

The Measure of Adolescent Heterosocial Competence: Development and Initial Validation

ERIC Educational Resources Information Center

Grover, Rachel L.; Nangle, Douglas W.; Zeff, Karen R.

2005-01-01

We developed and began construct validation of the Measure of Adolescent Heterosocial Competence (MAHC), a self-report instrument assessing the ability to negotiate effectively a range of challenging other-sex social interactions. Development followed the Goldfried and D'Zurilla (1969) behavioral-analytic model for assessing competence.…

Development and Validation of the Family Beliefs Inventory: A Measure of Unrealistic Beliefs among Parents and Adolescents.

ERIC Educational Resources Information Center

Roehling, Patricia Vincent; Robin, Arthur L.

1986-01-01

Evaluated the criterion-related validity of the Family Beliefs Inventory, a new self-report measure of unreasonable beliefs regarding parent-adolescent relationships. Distressed fathers displayed more unreasonable beliefs concerning ruination, obedience, perfectionism, and malicious intent than nondistressed fathers. Distressed adolescents…

The Marital Disaffection Scale: An Inventory for Assessing Emotional Estrangement in Marriage.

ERIC Educational Resources Information Center

Kayser, Karen

1996-01-01

Describes a self-report scale measuring levels of disaffection toward one's spouse. A questionnaire containing the Marital Disaffection Scale (MDS) and other disaffection measures of marital happiness was administered to 76 spouses. Results indicated good criterion-related validity, discriminant validity, and interitem reliability. Findings…

Self-report measure of financial exploitation of older adults.

PubMed

Conrad, Kendon J; Iris, Madelyn; Ridings, John W; Langley, Kate; Wilber, Kathleen H

2010-12-01

this study was designed to improve the measurement of financial exploitation (FE) by testing psychometric properties of the older adult financial exploitation measure (OAFEM), a client self-report instrument. rasch item response theory and traditional validation approaches were used. Questionnaires were administered by 22 adult protective services investigators from 7 agencies in Illinois to 227 substantiated abuse clients. Analyses included tests for dimensionality, model fit, and additional construct validation. Results from the OAFEM were also compared with the substantiation decision of abuse and with investigators' assessments of FE using a staff report version. Hypotheses were generated to test hypothesized relationships. the OAFEM, including the original 79-, 54-, and 30-item measures, met stringent Rasch analysis fit and unidimensionality criteria and had high internal consistency and item reliability. The validation results were supportive, while leading to reconsideration of aspects of the hypothesized theoretical hierarchy. Thresholds were suggested to demonstrate levels of severity. the measure is now available to aid in the assessment of FE of older adults by both clinicians and researchers. Theoretical refinements developed using the empirically generated item hierarchy may help to improve assessment and intervention.

The Parent Trauma Response Questionnaire (PTRQ): development and preliminary validation

PubMed Central

Creswell, Cathy; Dalgleish, Tim; Fearon, Pasco; Goodall, Ben; McKinnon, Anna; Smith, Patrick; Wright, Isobel

2018-01-01

ABSTRACT Background: Following a child’s experience of trauma, parental response is thought to play an important role in either facilitating or hindering their psychological adjustment. However, the ability to investigate the role of parenting responses in the post-trauma period has been hampered by a lack of valid and reliable measures. Objectives: The aim of this study was to design, and provide a preliminary validation of, the Parent Trauma Response Questionnaire (PTRQ), a self-report measure of parental appraisals and support for children’s coping, in the aftermath of child trauma. Methods: We administered an initial set of 78 items to 365 parents whose children, aged 2–19 years, had experienced a traumatic event. We conducted principal axis factoring and then assessed the validity of the reduced measure against a standardized general measure of parental overprotection and via the measure’s association with child post-trauma mental health. Results: Factor analysis generated three factors assessing parental maladaptive appraisals: (i) permanent change/damage, (ii) preoccupation with child’s vulnerability, and (iii) self-blame. In addition, five factors were identified that assess parental support for child coping: (i) behavioural avoidance, (ii) cognitive avoidance, (iii) overprotection, (iv) maintaining pre-trauma routines, and (v) approach coping. Good validity was evidenced against the measure of parental overprotection and child post-traumatic stress symptoms. Good test–retest reliability of the measure was also demonstrated. Conclusions: The PTRQ is a valid and reliable self-report assessment of parenting cognitions and coping in the aftermath of child trauma. PMID:29938010

Multidimensional assessment of self-regulated learning with middle school math students.

PubMed

Callan, Gregory L; Cleary, Timothy J

2018-03-01

This study examined the convergent and predictive validity of self-regulated learning (SRL) measures situated in mathematics. The sample included 100 eighth graders from a diverse, urban school district. Four measurement formats were examined including, 2 broad-based (i.e., self-report questionnaire and teacher ratings) and 2 task-specific measures (i.e., SRL microanalysis and behavioral traces). Convergent validity was examined across task-difficulty, and the predictive validity was examined across 3 mathematics outcomes: 2 measures of mathematical problem solving skill (i.e., practice session math problems, posttest math problems) and a global measure of mathematical skill (i.e., standardized math test). Correlation analyses were used to examine convergent validity and revealed medium correlations between measures within the same category (i.e., broad-based or task-specific). Relations between measurement classes were not statistically significant. Separate regressions examined the predictive validity of the SRL measures. While controlling all other predictors, a SRL microanalysis metacognitive-monitoring measure emerged as a significant predictor of all 3 outcomes and teacher ratings accounted for unique variance on 2 of the outcomes (i.e., posttest math problems and standardized math test). Results suggest that a multidimensional assessment approach should be considered by school psychologists interested in measuring SRL. (PsycINFO Database Record (c) 2018 APA, all rights reserved).

A method for sensitivity analysis to assess the effects of measurement error in multiple exposure variables using external validation data.

PubMed

Agogo, George O; van der Voet, Hilko; van 't Veer, Pieter; Ferrari, Pietro; Muller, David C; Sánchez-Cantalejo, Emilio; Bamia, Christina; Braaten, Tonje; Knüppel, Sven; Johansson, Ingegerd; van Eeuwijk, Fred A; Boshuizen, Hendriek C

2016-10-13

Measurement error in self-reported dietary intakes is known to bias the association between dietary intake and a health outcome of interest such as risk of a disease. The association can be distorted further by mismeasured confounders, leading to invalid results and conclusions. It is, however, difficult to adjust for the bias in the association when there is no internal validation data. We proposed a method to adjust for the bias in the diet-disease association (hereafter, association), due to measurement error in dietary intake and a mismeasured confounder, when there is no internal validation data. The method combines prior information on the validity of the self-report instrument with the observed data to adjust for the bias in the association. We compared the proposed method with the method that ignores the confounder effect, and with the method that ignores measurement errors completely. We assessed the sensitivity of the estimates to various magnitudes of measurement error, error correlations and uncertainty in the literature-reported validation data. We applied the methods to fruits and vegetables (FV) intakes, cigarette smoking (confounder) and all-cause mortality data from the European Prospective Investigation into Cancer and Nutrition study. Using the proposed method resulted in about four times increase in the strength of association between FV intake and mortality. For weakly correlated errors, measurement error in the confounder minimally affected the hazard ratio estimate for FV intake. The effect was more pronounced for strong error correlations. The proposed method permits sensitivity analysis on measurement error structures and accounts for uncertainties in the reported validity coefficients. The method is useful in assessing the direction and quantifying the magnitude of bias in the association due to measurement errors in the confounders.

Leadership: validation of a self-report scale: comment on Dussault, Frenette, and Fernet (2013).

PubMed

Chakrabarty, Subhra

2014-10-01

In a recent study, Dussault, Frenette, and Fernet (2013) developed a 21-item self-report instrument to measure leadership based on Bass's (1985) transformational/transactional leadership paradigm. The final specification included a third-order dimension (leadership), two second-order dimensions (transactional leadership and transformational leadership), and a first-order dimension (laissez-faire leadership). This note focuses on the need for assessing convergent and discriminant validity of the scale, and on ruling out the potential for common method bias.

Measuring social science concepts in pharmacy education research: From definition to item analysis of self-report instruments.

PubMed

Cor, M Ken

Interpreting results from quantitative research can be difficult when measures of concepts are constructed poorly, something that can limit measurement validity. Social science steps for defining concepts, guidelines for limiting construct-irrelevant variance when writing self-report questions, and techniques for conducting basic item analysis are reviewed to inform the design of instruments to measure social science concepts in pharmacy education research. Based on a review of the literature, four main recommendations emerge: These include: (1) employ a systematic process of conceptualization to derive nominal definitions; (2) write exact and detailed operational definitions for each concept, (3) when creating self-report questionnaires, write statements and select scales to avoid introducing construct-irrelevant variance (CIV); and (4) use basic item analysis results to inform instrument revision. Employing recommendations that emerge from this review will strengthen arguments to support measurement validity which in turn will support the defensibility of study finding interpretations. An example from pharmacy education research is used to contextualize the concepts introduced. Copyright © 2017 Elsevier Inc. All rights reserved.

VALIDITATION OF A LIGHT QUESTIONNAIRE WITH REAL-LIFE PHOTOPIC ILLUMINANCE MEASUREMENTS: THE HARVARD LIGHT EXPOSURE ASSESSMENT QUESTIONNAIRE

PubMed Central

Bajaj, Archna; Rosner, Bernard; Lockley, Steven; Schernhammer, Eva S.

2011-01-01

Background Light exposure at night is now considered a probable carcinogen. To study the effects of light on chronic diseases like cancer, methods to measure light exposure in large observational studies are needed. We aimed to investigate the validity of self-reported current light exposure. Methods We developed a self-administered semiquantitative light questionnaire, the Harvard Light Exposure Assessment (H-LEA) questionnaire, and compared photopic scores derived from this questionnaire with actual photopic and circadian measures obtained from a real-life 7-day light meter application among 132 women (85 rotating night shift workers and 47 day workers) participating in the Nurses' Health Study II. Results After adjustment for age, BMI, collection day, and night work status, the overall partial Spearman correlation between self-report of light exposure and actual photopic light measurements was 0.72 (P<0.001; Kendall τ =0.57) and 0.73 (P<0.0001; Kendall τ =0.58) when correlating circadian light measurements. There were only minimal differences in accuracy of self-report of light exposure and photopic or circadian light measurement between day (r=0.77 and 0.78, respectively) and rotating night shift workers (r=0.68 and 0.69, respectively). Conclusions The results of this study provide evidence of the criterion validity of self-reported light exposure using the H-LEA questionnaire. Impact: This questionnaire is a practical method of assessing light exposure in large scale epidemiologic studies. PMID:21737411

Vocational Rehabilitation Counselor Training Needs Assessment and Competence Measure: An Exploratory Factor Analysis

ERIC Educational Resources Information Center

Kundu, Madan M.; Dutta, Alo; Chan, Fong; Torres, Viviana; Fleming, Kayla

2011-01-01

Purpose: To validate an 80-item self-report measure, A Systems Approach to Placement: Self-Assessment for Students and Counselors (SAP-SASC), designed to identify critical areas of knowledge, skills, and competencies possessed by rehabilitation counselors in state vocational rehabilitation (VR) agency settings. Participants: 275 rehabilitation…

Measuring Twenty-First Century Skills: Development and Validation of a Scale for In-Service and Pre-Service Teachers

ERIC Educational Resources Information Center

Jia, Yueming; Oh, Youn Joo; Sibuma, Bernadette; LaBanca, Frank; Lorentson, Mhora

2016-01-01

A self-report scale that measures teachers' confidence in teaching students about twenty-first century skills was developed and validated with pre-service and in-service teachers. First, 16 items were created to measure teaching confidence in six areas: information literacy, collaboration, communication, innovation and creativity, problem solving,…

Tests of the Construct Validity of Occupational Stress Measures with College Students: Failure to Support Discriminant Validity.

ERIC Educational Resources Information Center

Meier, Scott T.

1991-01-01

Examined correlations among stress, anxiety, and depression scales in 129 college students, as well as ability of measures of depression and anxiety to add to predictive power of occupational stress for recognition memory task and self-reported physical symptoms. Results indicated that stress, depression, and anxiety measures were moderately to…

Three assessment tools for deliberate self-harm and suicide behavior: evaluation and psychopathological correlates.

PubMed

Fliege, Herbert; Kocalevent, Rueya-Daniela; Walter, Otto B; Beck, Stefanie; Gratz, Kim L; Gutierrez, Peter M; Klapp, Burghard F

2006-07-01

The aims of this study are to adapt two validated self-report questionnaires of deliberate self-harm and suicidal behavior to German, to investigate their psychometric properties and agreement with clinician-administered ratings, and to examine their psychopathological correlates. The Deliberate Self-Harm Inventory [Gratz KL. Measurement of deliberate self-harm: preliminary data on the deliberate self-harm inventory. J Psychopathol Behav 2001;23:253-263] and the Self-Harm Behavior Questionnaire [Guttierez PM, Osman A, Barrios FX, Kopper BA. Development and initial validation of the self-harm behavior questionnaire. J Pers Assess 2001;77:475-490] were completed by 361 patients hospitalized for depressive, anxiety, adjustment, somatoform, and/or eating disorders. A clinician-administered rating scale of self-destructive behavior was included. Psychopathological variables were assessed by standardized questionnaires. The self-report questionnaires demonstrated good reliability (alpha=.81-.96, split-half r=.78-.98, test-retest r=.65-.91). Reliability of the clinician-administered ratings was acceptable (interrater kappa=.46-.77, test-retest kappa=.35-.48). Intraclass correlations (ICC=.68) for all three instruments were satisfactory. Rates of self-harm and associations between self-harm and suicidal behaviors are reported. The findings support the hypotheses of a higher degree of psychiatric symptomatology in patients with self-harm behavior compared to those without. The two questionnaire adaptations are reliable and valid self-report scales for the assessment of self-harm and past suicidal behavior.

PROMIS Sleep Disturbance and Sleep-Related Impairment in Adolescents: Examining Psychometrics Using Self-Report and Actigraphy.

PubMed

Hanish, Alyson E; Lin-Dyken, Deborah C; Han, Joan C

The National Institutes of Health Patient-Reported Outcomes Measurement Information System (PROMIS) has self-reported health measures available for both pediatric and adult populations, but no pediatric measures are available currently in the sleep domains. The purpose of this observational study was to perform preliminary validation studies on age-appropriate, self-reported sleep measures in healthy adolescents. This study examined 25 healthy adolescents' self-reported daytime sleepiness, sleep disturbance, sleep-related impairment, and sleep patterns. Healthy adolescents completed a physical exam at the National Institutes of Health Clinical Center (Bethesda, MD), had no chronic medical conditions, and were not taking any chronic medications. The Cleveland Adolescent Sleepiness Questionnaire (CASQ), PROMIS Sleep Disturbance (v. 1.0; 8a), and PROMIS Sleep-Related Impairment (v. 1.0; 8b) questionnaires were completed, and sleep patterns were assessed using actigraphy. Total scores on the three sleep questionnaires were correlated (all Spearman's r > .70, p < .001). Total sleep time determined by actigraphy was negatively correlated with the CASQ (p = .01), PROMIS Sleep Disturbance (p = .02), and PROMIS Sleep-Related Impairment (p = .02). The field of pediatric sleep is rapidly expanding, and researchers and clinicians will benefit from well-designed, psychometrically sound sleep questionnaires. Findings suggest the potential research and clinical utility of adult versions of PROMIS sleep measures in adolescents. Future studies should include larger, more diverse samples and explore additional psychometric properties of PROMIS sleep measures to provide age-appropriate, validated, and reliable measures of sleep in adolescents.

Validity and reliability of a self-report instrument to assess social support and physical environmental correlates of physical activity in adolescents

PubMed Central

2012-01-01

Background The purpose of this study was to examine the internal consistency, test-retest reliability, construct validity and predictive validity of a new German self-report instrument to assess the influence of social support and the physical environment on physical activity in adolescents. Methods Based on theoretical consideration, the short scales on social support and physical environment were developed and cross-validated in two independent study samples of 9 to 17 year-old girls and boys. The longitudinal sample of Study I (n = 196) was recruited from a German comprehensive school, and subjects in this study completed the questionnaire twice with a between-test interval of seven days. Cronbach’s alphas were computed to determine the internal consistency of the factors. Test-retest reliability of the latent factors was assessed using intra-class coefficients. Factorial validity of the scales was assessed using principle components analysis. Construct validity was determined using a cross-validation technique by performing confirmatory factor analysis with the independent nationwide cross-sectional sample of Study II (n = 430). Correlations between factors and three measures of physical activity (objectively measured moderate-to-vigorous physical activity (MVPA), self-reported habitual MVPA and self-reported recent MVPA) were calculated to determine the predictive validity of the instrument. Results Construct validity of the social support scale (two factors: parental support and peer support) and the physical environment scale (four factors: convenience, public recreation facilities, safety and private sport providers) was shown. Both scales had moderate test-retest reliability. The factors of the social support scale also had good internal consistency and predictive validity. Internal consistency and predictive validity of the physical environment scale were low to acceptable. Conclusions The results of this study indicate moderate to good reliability and construct validity of the social support scale and physical environment scale. Predictive validity was only confirmed for the social support scale but not for the physical environment scale. Hence, it remains unclear if a person’s physical environment has a direct or an indirect effect on physical activity behavior or a moderation function. PMID:22928865

Validity and reliability of a self-report instrument to assess social support and physical environmental correlates of physical activity in adolescents.

PubMed

Reimers, Anne K; Jekauc, Darko; Mess, Filip; Mewes, Nadine; Woll, Alexander

2012-08-29

The purpose of this study was to examine the internal consistency, test-retest reliability, construct validity and predictive validity of a new German self-report instrument to assess the influence of social support and the physical environment on physical activity in adolescents. Based on theoretical consideration, the short scales on social support and physical environment were developed and cross-validated in two independent study samples of 9 to 17 year-old girls and boys. The longitudinal sample of Study I (n = 196) was recruited from a German comprehensive school, and subjects in this study completed the questionnaire twice with a between-test interval of seven days. Cronbach's alphas were computed to determine the internal consistency of the factors. Test-retest reliability of the latent factors was assessed using intra-class coefficients. Factorial validity of the scales was assessed using principle components analysis. Construct validity was determined using a cross-validation technique by performing confirmatory factor analysis with the independent nationwide cross-sectional sample of Study II (n = 430). Correlations between factors and three measures of physical activity (objectively measured moderate-to-vigorous physical activity (MVPA), self-reported habitual MVPA and self-reported recent MVPA) were calculated to determine the predictive validity of the instrument. Construct validity of the social support scale (two factors: parental support and peer support) and the physical environment scale (four factors: convenience, public recreation facilities, safety and private sport providers) was shown. Both scales had moderate test-retest reliability. The factors of the social support scale also had good internal consistency and predictive validity. Internal consistency and predictive validity of the physical environment scale were low to acceptable. The results of this study indicate moderate to good reliability and construct validity of the social support scale and physical environment scale. Predictive validity was only confirmed for the social support scale but not for the physical environment scale. Hence, it remains unclear if a person's physical environment has a direct or an indirect effect on physical activity behavior or a moderation function.

Development of the NIH PROMIS ® Sexual Function and Satisfaction measures in patients with cancer.

PubMed

Flynn, Kathryn E; Lin, Li; Cyranowski, Jill M; Reeve, Bryce B; Reese, Jennifer Barsky; Jeffery, Diana D; Smith, Ashley Wilder; Porter, Laura S; Dombeck, Carrie B; Bruner, Deborah Watkins; Keefe, Francis J; Weinfurt, Kevin P

2013-02-01

We describe the development and validation of the Patient-Reported Outcomes Measurement Information System(®) Sexual Function and Satisfaction (PROMIS(®) SexFS; National Institutes of Health) measures, version 1.0, for cancer populations. To develop a customizable self-report measure of sexual function and satisfaction as part of the U.S. National Institutes of Health PROMIS Network. Our multidisciplinary working group followed a comprehensive protocol for developing psychometrically robust patient-reported outcome measures including qualitative (scale development) and quantitative (psychometric evaluation) development. We performed an extensive literature review, conducted 16 focus groups with cancer patients and multiple discussions with clinicians, and evaluated candidate items in cognitive testing with patients. We administered items to 819 cancer patients. Items were calibrated using item-response theory and evaluated for reliability and validity. The PROMIS SexFS measures, version 1.0, include 81 items in 11 domains: Interest in Sexual Activity, Lubrication, Vaginal Discomfort, Erectile Function, Global Satisfaction with Sex Life, Orgasm, Anal Discomfort, Therapeutic Aids, Sexual Activities, Interfering Factors, and Screener Questions. In addition to content validity (patients indicate that items cover important aspects of their experiences) and face validity (patients indicate that items measure sexual function and satisfaction), the measure shows evidence for discriminant validity (domains discriminate between groups expected to be different) and convergent validity (strong correlations between scores on PROMIS and scores on conceptually similar older measures of sexual function), as well as favorable test-retest reliability among people not expected to change (interclass correlations from two administrations of the instrument, 1 month apart). The PROMIS SexFS offers researchers a reliable and valid set of tools to measure self-reported sexual function and satisfaction among diverse men and women. The measures are customizable; researchers can select the relevant domains and items comprising those domains for their study. © 2013 International Society for Sexual Medicine.

Validation of sick leave measures: self-reported sick leave and sickness benefit data from a Danish national register compared to multiple workplace-registered sick leave spells in a Danish municipality

PubMed Central

2012-01-01

Background Previous validation studies of sick leave measures have focused on self-reports. Register-based sick leave data are considered to be valid; however methodological problems may be associated with such data. A Danish national register on sickness benefit (DREAM) has been widely used in sick leave research. On the basis of sick leave records from 3,554 and 2,311 eldercare workers in 14 different workplaces, the aim of this study was to: 1) validate registered sickness benefit data from DREAM against workplace-registered sick leave spells of at least 15 days; 2) validate self-reported sick leave days during one year against workplace-registered sick leave. Methods Agreement between workplace-registered sick leave and DREAM-registered sickness benefit was reported as sensitivities, specificities and positive predictive values. A receiver-operating characteristic curve and a Bland-Altman plot were used to study the concordance with sick leave duration of the first spell. By means of an analysis of agreement between self-reported and workplace-registered sick leave sensitivity and specificity was calculated. Ninety-five percent confidence intervals (95% CI) were used. Results The probability that registered DREAM data on sickness benefit agrees with workplace-registered sick leave of at least 15 days was 96.7% (95% CI: 95.6-97.6). Specificity was close to 100% (95% CI: 98.3-100). The registered DREAM data on sickness benefit overestimated the duration of sick leave spells by an average of 1.4 (SD: 3.9) weeks. Separate analysis on pregnancy-related sick leave revealed a maximum sensitivity of 20% (95% CI: 4.3-48.1). The sensitivity of self-reporting at least one or at least 56 sick leave day/s was 94.5 (95% CI: 93.4 – 95.5) % and 58.5 (95% CI: 51.1 – 65.6) % respectively. The corresponding specificities were 85.3 (95% CI: 81.4 – 88.6) % and 98.9 (95% CI: 98.3 – 99.3) %. Conclusions The DREAM register offered valid measures of sick leave spells of at least 15 days among eldercare employees. Pregnancy-related sick leave should be excluded in studies planning to use DREAM data on sickness benefit. Self-reported sick leave became more imprecise when number of absence days increased, but the sensitivity and specificity were acceptable for lengths not exceeding one week. PMID:22894644

Validation of sick leave measures: self-reported sick leave and sickness benefit data from a Danish national register compared to multiple workplace-registered sick leave spells in a Danish municipality.

PubMed

Stapelfeldt, Christina Malmose; Jensen, Chris; Andersen, Niels Trolle; Fleten, Nils; Nielsen, Claus Vinther

2012-08-15

Previous validation studies of sick leave measures have focused on self-reports. Register-based sick leave data are considered to be valid; however methodological problems may be associated with such data. A Danish national register on sickness benefit (DREAM) has been widely used in sick leave research. On the basis of sick leave records from 3,554 and 2,311 eldercare workers in 14 different workplaces, the aim of this study was to: 1) validate registered sickness benefit data from DREAM against workplace-registered sick leave spells of at least 15 days; 2) validate self-reported sick leave days during one year against workplace-registered sick leave. Agreement between workplace-registered sick leave and DREAM-registered sickness benefit was reported as sensitivities, specificities and positive predictive values. A receiver-operating characteristic curve and a Bland-Altman plot were used to study the concordance with sick leave duration of the first spell. By means of an analysis of agreement between self-reported and workplace-registered sick leave sensitivity and specificity was calculated. Ninety-five percent confidence intervals (95% CI) were used. The probability that registered DREAM data on sickness benefit agrees with workplace-registered sick leave of at least 15 days was 96.7% (95% CI: 95.6-97.6). Specificity was close to 100% (95% CI: 98.3-100). The registered DREAM data on sickness benefit overestimated the duration of sick leave spells by an average of 1.4 (SD: 3.9) weeks. Separate analysis on pregnancy-related sick leave revealed a maximum sensitivity of 20% (95% CI: 4.3-48.1).The sensitivity of self-reporting at least one or at least 56 sick leave day/s was 94.5 (95% CI: 93.4 - 95.5) % and 58.5 (95% CI: 51.1 - 65.6) % respectively. The corresponding specificities were 85.3 (95% CI: 81.4 - 88.6) % and 98.9 (95% CI: 98.3 - 99.3) %. The DREAM register offered valid measures of sick leave spells of at least 15 days among eldercare employees. Pregnancy-related sick leave should be excluded in studies planning to use DREAM data on sickness benefit. Self-reported sick leave became more imprecise when number of absence days increased, but the sensitivity and specificity were acceptable for lengths not exceeding one week.

A Paradigm to Assess Implicit Attitudes towards God: The Positive/Negative God Associations Task.

PubMed

Pirutinsky, Steven; Carp, Sean; Rosmarin, David H

2017-02-01

Psychological research on the relationship between spirituality/religion and mental health has grown considerably over the past several decades and now constitutes a sizable body of scholarship. Among dimensions of S/R, positive beliefs about God have been significantly related to better mental health outcomes, and conversely negative beliefs about God are generally associated with more distress. However, prior research on this topic has relied heavily upon self-report Likert-type scales, which are vulnerable to self-report biases and measure only explicit cognitive processes. In this study, we developed and validated an implicit social cognition task, the Positive/Negative God Go/No-go Association Task (PNG-GNAT), for use in psychological research on spirituality and religion (S/R). Preliminary evidence in a large sample (N = 381) suggests that the PNG-GNAT demonstrates internal consistency, test-retest and split-half reliability, and concurrent evidence of validity. Further, our results suggest that PNG-GNAT scores represent different underlying dimensions of S/R than explicit self-report measures, and incrementally predict mental health above and beyond self-report assessment. The PNG-GNAT appears to be an effective tool for measuring implicit positive/negative beliefs about God.

Red flags in the clinical interview may forecast invalid neuropsychological testing.

PubMed

Keesler, Michael E; McClung, Kirstie; Meredith-Duliba, Tawny; Williams, Kelli; Swirsky-Sacchetti, Thomas

2017-04-01

Evaluating assessment validity is expected in neuropsychological evaluation, particularly in cases with identified secondary gain, where malingering or somatization may be present. Assessed with standalone measures and embedded indices, all within the testing portion of the examination, research on validity of self-report in the clinical interview is limited. Based on experience with litigation-involved examinees recovering from mild traumatic brain injury (mTBI), it was hypothesized that inconsistently reported date of injury (DOI) and/or loss of consciousness (LOC) might predict invalid performance on neurocognitive testing. This archival study examined cases of litigation-involved mTBI patients seen at an outpatient neuropsychological practice in Philadelphia, PA. Coded data included demographic variables, performance validity measures, and consistency between self-report and medicolegal records. A significant relationship was found between the consistency of examinees' self-report with records and their scores on performance validity testing, X 2 (1, N = 84) = 24.18, p < .01, Φ = .49. Post hoc testing revealed significant between-group differences in three of four comparisons, with medium to large effect sizes. A final post hoc analysis found significance between the number of performance validity tests (PVTs) failed and the extent to which an examinee incorrectly reported DOI r(83) = .49, p < .01. Using inconsistently reported LOC and/or DOI to predict an examinee's performance as invalid had a 75% sensitivity and a 75% specificity. Examinees whose reported DOI or LOC differs from records may be more likely to fail one or more PVTs, suggesting possible symptom exaggeration and/or under performance on cognitive testing.s.

The Construction and Validation of an Abridged Version of the Autism-Spectrum Quotient (AQ-Short)

ERIC Educational Resources Information Center

Hoekstra, Rosa A.; Vinkhuyzen, Anna A. E.; Wheelwright, Sally; Bartels, Meike; Boomsma, Dorret I.; Baron-Cohen, Simon; Posthuma, Danielle; van der Sluis, Sophie

2011-01-01

This study reports on the development and validation of an abridged version of the 50-item Autism-Spectrum Quotient (AQ), a self-report measure of autistic traits. We aimed to reduce the number of items whilst retaining high validity and a meaningful factor structure. The item reduction procedure was performed on data from 1,263 Dutch students and…

Reliability and concurrent and construct validity of the Strategies for Weight Management measure for adults.

PubMed

Kolodziejczyk, Julia K; Norman, Gregory J; Rock, Cheryl L; Arredondo, Elva M; Roesch, Scott C; Madanat, Hala; Patrick, Kevin

2016-01-01

This study evaluates the reliability and validity of the strategies for weight management (SWM) measure, a questionnaire that assesses weight management strategies for adults. The SWM includes 20 items that are categorized within the following subscales: (1) energy intake, (2) energy expenditure, (3) self-monitoring, and (4) self-regulation. Baseline and 6-month data were collected from 404 overweight/obese adults (mean age=22±3.8 years, 68% ethnic minority) enrolled in a randomized controlled trial aiming to reduce weight by improving diet and physical activity behaviours. Reliability and validity were assessed for each subscale separately. Cronbach alpha was conducted to assess reliability. Concurrent, construct I (sensitivity to the study treatment condition), and construct II (relationship to the outcomes) validity were assessed using linear regressions with the following outcome measures: weight, self-reported diet, and weekly energy expenditure. All subscales showed strong internal consistency. The strength of the validity evidence depended on subscale and validity type. The strongest validity evidence was concurrent validity of the energy intake and energy expenditure subscales; construct I validity of the energy intake and self-monitoring subscales; and construct II validity of the energy intake, energy expenditure, and self-regulation subscales. Results indicate that the SWM can be used to assess weight management strategies among an ethnically diverse sample of adults as each subscale showed evidence of reliability and select types of validity. As validity is an accumulation of evidence over multiple studies, this study provides initial reliability and validity evidence in one population segment. Copyright © 2015 Asia Oceania Association for the Study of Obesity. Published by Elsevier Ltd. All rights reserved.

Adolescent self-report and parent proxy-report of health-related quality of life: an analysis of validity and reliability of PedsQL 4.0 among a sample of Malaysian adolescents and their parents.

PubMed

Kaartina, Sanker; Chin, Yit Siew; Fara Wahida, Rezali; Woon, Fui Chee; Hiew, Chu Chien; Zalilah, Mohd Shariff; Mohd Nasir, Mohd Taib

2015-04-08

The Pediatric Quality of Life Inventory Generic Core Scales (PedsQL) 4.0 is a generalized assessment of health-related quality of life (HRQoL) based on adolescent self-report and parent proxy-report. This study aims to determine the construct validity and reliability of PedsQL 4.0 among a sample of Malaysian adolescents and parents. A cross-sectional study was carried out at three selected public schools in the state of Selangor. A total of 379 Malaysian adolescents completed the PedsQL 4.0 adolescent self-report and 218 (55.9%) parents completed the PedsQL 4.0 parent proxy-report. Weight and height of adolescents were measured and BMI-for-age by sex was used to determine their body weight status. There were 50.8% male and 49.2% female adolescents who participated in this study (14.25 ± 1.23 years). The prevalence of overweight and obesity (25.8%) was four times higher than the prevalence of severe thinness and thinness (6.1%). Construct validity was analyzed using Confirmatory Factor Analysis (CFA). Based on CFA, adolescent self-report and parent proxy-report met the criteria of convergent validity (factor loading > 0.5, Average Variance Extracted (AVE) > 0.5, Construct Reliability > 0.7) and showed good fit to the data. The adolescent self-report and parent proxy-report exhibited discriminant validity as the AVE values were larger than the R(2) values. Cronbach's alpha coefficients of the adolescent self-report (α = 0.862) and parent proxy-report (α = 0.922) showed these instruments are reliable. Parents perceived the HRQoL of adolescents was poorer compared to the perception of the adolescent themselves (t = 5.92, p < 0.01). There was no significant difference in total HRQoL score between male and female adolescents (t = 0.858, p > 0.05). Parent proxy-report was negatively associated with the adolescents' BMI-for-age (r = -0.152, p < 0.05) whereas no significant association was found between adolescent self-report and BMI-for-age (r = 0.001, p > 0.05). Adolescent self-report and parent proxy-report of the PedsQL 4.0 are valid and reliable to assess HRQoL of Malaysian adolescents. Future studies are recommended to use both adolescent self-report and parent-proxy report of HRQoL as adolescents and parents can provide different perspectives on HRQoL of adolescents.

SCREENING FOR PERSONALITY DISORDERS

PubMed Central

Morse, Jennifer Q.; Pilkonis, Paul A.

2010-01-01

A brief but valid self-report measure to screen for personality disorders (PDs) would be a valuable tool in making decisions about further assessment and in planning optimal treatments. In psychiatric and nonpsychiatric samples, we compared the validity of three screening measures: the PD scales from the Inventory of Interpersonal Problems, a self-report version of the Iowa Personality Disorder Screen, and the self-directedness scale of the Temperament and Character Inventory. Despite their different theoretical origins, the screeners were highly correlated in a range from .71 to .77. As a result, the use of multiple screeners was not a significant improvement over any individual screener, and no single screener stood out as clearly superior to the others. Each performed modestly in predicting the presence of any PD diagnosis in both the psychiatric and nonpsychiatric groups. Performance was best when predicting a more severe PD diagnosis in the psychiatric sample. The results also highlight the potential value of multiple assessments when relying on self-reports. PMID:17492920

Reliability and validity of the Thai version of the Pediatric Quality of Life Inventory 4.0.

PubMed

Sritipsukho, Paskorn; Wisai, Matoorada; Thavorncharoensap, Montarat

2013-04-01

The study aimed to evaluate the reliability and validity of the Thai version of the Pediatric Quality of Life Inventory™ 4.0 Core Scales (PedsQL) as a measure of health-related quality of life (HRQOL). The PedsQL items were completed by 2,086 pupils aged 8-15 years and 1,914 parents from four schools, and 100 pediatric outpatients and 100 parents from a University Hospital. Test-retest reliability was conducted in a randomly selected of 150 pupils at a 1-month interval. Internal consistency reliability for the Total Scale score (α = 0.84 self-report, 0.88 proxy-report), Physical Health Summary score (α = 0.76 self-report, 0.79 proxy-report), and Psychosocial Health Summary score (α = 0.74 self-report, 0.85 proxy-report) exceeded the minimum reliability standard of 0.70. School children had significantly higher mean HRQOL scores compared to those with chronic health conditions for all subscales with the mean differences of 3.1-12.4 for self-report (p < 0.03) and 7.7-15.6 for proxy-report (p < 0.001). Test-retest reliability showed intraclass correlation coefficients above 0.60 in all subscales (p < 0.001). The Thai version of PedsQL had adequate reliability and validity and could be used as an outcome measure of HRQOL in Thai children aged 8-15 years.

Motivation and Pleasure Scale-Self-Report (MAP-SR): Validation of the German version of a self-report measure for screening negative symptoms in schizophrenia.

PubMed

Engel, Maike; Lincoln, Tania Marie

2016-02-01

Validated self-report instruments could provide a time efficient screening method for negative symptoms in people with schizophrenia. The aim of this study was to examine the psychometric properties of a German version of the Motivation and Pleasure Scale-Self-Report (MAP-SR) which is based on the Clinical Assessment Interview for Negative Symptoms (CAINS). In- and outpatients (N=50) with schizophrenia or schizoaffective disorder were assessed with standardized interviews and questionnaires on negative and positive symptoms and general psychopathology in schizophrenia, depression, and global functioning. The German version of the MAP-SR showed high internal consistency. Convergent validity was supported by significant correlations between the MAP-SR with the experience sub-scale of the CAINS and the negative symptom sub-scale of the Positive and Negative Syndrome Scale. The MAP-SR also exhibited discriminant validity indicated by its non-significant correlations with positive symptoms and general psychopathology, which is in line with the findings for the original version of the MAP-SR. However, the MAP-SR correlated moderately with depression. The German MAP-SR appears to be a valid and suitable diagnostic tool for the identification of negative symptoms in schizophrenia. Copyright © 2015 Elsevier Inc. All rights reserved.

The validity and diagnostic efficiency of the Davidson Trauma Scale in military veterans who have served since September 11th, 2001.

PubMed

McDonald, Scott D; Beckham, Jean C; Morey, Rajendra A; Calhoun, Patrick S

2009-03-01

The present study examined the psychometric properties and diagnostic efficiency of the Davidson Trauma Scale (DTS), a self-report measure of posttraumatic stress disorder (PTSD) symptoms. Participants included 158 U.S. military veterans who have served since September 11, 2001 (post-9/11). Results support the DTS as a valid self-report measure of PTSD symptoms. The DTS demonstrated good internal consistency, concurrent validity, and convergent and divergent validity. Diagnostic efficiency was excellent when discriminating between veterans with PTSD and veterans with no Axis I diagnosis. However, although satisfactory by conventional standards, efficiency was substantially attenuated when discriminating between PTSD and other Axis I diagnoses. Thus, results illustrate that potency of the DTS as a diagnostic aid was highly dependent on the comparison group used for analyses. Results are discussed in terms of applications to clinical practice and research.

Quantifying Engagement: Measuring Player Involvement in Human-Avatar Interactions

PubMed Central

Norris, Anne E.; Weger, Harry; Bullinger, Cory; Bowers, Alyssa

2014-01-01

This research investigated the merits of using an established system for rating behavioral cues of involvement in human dyadic interactions (i.e., face-to-face conversation) to measure involvement in human-avatar interactions. Gameplay audio-video and self-report data from a Feasibility Trial and Free Choice study of an effective peer resistance skill building simulation game (DRAMA-RAMA™) were used to evaluate reliability and validity of the rating system when applied to human-avatar interactions. The Free Choice study used a revised game prototype that was altered to be more engaging. Both studies involved girls enrolled in a public middle school in Central Florida that served a predominately Hispanic (greater than 80%), low-income student population. Audio-video data were coded by two raters, trained in the rating system. Self-report data were generated using measures of perceived realism, predictability and flow administered immediately after game play. Hypotheses for reliability and validity were supported: Reliability values mirrored those found in the human dyadic interaction literature. Validity was supported by factor analysis, significantly higher levels of involvement in Free Choice as compared to Feasibility Trial players, and correlations between involvement dimension sub scores and self-report measures. Results have implications for the science of both skill-training intervention research and game design. PMID:24748718

Variability and validity of intimate partner violence reporting by couples in Tanzania

PubMed Central

Steven, Ester; Reich, Naomi; Badi, Lilian; Messersmith, Lisa

2018-01-01

In recent years, major global institutions have amplified their efforts to address intimate partner violence (IPV) against women—a global health and human rights violation affecting 15–71% of reproductive aged women over their lifetimes. Still, some scholars remain concerned about the validity of instruments used for IPV assessment in population-based studies. In this paper, we conducted two validation analyses using novel data from 450 women-men dyads across nine villages in Northern Tanzania. First, we examined the level of inter-partner agreement in reporting of men’s physical, sexual, emotional and economic IPV against women in the last three and twelve months prior to the survey, ever in the relationship, and during pregnancy. Second, we conducted a convergent validity analysis to compare the relative efficacy of men’s self-reports of perpetration and women’s of victimization as a valid indicator of IPV against Tanzanian women using logistic regression models with village-level clustered errors. We found that, for every violence type across the recall periods of the last three months, the last twelve months and ever in the relationship, at least one in three couples disagreed about IPV occurrences in the relationship. Couples’ agreement about physical, sexual and economic IPV during pregnancy was high with 86–93% of couples reporting concordantly. Also, men’s self-reported perpetration had statistically significant associations with at least as many validated risk factors as had women’s self-reported victimization. This finding suggests that men’s self-reports are at least as valid as women’s as an indicator of IPV against women in Northern Tanzania. We recommend more validation studies are conducted in low-income countries, and that data on relationship factors affecting IPV reports and reporting are made available along with data on IPV occurrences. Keywords: Intimate partner violence; measurement; validity; survey research; Tanzania. PMID:29518162

Do Subjective Alcohol Screening Tools Correlate with Biomarkers Among High-Risk Transgender Women and Men Who Have Sex with Men in Lima, Peru?

PubMed

Herrera, M C; Konda, K A; Leon, S R; Brown, B; Calvo, G M; Salvatierra, H J; Caceres, C F; Klausner, J D; Deiss, R

2017-11-01

Alcohol abuse can influence sexual risk behavior; however, its measurement is not straightforward. This study compared self-reported alcohol use, via the AUDIT and CAGE, with levels of phosphatidylethanol (Peth), a phospholipid biomarker that forms with chronic, heavy drinking, among high-risk MSM and TW in Lima, Peru. Chi square, Fisher's exact, Wilcoxon ranksum tests compared the instruments. Receiver operating curves determined sensitivity and specificity of the self-reported measures. Among 69 MSM and 17 TW, PEth was positive for 86% (95% CI 77-93%) of participants, while 67% reported binge-drinking in the last 2 weeks. The AUDIT classified 25% as hazardous drinkers while CAGE identified 6% as problem drinkers. Self-reported binge drinking was more sensitive than the AUDIT for PEth positivity (71% vs. 27%, p = 0.022). Among high-risk MSM and TW in Lima, validated, self-report measures of alcohol abuse underestimated biological measures. Further research correlating bio-markers and self-reported alcohol abuse measures is needed.

Global positioning system technology (GPS) for psychological research: a test of convergent and nomological validity.

PubMed

Wolf, Pedro S A; Figueredo, Aurelio J; Jacobs, W Jake

2013-01-01

The purpose of this paper is to examine the convergent and nomological validity of a GPS-based measure of daily activity, operationalized as Number of Places Visited (NPV). Relations among the GPS-based measure and two self-report measures of NPV, as well as relations among NPV and two factors made up of self-reported individual differences were examined. The first factor was composed of variables related to an Active Lifestyle (AL) (e.g., positive affect, extraversion…) and the second factor was composed of variables related to a Sedentary Lifestyle (SL) (e.g., depression, neuroticism…). NPV was measured over 4 days. This timeframe was made up of two week and two weekend days. A bi-variate analysis established one level of convergent validity and a Split-Plot GLM examined convergent validity, nomological validity, and alternative hypotheses related to constraints on activity throughout the week simultaneously. The first analysis revealed significant correlations among NPV measures- weekday, weekend, and the entire 4-day time period, supporting the convergent validity of the Diary-, Google Maps-, and GPS-NPV measures. Results from the second analysis, indicating non-significant mean differences in NPV regardless of method, also support this conclusion. We also found that AL is a statistically significant predictor of NPV no matter how NPV was measured. We did not find a statically significant relation among NPV and SL. These results permit us to infer that the GPS-based NPV measure has convergent and nomological validity.

Global positioning system technology (GPS) for psychological research: a test of convergent and nomological validity

PubMed Central

Wolf, Pedro S. A.; Figueredo, Aurelio J.; Jacobs, W. Jake

2013-01-01

The purpose of this paper is to examine the convergent and nomological validity of a GPS-based measure of daily activity, operationalized as Number of Places Visited (NPV). Relations among the GPS-based measure and two self-report measures of NPV, as well as relations among NPV and two factors made up of self-reported individual differences were examined. The first factor was composed of variables related to an Active Lifestyle (AL) (e.g., positive affect, extraversion…) and the second factor was composed of variables related to a Sedentary Lifestyle (SL) (e.g., depression, neuroticism…). NPV was measured over 4 days. This timeframe was made up of two week and two weekend days. A bi-variate analysis established one level of convergent validity and a Split-Plot GLM examined convergent validity, nomological validity, and alternative hypotheses related to constraints on activity throughout the week simultaneously. The first analysis revealed significant correlations among NPV measures- weekday, weekend, and the entire 4-day time period, supporting the convergent validity of the Diary-, Google Maps-, and GPS-NPV measures. Results from the second analysis, indicating non-significant mean differences in NPV regardless of method, also support this conclusion. We also found that AL is a statistically significant predictor of NPV no matter how NPV was measured. We did not find a statically significant relation among NPV and SL. These results permit us to infer that the GPS-based NPV measure has convergent and nomological validity. PMID:23761772

Reliability and validity of two multidimensional self-reported physical activity questionnaires in people with chronic low back pain.

PubMed

Carvalho, Flávia A; Morelhão, Priscila K; Franco, Marcia R; Maher, Chris G; Smeets, Rob J E M; Oliveira, Crystian B; Freitas Júnior, Ismael F; Pinto, Rafael Z

2017-02-01

Although there is some evidence for reliability and validity of self-report physical activity (PA) questionnaires in the general adult population, it is unclear whether we can assume similar measurement properties in people with chronic low back pain (LBP). To determine the test-retest reliability of the International Physical Activity Questionnaire (IPAQ) long-version and the Baecke Physical Activity Questionnaire (BPAQ) and their criterion-related validity against data derived from accelerometers in patients with chronic LBP. Cross-sectional study. Patients with non-specific chronic LBP were recruited. Each participant attended the clinic twice (one week interval) and completed self-report PA. Accelerometer measures >7 days included time spent in moderate-and-vigorous physical activity, steps/day, counts/minute, and vector magnitude counts/minute. Intraclass Correlation Coefficients (ICC) and Bland and Altman method were used to determine reliability and spearman rho correlation were used for criterion-related validity. A total of 73 patients were included in our analyses. The reliability analyses revealed that the BPAQ and its subscales have moderate to excellent reliability (ICC 2,1 : 0.61 to 0.81), whereas IPAQ and most IPAQ domains (except walking) showed poor reliability (ICC 2,1 : 0.20 to 0.40). The Bland and Altman method revealed larger discrepancies for the IPAQ. For the validity analysis, questionnaire and accelerometer measures showed at best fair correlation (rho < 0.37). Although the BPAQ showed better reliability than the IPAQ long-version, both questionnaires did not demonstrate acceptable validity against accelerometer data. These findings suggest that questionnaire and accelerometer PA measures should not be used interchangeably in this population. Copyright © 2016 Elsevier Ltd. All rights reserved.

Self-Other Knowledge Asymmetries in Personality Pathology

PubMed Central

Carlson, Erika N.; Vazire, Simine; Oltmanns, Thomas F.

2012-01-01

Objective Self-reports of personality provide valid information about personality disorders (PDs). However, informant-reports provide information about PDs that self-reports alone do not provide. The current paper examines if and when one perspective is more valid than the other in identifying PDs. Method Using a representative sample of adults 55 to 65 year of age (N = 991; 45% males), we compared the validity of self- and informant- (e.g., spouse, family, or friend) reports of the FFM traits in predicting PD scores (i.e., composite of interviewer, self-, and informant-reports of PDs). Results Self-reports (particularly of neuroticism) were more valid than informant-reports for most internalizing PDs (i.e., PDs defined by high neuroticism). Informant-reports (particularly of agreeableness and conscientiousness) were more valid than self-reports for externalizing and/or antagonistic PDs (i.e., PDs defined by low agreeableness, conscientiousness). Neither report was consistently more valid for thought disorder PDs (i.e., PDs defined by low extraversion). However, informant-reports (particularly of agreeableness) were more valid than self-reports for PDs that were both internalizing and externalizing (i.e., PDs defined by high neuroticism and low agreeableness). Conclusions The intrapersonal and interpersonal manifestations of PDs differ, and these differences influence who knows more about pathology. PMID:22583054

Measurement properties of quality-of-life measurement instruments for infants, children and adolescents with eczema: a systematic review.

PubMed

Heinl, D; Prinsen, C A C; Sach, T; Drucker, A M; Ofenloch, R; Flohr, C; Apfelbacher, C

2017-04-01

Quality of life (QoL) is one of the core outcome domains identified by the Harmonising Outcome Measures for Eczema (HOME) initiative to be assessed in every eczema trial. There is uncertainty about the most appropriate QoL instrument to measure this domain in infants, children and adolescents. To systematically evaluate the measurement properties of existing measurement instruments developed and/or validated for the measurement of QoL in infants, children and adolescents with eczema. A systematic literature search in PubMed and Embase, complemented by a thorough hand search of reference lists, retrieved studies on measurement properties of eczema QoL instruments for infants, children and adolescents. For all eligible studies, we judged the adequacy of the measurement properties and the methodological study quality with the COnsensus-based Standards for the selection of health Measurement INstruments (COSMIN) checklist. Results from different studies were summarized in a best-evidence synthesis and formed the basis to assign four degrees of recommendation. Seventeen articles, three of which were found by hand search, were included. These 17 articles reported on 24 instruments. No instrument can be recommended for use in all eczema trials because none fulfilled all required adequacy criteria. With adequate internal consistency, reliability and hypothesis testing, the U.S. version of the Childhood Atopic Dermatitis Impact Scale (CADIS), a proxy-reported instrument, has the potential to be recommended depending on the results of further validation studies. All other instruments, including all self-reported ones, lacked significant validation data. Currently, no QoL instrument for infants, children and adolescents with eczema can be highly recommended. Future validation research should primarily focus on the CADIS, but also attempt to broaden the evidence base for the validity of self-reported instruments. © 2016 British Association of Dermatologists.

Validation of the Mindful Coping Scale

ERIC Educational Resources Information Center

Tharaldsen, Kjersti B.; Bru, Edvin

2011-01-01

The aim of this research is to develop and validate a self-report measure of mindfulness and coping, the mindful coping scale (MCS). Dimensions of mindful coping were theoretically deduced from mindfulness theory and coping theory. The MCS was empirically evaluated by use of factor analyses, reliability testing and nomological network validation.…

Reliability and validity of the Lithuanian Tinnitus Handicap Inventory.

PubMed

Ulozienė, Ingrida; Balnytė, Renata; Alzbutienė, Giedrė; Arechvo, Irina; Vaitkus, Antanas; Šileikaitė, Milda; Šaferis, Viktoras; Ulozas, Virgilijus

2016-01-01

The aim of this study was to determine the reliability and validity of the Lithuanian version of the Tinnitus Handicap Inventory (THI), a self-report measure of perceived tinnitus handicap. A cross-sectional psychometric validation study was performed in the University Hospital. A total of 248 subjects reporting chronic tinnitus as their primary complaint or secondary to hearing loss were encluded in the study and filled in the Lithuanian version of THI. For assessment of construct validity a subgroup of 55 participants completed the Lithuanian version of the Hospital Anxiety and Depression Scale as a measure of self-perceived levels of anxiety and depression. Test-retest and internal consistency reliability as well as construct validity were calculated. The Lithuanian version of the THI and its subscales showed a robust internal consistency reliability (Cronbach's alpha=0.93) comparable to the original version. Statistically significant correlations were observed between the Lithuanian translation of the THI and the measures of self-perceived levels of anxiety and depression using HADS. Confirmatory factor analysis demonstrated that the three subscales of the THI Lithuanian version corresponded to three different factors, which strongly correlated between themselves. The results suggest that the Lithuanian version of THI maintains its original validity and may serve as reliable and valid measure of general tinnitus related distress that can be used in a clinical setting to quantify the impact of tinnitus on daily living. Copyright © 2016 The Lithuanian University of Health Sciences. Production and hosting by Elsevier Urban & Partner Sp. z o.o. All rights reserved.

Validity of the Depression Anxiety Stress Scales in assessing depression and anxiety following traumatic brain injury.

PubMed

Dahm, Jane; Wong, Dana; Ponsford, Jennie

2013-10-01

Anxiety and depression following traumatic brain injury (TBI) are associated with poorer outcomes. A brief self-report questionnaire would assist in identifying those at risk, however validity of such measures is complicated by confounding symptoms of the injury. This study investigated the validity of the Depression Anxiety Stress Scales (DASS) and Hospital Anxiety and Depression Scale (HADS), in screening for clinical diagnoses of anxiety and mood disorders following TBI. One hundred and twenty-three participants with mild to severe TBI were interviewed using the SCID (Axis I) and completed the DASS and HADS. The DASS, DASS21 and HADS scales demonstrated validity compared with SCID diagnoses of anxiety and mood disorders as measured by Area Under ROC Curve, sensitivity and specificity. Validity of the DASS depression scale benefited from items reflecting symptoms of devaluation of life, self-deprecation, and hopelessness that are not present on the HADS. Validity of the HADS anxiety scale benefited from items reflecting symptoms of tension and worry that are measured separately for the DASS on the stress scale. Participants were predominantly drawn from a rehabilitation centre which may limit the extent to which results can be generalized. Scores for the DASS21 were derived from the DASS rather than being administered separately. The DASS, DASS21 and HADS demonstrated validity as screening measures of anxiety and mood disorders in this TBI sample. The findings support use of these self-report questionnaires for individuals with TBI to identify those who should be referred for clinical diagnostic follow-up. © 2013 Elsevier B.V. All rights reserved.

Why does self-reported emotional intelligence predict job performance? A meta-analytic investigation of mixed EI.

PubMed

Joseph, Dana L; Jin, Jing; Newman, Daniel A; O'Boyle, Ernest H

2015-03-01

Recent empirical reviews have claimed a surprisingly strong relationship between job performance and self-reported emotional intelligence (also commonly called trait EI or mixed EI), suggesting self-reported/mixed EI is one of the best known predictors of job performance (e.g., ρ = .47; Joseph & Newman, 2010b). Results further suggest mixed EI can robustly predict job performance beyond cognitive ability and Big Five personality traits (Joseph & Newman, 2010b; O'Boyle, Humphrey, Pollack, Hawver, & Story, 2011). These criterion-related validity results are problematic, given the paucity of evidence and the questionable construct validity of mixed EI measures themselves. In the current research, we update and reevaluate existing evidence for mixed EI, in light of prior work regarding the content of mixed EI measures. Results of the current meta-analysis demonstrate that (a) the content of mixed EI measures strongly overlaps with a set of well-known psychological constructs (i.e., ability EI, self-efficacy, and self-rated performance, in addition to Conscientiousness, Emotional Stability, Extraversion, and general mental ability; multiple R = .79), (b) an updated estimate of the meta-analytic correlation between mixed EI and supervisor-rated job performance is ρ = .29, and (c) the mixed EI-job performance relationship becomes nil (β = -.02) after controlling for the set of covariates listed above. Findings help to establish the construct validity of mixed EI measures and further support an intuitive theoretical explanation for the uncommonly high association between mixed EI and job performance--mixed EI instruments assess a combination of ability EI and self-perceptions, in addition to personality and cognitive ability. PsycINFO Database Record (c) 2015 APA, all rights reserved.

Calibration of self-report tools for physical activity research: the Physical Activity Questionnaire (PAQ)

PubMed Central

2014-01-01

Background The utility of self-report measures of physical activity (PA) in youth can be greatly enhanced by calibrating self-report output against objectively measured PA data. This study demonstrates the potential of calibrating self-report output against objectively measured physical activity (PA) in youth by using a commonly used self-report tool called the Physical Activity Questionnaire (PAQ). Methods A total of 148 participants (grades 4 through 12) from 9 schools (during the 2009–2010 school year) wore an Actigraph accelerometer for 7 days and then completed the PAQ. Multiple linear regression modeling was used on 70% of the available sample to develop a calibration equation and this was cross validated on an independent sample of participants (30% of sample). Results A calibration model with age, gender, and PAQ scores explained 40% of the variance in values for the percentage of time in moderate-to-vigorous PA (%MVPA) measured from the accelerometers (%MVPA = 14.56 - (sex*0.98) - (0.84*age) + (1.01*PAQ)). When tested on an independent, hold-out sample, the model estimated %MVPA values that were highly correlated with the recorded accelerometer values (r = .63) and there was no significant difference between the estimated and recorded activity values (mean diff. = 25.3 ± 18.1 min; p = .17). Conclusions These results suggest that the calibrated PAQ may be a valid alternative tool to activity monitoring instruments for estimating %MVPA in groups of youth. PMID:24886625

Calibration of self-report tools for physical activity research: the Physical Activity Questionnaire (PAQ).

PubMed

Saint-Maurice, Pedro F; Welk, Gregory J; Beyler, Nicholas K; Bartee, Roderick T; Heelan, Kate A

2014-05-16

The utility of self-report measures of physical activity (PA) in youth can be greatly enhanced by calibrating self-report output against objectively measured PA data.This study demonstrates the potential of calibrating self-report output against objectively measured physical activity (PA) in youth by using a commonly used self-report tool called the Physical Activity Questionnaire (PAQ). A total of 148 participants (grades 4 through 12) from 9 schools (during the 2009-2010 school year) wore an Actigraph accelerometer for 7 days and then completed the PAQ. Multiple linear regression modeling was used on 70% of the available sample to develop a calibration equation and this was cross validated on an independent sample of participants (30% of sample). A calibration model with age, gender, and PAQ scores explained 40% of the variance in values for the percentage of time in moderate-to-vigorous PA (%MVPA) measured from the accelerometers (%MVPA = 14.56 - (sex*0.98) - (0.84*age) + (1.01*PAQ)). When tested on an independent, hold-out sample, the model estimated %MVPA values that were highly correlated with the recorded accelerometer values (r = .63) and there was no significant difference between the estimated and recorded activity values (mean diff. = 25.3 ± 18.1 min; p = .17). These results suggest that the calibrated PAQ may be a valid alternative tool to activity monitoring instruments for estimating %MVPA in groups of youth.

Internal Invalidity in Pretest-Posttest Self-Report Evaluations and a Re-Evaluation of Retrospective Pretests.

ERIC Educational Resources Information Center

Howard, George S.; And Others

1979-01-01

True experimental designs are thought to provide internally valid results. In this investigation of the evaluations of five interventions, a source of internal invalidity is identified when self-report measures are used. An alternative approach is presented and implications of the findings for evaluation research are discussed. (JKS)

Validation of the Social Appearance Anxiety Scale: factor, convergent, and divergent validity.

PubMed

Levinson, Cheri A; Rodebaugh, Thomas L

2011-09-01

The Social Appearance Anxiety Scale (SAAS) was created to assess fear of overall appearance evaluation. Initial psychometric work indicated that the measure had a single-factor structure and exhibited excellent internal consistency, test-retest reliability, and convergent validity. In the current study, the authors further examined the factor, convergent, and divergent validity of the SAAS in two samples of undergraduates. In Study 1 (N = 323), the authors tested the factor structure, convergent, and divergent validity of the SAAS with measures of the Big Five personality traits, negative affect, fear of negative evaluation, and social interaction anxiety. In Study 2 (N = 118), participants completed a body evaluation that included measurements of height, weight, and body fat content. The SAAS exhibited excellent convergent and divergent validity with self-report measures (i.e., self-esteem, trait anxiety, ethnic identity, and sympathy), predicted state anxiety experienced during the body evaluation, and predicted body fat content. In both studies, results confirmed a single-factor structure as the best fit to the data. These results lend additional support for the use of the SAAS as a valid measure of social appearance anxiety.

Concurrent Validity of the Psychopathic Personality Inventory with Offender and Community Samples

ERIC Educational Resources Information Center

Malterer, Melanie B.; Lilienfeld, Scott O.; Neumann, Craig S.; Newman, Joseph P.

2010-01-01

The Psychopathy Checklist-Revised (PCL-R) is a frequently used and well-validated measure of psychopathy but is relatively time-intensive and expensive to administer. The Psychopathic Personality Inventory (PPI) is a self-report measure that provides a less time-intensive and less expensive method for identifying psychopathic individuals. Using…

Beyond Immanent and Transcendent Critique: Exploring Maul's Argument within the NRC (2001) Framework

ERIC Educational Resources Information Center

Duckor, Brent

2017-01-01

In Andrew Maul's focus paper "Rethinking Traditional Methods of Survey Validation'" published in this issue of "Measurement: Interdisciplinary Research and Perspectives," Maul contends that self-report measures may be particularly difficult to validate. He cautions that such techniques may fall short of providing the kinds of…

Children's Assertive Behavior: The Reliability and Validity of Three Self-Report Measures.

ERIC Educational Resources Information Center

Scanlon, Elizabeth M.; Ollendick, Thomas H.

1985-01-01

The internal consistency and validity of three new scales for measuring assertiveness in children were tested. Two of the scales were able to "unbind" aggressive from assertive behavior, while the third was able to "unbind" submissive from assertive behavior. At present, a combination of the three scales is recommended. (KH)

The Sexual Thoughts Questionnaire: Psychometric Evaluation of a Measure to Assess Self-Reported Thoughts During Exposure to Erotica Using Sexually Functional Individuals.

PubMed

Sigre-Leirós, Vera; Carvalho, Joana; Nobre, Pedro J

2016-05-01

Validated instruments for assessing specific thought content during exposure to sexually explicit material are lacking. To investigate the psychometric properties of a measure that assesses self-reported thoughts during exposure to sexual stimuli in laboratory settings, namely the Sexual Thoughts Questionnaire. The factorial structure of the questionnaire and its reliability and validity were examined. One hundred sixty-seven sexually functional individuals (97 women and 70 men) were exposed to sexually explicit material while their genital arousal was being assessed. Subjective sexual arousal and thoughts during exposure to sexually explicit material also were assessed. Women's genital arousal was measured with a vaginal photoplethysmograph and men's genital arousal was measured with an indium-gallium strain gauge. Subjective sexual arousal and thoughts during exposure to erotica were assessed with self-report scales. Principal component analysis with varimax rotation identified five factors: sexual arousal thoughts, distractive and disengaging thoughts, body image and performance thoughts, actress's physical attractiveness thoughts, and sinful and lack of affection thoughts. Moreover, the scale showed satisfactory levels of internal consistency. Studies on convergent validity showed an association between self-reported thoughts and subjective sexual arousal levels in the women and men. The Sexual Thoughts Questionnaire showed adequate psychometric properties in a sexually functional sample. It could be useful in further experimental research on the role of cognitions in sexual response and allow further comparison between sexually functional and dysfunctional individuals, with possible significant implications for the assessment and treatment of sexual problems. Copyright © 2016 International Society for Sexual Medicine. Published by Elsevier Inc. All rights reserved.

Development and validation of a new self-report instrument for measuring sedentary behaviors and light-intensity physical activity in adults.

PubMed

Barwais, Faisal Awad; Cuddihy, Thomas F; Washington, Tracy; Tomson, L Michaud; Brymer, Eric

2014-08-01

Low levels of physical activity and high levels of sedentary behavior (SB) are major public health concerns. This study was designed to develop and validate the 7-day Sedentary (S) and Light Intensity Physical Activity (LIPA) Log (7-day SLIPA Log), a self-report measure of specific daily behaviors. To develop the log, 62 specific SB and LIPA behaviors were chosen from the Compendium of Physical Activities. Face-to-face interviews were conducted with 32 sedentary volunteers to identify domains and behaviors of SB and LIPA. To validate the log, a further 22 sedentary adults were recruited to wear the GT3x for 7 consecutive days and nights. Pearson correlations (r) between the 7-day SLIPA Log and GT3x were significant for sedentary (r = .86, P < .001), for LIPA (r = .80, P < .001). Lying and sitting postures were positively correlated with GT3x output (r = .60 and r = .64, P < .001, respectively). No significant correlation was found for standing posture (r = .14, P = .53).The kappa values between the 7-day SLIPA Log and GT3x variables ranged from 0.09 to 0.61, indicating poor to good agreement. The 7-day SLIPA Log is a valid self-report measure of SB and LIPA in specific behavioral domains.

Examining a Self-Report Measure of Parent-Teacher Cocaring Relationships and Associations with Parental Involvement

ERIC Educational Resources Information Center

Lang, Sarah N.; Schoppe-Sullivan, Sarah J.; Jeon, Lieny

2017-01-01

By adapting a self-administered assessment of coparenting, we sought to provide a new tool, the Cocaring Relationship Questionnaire, to measure parent-teacher, or cocaring relationships, and provide additional construct validity for the multidimensional concept of cocaring. Next, recognizing the importance of parental involvement for young…

The Development of a Happiness Measure for Schoolchildren

ERIC Educational Resources Information Center

Ivens, John

2007-01-01

Happiness, or subjective well-being, the self-evaluation of how happy or unhappy a person is, has been studied amongst adults using a variety of self-report methods. However, there has been relatively little related work with children. A psychometrically valid and reliable SWB measure for schoolchildren aged 8- to 15-years-old, the School…

Validity assessment of self-reported medication use by comparing to pharmacy insurance claims

PubMed Central

Fujita, Misuzu; Sato, Yasunori; Nagashima, Kengo; Takahashi, Sho; Hata, Akira

2015-01-01

Objectives In Japan, an annual health check-up and health promotion guidance programme was established in 2008 in accordance with the Act on Assurance of Medical Care for the Elderly. A self-reported questionnaire on medication use is a required item in this programme and has been used widely, but its validity has not been assessed. The aim of this study was to evaluate the validity of this questionnaire by comparing self-reported usage to pharmacy insurance claims. Setting This is a population-based validation study. Self-reported medication use for hypertension, diabetes and dyslipidaemia is the evaluated measurement. Data on pharmacy insurance claims are used as a reference standard. Participants Participants were 54 712 beneficiaries of the National Health Insurance of Chiba City. Primary and secondary outcome measures Sensitivity, specificity and κ statistics of the self-reported medication-use questionnaire for predicting actual prescriptions during 1 month (that of the check-up) and 3 months (that of the check-up and the previous 2 months) were calculated. Results Sensitivity and specificity scores of questionnaire data for predicting insurance claims covering 3 months were, respectively, 92.4% (95% CI 91.9 to 92.8) and 86.4% (95% CI 86.0 to 86.7) for hypertension, 82.6% (95% CI 81.1 to 84.0) and 98.5% (95% CI 98.4 to 98.6) for diabetes, and 86.2% (95% CI 85.5 to 86.8) and 91.0% (95% CI 90.8 to 91.3) for dyslipidaemia. Corresponding κ statistics were 70.9% (95% CI 70.1 to 71.7), 77.1% (95% CI 76.2 to 77.9) and 69.8% (95% CI 68.9 to 70.6). The specificity was significantly higher for questionnaire data covering 3 months compared with data covering 1 month for all 3 conditions. Conclusions Self-reported questionnaire data on medication use had sufficiently high validity for further analyses. Item responses showed close agreement with actual prescriptions, particularly those covering 3 months. PMID:26553839

Weight Bias: A Systematic Review of Characteristics and Psychometric Properties of Self-Report Questionnaires.

PubMed

Lacroix, Emilie; Alberga, Angela; Russell-Mathew, Shelly; McLaren, Lindsay; von Ranson, Kristin

2017-01-01

People living with overweight and obesity often experience weight-based stigmatization. Investigations of the prevalence and correlates of weight bias and evaluation of weight bias reduction interventions depend upon psychometrically-sound measurement. Our paper is the first to comprehensively evaluate the psychometric properties, use of people-first language within items, and suitability for use with various populations of available self-report measures of weight bias. We searched five electronic databases to identify English-language self-report questionnaires of weight bias. We rated each questionnaire's psychometric properties based on initial validation reports and subsequent use, and examined item language. Our systematic review identified 40 original self-report questionnaires. Most questionnaires were brief, demonstrated adequate internal consistency, and tapped key cognitive and affective dimensions of weight bias such as stereotypes and blaming. Current psychometric evidence is incomplete for many questionnaires, particularly with regard to the properties of test-retest reliability, sensitivity to change as well as discriminant and structural validity. Most questionnaires were developed prior to debate surrounding terminology preferences, and do not employ people-first language in the items administered to participants. We provide information and recommendations for clinicians and researchers in selecting psychometrically sound measures of weight bias for various purposes and populations, and discuss future directions to improve measurement of this construct. © 2017 The Author(s) Published by S. Karger GmbH, Freiburg.

The evaluation of violent thinking in adult offenders and non-offenders using the Maudsley Violence Questionnaire.

PubMed

Walker, Julian; Bowes, Nicola

2013-04-01

The Maudsley Violence Questionnaire (MVQ) was designed to measure explicit rules and beliefs associated with violence. Previous studies with young people and offenders with mental disorder found the MVQ to be a valid and reliable measure of violent thinking. This study explores the use of the MVQ with a 'normal' (non-offender) population and an offender population without mental illness in order to evaluate how the MVQ's subscales related to violence within these groups. The MVQ was given to 78 adult male participants along with a measure of self-reported violence; demographic information and criminal history were also recorded. Thirty-five of the participants were convicted adult male offenders resident of an adult male closed prison in South Wales; 43 were volunteers from the staff group in the same prison. The MVQ factors were compared with self-reported violence and with officially recorded violent convictions. Although both subscales of the MVQ related to self-reported violence, 'Machismo' showed a stronger relationship to both self-reported and officially recorded violence. Violent thinking, specifically beliefs measured by the Machismo subscale of the MVQ, was robustly associated with self-reported and officially recorded violence in this study with offender and non-offender adults. The MVQ is a valid and feasible measure for use with adult populations. Violent thinking (specifically Machismo thinking styles) should be included in the assessments of violent offenders. Work on violent thinking and reducing 'macho' thinking could be a useful adjunct to anger management work with violent offenders. Copyright © 2013 John Wiley & Sons, Ltd.

Concurrent Validity of the Defense and Veterans Pain Rating Scale in VA Outpatients.

PubMed

Nassif, Thomas H; Hull, Amanda; Holliday, Stephanie Brooks; Sullivan, Patrick; Sandbrink, Friedhelm

2015-11-01

The purpose of this report is to investigate the concurrent validity of the Defense and Veterans Pain Rating Scale (DVPRS) with other validated self-report measures in U.S. veterans. This correlational study was conducted using two samples of outpatients at the Washington, DC Veterans Affairs Medical Center who completed self-report measures relevant to pain conditions, including pain disability, quality of life, and mental health. Study 1 and 2 consisted of n = 204 and n = 13 participants, respectively. Bivariate Spearman correlations were calculated to examine the correlation among total scores and subscale scores for each scale of interest. Multiple linear regressions were also computed in Study 1. In Study 1, the DVPRS interference scale (DVPRS-II) was significantly correlated with the Pain Disability Questionnaire (PDQ) (ρ = 0.69, P < 0.001) and the Veterans RAND 36-item Health Survey physical and mental component scales (ρ = -0.37, P < 0.001; ρ = -0.46, P < 0.001, respectively). When controlling for sex, age, and other self-report measures, the relationship between the DVPRS-II and PDQ remained significant. In Study 2, pain interference on the DVPRS and Brief Pain Inventory were highly correlated (ρ = 0.90, P < 0.001); however, the intensity scale of each measure was also highly associated with the interference summary scores. These findings provide preliminary evidence for the concurrent validity of the DVPRS as a brief, multidimensional measure of pain interference that make it a practical tool for use in primary care settings to assess the impact of pain on daily functioning and monitor chronic pain over time. Wiley Periodicals, Inc.

The Association between Self-Reported Difficulties in Emotion Regulation and Heart Rate Variability: The Salient Role of Not Accepting Negative Emotions.

PubMed

Visted, Endre; Sørensen, Lin; Osnes, Berge; Svendsen, Julie L; Binder, Per-Einar; Schanche, Elisabeth

2017-01-01

Difficulties in emotion regulation are associated with development and maintenance of psychopathology. Typically, features of emotion regulation are assessed with self-report questionnaires. Heart rate variability (HRV) is an objective measure proposed as an index of emotional regulation capacity. A limited number of studies have shown that self-reported difficulties in emotion regulation are associated with HRV. However, results from prior studies are inconclusive, and an ecological validation of the association has not yet been tested. Therefore, further exploration of the relation between self-report questionnaires and psychophysiological measures of emotional regulation is needed. The present study investigated the contribution of self-reported emotion regulation difficulties on HRV in a student sample. We expected higher scores on emotion regulation difficulties to be associated with lower vagus-mediated HRV (vmHRV). Sixty-three participants filled out the Difficulties in Emotion Regulation Scale and their resting HRV was assessed. In addition, a subsample of participants provided ambulatory 24-h HRV data, in order to ecologically validate the resting data. Correlation analyses indicated that self-reported difficulties in emotion regulation was negatively associated with vmHRV in both resting HRV and 24-h HRV. Specifically, when exploring the contribution of the different facets of emotion dysregulation, the inability to accept negative emotions showed the strongest association with HRV. The results are discussed and need for future research is described.

Cross-cultural validation of a simple self-report instrument of physical activity in immigrants from the Middle East and native Swedes.

PubMed

Arvidsson, Daniel; Leijon, Matti; Sundquist, Jan; Sundquist, Kristina; Lindblad, Ulf; Bennet, Louise

2014-05-01

To investigate cross-cultural validity of a simple self-report instrument of physical activity intended to be used in Swedish health care. A validation study performed in 599 Iraqis (58% men) and 553 Swedes (53% men) aged 30-75 years living in the city of Malmö, Sweden. The self-report instrument by the Swedish National Board of Health and Welfare was compared to corresponding measures assessed from accelerometry as reference. The agreement between the methods in assessing the participants as sufficiently/insufficiently physically active (cut-point 150 min/week) was 65% in the Iraqis and 52% in the Swedes (p<0.001). The proportion disagreement where the self-reported physical activity was sufficient but insufficient according to the accelerometry was 26% and 45% in Iraqis and Swedes, respectively. Physical activity time (min/week) was overestimated by self-report compared to accelerometry by 71% in the Iraqis and 115% in the Swedes (p<0.001). The smallest and largest overestimation was seen in Iraqi (57%) and Swedish (139%) women, respectively. The deviation of the self-report instrument compared to accelerometry was related to the physical activity level, as the overestimation mainly occurred at lower physical activity. The self-report instrument proposed by the Swedish National Board of Health and Welfare may overestimate the proportion sufficiently physically active, but to an extent depending on cultural background and gender.

Self-reported difficulty in conceiving as a measure of infertility.

PubMed

Dick, M-L B; Bain, C J; Purdie, D M; Siskind, V; Molloy, D; Green, A C

2003-12-01

This study aimed to explore the meaning and potential use of women's self-reported difficulties in conceiving as a measure of infertility in epidemiological studies, and to compare women's stated reasons for infertility with information in their medical records. Data were available from a population-based case-control study of ovarian cancer involving 1638 women. The sensitivity and specificity of women's self-reported infertility were calculated against their estimated fertility status based on detailed reproductive histories. Self-reported reasons for infertility were compared with diagnoses documented in women's medical records. The sensitivity of women's self-reported difficulty in conceiving was 66 and 69% respectively when compared with calendar-derived and self-reported times taken trying to conceive; its specificity was 95%. Forty-one (23%) of the 179 women for whom medical records were available had their self-reported fertility problem confirmed. Self-reported infertility causes could be compared with diagnoses in medical records for only 22 of these women. Self-reported difficulty conceiving is a useful measure of infertility for quantifying the burden of fertility problems experienced in the community. Validation of reasons for infertility is unlikely to be feasible through examination of medical records. Improved education of the public regarding the availability and success rates of infertility treatments is proposed.

Validity of a brief self-report instrument for assessing compliance with physical activity guidelines amongst adolescents.

PubMed

Ridgers, Nicola D; Timperio, Anna; Crawford, David; Salmon, Jo

2012-03-01

To examine the validity of a brief self-report questionnaire for assessing physical activity, and compliance and non-compliance with moderate-to-vigorous physical activity (MVPA) recommendations in Australian adolescents against accelerometry. Cross-sectional study. MVPA of 203 adolescents (124 females, 79 males) aged 15-17 years was objectively assessed for 8 consecutive days using uni-axial accelerometers and calculated using age-specific cut-points. Adolescents self-reported the number of days (0-7) they were physically active for a total of at least 60 min/day (1) over the past 7 days and (2) over a typical week. Compliance with physical activity recommendations was defined as (1) 5 and (2) 7 days of self-reported MVPA (of at least 60 min/day), and (3) ≥60 min MVPA per average day, and (4) >60 min MVPA on every day according to accelerometry. Spearman's Rho correlations analysed the association between accelerometry-derived MVPA/day and self-reported MVPA days/week for the whole sample, sex and weight status. Percent agreement determined the proportion of adolescents correctly identified as not meeting physical activity recommendations (specificity) or as meeting physical activity recommendations (sensitivity) according to the self-report questionnaire. Moderate to large correlations were found between the self-report and accelerometer data (0.2-0.51) across population subgroups. The percent agreement between the self-report and accelerometry data was good for specificity; however, the sensitivity was low, potentially due to poor compliance with recommendations. Compared to accelerometry, the brief MVPA self-report questionnaire appears to have acceptable validity for measuring non-compliance with physical activity recommendations in 15-17 year old adolescents. Copyright © 2011 Sports Medicine Australia. Published by Elsevier Ltd. All rights reserved.

Computer Usage and the Validity of Self-Assessed Computer Competence among First-Year Business Students

ERIC Educational Resources Information Center

Ballantine, Joan A.; McCourt Larres, Patricia; Oyelere, Peter

2007-01-01

This study evaluates the reliability of self-assessment as a measure of computer competence. This evaluation is carried out in response to recent research which has employed self-reported ratings as the sole indicator of students' computer competence. To evaluate the reliability of self-assessed computer competence, the scores achieved by students…

Psychometric properties of the Sinhala version of the PedsQL™ 4.0 Generic Core Scales in early adolescents in Sri Lanka.

PubMed

Danansuriya, Manjula Nishanthi; Rajapaksa, Lalini C

2012-09-04

The concept Health related Quality of life (HRQOL) is increasingly recognized as an important health outcome measure in clinical and research fields. The present study attempted to evaluate the psychometric properties of the Sinhala version of the Pediatric Quality of Life Inventory™ 4.0 (PedsQL™ 4.0) Generic Core Scales among adolescents in Sri Lanka. The original US PedsQL™ was translated into Sinhala and conceptually validated according to international guidelines. A cross-sectional study was conducted among 142 healthy school going adolescents (12-14 years), their parents (n = 120) and a group of adolescents with asthma who attended asthma clinics (n = 115). Reliability was assessed using Cronbach's alpha and validity by examining scale structure, exploring inter-scale correlations and comparing across known groups (healthy vs. chronically ill). The PedsQL™ Sinhala version was found to be acceptable with minimal missing responses. All scales demonstrated satisfactory reliability. Cronbach's alpha for the total scale scores was 0.85 for adolescent self-report while for the parent proxy-report for the healthy group it was 0.86. No floor effects were observed. Ceiling effects were noticed in self-report and parent proxy-report for the healthy group. Overall results of the multi trait scaling analysis confirmed the scale structure with 74% item-convergent validity, 88% item-discriminant validity and an overall scaling success of 72%. Moderate to high correlations were shown among the domains of teen self-report (Spearman rho = .37-.54) and between teen self-report and parent proxy-reports (Spearman rho = .41-.57). The PedsQL™ tool was able to discriminate between the quality of life in healthy adolescents and adolescents with asthma. The findings support the reliability and validity of the Sinhala version of the PedsQL™ 4.0 Generic Core Scales as a generic instrument to measure HRQOL among early adolescents in Sri Lanka in a population setting.

Report on the Validation of the Emotionally Intelligent Leadership for Students Inventory

ERIC Educational Resources Information Center

Miguel, Rosanna F.; Allen, Scott J.

2016-01-01

The present study was designed to examine the measurement of the Emotionally Intelligent Leadership (EIL) construct and to provide evidence of validation for the multidimensional Emotionally Intelligence Leadership for Students: Inventory 2.0 (EILS:I 2.0). The EILS:I 2.0 is a self-report assessment of emotionally intelligent leadership in the…

Validation of the use of the Critical-Care Pain Observation Tool (CPOT) with brain surgery patients in the neurosurgical intensive care unit.

PubMed

Echegaray-Benites, Christine; Kapoustina, Oxana; Gélinas, Céline

2014-10-01

Many critically ill patients are unable to self-report their pain. In such situations, the use of valid behavioral pain scales is recommended. To validate the use of the Critical-Care Pain Observation Tool (CPOT) with brain surgery adults in the neurosurgical intensive care unit. Repeated-measure within subject prospective design. Forty-three elective brain surgery patients of a Canadian university hospital participated. Participants were video recorded and scored with the CPOT before, during and after a non-nociceptive (non-invasive blood pressure using cuff inflation) and a nociceptive (turning) procedure for a total of six assessments. Self-reports of pain were also obtained. Discriminant validation was supported with higher mean CPOT scores during the nociceptive procedure compared with the non-nociceptive one. More participants reported higher pain intensity during turning compared with cuff inflation. Criterion validation was supported with a moderate positive correlation between self-reports of pain intensity and CPOT scores during turning. Interrater and intrarater reliability of CPOT scores through the viewing of participants' videos by two trained raters was supported with high Intraclass Correlation Coefficients. The CPOT appears to be valid for the detection of pain in elective brain surgery patients in the neurosurgical intensive care unit. Copyright © 2014. Published by Elsevier Ltd.

Psychometric properties of the self-report Malay version of the Pediatric Quality of Life (PedsQLTM) 4.0 Generic Core Scales among multiethnic Malaysian adolescents.

PubMed

Ainuddin, Husna A; Loh, Siew Yim; Chinna, Karuthan; Low, Wah Yun; Roslani, April Camilla

2015-06-01

Adolescence is the potential period for growth and optimal functioning, but developmental issues like time of transition from childhood to adulthood will create stress and affect the adolescent's quality of life (QOL). However, there is a lack of research tool for measuring adolescent's QOL in Malaysia. The aim of the study was to determine the validity and reliability of the self-report Malay version of the pediatric QOL (PedsQL™) 4.0 Generic Core Scales in assessing the QOL of Malaysian adolescents. A cross-sectional study design using the 23-item self-report Malay version of the PedsQL 4.0 Generic Core Scales was administered on a convenient cluster sampling (n = 297 adolescent) from a secondary school. The internal consistency reliability had Cronbach's α values ranging from .70 to .89. Factor analysis reported a six-factor structure via principal axis factor analysis. In conclusion, the self-report Malay version of the pediatric QOL 4.0 Generic Core Scales is a reliable and valid tool to measure the QOL of multiethnic Malaysian adolescents. © The Author(s) 2013.

Validating Common Measures of Self-Efficacy and Career Attitudes within Informal Health Education for Middle and High School Students.

PubMed

Peterman, Karen; Withy, Kelley; Boulay, Rachel

2018-06-01

A common challenge in the evaluation of K-12 science education is identifying valid scales that are an appropriate fit for both a student's age and the educational outcomes of interest. Though many new scales have been validated in recent years, there is much to learn about the appropriate educational contexts and audiences for these measures. This study investigated two such scales, the DEVISE Self-Efficacy for Science scale and the Career Interest Questionnaire (CIQ), within the context of two related health sciences projects. Consistent patterns were found in the reliability of each scale across three age groups (middle school, high school, early college) and within the context of each project. As expected, self-efficacy and career interest, as measured through these scales, were found to be correlated. The pattern of results for CIQ scores was also similar to that reported in other literature. This study provides examples of how practitioners can validate established measures for new and specific contexts and provides some evidence to support the use of the scales studied in health science education contexts.

Development and Validation of an Inventory for Measuring Student Attitudes toward Calculus

ERIC Educational Resources Information Center

Huang, Yun-Chen; Lin, Shu-Hui

2015-01-01

This study aimed to develop and validate the Attitude Toward Calculus Inventory (ATCI). Results from three studies are reported that establish the reliability and validity of this instrument. An examination of the factor structure confirms that student attitudes can be explained in terms of four factors: self-confidence, value, enjoyment, and…

Eating Disorder Diagnostic Scale: Additional Evidence of Reliability and Validity

ERIC Educational Resources Information Center

Stice, Eric; Fisher, Melissa; Martinez, Erin

2004-01-01

The authors conducted 4 studies investigating the reliability and validity of the Eating Disorder Diagnostic Scale (HDDS; E. Stice, C. F. Telch, & S. L. Rizvi, 2000), a brief self-report measure for diagnosing anorexia nervosa, bulimia nervosa, and binge eating disorder. Study 1 found that the HDDS showed criterion validity with interview-based…

Observed Parenting Behavior with Teens: Measurement Invariance and Predictive Validity Across Race

PubMed Central

Skinner, Martie L.; MacKenzie, Elizabeth P.; Haggerty, Kevin P.; Hill, Karl G.; Roberson, Kendra C.

2011-01-01

Previous reports supporting measurement equality between European American and African American families have often focused on self-reported risk factors or observed parent behavior with young children. This study examines equality of measurement of observer ratings of parenting behavior with adolescents during structured tasks; mean levels of observed parenting; and predictive validity of teen self-reports of antisocial behaviors and beliefs using a sample of 163 African American and 168 European American families. Multiple-group confirmatory factor analyses supported measurement invariance across ethnic groups for 4 measures of observed parenting behavior: prosocial rewards, psychological costs, antisocial rewards, and problem solving. Some mean-level differences were found: African American parents exhibited lower levels of prosocial rewards, higher levels of psychological costs, and lower problem solving when compared to European Americans. No significant mean difference was found in rewards for antisocial behavior. Multigroup structural equation models suggested comparable relationships across race (predictive validity) between parenting constructs and youth antisocial constructs (i.e., drug initiation, positive drug attitudes, antisocial attitudes, problem behaviors) in all but one of the tested relationships. This study adds to existing evidence that family-based interventions targeting parenting behaviors can be generalized to African American families. PMID:21787057

Self-reported sunscreen use and urinary benzophenone-3 concentrations in the United States: NHANES 2003–2006 and 2009–2012

DOE Office of Scientific and Technical Information (OSTI.GOV)

Zamoiski, Rachel D., E-mail: rachel.zamoiski@nih.gov; Cahoon, Elizabeth K.; Michal Freedman, D.

Background: Sunscreens protect against skin cancer and other harmful effects of solar ultraviolet radiation (UVR). Epidemiologic and public health surveys often rely on self-reported sunscreen use to estimate sun exposure and avoidance, but questions remain about the validity of self-reports. Benzophenone-3 (BP-3), a common sunscreen ingredient, can be detected in the urine. Prior studies suggest that BP-3 concentrations increase after application of sunscreen. Objectives: The goal of this study was to assess the validity of self-reported frequency of sunscreen use in relation to urinary BP-3 concentrations in a representative sample of the general US population, including in sub-groups defined bymore » age, sex and race/ethnicity. Methods: To assess the relationship between categorical self-reported sunscreen use and creatinine-corrected urinary BP-3 concentrations, we conducted a linear regression adjusted for age, sex, race/ethnicity, six-month time period, body mass index, education, and sun avoidance behaviors. We tested for effect modification by age, sex, ethnicity and time period of measurement using multiplicative interaction terms and a F test. Results: BP-3 was positively associated with self-reported frequency of sunscreen use across all ages, sexes, race/ethnicities, and time periods. Crude and multivariate adjusted models were all statistically significant. R-square was relatively low for all models, ranging from 0.15 to 0.43. Conclusions: Urinary BP-3 is positively associated with self-reported frequency of sunscreen use in the general US population, even in groups with overall low sunscreen use. These results suggest that self-report is a valid, although weak, way of assessing relative frequencies of sunscreen usage in a population-based study. - Highlights: • Urinary benzophenone-3 (BP-3) is a metabolite of a common sunscreen ingredient. • We modeled urinary BP-3 against self-reported sunscreen usage. • We observed a positive association between sunscreen use and urinary BP-3. • R{sup 2} was low, suggesting self-report is a valid but weak way to assess sunscreen use.« less

Validity of Multiprocess IRT Models for Separating Content and Response Styles

ERIC Educational Resources Information Center

Plieninger, Hansjörg; Meiser, Thorsten

2014-01-01

Response styles, the tendency to respond to Likert-type items irrespective of content, are a widely known threat to the reliability and validity of self-report measures. However, it is still debated how to measure and control for response styles such as extreme responding. Recently, multiprocess item response theory models have been proposed that…

Coping with Health Problems: Developing a Reliable and Valid Multidimensional Measure.

ERIC Educational Resources Information Center

Endler, Norman S.; Parker, James D. A.; Summerfeldt, Laura J.

1998-01-01

A self-report measure, the Coping with Health Injuries and Problems Scale (CHIP), was developed to identify basic coping dimensions for responding to health problems. The CHIP factor structure, established with samples of 532 adults and 598 adults in Canada, is cross-validated with 390 general medical patients and 286 chronic back pain patients.…

Examining Evidence for the Validity of PISA Learning Strategy Scales Based on Student Response Processes

ERIC Educational Resources Information Center

Hopfenbeck, Therese N.; Maul, Andrew

2011-01-01

The aim of this study was to investigate response-process based evidence for the validity of the Programme for International Student Assessment's (PISA) self-report questionnaire scales as measures of specific psychological constructs, with a focus on scales meant to measure inclination toward specific learning strategies. Cognitive interviews (N…

The Distress Disclosure Index: a research review and multitrait-multimethod examination.

PubMed

Kahn, Jeffrey H; Hucke, Brandy E; Bradley, Allyson M; Glinski, Austin J; Malak, Brittany L

2012-01-01

The Distress Disclosure Index (DDI; J. H. Kahn & R. M. Hessling, 2001) is a brief self-report measure of one's tendency to disclose personally distressing information. The purpose of this article was to summarize what is known about the DDI, present new validity evidence, and make recommendations for use of the DDI. This article reviews research on the DDI from the past decade that indicates that distress disclosure is associated with well-being, professional help-seeking attitudes and intentions, and success in brief psychotherapy. On the basis of the reviewed literature, the authors report a reliability generalization study of DDI scores that strongly supports the internal consistency and test-retest reliability of DDI scores, and they review criterion-related and construct validity evidence. Next, the authors present a new multitrait-multimethod validity study of the DDI. Participants (N = 153) and peer informants (N = 153)--one per participant--completed paper-and-pencil questionnaire packets. Convergent validity of self-reported DDI scores was supported by a strong association with self-reports of emotional self-disclosure in response to a specific, unpleasant event, and self- and peer reports on the DDI were moderately correlated. DDI scores were not strongly associated with cognitive reappraisal and ambivalence over emotional expression, thus supporting discriminant validity. DDI scores were strongly associated with expressive suppression, and correlations between DDI scores and affect, depression symptoms, coping, and emotional expressivity were similar to those found with expressive suppression. The authors offer possible hypotheses explaining the overlap between distress disclosure and expressive suppression and present recommendations for future use of the DDI. (c) 2012 APA, all rights reserved.

Immersion in Cold-Water Evaluation (ICE) and self-reported cold intolerance are reliable but unrelated measures.

PubMed

Traynor, Robyn; MacDermid, Joy C

2008-09-01

Intolerance to the cold is common following peripheral nerve injury and surgery of the upper extremity. Despite its prevalence, the exact pathophysiology and natural history of this condition are not well understood. Subjective, self-report questionnaires have been created and validated as reliable measures of post-traumatic cold intolerance. The difficulty currently lies in assigning an objective measure to this predominantly subjective phenomenon. The present study evaluated the test-retest reliability of a proposed objective measure of cold intolerance, the Immersion in Cold-water Evaluation (ICE), and its correlation with subjective measures in healthy control subjects. Two age groups were also compared to investigate the effect of age on cold intolerance and temperature recovery. On two separate testing days, subjects completed three health-related questionnaires and submersed their dominant hands in cold water. The temperature of their second and fifth digits was monitored during recovery. Both the objective cold-provocation testing and the subjective self-report questionnaires were highly reliable albeit not significantly correlated. No significant temperature recovery trend was noted between the age groups. Post-traumatic cold intolerance is postulated to have both a vascular and neural etiology among other contributing causes. The protocol studied here was centered predominantly on the former etiology, examining peripheral blood flow and associated temperature recovery. This study established ICE as a reliable means to objectively measure cold response, supplementing information provided by previously validated self-report methods.

The Development of an Instrument to Measure the Work Capability of People with Limited Work Capacity (LWC).

PubMed

van Ruitenbeek, Gemma M C; Zijlstra, Fred R H; Hülsheger, Ute R

2018-06-04

Purpose Participation in regular paid jobs positively affects mental and physical health of all people, including people with limited work capacities (LWC), people that are limited in their work capacity as a consequence of their disability, such as chronic mental illness, psychological or developmental disorder. For successful participation, a good fit between on one hand persons' capacities and on the other hand well-suited individual support and a suitable work environment is necessary in order to meet the demands of work. However, to date there is a striking paucity of validated measures that indicate the capability to work of people with LWC and that outline directions for support that facilitate the fit. Goal of the present study was therefore to develop such an instrument. Specifically, we adjusted measures of mental ability, conscientiousness, self-efficacy, and coping by simplifying the language level of these measures to make the scales accessible for people with low literacy. In order to validate these adjusted self-report and observer measures we conducted two studies, using multi-source, longitudinal data. Method Study 1 was a longitudinal multi-source study in which the newly developed instrument was administered twice to people with LWC and their significant other. We statistically tested the psychometric properties with respect to dimensionality and reliability. In Study 2, we collected new multi-source data and conducted a confirmatory factor analysis (CFA). Results Studies yielded a congruous factor structure in both samples, internally consistent measures with adequate content validity of scales and subscales, and high test-retest reliability. The CFA confirmed the factorial validity of the scales. Conclusion The adjusted self-report and the observer scales of mental ability, conscientiousness, self-efficacy, and coping are reliable measures that are well-suited to assess the work capability of people with LWC. Further research is needed to examine criterion-related validity with respect to the work demands such as work-behaviour and task performance.

The push-off test: development of a simple, reliable test of upper extremity weight-bearing capability.

PubMed

Vincent, Joshua I; MacDermid, Joy C; Michlovitz, Susan L; Rafuse, Richard; Wells-Rowsell, Christina; Wong, Owen; Bisbee, Leslie

2014-01-01

Longitudinal clinical measurement study. The push-off test (POT) is a novel and simple measure of upper extremity weight-bearing that can be measured with a grip dynamometer. There are no published studies on the validity and reliability of the POT. The relationship between upper extremity self-report activity/participation and impairment measures remain an unexplored realm. The primary purpose of this study is to estimate the intra and inter-rater reliability and construct validity of the POT. The secondary purpose is to estimate the relationship between upper extremity self-report activity/participation questionnaires and impairment measures. A convenience sample of 22 patients with wrist or elbow injuries were tested for POT, wrist/elbow range of motion (ROM), isometric wrist extension strength (WES) and grip strength; and completed two self-report activity/participation questionnaires: Disability of the Arm, Shoulder and the Hand (DASH) and Work Limitations Questionnaire (WLQ-26). POT's inter and intra-rater reliability and construct validity was tested. Pearson's correlations were run between the impairment measures and self-report questionnaires to look into the relationship amongst them. The POT demonstrated high inter-rater reliability (ICC affected = 0.97; 95% C.I. 0.93-0.99; ICC unaffected = 0.85; 95% C.I. 0.68-0.94) and intra-rater reliability (ICC affected = 0.96; 95% C.I. 0.92-0.97; ICC unaffected = 0.92; 95% C.I. 0.85-0.97). The POT was correlated moderately with the DASH (r = -0.47; p = 0.03). While examining the relationship between upper extremity self-reported activity/participation questionnaires and impairment measures the strongest correlation was between the DASH and the POT (r = -0.47; p = 0.03) and none of the correlations with the other physical impairment measures reached significance. At-work disability demonstrated insignificant correlations with physical impairments. The POT test provides a reliable and easily administered quantitative measure of ability to bear the load through an injured arm. Preliminary evidence supports a moderate relationship between loading bearing measured by the POT and upper extremity function measured by the DASH. 1b. Copyright © 2014 Hanley & Belfus. Published by Elsevier Inc. All rights reserved.

Physical activity questionnaires for youth: a systematic review of measurement properties.

PubMed

Chinapaw, Mai J M; Mokkink, Lidwine B; van Poppel, Mireille N M; van Mechelen, Willem; Terwee, Caroline B

2010-07-01

Because of the diversity in available questionnaires, it is not easy for researchers to decide which instrument is most suitable for his or her specific demands. Therefore, we systematically summarized and appraised studies examining measurement properties of self-administered and proxy-reported physical activity (PA) questionnaires in youth. Literature was identified through searching electronic databases (PubMed, EMBASE using 'EMBASE only' and SportDiscus) until May 2009. Studies were included if they reported on the measurement properties of self-administered and proxy-reported PA questionnaires in youth (mean age <18 years) and were published in the English language. Methodological quality and results of included studies was appraised using a standardized checklist (qualitative attributes and measurement properties of PA questionnaires [QAPAQ]). We included 54 manuscripts examining 61 versions of questionnaires. None of the included questionnaires showed both acceptable reliability and validity. Only seven questionnaires received a positive rating for reliability. Reported validity varied, with correlations between PA questionnaires and accelerometers ranging from very low to high (previous day PA recall: correlation coefficient [r] = 0.77). In general, PA questionnaires for adolescents correlated better with accelerometer scores than did those for children. From this systematic review, we conclude that no questionnaires were available with both acceptable reliability and validity. Considerably more high-quality research is required to examine the validity and reliability of promising PA questionnaires for youth.

The Prison Adjusted Measure of Aggression (PAMA): Psychometric characteristics of a new tool measuring change in aggressive behaviors in correctional settings.

PubMed

Kerekes, Nóra; Apelqvist, Susanne; Fielding, Cecilia; Anckarsäter, Henrik; Nilsson, Thomas

2018-05-01

There is a need for instruments that can be used in correctional settings to measure changes in aggressive behaviors over a limited time period. This study aimed to validate an instrument (the Prison Adjusted Measure of Aggression, PAMA) that assesses specifically the past month's aggressive behaviors and is adapted for use in correctional facilities. The psychometric properties of the self-rated and interview versions of the PAMA were explored and compared to those of two well-established measures of aggression: The Staff Observation Aggression Scale (SOAS); and the self-rate Aggression Questionnaire-Revised Swedish Version (AQ-RSV). The study group comprised 93 male and 59 female inmates, who were followed for two months. During the study, the prevalence of aggressive acts was observed and reported by SOAS. On two occasions, at monthly intervals, subjects reported their own aggressive behaviors using AQ-RSV and the self-report version of the PAMA; also, a psychologist conducted interviews according to PAMA. This study's main finding was that the self-rated version of PAMA is a valid measure of different types and dimensions of aggression (physical and verbal aggression, hostility) and has acceptable psychometric properties. Therefore, PAMA could potentially be of value for use in correctional services evaluating aggression managing treatment interventions. Copyright © 2018 The Authors. Published by Elsevier B.V. All rights reserved.

Development of the NIH PROMIS® Sexual Function and Satisfaction Measures in Patients with Cancer

PubMed Central

Flynn, Kathryn E.; Lin, Li; Cyranowski, Jill M.; Reeve, Bryce B.; Reese, Jennifer Barsky; Jeffery, Diana D.; Smith, Ashley Wilder; Porter, Laura S.; Dombeck, Carrie B.; Bruner, Deborah Watkins; Keefe, Francis J.; Weinfurt, Kevin P.

2013-01-01

Introduction We describe the development and validation of the PROMIS Sexual Function and Satisfaction (PROMIS SexFS) measures version 1.0 for cancer populations. Aim To develop a customizable self-report measure of sexual function and satisfaction as part of the U.S. National Institutes of Health PROMIS® Network. Methods Our multidisciplinary working group followed a comprehensive protocol for developing psychometrically robust patient reported outcome (PRO) measures including qualitative (scale development) and quantitative (psychometric evaluation) development. We performed an extensive literature review, conducted 16 focus groups with cancer patients and multiple discussions with clinicians, and evaluated candidate items in cognitive testing with patients. We administered items to 819 cancer patients. Items were calibrated using item response theory and evaluated for reliability and validity. Main Outcome Measures The PROMIS Sexual Function and Satisfaction (PROMIS SexFS) measures version 1.0 include 79 items in 11 domains: interest in sexual activity, lubrication, vaginal discomfort, erectile function, global satisfaction with sex life, orgasm, anal discomfort, therapeutic aids, sexual activities, interfering factors, and screener questions. Results In addition to content validity (patients indicate that items cover important aspects of their experiences) and face validity (patients indicate that items measure sexual function and satisfaction), the measure shows evidence for discriminant validity (domains discriminate between groups expected to be different), convergent validity (strong correlations between scores on PROMIS and scores on conceptually-similar older measures of sexual function), as well as favorable test-retest reliability among people not expected to change (inter-class correlations from 2 administrations of the instrument, 1 month apart). Conclusions The PROMIS SexFS offers researchers a reliable and valid set of tools to measure self-reported sexual function and satisfaction among diverse men and women. The measures are customizable; researchers can select the relevant domains and items comprising those domains for their study. PMID:23387911

Do impression management and self-deception distort self-report measures with content of dynamic risk factors in offender samples? A meta-analytic review.

PubMed

Hildebrand, Martin; Wibbelink, Carlijn J M; Verschuere, Bruno

Self-report measures provide an important source of information in correctional/forensic settings, yet at the same time the validity of that information is often questioned because self-reports are thought to be highly vulnerable to self-presentation biases. Primary studies in offender samples have provided mixed results with regard to the impact of socially desirable responding on self-reports. The main aim of the current study was therefore to investigate-via a meta-analytic review of published studies-the association between the two dimensions of socially desirable responding, impression management and self-deceptive enhancement, and self-report measures with content of dynamic risk factors using the Balanced Inventory of Desirable Responding (BIDR) in offender samples. These self-report measures were significantly and negatively related with self-deception (r = -0.120, p < 0.001; k = 170 effect sizes) and impression management (r = -0.158, p < 0.001; k = 157 effect sizes), yet there was evidence of publication bias for the impression management effect with the trim and fill method indicating that the relation is probably even smaller (r = -0.07). The magnitude of the effect sizes was small. Moderation analyses suggested that type of dynamic risk factor (e.g., antisocial cognition versus antisocial personality), incentives, and publication year affected the relationship between impression management and self-report measures with content of dynamic risk factors, whereas sample size, setting (e.g., incarcerated, community), and publication year influenced the relation between self-deception and these self-report measures. The results indicate that the use of self-report measures to assess dynamic risk factors in correctional/forensic settings is not inevitably compromised by socially desirable responding, yet caution is warranted for some risk factors (antisocial personality traits), particularly when incentives are at play. Copyright © 2018 Elsevier Ltd. All rights reserved.

The Recovery Knowledge Inventory for Measurement of Nursing Student Views on Recovery-oriented Mental Health Services.

PubMed

Happell, Brenda; Byrne, Louise; Platania-Phung, Chris

2015-01-01

Recovery-oriented services are a goal for policy and practice in the Australian mental health service system. Evidence-based reform requires an instrument to measure knowledge of recovery concepts. The Recovery Knowledge Inventory (RKI) was designed for this purpose, however, its suitability and validity for student health professionals has not been evaluated. The purpose of the current article is to report the psychometric features of the RKI for measuring nursing students' views on recovery. The RKI, a self-report measure, consists of four scales: (I) Roles and Responsibilities, (II) Non-Linearity of the Recovery Process, (III) Roles of Self-Definition and Peers, and (IV) Expectations Regarding Recovery. Confirmatory and exploratory factor analyses of the baseline data (n = 167) were applied to assess validity and reliability. Exploratory factor analyses generally replicated the item structure suggested by the three main scales, however more stringent analyses (confirmatory factor analysis) did not provide strong support for convergent validity. A refined RKI with 16 items had internal reliabilities of α = .75 for Roles and Responsibilities, α = .49 for Roles of Self-Definition and Peers, and α = .72, for Recovery as Non-Linear Process. If the RKI is to be applied to nursing student populations, the conceptual underpinning of the instrument needs to be reworked, and new items should be generated to evaluate and improve scale validity and reliability.

Assessing Anger Expression: Construct Validity of Three Emotion Expression-Related Measures

PubMed Central

Jasinski, Matthew J.; Lumley, Mark A.; Latsch, Deborah V.; Schuster, Erik; Kinner, Ellen; Burns, John W.

2016-01-01

Self-report measures of emotional expression are common, but their validity to predict objective emotional expression, particularly of anger, is unclear. We tested the validity of the Anger Expression Inventory (AEI; Spielberger et al., 1985)), Emotional Approach Coping Scale (EAC; Stanton, Kirk, Cameron & Danoff-Burg, 2000), and Toronto Alexithymia Scale-20 (TAS-20; Bagby, Taylor, & Parker, 1994) to predict objective anger expression in 95 adults with chronic back pain. Participants attempted to solve a difficult computer maze by following the directions of a confederate who treated them rudely and unjustly. Participants then expressed their feelings for 4 minutes. Blinded raters coded the videos for anger expression, and a software program analyzed expression transcripts for anger-related words. Analyses related each questionnaire to anger expression. The AEI anger-out scale predicted greater anger expression, as expected, but AEI anger-in did not. The EAC emotional processing scale predicted less anger expression, but the EAC emotional expression scale was unrelated to anger expression. Finally, the TAS-20 predicted greater anger expression. Findings support the validity of the AEI anger-out scale but raise questions about the other measures. The assessment of emotional expression by self-report is complex and perhaps confounded by general emotional experience, the specificity or generality of the emotion(s) assessed, and self-awareness limitations. Performance-based or clinician-rated measures of emotion expression are needed. PMID:27248355

Validity and applicability of a video-based animated tool to assess mobility in elderly Latin American populations

PubMed Central

Guerra, Ricardo Oliveira; Oliveira, Bruna Silva; Alvarado, Beatriz Eugenia; Curcio, Carmen Lucia; Rejeski, W Jack; Marsh, Anthony P; Ip, Edward H; Barnard, Ryan T; Guralnik, Jack M; Zunzunegui, Maria Victoria

2016-01-01

Aim To assess the reliability and the validity of Portuguese- and Spanish-translated versions of the video-based short-form Mobility Assessment Tool in assessing self-reported mobility, and to provide evidence for the applicability of these videos in elderly Latin American populations as a complement to physical performance measures. Methods The sample consisted of 300 elderly participants (150 from Brazil, 150 from Colombia) recruited at neighborhood social centers. Mobility was assessed with the Mobility Assessment Tool, and compared with the Short Physical Performance Battery score and self-reported functional limitations. Reliability was calculated using intraclass correlation coefficients. Multiple linear regression analyses were used to assess associations among mobility assessment tools and health, and sociodemographic variables. Results A significant gradient of increasing Mobility Assessment Tool score with better physical function was observed for both self-reported and objective measures, and in each city. Associations between self-reported mobility and health were strong, and significant. Mobility Assessment Tool scores were lower in women at both sites. Intraclass correlation coefficients of the Mobility Assessment Tool were 0.94 (95% confidence interval 0.90–0.97) in Brazil and 0.81 (95% confidence interval 0.66–0.91) in Colombia. Mobility Assessment Tool scores were lower in Manizales than in Natal after adjustment by Short Physical Performance Battery, self-rated health and sex. Conclusions These results provide evidence for high reliability and good validity of the Mobility Assessment Tool in its Spanish and Portuguese versions used in Latin American populations. In addition, the Mobility Assessment Tool can detect mobility differences related to environmental features that cannot be captured by objective perfor mance measures. PMID:24666718

Validity and applicability of a video-based animated tool to assess mobility in elderly Latin American populations.

PubMed

Guerra, Ricardo Oliveira; Oliveira, Bruna Silva; Alvarado, Beatriz Eugenia; Curcio, Carmen Lucia; Rejeski, W Jack; Marsh, Anthony P; Ip, Edward H; Barnard, Ryan T; Guralnik, Jack M; Zunzunegui, Maria Victoria

2014-10-01

To assess the reliability and the validity of Portuguese- and Spanish-translated versions of the video-based short-form Mobility Assessment Tool in assessing self-reported mobility, and to provide evidence for the applicability of these videos in elderly Latin American populations as a complement to physical performance measures. The sample consisted of 300 elderly participants (150 from Brazil, 150 from Colombia) recruited at neighborhood social centers. Mobility was assessed with the Mobility Assessment Tool, and compared with the Short Physical Performance Battery score and self-reported functional limitations. Reliability was calculated using intraclass correlation coefficients. Multiple linear regression analyses were used to assess associations among mobility assessment tools and health, and sociodemographic variables. A significant gradient of increasing Mobility Assessment Tool score with better physical function was observed for both self-reported and objective measures, and in each city. Associations between self-reported mobility and health were strong, and significant. Mobility Assessment Tool scores were lower in women at both sites. Intraclass correlation coefficients of the Mobility Assessment Tool were 0.94 (95% confidence interval 0.90-0.97) in Brazil and 0.81 (95% confidence interval 0.66-0.91) in Colombia. Mobility Assessment Tool scores were lower in Manizales than in Natal after adjustment by Short Physical Performance Battery, self-rated health and sex. These results provide evidence for high reliability and good validity of the Mobility Assessment Tool in its Spanish and Portuguese versions used in Latin American populations. In addition, the Mobility Assessment Tool can detect mobility differences related to environmental features that cannot be captured by objective performance measures. © 2013 Japan Geriatrics Society.

Validation of self-reported information on dental caries in a birth cohort at 18 years of age.

PubMed

Silva, Alexandre Emidio Ribeiro; Menezes, Ana Maria Baptista; Assunção, Maria Cecília Formoso; Gonçalves, Helen; Demarco, Flávio Fernando; Vargas-Ferreira, Fabiana; Peres, Marco Aurélio

2014-01-01

Estimate the prevalence of dental caries based on clinical examinations and self-reports and compare differences in the prevalence and effect measures between the two methods among 18-year-olds belonging to a 1993 birth cohort in the city of Pelotas, Brazil. Data on self-reported caries, socio-demographic aspects and oral health behaviour were collected using a questionnaire administered to adolescents aged 18 years (n = 4041). Clinical caries was evaluated (n = 1014) by a dentist who had undergone training and calibration exercises. Prevalence rates of clinical and self-reported caries, sensitivity, specificity, positive and negative predictive values, absolute and relative bias, and inflation factors were calculated. Prevalence ratios of dental caries were estimated for each risk factor. The prevalence of clinical and self-reported caries (DMFT>1) was 66.5% (95%CI: 63.6%-69.3%) and 60.3% (95%CI: 58.8%-61.8%), respectively. Self-reports underestimated the prevalence of dental caries by 9.3% in comparison to clinical evaluations. The analysis of the validity of self-reports regarding the DMFT index indicated high sensitivity (81.8%; 95%CI: 78.7%-84.7%) and specificity (78.1%; 95%CI: 73.3%-82.4%) in relation to the gold standard (clinical evaluation). Both the clinical and self-reported evaluations were associated with gender, schooling and self-rated oral health. Clinical dental caries was associated with visits to the dentist in the previous year. Self-reported dental caries was associated with daily tooth brushing frequency. Based on the present findings, self-reported information on dental caries using the DMFT index requires further studies prior to its use in the analysis of risk factors, but is valid for population-based health surveys with the aim of planning and monitoring oral health actions directed at adolescents.

How well do adolescents recall use of mobile telephones? Results of a validation study

PubMed Central

2009-01-01

Background In the last decade mobile telephone use has become more widespread among children. Concerns expressed about possible health risks have led to epidemiological studies investigating adverse health outcomes associated with mobile telephone use. Most epidemiological studies have relied on self reported questionnaire responses to determine individual exposure. We sought to validate the accuracy of self reported adolescent mobile telephone use. Methods Participants were recruited from year 7 secondary school students in Melbourne, Australia. Adolescent recall of mobile telephone use was assessed using a self administered questionnaire which asked about number and average duration of calls per week. Validation of self reports was undertaken using Software Modified Phones (SMPs) which logged exposure details such as number and duration of calls. Results A total of 59 adolescents participated (39% boys, 61% girls). Overall a modest but significant rank correlation was found between self and validated number of voice calls (ρ = 0.3, P = 0.04) with a sensitivity of 57% and specificity of 66%. Agreement between SMP measured and self reported duration of calls was poorer (ρ = 0.1, P = 0.37). Participants whose parents belonged to the 4th socioeconomic stratum recalled mobile phone use better than others (ρ = 0.6, P = 0.01). Conclusion Adolescent recall of mobile telephone use was only modestly accurate. Caution is warranted in interpreting results of epidemiological studies investigating health effects of mobile phone use in this age group. PMID:19523193

Brief report: Assessing dispositional optimism in adolescence--factor structure and concurrent validity of the Life Orientation Test--Revised.

PubMed

Monzani, Dario; Steca, Patrizia; Greco, Andrea

2014-02-01

Dispositional optimism is an individual difference promoting psychosocial adjustment and well-being during adolescence. Dispositional optimism was originally defined as a one-dimensional construct; however, empirical evidence suggests two correlated factors in the Life Orientation Test - Revised (LOT-R). The main aim of the study was to evaluate the dimensionality of the LOT-R. This study is the first attempt to identify the best factor structure, comparing congeneric, two correlated-factor, and two orthogonal-factor models in a sample of adolescents. Concurrent validity was also assessed. The results demonstrated the superior fit of the two orthogonal-factor model thus reconciling the one-dimensional definition of dispositional optimism with the bi-dimensionality of the LOT-R. Moreover, the results of correlational analyses proved the concurrent validity of this self-report measure: optimism is moderately related to indices of psychosocial adjustment and well-being. Thus, the LOT-R is a useful, valid, and reliable self-report measure to properly assess optimism in adolescence. Copyright © 2013 The Foundation for Professionals in Services for Adolescents. Published by Elsevier Ltd. All rights reserved.

How best to measure implementation of school health curricula: a comparison of three measures.

PubMed

Resnicow, K; Davis, M; Smith, M; Lazarus-Yaroch, A; Baranowski, T; Baranowski, J; Doyle, C; Wang, D T

1998-06-01

The impact of school health education programs is often attenuated by inadequate teacher implementation. Using data from a school-based nutrition education program delivered in a sample of fifth graders, this study examines the discriminant and predictive validity of three measures of curriculum implementation: class-room observation of fidelity, and two measures of completeness, teacher self-report questionnaire and post-implementation interview. A fourth measure, obtained during teacher observations, that assessed student and teacher interaction and student receptivity to the curriculum (labeled Rapport) was also obtained. Predictive validity was determined by examining the association of implementation measures with three study outcomes; health knowledge, asking behaviors related to fruit and vegetables, and fruit and vegetable intake, assessed by 7-day diary. Of the 37 teachers observed, 21 were observed for two sessions and 16 were observed once. Implementation measures were moderately correlated, an indication of discriminant validity. Predictive validity analyses indicated that the observed fidelity, Rapport and interview measures were significantly correlated with post-test student knowledge. The association between health knowledge and observed fidelity (based on dual observation only), Rapport and interview measures remained significant after adjustment for pre-test knowledge values. None of the implementation variables were significantly associated with student fruit and vegetable intake or asking behaviors controlling for pre-test values. These results indicate that the teacher self-report questionnaire was not a valid measure of implementation completeness in this study. Post-implementation completeness interviews and dual observations of fidelity and Rapport appear to be more valid, and largely independent methods of implementation assessment.

Measuring the Quality of Life of Visually Impaired Children: First Stage Psychometric Evaluation of the Novel VQoL_CYP Instrument.

PubMed

Tadić, Valerija; Cooper, Andrew; Cumberland, Phillippa; Lewando-Hundt, Gillian; Rahi, Jugnoo S

2016-01-01

To report piloting and initial validation of the VQoL_CYP, a novel age-appropriate vision-related quality of life (VQoL) instrument for self-reporting by children with visual impairment (VI). Participants were a random patient sample of children with VI aged 10-15 years. 69 patients, drawn from patient databases at Great Ormond Street Hospital and Moorfields Eye Hospital, United Kingdom, participated in piloting of the draft 47-item VQoL instrument, which enabled preliminary item reduction. Subsequent administration of the instrument, alongside functional vision (FV) and generic health-related quality of life (HRQoL) self-report measures, to 101 children with VI comprising a nationally representative sample enabled further item reduction and evaluation of psychometric properties using Rasch analysis. Construct validity was assessed through Pearson correlation coefficients. Item reduction through piloting (8 items removed for skewness and individual item response pattern) and validation (1 item removed for skewness and 3 for misfit in Rasch) produced a 35-item scale, with fit values within acceptable limits, no notable differential item functioning, good measurement precision, ordered response categories and acceptable targeting in Rasch. The VQoL_CYP showed good construct validity, correlating strongly with HRQoL scores, moderately with FV scores but not with acuity. Robust child-appropriate self-report VQoL measures for children with VI are necessary for understanding the broader impacts of living with a visual disability, distinguishing these from limited functioning per se. Future planned use in larger patient samples will allow further psychometric development of the VQoL_CYP as an adjunct to objective outcomes assessment.

Academic Self-Concept: Modeling and Measuring for Science

NASA Astrophysics Data System (ADS)

Hardy, Graham

2014-08-01

In this study, the author developed a model to describe academic self-concept (ASC) in science and validated an instrument for its measurement. Unlike previous models of science ASC, which envisage science as a homogenous single global construct, this model took a multidimensional view by conceiving science self-concept as possessing distinctive facets including conceptual and procedural elements. In the first part of the study, data were collected from 1,483 students attending eight secondary schools in England, through the use of a newly devised Secondary Self-Concept Science Instrument, and structural equation modeling was employed to test and validate a model. In the second part of the study, the data were analysed within the new self-concept framework to examine learners' ASC profiles across the domains of science, with particular attention paid to age- and gender-related differences. The study found that the proposed science self-concept model exhibited robust measures of fit and construct validity, which were shown to be invariant across gender and age subgroups. The self-concept profiles were heterogeneous in nature with the component relating to self-concept in physics, being surprisingly positive in comparison to other aspects of science. This outcome is in stark contrast to data reported elsewhere and raises important issues about the nature of young learners' self-conceptions about science. The paper concludes with an analysis of the potential utility of the self-concept measurement instrument as a pedagogical device for science educators and learners of science.

Utility of biochemical verification of tobacco cessation in the Department of Veterans Affairs.

PubMed

Noonan, Devon; Jiang, Yunyun; Duffy, Sonia A

2013-03-01

Research on the validity of self-report tobacco use has varied by the population studied and has yet to be examined among smokers serviced by the Department of Veterans Affairs (VA). The purpose of this study was to determine the predictors of returning a biochemical urine test and the specificity and sensitivity of self-reported tobacco use status compared to biochemical verification. This was a sub-analysis of the larger Tobacco Tactics research study, a pre-/post-non-randomized control design study to implement and evaluate a smoking cessation intervention in three large VA hospitals. Inpatient smokers completed baseline demographic, health history and tobacco use measures. Patients were sent a follow-up survey at six-months to assess tobacco use and urine cotinine levels. A total of 645 patients returned six-month surveys of which 578 also returned a urinary cotinine strip at six-months. Multivariate analysis of the predictors of return rate revealed those more likely to return biochemical verification of their smoking status were younger, more likely to be thinking about quitting smoking, have arthritis, and less likely to have heart disease. The sensitivity and specificity of self-report tobacco use were 97% (95% confidence interval=0.95-0.98) and 93% (95% confidence interval=0.84-0.98) respectively. The misclassification rate among self-reported quitters was 21%. The misclassification rate among self-reported tobacco users was 1%. The sensitivity and specificity of self-report tobacco use were high among veteran smokers, yet among self-report quitters that misclassification rate was high at 21% suggesting that validating self-report tobacco measures is warranted in future studies especially in populations that are prone to misclassification. Copyright © 2012 Elsevier Ltd. All rights reserved.

Validation of the Childbirth Attitudes Questionnaire in Greek and psychosocial characteristics of pregnant women with fear of childbirth.

PubMed

Gourounti, Kleanthi; Kouklaki, Eleni; Lykeridou, Katerina

2015-09-01

Fear of childbirth has been found to be a factor that influences women's decision about their choice of delivery. The investigation of psychological factors that relate to fear of childbirth as well as the validation of the Childbirth Attitudes Questionnaire (CAQ) can help identify pregnant women with high fear of childbirth. This study aimed to (a) translate and validate the Childbirth Attitude Questionnaire in Greek and (b) explore how fear of childbirth was related to childbirth self-efficacy, state anxiety, depression, neuroticism, self-esteem and optimism. 145 nulliparous pregnant women, in late pregnancy, attending routine antenatal visit in a private maternity clinic participated. All participants completed the CAQ (fear of childbirth) and other self-report questionnaires that measured childbirth self-efficacy, self-esteem, optimism, neuroticism, state anxiety and depressive symptomatology. Factor structure was investigated using principal axis factoring. Cronbach's α was used to measure internal consistency reliability. Pearson's correlation coefficients were calculated between all study variables, followed by multiple linear regression. The factor analysis suggested the existence of one-factor structure. Construct validity was confirmed by computing correlations between the CAQ and childbirth self-efficacy, self-esteem and optimism. Multivariate analysis showed that childbirth self-efficacy, self-esteem and optimism were negatively and significantly associated with fear of childbirth. The Greek version of the CAQ is a reliable and valid measure. The clinical use of CAQ may enable midwives and other health care professionals to identify pregnant women with low childbirth confidence and to provide information and support. Copyright © 2015 Australian College of Midwives. Published by Elsevier Ltd. All rights reserved.

Measuring the bias, precision, accuracy, and validity of self-reported height and weight in assessing overweight and obesity status among adolescents using a surveillance system.

PubMed

Pérez, Adriana; Gabriel, Kelley; Nehme, Eileen K; Mandell, Dorothy J; Hoelscher, Deanna M

2015-07-27

Evidence regarding bias, precision, and accuracy in adolescent self-reported height and weight across demographic subpopulations is lacking. The bias, precision, and accuracy of adolescent self-reported height and weight across subpopulations were examined using a large, diverse and representative sample of adolescents. A second objective was to develop correction equations for self-reported height and weight to provide more accurate estimates of body mass index (BMI) and weight status. A total of 24,221 students from 8th and 11th grade in Texas participated in the School Physical Activity and Nutrition (SPAN) surveillance system in years 2000-2002 and 2004-2005. To assess bias, the differences between the self-reported and objective measures, for height and weight were estimated. To assess precision and accuracy, the Lin's concordance correlation coefficient was used. BMI was estimated for self-reported and objective measures. The prevalence of students' weight status was estimated using self-reported and objective measures; absolute (bias) and relative error (relative bias) were assessed subsequently. Correction equations for sex and race/ethnicity subpopulations were developed to estimate objective measures of height, weight and BMI from self-reported measures using weighted linear regression. Sensitivity, specificity and positive predictive values of weight status classification using self-reported measures and correction equations are assessed by sex and grade. Students in 8th- and 11th-grade overestimated their height from 0.68cm (White girls) to 2.02 cm (African-American boys), and underestimated their weight from 0.4 kg (Hispanic girls) to 0.98 kg (African-American girls). The differences in self-reported versus objectively-measured height and weight resulted in underestimation of BMI ranging from -0.23 kg/m2 (White boys) to -0.7 kg/m2 (African-American girls). The sensitivity of self-reported measures to classify weight status as obese was 70.8% and 81.9% for 8th- and 11th-graders, respectively. These estimates increased when using the correction equations to 77.4% and 84.4% for 8th- and 11th-graders, respectively. When direct measurement is not practical, self-reported measurements provide a reliable proxy measure across grade, sex and race/ethnicity subpopulations of adolescents. Correction equations increase the sensitivity of self-report measures to identify prevalence of overall overweight/obesity status.

A systematic review of publications assessing reliability and validity of the Behavioral Risk Factor Surveillance System (BRFSS), 2004–2011

PubMed Central

2013-01-01

Background In recent years response rates on telephone surveys have been declining. Rates for the behavioral risk factor surveillance system (BRFSS) have also declined, prompting the use of new methods of weighting and the inclusion of cell phone sampling frames. A number of scholars and researchers have conducted studies of the reliability and validity of the BRFSS estimates in the context of these changes. As the BRFSS makes changes in its methods of sampling and weighting, a review of reliability and validity studies of the BRFSS is needed. Methods In order to assess the reliability and validity of prevalence estimates taken from the BRFSS, scholarship published from 2004–2011 dealing with tests of reliability and validity of BRFSS measures was compiled and presented by topics of health risk behavior. Assessments of the quality of each publication were undertaken using a categorical rubric. Higher rankings were achieved by authors who conducted reliability tests using repeated test/retest measures, or who conducted tests using multiple samples. A similar rubric was used to rank validity assessments. Validity tests which compared the BRFSS to physical measures were ranked higher than those comparing the BRFSS to other self-reported data. Literature which undertook more sophisticated statistical comparisons was also ranked higher. Results Overall findings indicated that BRFSS prevalence rates were comparable to other national surveys which rely on self-reports, although specific differences are noted for some categories of response. BRFSS prevalence rates were less similar to surveys which utilize physical measures in addition to self-reported data. There is very little research on reliability and validity for some health topics, but a great deal of information supporting the validity of the BRFSS data for others. Conclusions Limitations of the examination of the BRFSS were due to question differences among surveys used as comparisons, as well as mode of data collection differences. As the BRFSS moves to incorporating cell phone data and changing weighting methods, a review of reliability and validity research indicated that past BRFSS landline only data were reliable and valid as measured against other surveys. New analyses and comparisons of BRFSS data which include the new methodologies and cell phone data will be needed to ascertain the impact of these changes on estimates in the future. PMID:23522349

Self-reported sunscreen use and urinary benzophenone-3 concentrations in the United States: NHANES 2003-2006 and 2009-2012

PubMed Central

Zamoiski, Rachel D.; Cahoon, Elizabeth K.; Freedman, D. Michal; Linet, Martha S.

2015-01-01

Background Sunscreens protect against skin cancer and other harmful effects of solar ultraviolet radiation (UVR). Epidemiologic and public health surveys often rely on self-reported sunscreen use to estimate sun exposure and avoidance, but questions remain about the validity of self-reports. Benzophenone-3 (BP-3), a common sunscreen ingredient, can be detected in the urine. Prior studies suggest that BP-3 concentrations increase after application of sunscreen. Objectives The goal of this study was to assess the validity of self-reported frequency of sunscreen use in relation to urinary BP-3 concentrations in a representative sample of the general US population, including in sub-groups defined by age, sex and race/ethnicity. Methods To assess the relationship between categorical self-reported sunscreen use and creatinine-corrected urinary BP-3 concentrations, we conducted a linear regression adjusted for age, sex, race/ethnicity, six-month time period, body mass index, education, and sun avoidance behaviors. We tested for effect modification by age, sex, ethnicity and time period of measurement using multiplicative interaction terms and a F test. Results BP-3 was positively associated with self-reported frequency of sunscreen use across all ages, sexes, race/ethnicities, and time periods. Crude and multivariate adjusted models were all statistically significant. R-square was relatively low for all models, ranging from 0.15-0.43. Conclusions Urinary BP-3 is positively associated with self-reported frequency of sunscreen use in the general US population, even in groups with overall low sunscreen use. These results suggest that self-report is a valid, although weak, way of assessing relative frequencies of sunscreen usage in a population-based study. PMID:26298557

Self-reported sunscreen use and urinary benzophenone-3 concentrations in the United States: NHANES 2003-2006 and 2009-2012.

PubMed

Zamoiski, Rachel D; Cahoon, Elizabeth K; Michal Freedman, D; Linet, Martha S

2015-10-01

Sunscreens protect against skin cancer and other harmful effects of solar ultraviolet radiation (UVR). Epidemiologic and public health surveys often rely on self-reported sunscreen use to estimate sun exposure and avoidance, but questions remain about the validity of self-reports. Benzophenone-3 (BP-3), a common sunscreen ingredient, can be detected in the urine. Prior studies suggest that BP-3 concentrations increase after application of sunscreen. The goal of this study was to assess the validity of self-reported frequency of sunscreen use in relation to urinary BP-3 concentrations in a representative sample of the general US population, including in sub-groups defined by age, sex and race/ethnicity. To assess the relationship between categorical self-reported sunscreen use and creatinine-corrected urinary BP-3 concentrations, we conducted a linear regression adjusted for age, sex, race/ethnicity, six-month time period, body mass index, education, and sun avoidance behaviors. We tested for effect modification by age, sex, ethnicity and time period of measurement using multiplicative interaction terms and a F test. BP-3 was positively associated with self-reported frequency of sunscreen use across all ages, sexes, race/ethnicities, and time periods. Crude and multivariate adjusted models were all statistically significant. R-square was relatively low for all models, ranging from 0.15 to 0.43. Urinary BP-3 is positively associated with self-reported frequency of sunscreen use in the general US population, even in groups with overall low sunscreen use. These results suggest that self-report is a valid, although weak, way of assessing relative frequencies of sunscreen usage in a population-based study. Published by Elsevier Inc.

Assessing Adolescents' Positive Psychological Functioning at School: Development and Validation of the Student Subjective Wellbeing Questionnaire

ERIC Educational Resources Information Center

Renshaw, Tyler L.; Long, Anna C. J.; Cook, Clayton R.

2015-01-01

This study reports on the initial development and validation of the Student Subjective Wellbeing Questionnaire (SSWQ) with a sample of 1,002 students in Grades 6-8. The SSWQ is a 16-item self-report instrument for assessing youths' subjective wellbeing at school, which is operationalized via 4 subscales measuring school connectedness, academic…

Self-reported versus measured height and weight in Hispanic and non-Hispanic menopausal women.

PubMed

Griebeler, Marcio L; Levis, Silvina; Beringer, Laura Muñoz; Chacra, Walid; Gómez-Marín, Orlando

2011-04-01

Height and weight information is commonly used in clinical trials and in making therapeutic decisions in medical practice. In both settings, the data are often obtained by self-report. If erroneous, this practice could lead to inaccuracies in estimating renal function and medication doses or to inaccurate outcomes of research studies. Previous publications have reported lack of reliability of self-reported weight and height in the general population but have not addressed age-specific and ethnicity-specific subgroups in the U.S. population. The inaccuracy of self-reported weight and height could be particularly significant in times of considerable changes in body weight, such as at menopause, which is often associated with weight gain. We assessed the validity of self-reported height and weight in 428 women within the first 5 years of menopause, 70.6% of whom were Hispanic. Participants overestimated their height by 2.2±3.5 cm (mean±standard deviation [SD]) and underestimated their weight by 1.5±2.9 kg. As a group, based on self-reported measures, 33.3% were misclassified with respect to body mass index (BMI) category, and the difference between measured BMI and self-reported BMI was similar between Hispanic white and non-Hispanic white women, positively related to measured weight, and inversely related to measured height, years from menopause, and multiple parity. From the public health perspective, inaccurate self-report could lead to a considerable underestimation of the current obesity prevalence rates. In our study population, the prevalence of obesity (BMI ≥30 kg/m(2)) was 6.3% based on self-reported values and 18% based on measured height and weight, representing a 3-fold underestimation.

Self-Reported Versus Measured Height and Weight in Hispanic and Non-Hispanic Menopausal Women

PubMed Central

Griebeler, Marcio L.; Beringer, Laura Muñoz; Chacra, Walid; Gómez-Marín, Orlando

2011-01-01

Abstract Background Height and weight information is commonly used in clinical trials and in making therapeutic decisions in medical practice. In both settings, the data are often obtained by self-report. If erroneous, this practice could lead to inaccuracies in estimating renal function and medication doses or to inaccurate outcomes of research studies. Previous publications have reported lack of reliability of self-reported weight and height in the general population but have not addressed age-specific and ethnicity-specific subgroups in the U.S. population. The inaccuracy of self-reported weight and height could be particularly significant in times of considerable changes in body weight, such as at menopause, which is often associated with weight gain. Methods We assessed the validity of self-reported height and weight in 428 women within the first 5 years of menopause, 70.6% of whom were Hispanic. Results Participants overestimated their height by 2.2±3.5 cm (mean±standard deviation [SD]) and underestimated their weight by 1.5±2.9 kg. As a group, based on self-reported measures, 33.3% were misclassified with respect to body mass index (BMI) category, and the difference between measured BMI and self-reported BMI was similar between Hispanic white and non-Hispanic white women, positively related to measured weight, and inversely related to measured height, years from menopause, and multiple parity. Conclusions From the public health perspective, inaccurate self-report could lead to a considerable underestimation of the current obesity prevalence rates. In our study population, the prevalence of obesity (BMI ≥30 kg/m2) was 6.3% based on self-reported values and 18% based on measured height and weight, representing a 3-fold underestimation. PMID:21413893

Self-Reported Physical Activity in Medically Underserved Adults With Type 2 Diabetes in Clinical and Community Settings.

PubMed

Cooper, John; Stetson, Barbara; Bonner, Jason; Spille, Sean; Krishnasamy, Sathya; Mokshagundam, Sri Prakash

2015-07-01

This study assessed physical activity (PA) in community dwelling adults with Type 2 diabetes, using multiple instruments reflecting internationally normed PA and diabetes-specific self-care behaviors. Two hundred and fifty-three Black (44.8%) and White (55.2%) Americans [mean age = 57.93; 39.5% male] recruited at low-income clinic and community health settings. Participants completed validated PA self-report measures developed for international comparisons (International Physical Activity Questionnaire Short Form), characterization of diabetes self-care (Summary of Diabetes Self-Care Activities Measure; SDSCA) and exercise-related domains including provider recommendations and PA behaviors and barriers (Personal Diabetes Questionnaire; PDQ). Self-reported PA and PA correlates differed by instrument. BMI was negatively correlated with PA level assessed by the PDQ in both genders, and assessed with SDSCA activity items in females. PA levels were low, comparable to previous research with community and diabetes samples. Pain was the most frequently reported barrier; females reported more frequent PA barriers overall. When using self-report PA measures for PA evaluation of adults with diabetes in clinical settings, it is critical to consider population and setting in selecting appropriate tools. PA barriers may be an important consideration when interpreting PA levels and developing interventions. Recommendations for incorporating these measures in clinical and research settings are discussed.

The Body Dysmorphic Disorder Symptom Scale: Development and preliminary validation of a self-report scale of symptom specific dysfunction.

PubMed

Wilhelm, Sabine; Greenberg, Jennifer L; Rosenfield, Elizabeth; Kasarskis, Irina; Blashill, Aaron J

2016-06-01

The Body Dysmorphic Disorder Symptom Scale (BDD-SS) is a new self-report measure used to examine the severity of a wide variety of symptoms associated with body dysmorphic disorder (BDD). The BDD-SS was designed to differentiate, for each group of symptoms, the number of symptoms endorsed and their severity. This report evaluates and compares the psychometric characteristics of the BDD-SS in relation to other measures of BDD, body image, and depression in 99 adult participants diagnosed with BDD. Total scores of the BDD-SS showed good reliability and convergent validity and moderate discriminant validity. Analyses of the individual BDD-SS symptom groups confirmed the reliability of the checking, grooming, weight/shape, and cognition groups. The current findings indicate that the BDD-SS can be quickly administered and used to examine the severity of heterogeneous BDD symptoms for research and clinical purposes. Copyright © 2016. Published by Elsevier Ltd.

Validity and reproducibility of self-reported total physical activity--differences by relative weight.

PubMed

Norman, A; Bellocco, R; Bergström, A; Wolk, A

2001-05-01

Physical activity is hypothesized to reduce the risk of obesity and several other chronic diseases and enhance longevity. However, most of the questionnaires used measure only part of total physical activity, occupational and/or leisure-time activity, which might lead to misclassification of total physical activity level and to dilution of risk estimates. We evaluated the validity and reproducibility of a short self-administered physical activity questionnaire, intended to measure long-term total daily 24 h physical activity. The questionnaire included questions on level of physical activity at work, hours per day of walking/bicycling, home/household work, leisure-time activity/inactivity and sleeping and was sent twice during one year (winter/spring and late summer). Two 7-day activity records, performed 6 months apart, were used as the reference method. One-hundred and eleven men, aged 44-78, completed the questionnaire and one or two activity records. The physical activity levels were measured as metabolic equivalents (MET)xh/day. Spearman correlation coefficient between total daily activity score estimated from the first questionnaire and the records (validity) was 0.56 (deattenuated) and between the first and the second questionnaire (reproducibility) 0.65. Significantly higher validity correlations were observed in men with self-reported body mass index below 26 kg/m(2) than in heavier men (r=0.73 vs r=0.39). This study indicates that the average total daily physical activity scores can be estimated satisfactorily in men using this simple self-administered questionnaire.

Reliability and Construct Validity of the Psychopathic Personality Inventory-Revised in a Swedish Non-Criminal Sample - A Multimethod Approach including Psychophysiological Correlates of Empathy for Pain.

PubMed

Sörman, Karolina; Nilsonne, Gustav; Howner, Katarina; Tamm, Sandra; Caman, Shilan; Wang, Hui-Xin; Ingvar, Martin; Edens, John F; Gustavsson, Petter; Lilienfeld, Scott O; Petrovic, Predrag; Fischer, Håkan; Kristiansson, Marianne

2016-01-01

Cross-cultural investigation of psychopathy measures is important for clarifying the nomological network surrounding the psychopathy construct. The Psychopathic Personality Inventory-Revised (PPI-R) is one of the most extensively researched self-report measures of psychopathic traits in adults. To date however, it has been examined primarily in North American criminal or student samples. To address this gap in the literature, we examined PPI-R's reliability, construct validity and factor structure in non-criminal individuals (N = 227) in Sweden, using a multimethod approach including psychophysiological correlates of empathy for pain. PPI-R construct validity was investigated in subgroups of participants by exploring its degree of overlap with (i) the Psychopathy Checklist: Screening Version (PCL:SV), (ii) self-rated empathy and behavioral and physiological responses in an experiment on empathy for pain, and (iii) additional self-report measures of alexithymia and trait anxiety. The PPI-R total score was significantly associated with PCL:SV total and factor scores. The PPI-R Coldheartedness scale demonstrated significant negative associations with all empathy subscales and with rated unpleasantness and skin conductance responses in the empathy experiment. The PPI-R higher order Self-Centered Impulsivity and Fearless Dominance dimensions were associated with trait anxiety in opposite directions (positively and negatively, respectively). Overall, the results demonstrated solid reliability (test-retest and internal consistency) and promising but somewhat mixed construct validity for the Swedish translation of the PPI-R.

Reliability and Construct Validity of the Psychopathic Personality Inventory-Revised in a Swedish Non-Criminal Sample – A Multimethod Approach including Psychophysiological Correlates of Empathy for Pain

PubMed Central

Sörman, Karolina; Nilsonne, Gustav; Howner, Katarina; Tamm, Sandra; Caman, Shilan; Wang, Hui-Xin; Ingvar, Martin; Edens, John F.; Gustavsson, Petter; Lilienfeld, Scott O; Petrovic, Predrag; Fischer, Håkan; Kristiansson, Marianne

2016-01-01

Cross-cultural investigation of psychopathy measures is important for clarifying the nomological network surrounding the psychopathy construct. The Psychopathic Personality Inventory-Revised (PPI-R) is one of the most extensively researched self-report measures of psychopathic traits in adults. To date however, it has been examined primarily in North American criminal or student samples. To address this gap in the literature, we examined PPI-R’s reliability, construct validity and factor structure in non-criminal individuals (N = 227) in Sweden, using a multimethod approach including psychophysiological correlates of empathy for pain. PPI-R construct validity was investigated in subgroups of participants by exploring its degree of overlap with (i) the Psychopathy Checklist: Screening Version (PCL:SV), (ii) self-rated empathy and behavioral and physiological responses in an experiment on empathy for pain, and (iii) additional self-report measures of alexithymia and trait anxiety. The PPI-R total score was significantly associated with PCL:SV total and factor scores. The PPI-R Coldheartedness scale demonstrated significant negative associations with all empathy subscales and with rated unpleasantness and skin conductance responses in the empathy experiment. The PPI-R higher order Self-Centered Impulsivity and Fearless Dominance dimensions were associated with trait anxiety in opposite directions (positively and negatively, respectively). Overall, the results demonstrated solid reliability (test-retest and internal consistency) and promising but somewhat mixed construct validity for the Swedish translation of the PPI-R. PMID:27300292

Accuracy of self-reported height, weight and waist circumference in a Japanese sample.

PubMed

Okamoto, N; Hosono, A; Shibata, K; Tsujimura, S; Oka, K; Fujita, H; Kamiya, M; Kondo, F; Wakabayashi, R; Yamada, T; Suzuki, S

2017-12-01

Inconsistent results have been found in prior studies investigating the accuracy of self-reported waist circumference, and no study has investigated the validity of self-reported waist circumference among Japanese individuals. This study used the diagnostic standard of metabolic syndrome to assess the accuracy of individual's self-reported height, weight and waist circumference in a Japanese sample. Study participants included 7,443 Japanese men and women aged 35-79 years. They participated in a cohort study's baseline survey between 2007 and 2011. Participants' height, weight and waist circumference were measured, and their body mass index was calculated. Self-reported values were collected through a questionnaire before the examination. Strong correlations between measured and self-reported values for height, weight and body mass index were detected. The correlation was lowest for waist circumference (men, 0.87; women, 0.73). Men significantly overestimated their waist circumference (mean difference, 0.8 cm), whereas women significantly underestimated theirs (mean difference, 5.1 cm). The sensitivity of self-reported waist circumference using the cut-off value of metabolic syndrome was 0.83 for men and 0.57 for women. Due to systematic and random errors, the accuracy of self-reported waist circumference was low. Therefore, waist circumference should be measured without relying on self-reported values, particularly in the case of women.

Reliability, Validity, and Factor Structure of the Imaginative Capability Scale

ERIC Educational Resources Information Center

Liang, Chaoyun; Chia, Tsorng-Lin

2014-01-01

Three studies were combined to test the reliability, validity, and factor structure of the imaginative capability scale (ICS). The ICS was a new self-report measure, which was developed to be empirically valid and easy to administer. Study 1 consisted in an exploratory factor analysis to determine the most appropriate structure of the ICS in a…

The PedsQL in pediatric cancer: reliability and validity of the Pediatric Quality of Life Inventory Generic Core Scales, Multidimensional Fatigue Scale, and Cancer Module.

PubMed

Varni, James W; Burwinkle, Tasha M; Katz, Ernest R; Meeske, Kathy; Dickinson, Paige

2002-04-01

The Pediatric Quality of Life Inventory (PedsQL) is a modular instrument designed to measure health-related quality of life (HRQOL) in children and adolescents ages 2-18 years. The PedsQL 4.0 Generic Core Scales are multidimensional child self-report and parent proxy-report scales developed as the generic core measure to be integrated with the PedsQL disease specific modules. The PedsQL Multidimensional Fatigue Scale was designed to measure fatigue in pediatric patients. The PedsQL 3.0 Cancer Module was designed to measure pediatric cancer specific HRQOL. The PedsQL Generic Core Scales, Multidimensional Fatigue Scale, and Cancer Module were administered to 339 families (220 child self-reports; 337 parent proxy-reports). Internal consistency reliability for the PedsQL Generic Core Total Scale Score (alpha = 0.88 child, 0.93 parent report), Multidimensional Fatigue Total Scale Score (alpha = 0.89 child, 0.92 parent report) and most Cancer Module Scales (average alpha = 0.72 child, 0.87 parent report) demonstrated reliability acceptable for group comparisons. Validity was demonstrated using the known-groups method. The PedsQL distinguished between healthy children and children with cancer as a group, and among children on-treatment versus off-treatment. The validity of the PedsQL Multidimensional Fatigue Scale was further demonstrated through hypothesized intercorrelations with dimensions of generic and cancer specific HRQOL. The results demonstrate the reliability and validity of the PedsQL Generic Core Scales, Multidimensional Fatigue Scale, and Cancer Module in pediatric cancer. The PedsQL may be utilized as an outcome measure in clinical trials, research, and clinical practice. Copyright 2002 American Cancer Society.

Social Desirability, Non-Response Bias and Reliability in a Long Self-Report Measure: Illustrations from the MMPI-2 Administered to Brunei Student Teachers

ERIC Educational Resources Information Center

Mundia, Lawrence

2011-01-01

The survey investigated the problems of social desirability (SD), non-response bias (NRB) and reliability in the Minnesota Multiphasic Personality Inventory--Revised (MMPI-2) self-report inventory administered to Brunei student teachers. Bruneians scored higher on all the validity scales than the normative US sample, thereby threatening the…

Obtaining Self-Report Data from Cognitively Impaired Elders: Methodological Issues and Clinical Implications for Nursing Home Pain Assessment

ERIC Educational Resources Information Center

Fisher, Susan E.; Burgio, Louis D.; Thorn, Beverly E.; Hardin, J. Michael

2006-01-01

Purpose: We developed and evaluated an explicit procedure for obtaining self-report pain data from nursing home residents across a broad range of cognitive status, and we evaluated the consistency, stability, and concurrent validity of resident responses. Design and Methods: Using a modification of the Geriatric Pain Measure (GPM-M2), we…

Measuring Implicit Attitudes with the Inclusion ST-IAT: A Replication and Further Validation

ERIC Educational Resources Information Center

Wüthrich, Sergej; Sahli Lozano, Caroline

2018-01-01

Assessment of attitudes in inclusive education research is almost exclusively based on self-report scales. This may lead to overestimation of positive attitudes due to social desirability bias, and self-reported attitudes may not capture all relevant aspects of attitudes. Recently, Lüke and Grosche (2018a) proposed a new attitude test based on a…

The Unidimensional Relationship Closeness Scale (URCS): Reliability and Validity Evidence for a New Measure of Relationship Closeness

ERIC Educational Resources Information Center

Dibble, Jayson L.; Levine, Timothy R.; Park, Hee Sun

2012-01-01

A fundamental dimension along which all social and personal relationships vary is closeness. The Unidimensional Relationship Closeness Scale (URCS) is a 12-item self-report scale measuring the closeness of social and personal relationships. The reliability and validity of the URCS were assessed with college dating couples (N = 192), female friends…

Construct Validity of the Posttraumatic Stress Disorder Checklist in Cancer Survivors: Analyses Based on Two Samples

ERIC Educational Resources Information Center

DuHamel, Katherine N.; Ostrof, Jamie; Ashman, Teresa; Winkel, Gary; Mundy, Elizabeth A.; Keane, Terence M.; Morasco, Benjamin J.; Vickberg, Suzanne M. J.; Hurley, Karen; Chhabra, Rosy; Scigliano, Eileen; Papadopoulos, Esperanza; Moskowitz, Craig; Redd, William

2004-01-01

The measurement of posttraumatic stress disorder (PTSD) is critically important for the identification and treatment of this disorder. The PTSD Checklist (PCL; F. W. Weathers & J. Ford, 1996) is a self-report measure that is increasingly used. In this study, the authors investigated the factorial validity of the PCL with data from 236 cancer…

Further Validation of the Learning Alliance Inventory: The Roles of Working Alliance, Rapport, and Immediacy in Student Learning

ERIC Educational Resources Information Center

Rogers, Daniel T.

2015-01-01

This study further examined the reliability and validity of the Learning Alliance Inventory (LAI), a self-report measure designed to assess the working alliance between a student and a teacher. The LAI was found to have good internal consistency and test--retest reliability, and it demonstrated the predicted convergence with measures of immediacy…

Do Smokers Know What We're Talking about? The Construct Validity of Nicotine Dependence Questionnaire Measures

ERIC Educational Resources Information Center

Japuntich, Sandra J.; Piper, Megan E.; Schlam, Tanya R.; Bolt, Daniel M.; Baker, Timothy B.

2009-01-01

Few studies have examined whether nicotine dependence self-report questionnaires can predict specific behaviors and symptoms at specific points in time. The present study used data from a randomized clinical trial (N = 608; M. E. Piper et al., 2007) to assess the construct validity of scales and items from 3 nicotine dependence measures: the…

The Spanish version of the Self-Determination Inventory Student Report: application of item response theory to self-determination measurement.

PubMed

Mumbardó-Adam, C; Guàrdia-Olmos, J; Giné, C; Raley, S K; Shogren, K A

2018-04-01

A new measure of self-determination, the Self-Determination Inventory: Student Report (Spanish version), has recently been adapted and empirically validated in Spanish language. As it is the first instrument intended to measure self-determination in youth with and without disabilities, there is a need to further explore and strengthen its psychometric analysis based on item response patterns. Through item response theory approach, this study examined item observed distributions across the essential characteristics of self-determination. The results demonstrated satisfactory to excellent item functioning patterns across characteristics, particularly within agentic action domains. Increased variability across items was also found within action-control beliefs dimensions, specifically within the self-realisation subdomain. These findings further support the instrument's psychometric properties and outline future research directions. © 2017 MENCAP and International Association of the Scientific Study of Intellectual and Developmental Disabilities and John Wiley & Sons Ltd.

Development of an instrument to measure the use of behaviors taught in the American Physical Therapy Association Clinical Instructor Education and Credentialing Program (APTA CIECP): a pilot study.

PubMed

Bridges, Patricia H; Carter, Vincent; Rehm, Stephanie; Tintl, Sara Bowers; Halperin, Rebecca; Kniesly, Elizabeth; Pelino, Soni

2013-01-01

Conduct a pilot study to establish the reliability and validity of a survey instrument that directly measures the objectives and content of the APTA CIECP; and measure the self-reported frequency of use of the behaviors taught in the APTA CIECP. Eighteen (18) APTA credentialed CIs. Develop a web-based survey consisting of 58 items representative of the behaviors taught in the APTA CIECP and 8 demographic characteristics. Establish the content validity and reliability of the survey instrument. Conduct a descriptive analysis of the frequency of self-reported use of the behaviors. The APTA Clinical Instructor Education Board (CIEB) reviewed the items and determined that the items matched the objectives and content of the APTA CIECP, thereby establishing content validity. Cronbach's alpha coefficients ranging from 0.79-0.90 confirmed the reliability. The overall mean for all items on a 1-6 scale was 4.81. The content validity and reliability of the survey instrument were established. The outcomes of this pilot study suggest that when measured by a valid and reliable instrument that is representative of the objectives and content of the CIECP, the behaviors taught in the CIECP are being applied in the clinical setting by APTA credentialed clinical instructors.

The Generalizability of Overreporting Across Self-Report Measures: An Investigation With the Minnesota Multiphasic Personality Inventory-2-Restructured Form and the Personality Assessment Inventory in a Civil Disability Sample.

PubMed

Crighton, Adam H; Tarescavage, Anthony M; Gervais, Roger O; Ben-Porath, Yossef S

2017-07-01

Elevated overreporting Validity Scale scores on the Minnesota Multiphasic Personality Inventory-2-Restructured Form (MMPI-2-RF) are associated with higher scores on collateral measures; however, measures used in prior research lacked validity scales. We sought to extend these findings by examining associations between elevated MMPI-2-RF overreporting scale scores and Personality Assessment Inventory (PAI) scale scores among 654 non-head injury civil disability claimants. Individuals were classified as overreporting psychopathology (OR-P), overreporting somatic/cognitive complaints (OR-SC), inconclusive reporting psychopathology (IR-P), inconclusive reporting somatic/cognitive complaints (IR-SC), or valid reporting (VR). Both overreporting groups had significantly and meaningfully higher scores than the VR group on the MMPI-2-RF and PAI scales. Both IR groups had significantly and meaningfully higher scores than the VR group, as well as lower scores than their overreporting counterparts. Our findings demonstrate the utility of inventories with validity scales in assessment batteries that include instruments without measures of protocol validity.

Comparison of self-reported and biomedical data on hypertension and diabetes: findings from the China Health and Retirement Longitudinal Study (CHARLS)

PubMed Central

Ning, Meng; Zhang, Qiang; Yang, Min

2016-01-01

Objectives We examined the level of agreement between biomedical and self-reported measurements of hypertension and diabetes in a Chinese national community sample, and explored associations of the agreement and possible contextual effects among provinces and geographic regions in China. Design Secondary analysis of a cohort sample. Setting and participants Community samples were drawn from the national baseline survey of the China Health and Retirement Longitudinal Study (CHARLS, 2011–2012) through multistage probability sampling, which included households with members 45 years of age or above with a total sample size of 17 708 individuals. Outcome measures Sensitivity, specificity and κ were used as measurements of agreements or validity; variance of validity measures among provinces and communities was estimated using random-effects models. Results Self-reports for hypertension and diabetes showed high specificity (96.3% and 98.3%, respectively) but low sensitivity (56.3% and 61.5%, respectively). Agreement between self-reported data and biomedical measurements was moderate for both hypertension (κ 0.57) and diabetes (κ 0.65), with respondents who were older, of higher socioeconomic status, better educated and who had hospital admissions in the past 12 months showing stronger agreements than their counterparts. Large and significant variations in the sensitivity among provinces for hypertension, and among communities for both hypertension and diabetes, could neither be attributed to the effects of respondents’ characteristics nor to the contextual effects of city–village differences. Conclusions As a considerable number of people in the overall sample were unaware of their conditions, self-reports will lead to an underestimation of the prevalence of hypertension and diabetes. However, in more developed communities or provinces, self-reported data can be a reliable estimate of the prevalence of the two conditions. Further investigations of contextual effects at provincial and community levels could highlight public health strategies to improve awareness of the two conditions. PMID:26729390

A comparison of the prevalence of prenatal alcohol exposure obtained via maternal self-reports versus meconium testing: a systematic literature review and meta-analysis

PubMed Central

2014-01-01

Background Maternal self-reports, used for the detection of prenatal alcohol exposure (PAE), may lack validity, necessitating the use of an objective biomarker. The detection of fatty acid ethyl esters (products of non-oxidative ethanol metabolism) in meconium has been established as a novel biomarker of PAE. The purpose of the current study was to compare the prevalence of PAE as reported via maternal self-reports with the results of meconium testing, and to quantify the disparity between these two methods. Methods A systematic literature search for studies reporting on the prevalence of PAE, using maternal self-reports in combination with meconium testing, was conducted using multiple electronic bibliographic databases. Pooled prevalence estimates and 95% confidence intervals (CI) were calculated based on eight studies, using the Mantel-Haenszel method, assuming a random effects model. A random effects meta-regression was performed to test for a difference. Results The pooled prevalence of PAE as measured by meconium testing was 4.26 (95% CI: 1.34-13.57) times the pooled prevalence of PAE as measured by maternal self-reports. Large variations across the studies in regard to the difference between estimates obtained from maternal self-reports and those obtained from meconium testing were observed. Conclusions If maternal self-reports are the sole information source upon which health care professionals rely, a number of infants who were prenatally exposed to alcohol are not being recognized as such. However, further research is needed in order to validate existing biomarkers, as well as discover new biomarkers, for the detection of PAE. PMID:24708684

The Stigma Resistance Scale: A multi-sample validation of a new instrument to assess mental illness stigma resistance.

PubMed

Firmin, Ruth L; Lysaker, Paul H; McGrew, John H; Minor, Kyle S; Luther, Lauren; Salyers, Michelle P

2017-12-01

Although associated with key recovery outcomes, stigma resistance remains under-studied largely due to limitations of existing measures. This study developed and validated a new measure of stigma resistance. Preliminary items, derived from qualitative interviews of people with lived experience, were pilot tested online with people self-reporting a mental illness diagnosis (n = 489). Best performing items were selected, and the refined measure was administered to an independent sample of people with mental illness at two state mental health consumer recovery conferences (n = 202). Confirmatory factor analyses (CFA) guided by theory were used to test item fit, correlations between the refined stigma resistance measure and theoretically relevant measures were examined for validity, and test-retest correlations of a subsample were examined for stability. CFA demonstrated strong fit for a 5-factor model. The final 20-item measure demonstrated good internal consistency for each of the 5 subscales, adequate test-retest reliability at 3 weeks, and strong construct validity (i.e., positive associations with quality of life, recovery, and self-efficacy, and negative associations with overall symptoms, defeatist beliefs, and self-stigma). The new measure offers a more reliable and nuanced assessment of stigma resistance. It may afford greater personalization of interventions targeting stigma resistance. Copyright © 2017 Elsevier B.V. All rights reserved.

Quantifying alcohol consumption: Self-report, transdermal assessment, and prediction of dependence symptoms.

PubMed

Simons, Jeffrey S; Wills, Thomas A; Emery, Noah N; Marks, Russell M

2015-11-01

Research on alcohol use depends heavily on the validity of self-reported drinking. The present paper presents data from 647 days of self-monitoring with a transdermal alcohol sensor by 60 young adults. We utilized a biochemical measure, transdermal alcohol assessment with the WrisTAS, to examine the convergent validity of three approaches to collecting daily self-report drinking data: experience sampling, daily morning reports of the previous night, and 1-week timeline follow-back (TLFB) assessments. We tested associations between three pharmacokinetic indices (peak concentration, area under the curve (AUC), and time to reach peak concentration) derived from the transdermal alcohol signal and within- and between- person variation in alcohol dependence symptoms. The WrisTAS data corroborated 85.74% of self-reported drinking days based on the experience sampling data. The TLFB assessment and combined experience sampling and morning reports agreed on 87.27% of drinking days. Drinks per drinking day did not vary as a function of wearing or not wearing the sensor; this indicates that participants provided consistent reports of their drinking regardless of biochemical verification. In respect to self-reported alcohol dependence symptoms, the AUC of the WrisTAS alcohol signal was associated with dependence symptoms at both the within- and between- person level. Furthermore, alcohol dependence symptoms at baseline predicted drinking episodes characterized in biochemical data by both higher peak alcohol concentration and faster time to reach peak concentration. The results support the validity of self-report alcohol data, provide empirical data useful for optimal design of daily process sampling, and provide an initial demonstration of the use of transdermal alcohol assessment to characterize drinking dynamics associated with risk for alcohol dependence. Copyright © 2015 Elsevier Ltd. All rights reserved.

Quantifying alcohol consumption: Self-report, transdermal assessment, and prediction of dependence symptoms☆

PubMed Central

Simons, Jeffrey S.; Wills, Thomas A.; Emery, Noah N.; Marks, Russell M.

2015-01-01

Research on alcohol use depends heavily on the validity of self-reported drinking. The present paper presents data from 647 days of self-monitoring with a transdermal alcohol sensor by 60 young adults. We utilized a bio chemical measure, transdermal alcohol assessment with the WrisTAS, to examine the convergent validity of three approaches to collecting daily self-report drinking data: experience sampling, daily morning reports of the previous night, and 1-week timeline follow-back (TLFB) assessments. We tested associations between three pharmacokinetic indices (peak concentration, area under the curve (AUC), and time to reach peak concentration) derived from the transdermal alcohol signal and within- and between-person variation in alcohol dependence symptoms. The WrisTAS data corroborated 85.74% of self-reported drinking days based on the experience sampling data. The TLFB assessment and combined experience sampling and morning reports agreed on 87.27% of drinking days. Drinks per drinking day did not vary as a function of wearing or not wearing the sensor; this indicates that participants provided consistent reports of their drinking regardless of biochemical verification. In respect to self-reported alcohol dependence symptoms, the AUC of the WrisTAS alcohol signal was associated with dependence symptoms at both the within- and between-person level. Furthermore, alcohol dependence symptoms at baseline predicted drinking episodes characterized in biochemical data by both higher peak alcohol concentration and faster time to reach peak concentration. The results support the validity of self-report alcohol data, provide empirical data useful for optimal design of daily process sampling, and provide an initial demon stration of the use of transdermal alcohol assessment to characterize drinking dynamics associated with risk for alcohol dependence. PMID:26160523

Different measures of body weight as predictors of sickness absence.

PubMed

Korpela, Katri; Roos, Eira; Lallukka, Tea; Rahkonen, Ossi; Lahelma, Eero; Laaksonen, Mikko

2013-02-01

Excessive weight is associated with increased sickness absence from work due to obesity-linked health problems. However, it is not known which obesity measure best predicts sickness absence. First, we aimed to compare body mass index (BMI), waist circumference (WC), and waist-to-hip ratio (WHR) as predictors of sickness absence spells of various lengths. Second, we aimed to compare BMI based on self-reported and measured weight and height as a predictor of sickness absence to assess the validity of self-reported BMI. The participants were 5750 employees of the City of Helsinki, aged 40-60 years, who were followed up on average for 4.8 years using the employer's register. Sickness absence spells were classified as self-certified short (1-3 days), medically certified medium length (4-14 days), and long (>14 days) absence spells. All measures of body weight predicted sickness absence. The relative rates of long sickness absence in the highest quintile as compared to the lowest quintile varied in women from 1.62 (95% CI 1.35-1.94) to 1.89 (95% CI 1.62-2.23) and in men from 1.40 (95% CI 0.76-2.59) to 2.33 (95% CI 1.32-4.11). Differences in the predictive power of BMI and WC were small: both were more strongly associated with sickness absence than WHR. Self-reported BMI performed equally well as measured BMI. BMI - measured or self-reported - is a valid anthropometric indicator of body weight and predictor of obesity-associated health-risks. Its use is feasible for research purposes as well as for the assessment of weight-related risks to work ability.

Measuring Pre-Service Teachers' Self-Efficacy in Tutoring Children in Primary Mathematics: An Instrument

ERIC Educational Resources Information Center

Bjerke, Annette Hessen; Eriksen, Elisabeta

2016-01-01

This article reports on the use of Rasch modelling to develop and validate an instrument measuring self-efficacy in tutoring children in primary mathematics (SETcPM). In response to the literature on teacher efficacy, the 20-item instrument aims to inform teacher educators, and is designed for novice pre-service teachers (nPSTs) preparing to teach…

The HIV Medication Taking Self-Efficacy Scale: Psychometric Evaluation

PubMed Central

Erlen, Judith A.; Cha, EunSeok; Kim, Kevin H.; Caruthers, Donna; Sereika, Susan M.

2010-01-01

Aim This paper is a report of an examination of the psychometric properties of the HIV Medication Taking Self-efficacy Scale. Background Self-efficacy is a critically important component of strategies to improve HIV medication-taking; however, valid and reliable tools for assessing HIV medication-taking self-efficacy are limited. Method We used a cross-sectional, correlational design. Between 2003 and 2007, 326 participants were recruited from sites in Pennsylvania and Ohio in the United States of America. Six self-report questionnaires administered at baseline and 12 weeks later during “Improving Adherence to Antiretroviral Therapy” were used to examine the variables of interest. Means and variances, reliability, criterion, and construct validity of the HIV Medication Taking Self-efficacy Scale were assessed. Findings Participants reported high self-confidence in their ability to carry out specific medication-related tasks (mean=8.31) and in the medication’s ability to effect good outcomes (mean=8.56). The HIV Medication Taking Self-efficacy Scale and subscales showed excellent reliability (α = .93 ~ .94). Criterion validity was well-established by examining the relationships between the HIV Medication Taking Self-efficacy Scale and selected physiological and psychological factors, and self-reported medication adherence (r = −.20 ~ .58). A two-factor model with a correlation between self-efficacy belief and outcome expectancy fitted the data well (model χ2 = 3871.95, df = 325, p<001; CFA =.96; RMSEA =.046). Conclusion The HIV Medication Taking Self-efficacy Scale is a psychometrically sound measure of medication-taking self-efficacy for use by researchers and clinicians with people with HIV. The findings offer insight into the development of interventions to promote self-efficacy and medication adherence in persons with HIV. PMID:20722799

Standardizing patient-reported outcomes assessment in cancer clinical trials: a patient-reported outcomes measurement information system initiative.

PubMed

Garcia, Sofia F; Cella, David; Clauser, Steven B; Flynn, Kathryn E; Lad, Thomas; Lai, Jin-Shei; Reeve, Bryce B; Smith, Ashley Wilder; Stone, Arthur A; Weinfurt, Kevin

2007-11-10

Patient-reported outcomes (PROs), such as symptom scales or more broad-based health-related quality-of-life measures, play an important role in oncology clinical trials. They frequently are used to help evaluate cancer treatments, as well as for supportive and palliative oncology care. To be most beneficial, these PROs must be relevant to patients and clinicians, valid, and easily understood and interpreted. The Patient-Reported Outcomes Measurement Information System (PROMIS) Network, part of the National Institutes of Health Roadmap Initiative, aims to improve appreciably how PROs are selected and assessed in clinical research, including clinical trials. PROMIS is establishing a publicly available resource of standardized, accurate, and efficient PRO measures of major self-reported health domains (eg, pain, fatigue, emotional distress, physical function, social function) that are relevant across chronic illnesses including cancer. PROMIS is also developing measures of self-reported health domains specifically targeted to cancer, such as sleep/wake function, sexual function, cognitive function, and the psychosocial impacts of the illness experience (ie, stress response and coping; shifts in self-concept, social interactions, and spirituality). We outline the qualitative and quantitative methods by which PROMIS measures are being developed and adapted for use in clinical oncology research. At the core of this activity is the formation and application of item banks using item response theory modeling. We also present our work in the fatigue domain, including a short-form measure, as a sample of PROMIS methodology and work to date. Plans for future validation and application of PROMIS measures are discussed.

Self-Efficacy Beliefs amongst Parents of Young Children: Validation of a Self-Report Measure

ERIC Educational Resources Information Center

Meunier, Jean-Christophe; Roskam, Isabelle

2009-01-01

The self-efficacy belief (SEB) concept is discussed in the context of parenting. A questionnaire, the "Echelle Globale du Sentiment de Competence Parentale" (EGSCP), assessing several domain-specific SEBs and three related cognitive constructs, was developed with 705 French-speaking parents of 3- to 7-year-old children. The EGSCP displayed good…

International FItness Scale (IFIS): Construct Validity and Reliability in Women With Fibromyalgia: The al-Ándalus Project.

PubMed

Álvarez-Gallardo, Inmaculada C; Soriano-Maldonado, Alberto; Segura-Jiménez, Víctor; Carbonell-Baeza, Ana; Estévez-López, Fernando; McVeigh, Joseph G; Delgado-Fernández, Manuel; Ortega, Francisco B

2016-03-01

To examine the construct validity of the International FItness Scale (IFIS) (ie, self-reported fitness) against objectively measured physical fitness in women with fibromyalgia and in healthy women; and to study the test-retest reliability of the IFIS in women with fibromyalgia. Cross-sectional study. Fibromyalgia patient support groups. Women with fibromyalgia (n=413) and healthy women (controls) (n=195) for validity purposes and women with fibromyalgia (n=101) for the reliability study. The total sample was N=709. Not applicable. Fitness level was both self-reported (IFIS) and measured using performance-based fitness tests. For the reliability study the IFIS was completed on 2 occasions, 1 week apart. Women with fibromyalgia who reported average fitness had better measured fitness than those reporting very poor fitness (all P<.001, except 6-minute walk test where P<.05), with similar trends observed in healthy control women. The test-retest reliability of the IFIS, as measured by the average weighted κ, was .45. The IFIS was able to identify women with fibromyalgia who had very low fitness and distinguish them from those with higher fitness levels. Furthermore, the IFIS was moderately reliable in women with fibromyalgia. Copyright © 2016 American Congress of Rehabilitation Medicine. Published by Elsevier Inc. All rights reserved.

Self-reported confidence in recall as a predictor of validity and repeatability of physical activity questionnaire data.

PubMed

Cust, Anne E; Armstrong, Bruce K; Smith, Ben J; Chau, Josephine; van der Ploeg, Hidde P; Bauman, Adrian

2009-05-01

Self-reported confidence ratings have been used in other research disciplines as a tool to assess data quality, and may be useful in epidemiologic studies. We examined whether self-reported confidence in recall of physical activity was a predictor of the validity and retest reliability of physical activity measures from the European Prospective Investigation into Cancer and Nutrition (EPIC) past-year questionnaire and the International Physical Activity Questionnaire (IPAQ) last-7-day questionnaire.During 2005-2006 in Sydney, Australia, 97 men and 80 women completed both questionnaires at baseline and at 10 months and wore an accelerometer as an objective comparison measure for three 7-day periods during the same timeframe. Participants rated their confidence in recalling physical activity for each question using a 5-point scale and were dichotomized at the median confidence value. Participants in the high-confidence group had higher validity and repeatability coefficients than those in the low-confidence group for most comparisons. The differences were most apparent for validity of IPAQ moderate activity: Spearman correlation rho = 0.34 (95% confidence interval [CI] = 0.08 to 0.55) and 0.01 (-0.17 to 0.20) for high- and low-confidence groups, respectively; and repeatability of EPIC household activity: rho = 0.81 (0.72 to 0.87) and 0.63 (0.48 to 0.74), respectively, and IPAQ vigorous activity: rho = 0.58 (0.43 to 0.70) and 0.29 (0.07 to 0.49), respectively. Women were less likely than men to report high recall confidence of past-year activity (adjusted odds ratio = 0.38; 0.18 to 0.80). Confidence ratings could be useful as indicators of recall accuracy (ie, validity and repeatability) of physical activity measures, and possibly for detecting differential measurement error and identifying questionnaire items that require improvement.

What are validated self-report adherence scales really measuring?: a systematic review

PubMed Central

Nguyen, Thi-My-Uyen; Caze, Adam La; Cottrell, Neil

2014-01-01

Aims Medication non-adherence is a significant health problem. There are numerous methods for measuring adherence, but no single method performs well on all criteria. The purpose of this systematic review is to (i) identify self-report medication adherence scales that have been correlated with comparison measures of medication-taking behaviour, (ii) assess how these scales measure adherence and (iii) explore how these adherence scales have been validated. Methods Cinahl and PubMed databases were used to search articles written in English on the development or validation of medication adherence scales dating to August 2012. The search terms used were medication adherence, medication non-adherence, medication compliance and names of each scale. Data such as barriers identified and validation comparison measures were extracted and compared. Results Sixty articles were included in the review, which consisted of 43 adherence scales. Adherence scales include items that either elicit information regarding the patient's medication-taking behaviour and/or attempts to identify barriers to good medication-taking behaviour or beliefs associated with adherence. The validation strategies employed depended on whether the focus of the scale was to measure medication-taking behaviour or identify barriers or beliefs. Conclusions Supporting patients to be adherent requires information on their medication-taking behaviour, barriers to adherence and beliefs about medicines. Adherence scales have the potential to explore these aspects of adherence, but currently there has been a greater focus on measuring medication-taking behaviour. Selecting the ‘right’ adherence scale(s) requires consideration of what needs to be measured and how (and in whom) the scale has been validated. PMID:23803249

Attitudes toward Anger Management Scale: Development and Initial Validation

ERIC Educational Resources Information Center

Boudreaux, David J.; Dahlen, Eric R.; Madson, Michael B.; Bullock-Yowell, Emily

2014-01-01

This article describes the development and preliminary validation of the Attitudes Toward Anger Management Scale (ATAMS), a self-report measure of attitudes toward anger management services. Undergraduate volunteers ("N" = 415) completed an initial version of the instrument. Principal components analysis yielded a two-factor solution.…

Comparison of self-report and objective measures of driving behavior and road safety: A systematic review.

PubMed

Kaye, Sherrie-Anne; Lewis, Ioni; Freeman, James

2018-06-01

This research systematically reviewed the existing literature in regards to studies which have used both self-report and objective measures of driving behavior. The objective of the current review was to evaluate disparities or similarities between self-report and objective measures of driving behavior. Searches were undertaken in the following electronic databases, PsycINFO, PubMed, and Scopus, for peer-reviewed full-text articles that (1) focused on road safety, and (2) compared both subjective and objective measures of driving performance or driver safety. A total of 22,728 articles were identified, with 19 articles, comprising 20 studies, included as part of the review. The research reported herein suggested that for some behaviors (e.g., driving in stressful situations) there were similarities between self-report and objective measures while for other behaviors (e.g., sleepiness and vigilance states) there were differences between these measurement techniques. In addition, findings from some studies suggested that in-vehicle devices may be a valid measurement tool to assess driving exposure in older drivers. Further research is needed to examine the correspondence between self-report and objective measures of driving behavior. In particular, there is a need to increase the number of studies which compare "like with like" as it is difficult to draw comparisons when there are variations in measurement tools used. Incorporating a range of objective and self-report measurements tools in research would help to ensure that the methods used offer the most reliable measures of assessing on-road behaviors. Crown Copyright © 2018. Published by Elsevier Ltd. All rights reserved.

A Scoping Review of Self-Report Measures of Aggression and Bullying for Use With Preadolescent Children.

PubMed

Nelson, Helen J; Kendall, Garth E; Burns, Sharyn K; Schonert-Reichl, Kimberly A

2017-02-01

Bullying in schools is a major health concern throughout the world, contributing to poor educational and mental health outcomes. School nurses are well placed to facilitate the implementation and evaluation of bullying prevention strategies. To evaluate the effect of such strategies, it is necessary to measure children's behavior over time. This scoping review of instruments that measure the self-report of aggressive behavior and bullying by children will inform the evaluation of bullying interventions. This review aimed to identify validated instruments that measure aggression and bullying among preadolescent children (age 8-12). The review was part of a larger study that sought to differentiate bullying from aggressive behavior by measuring the self-report of power imbalance between the aggressor and the child being bullied. The measurement of power imbalance was therefore a key aspect of the scoping review.

Adaptation and evaluation of the measurement properties of the Brazilian version of the Self-efficacy for Appropriate Medication Adherence Scale1

PubMed Central

Pedrosa, Rafaela Batista dos Santos; Rodrigues, Roberta Cunha Matheus

2016-01-01

Objectives: to undertake the cultural adaptation of, and to evaluate the measurement properties of, the Brazilian version of the Self-efficacy for Appropriate Medication Adherence Scale in coronary heart disease (CHD) patients, with outpatient monitoring at a teaching hospital. Method: the process of cultural adaptation was undertaken in accordance with the international literature. The data were obtained from 147 CHD patients, through the application of the sociodemographic/clinical characterization instrument, and of the Brazilian versions of the Morisky Self-Reported Measure of Medication Adherence Scale, the General Perceived Self-Efficacy Scale, and the Self-efficacy for Appropriate Medication Adherence Scale. Results: the Brazilian version of the Self-efficacy for Appropriate Medication Adherence Scale presented evidence of semantic-idiomatic, conceptual and cultural equivalencies, with high acceptability and practicality. The floor effect was evidenced for the total score and for the domains of the scale studied. The findings evidenced the measure's reliability. The domains of the Brazilian version of the Self-efficacy for Appropriate Medication Adherence Scale presented significant inverse correlations of moderate to strong magnitude between the scores of the Morisky scale, indicating convergent validity, although correlations with the measure of general self-efficacy were not evidenced. The validity of known groups was supported, as the scale discriminated between "adherents" and "non-adherents" to the medications, as well as to "sufficient dose" and "insufficient dose". Conclusion: the Brazilian version of the Self-efficacy for Appropriate Medication Adherence Scale presented evidence of reliability and validity in coronary heart disease outpatients. PMID:27192417

Validity evidence for the situational judgment test paradigm in emotional intelligence measurement.

PubMed

Libbrecht, Nele; Lievens, Filip

2012-01-01

To date, various measurement approaches have been proposed to assess emotional intelligence (EI). Recently, two new EI tests have been developed based on the situational judgment test (SJT) paradigm: the Situational Test of Emotional Understanding (STEU) and the Situational Test of Emotion Management (STEM). Initial attempts have been made to examine the construct-related validity of these new tests; we extend these findings by placing the tests in a broad nomological network. To this end, 850 undergraduate students completed a personality inventory, a cognitive ability test, a self-report EI test, a performance-based EI measure, the STEU, and the STEM. The SJT-based EI tests were not strongly correlated with personality and fluid cognitive ability. Regarding their relation with existing EI measures, the tests did not capture the same construct as self-report EI measures, but corresponded rather to performance-based EI measures. Overall, these results lend support for the SJT paradigm for measuring EI as an ability.

Interrelating Behavioral Measures of Distress Tolerance with Self-Reported Experiential Avoidance.

PubMed

Schloss, Heather M; Haaga, David A F

2011-03-01

Experiential avoidance and distress intolerance play a central role in novel behavior therapies, yet they appear to overlap considerably the REBT concept of low frustration tolerance. Using baseline data from 100 adult cigarette smokers enrolled in a clinical trial of smoking cessation therapies, the present study evaluated the convergent validity of common questionnaire measures of experiential avoidance (Acceptance and Action Questionnaire; AAQ; Hayes et al. 2004, and Avoidance and Inflexibility Scale: AIS; Gifford et al. 2004) and behavioral measures of distress tolerance (computerized Mirror Tracing Persistence Task: MTPT-C: Strong et al. 2003; computerized Paced Auditory Serial Addition Task; PASAT-C; Lejuez et al. 2003). The distress tolerance measures correlated significantly (r = .29) with one another. However, the questionnaire measures of experiential avoidance did not correlate with each other, nor with the behavioral measures. Further research is needed on the validity of measuring experiential avoidance by self-report and of the overlap versus distinctiveness of seemingly similar constructs such as experiential avoidance, distress tolerance, and frustration tolerance.

Interrelating Behavioral Measures of Distress Tolerance with Self-Reported Experiential Avoidance

PubMed Central

Schloss, Heather M.

2011-01-01

Experiential avoidance and distress intolerance play a central role in novel behavior therapies, yet they appear to overlap considerably the REBT concept of low frustration tolerance. Using baseline data from 100 adult cigarette smokers enrolled in a clinical trial of smoking cessation therapies, the present study evaluated the convergent validity of common questionnaire measures of experiential avoidance (Acceptance and Action Questionnaire; AAQ; Hayes et al. 2004, and Avoidance and Inflexibility Scale: AIS; Gifford et al. 2004) and behavioral measures of distress tolerance (computerized Mirror Tracing Persistence Task: MTPT-C: Strong et al. 2003; computerized Paced Auditory Serial Addition Task; PASAT-C; Lejuez et al. 2003). The distress tolerance measures correlated significantly (r = .29) with one another. However, the questionnaire measures of experiential avoidance did not correlate with each other, nor with the behavioral measures. Further research is needed on the validity of measuring experiential avoidance by self-report and of the overlap versus distinctiveness of seemingly similar constructs such as experiential avoidance, distress tolerance, and frustration tolerance. PMID:21448252

Construction and validation of the fatigue impact and severity self-assessment for youth and young adults with cerebral palsy.

PubMed

Brunton, Laura K; Bartlett, Doreen J

2017-07-01

The Fatigue Impact and Severity Self-Assessment (FISSA) was created to assess the impact, severity, and self-management of fatigue for individuals with cerebral palsy (CP) aged 14-31 years. Items were generated from a review of measures and interviews with individuals with CP. Focus groups with health-care professionals were used for item reduction. A mailed survey was conducted (n=163/367) to assess the factor structure, known-groups validity, and test-retest reliability. The final measure contained 31 items in two factors and discriminated between individuals expected to have different levels of fatigue. Individuals with more functional abilities reported less fatigue (p < 0.002) and those with higher pain reported higher fatigue (p < 0.001). The FISSA was shown to have adequate test-retest reliability, intraclass correlation coefficient (ICC)(3,1)=0.74 (95% confidence interval [CI] 0.53-0.87). The FISSA valid and reliable for individuals with CP. It allows for identification of the activities that may be compromised by fatigue to enhance collaborative goal setting and intervention planning.

Validation of social self-esteem and an experimental index of delinquent behavior.

PubMed

Berman, S M

1976-12-01

30 male adolescents were administered a checklist of their delinquent behavior and the measure of social self-esteem designed by Ziller, Hagey, Smith, and Long (1969). A Pearson correlation of --.26 was found between self-esteem and scores on the delinquent behavior checklist. At a later session 18 of the subjects were assigned a puzzle-solving task which served as a measure of cheating. A significant relation between cheating scores and self-reported delinquent behavior indicated that the puzzle-solving task may be useful for measuring level of delinquency in an experimental setting.

Mother reports of maternal support following child sexual abuse: Preliminary psychometric data on the Maternal Self-report Support Questionnaire (MSSQ).

PubMed

Smith, Daniel W; Sawyer, Genelle K; Jones, Lisa M; Cross, Theodore; McCart, Michael R; Ralston, M Elizabeth

2010-10-01

Maternal support is an important factor in predicting outcomes following disclosure of child sexual abuse; however, definition of the construct has been unclear and existing measures of maternal support are utilized inconsistently and have limited psychometric data. The purpose of this study was to develop a reliable and valid mother-report measure for assessing maternal support following the disclosure of child sexual abuse. Data from 2 very similar samples of mother-child pairs seeking forensic evaluation following the discovery of child sexual abuse were combined, resulting in a final sample of 246. Exploratory factor analysis resulted in two reliable 7-item factors labeled "Emotional Support" and "Blame/Doubt," each of which had acceptable internal consistency. Analyses with a child-report measure of general maternal support the construct validity of the MSSQ. Concurrent validity analyses revealed unique relations with maternal ratings of child behavior problems and case characteristic data. The study resulted in the development of a brief, easily scored self-report measure of maternal support with reasonable preliminary psychometric properties that could easily be utilized in other studies of sexually abused children. Adoption of this promising measure in future research will reduce the lack of cross-study measurement comparability that has characterized the maternal support literature to date, increase the feasibility of expanding upon current literature on maternal support, and may produce important information leading to clinical and theoretical innovation. Copyright © 2010. Published by Elsevier Ltd.

Deviation between self-reported and measured occupational physical activity levels in office employees: effects of age and body composition.

PubMed

Wick, Katharina; Faude, Oliver; Schwager, Susanne; Zahner, Lukas; Donath, Lars

2016-05-01

Whether occupational physical activity (PA) will be assessed via questionnaires or accelerometry depends on available resources. Although self-reported data collection seems feasible and inexpensive, obtained information could be biased by demographic determinants. Thus, we aimed at comparing self-reported and objectively measured occupational sitting, standing, and walking times adjusted for socio-demographic variables. Thirty-eight office employees (eight males, 30 females, age 40.8 ± 11.4 years, BMI 23.9 ± 4.2 kg/m(2)) supplied with height-adjustable working desks were asked to report sitting, standing, and walking times using the Occupational Sitting and Physical Activity Questionnaire during one working week. The ActiGraph wGT3X-BT was used to objectively measure occupational PA during the same week. Subjectively and objectively measured data were compared computing the intra-class correlation coefficients, paired t tests and Bland-Altman plots. Furthermore, repeated-measurement ANOVAs for measurement (subjective vs. objective) and socio-demographic variables were calculated. Self-reported data yielded a significant underestimation of standing time (13.3 vs. 17.9%) and an overestimation of walking time (12.7 vs. 5.0%). Significant interaction effects of age and measurement of standing time (F = 6.0, p = .02, ηp(2) = .14) and BMI group and measurement of walking time were found (F = 3.7, p = .04, ηp(2) = .17). Older employees (>39 years) underestimated their standing time, while underweight workers (BMI < 20 kg/m(2)) overestimated their walking time. Self-reported PA data differ from objective data. Demographic variables (age, BMI) affect the amount of self-reported misjudging of PA. In order to improve the validity of self-reported data, a correction formula for the economic assessment of PA by subjective measures is needed, considering age and BMI.

The validity of self-reported cancer screening history and the role of social disadvantage in Ontario, Canada.

PubMed

Lofters, Aisha; Vahabi, Mandana; Glazier, Richard H

2015-01-29

Self-report may not be an accurate method of determining cervical, breast and colorectal cancer screening rates due to recall, acquiescence and social desirability biases, particularly for certain sociodemographic groups. Therefore, the aims of this study were to determine the validity of self-report of cancer screening in Ontario, Canada, both for people in the general population and for socially disadvantaged groups based on immigrant status, ethnicity, education, income, language ability, self-rated health, employment status, age category (for cervical cancer screening), and gender (for fecal occult blood testing). We linked multiple data sources for this study, including the Canadian Community Health Survey and provincial-level health databases. Using administrative data as our gold standard, we calculated validity measures for self-report (i.e. sensitivity, specificity, positive and negative likelihood ratios, positive and negative predictive values), calculated report-to-record ratios, and conducted a multivariable regression analysis to determine which characteristics were independently associated with over-reporting of screening. Specificity was less than 70% overall and for all subgroups for cervical and breast cancer screening, and sensitivity was lower than 80% overall and for all subgroups for fecal occult blood testing FOBT. Report-to-record ratios were persistently significantly greater than 1 across all cancer screening types, highest for the FOBT group: 1.246 [1.189-1.306]. Regression analyses showed no consistent patterns, but sociodemographic characteristics were associated with over-reporting for each screening type. We have found that in Ontario, as in other jurisdictions, there is a pervasive tendency for people to over-report their cancer screening histories. Sociodemographic status also appears to influence over-reporting. Public health practitioners and policymakers need to be aware of the limitations of self-report and adjust their methods and interpretations accordingly.

Development and validation of self-reported line drawings for assessment of knee malalignment and foot rotation: a cross-sectional comparative study

PubMed Central

2010-01-01

Background For large scale epidemiological studies clinical assessments and radiographs can be impractical and expensive to apply to more than just a sample of the population examined. The study objectives were to develop and validate two novel instruments for self-reported knee malalignment and foot rotation suitable for use in questionnaire studies of knee pain and osteoarthritis. Methods Two sets of line drawings were developed using similar methodology. Each instrument consisted of an explanatory question followed by a set of drawings showing straight alignment, then two each at 7.5° angulation and 15° angulation in the varus/valgus (knee) and inward/outward (foot) directions. Forty one participants undertaking a community study completed the instruments on two occasions. Participants were assessed once by a blinded expert clinical observer with demonstrated excellent reproducibility. Validity was assessed by sensitivity, specificity and likelihood ratio (LR) using the observer as the reference standard. Reliability was assessed using weighted kappa (κ). Knee malalignment was measured on 400 knee radiographs. General linear model was used to assess for the presence of a linear increase in knee alignment angle (measured medially) from self-reported severe varus to mild varus, straight, mild valgus and severe valgus deformity. Results Observer reproducibility (κ) was 0.89 and 0.81 for the knee malalignment and foot rotation instruments respectively. Self-reported participant reproducibility was also good for the knee (κ 0.73) and foot (κ 0.87) instruments. Validity was excellent for the knee malalignment instrument, with a sensitivity of 0.74 (95%CI 0.54, 0.93) and specificity of 0.97 (95%CI 0.94, 1.00). Similarly the foot rotation instrument was also found to have high sensitivity (0.92, 95%CI 0.83, 1.01) and specificity (0.96, 95%CI 0.93, 1.00). The knee alignment angle increased progressively from self reported severe varus to mild varus, straight, mild valgus and severe valgus knee malalignment (ptrend <0.001). Conclusions The two novel instruments appear to provide a valid and reliable assessment of self-reported knee malalignment and foot rotation, and may have a practical use in epidemiological studies. PMID:20565825

Testing reliability and validity of oral impacts on daily performances for Chinese-speaking elderly Singaporeans.

PubMed

Nair, Rahul; Tsakos, Georgios; Yee Ting Fai, Robert

2016-12-01

To cross-culturally adapt the oral impacts on daily performance (OIDP) and assess its reliability and validity on Chinese-speaking community dwelling elderly Singaporeans. There are no previous reports of valid oral health-related quality of life instruments for elderly Singaporeans or perceived conditions associated with impacts reported in OIDP among the Singaporean elders. The OIDP was translated from English to Chinese and then back translated. The OIDP questionnaire along with questions related to overall quality of life and self-rated dental health was administered to 202 Chinese-speaking elderly Singaporeans by trained interviewers, and it was repeated after 1 month. Test-retest reliability was assessed using intraclass correlation coefficient; internal consistency was established using Cronbach's alpha, and construct validity using correlation coefficients with self-reported oral health-related and global quality of life measures. In addition, Kruskal-Wallis tests assessed differences in the OIDP score between different subjective health and global quality of life groups. The median age of participants was 75 years. About 19% reported oral impacts and difficulty eating was the most prevalent oral impact. Internal consistency was good with a Cronbach's alpha of 0.75, and the intraclass correlation coefficient was 0.75 (0.67-0.81). OIDP was significantly correlated with all measures of self-reported oral health and global ratings of quality of life, with correlation coefficients ranging between 0.15 and 0.52. Groups with worse perceptions about their health and quality of life had significantly higher OIDP scores. The OIDP showed successful reliability and validity for its use among Chinese-speaking older Singaporeans. © 2015 John Wiley & Sons A/S and The Gerodontology Association. Published by John Wiley & Sons Ltd.

Validity of self-assessment in a quality improvement collaborative in Ecuador.

PubMed

Hermida, Jorge; Broughton, Edward I; Miller Franco, Lynne

2011-12-01

Health care quality improvement (QI) efforts commonly use self-assessment to measure compliance with quality standards. This study investigates the validity of self-assessment of quality indicators. Cross sectional. A maternal and newborn care improvement collaborative intervention conducted in health facilities in Ecuador in 2005. Four external evaluators were trained in abstracting medical records to calculate six indicators reflecting compliance with treatment standards. About 30 medical records per month were examined at 12 participating health facilities for a total of 1875 records. The same records had already been reviewed by QI teams at these facilities (self-assessment). Overall compliance, agreement (using the Kappa statistic), sensitivity and specificity were analyzed. We also examined patterns of disagreement and the effect of facility characteristics on levels of agreement. External evaluators reported compliance of 69-90%, while self-assessors reported 71-92%, with raw agreement of 71-95% and Kappa statistics ranging from fair to almost perfect agreement. Considering external evaluators as the gold standard, sensitivity of self-assessment ranged from 90 to 99% and specificity from 48 to 86%. Simpler indicators had fewer disagreements. When disagreements occurred between self-assessment and external valuators, the former tended to report more positive findings in five of six indicators, but this tendency was not of a magnitude to change program actions. Team leadership, understanding of the tools and facility size had no overall impact on the level of agreement. When compared with external evaluation (gold standard), self-assessment was found to be sufficiently valid for tracking QI team performance. Sensitivity was generally higher than specificity. Simplifying indicators may improve validity.

Development and initial validation of a brief self-report measure of cognitive dysfunction in fibromyalgia.

PubMed

Kratz, Anna L; Schilling, Stephen G; Goesling, Jenna; Williams, David A

2015-06-01

Pain is often the focus of research and clinical care in fibromyalgia (FM); however, cognitive dysfunction is also a common, distressing, and disabling symptom in FM. Current efforts to address this problem are limited by the lack of a comprehensive, valid measure of subjective cognitive dysfunction in FM that is easily interpretable, accessible, and brief. The purpose of this study was to leverage cognitive functioning item banks that were developed as part of the Patient Reported Outcomes Measurement Information System (PROMIS) to devise a 10-item short form measure of cognitive functioning for use in FM. In study 1, a nationwide (U.S.) sample of 1,035 adults with FM (age range = 18-82, 95.2% female) completed 2 cognitive item pools. Factor analyses and item response theory analyses were used to identify dimensionality and optimally performing items. A recommended 10-item measure, called the Multidimensional Inventory of Subjective Cognitive Impairment (MISCI) was created. In study 2, 232 adults with FM completed the MISCI and a legacy measure of cognitive functioning that is used in FM clinical trials, the Multiple Ability Self-Report Questionnaire (MASQ). The MISCI showed excellent internal reliability, low ceiling/floor effects, and good convergent validity with the MASQ (r = -.82). This paper presents the MISCI, a 10-item measure of cognitive dysfunction in FM, developed through classical test theory and item response theory. This brief but comprehensive measure shows evidence of excellent construct validity through large correlations with a lengthy legacy measure of cognitive functioning. Copyright © 2015 American Pain Society. Published by Elsevier Inc. All rights reserved.

Anthrax vaccination in the Millennium Cohort: validation and measures of health.

PubMed

Smith, Besa; Leard, Cynthia A; Smith, Tyler C; Reed, Robert J; Ryan, Margaret A K

2007-04-01

In 1998, the United States Department of Defense initiated the Anthrax Vaccine Immunization Program. Concerns about vaccine-related adverse health effects followed, prompting several studies. Although some studies used self-reported vaccination data, the reliability of such data has not been established. The purpose of this study was to compare self-reported anthrax vaccination to electronic vaccine records among a large military cohort and to evaluate the relationship between vaccine history and health outcome data. Between September 2005 and February 2006 self-reported anthrax vaccination was compared to electronic records for 67,018 participants enrolled in the Millennium Cohort Study between 2001 and 2003 using kappa statistics. Multivariable modeling investigated vaccination concordance as it pertains to subjective health (functional status) and objective health (hospitalization) metrics. Greater than substantial agreement (kappa=0.80) was found between self-report and electronic recording of anthrax vaccination. Of all participants with electronic documentation of anthrax vaccination, 98% self-reported being vaccinated; and of all participants with no electronic record of vaccination, 90% self-reported not receiving a vaccination. There were no differences between vaccinated and unvaccinated participants in overall measures of health. Only the subset of participants who self-reported anthrax vaccination, but had no electronic confirmation, differed from others in the cohort, with consistently lower measures of health as indicated by Medical Outcomes Study 36-Item Short Form Health Survey for Veterans (SF-36V) scores. These results indicate that military members accurately recall their anthrax vaccinations. Results also suggest that anthrax vaccination among Millennium Cohort participants is not associated with self-reported health problems or broad measures of health problems severe enough to require hospitalization. Service members who self-report vaccination with no electronic documentation of vaccination, however, report lower measures of physical and mental health and deserve further research.

Initial evidence for the validity of the California Bullying Victimization Scale (CBVS-R) as a retrospective measure for adults.

PubMed

Green, Jennifer Greif; Oblath, Rachel; Felix, Erika D; Furlong, Michael J; Holt, Melissa K; Sharkey, Jill D

2018-06-07

Childhood bullying is an important predictor of psychological and health outcomes in adulthood; however, validated retrospective measures of childhood bullying are lacking. This study investigates the psychometric properties of an adult retrospective version of the California Bullying Victimization Scale (CBVS). The CBVS self-report measure was developed for use with children and adolescents to assess the three definitional characteristics of bullying (aggression that is chronic, intentional, and involves an imbalance of power), without using the term "bullying." In the current study, we evaluate patterns of retrospective reports of bullying victimization, and compare results to a common definition-first measure of bullying. Concurrent validity and 4-year stability are addressed. In the fall of 2012, entering first-year students at 4 universities in the United States (N = 1,209; 65.2% female) completed the California Bullying Victimization Scale-Retrospective (CBVS-R) as part of an online survey. In spring of 2016, participants at 2 universities who provided contact information (N = 175) completed a 4-year follow-up survey. Results support the validity of the CBVS-R as a retrospective self-report measure of bullying victimization experienced in childhood. In particular, the percent of respondents classified as being bullied (27.9%) and age- and gender-related patterns of victimization were consistent with known patterns of childhood bullying. In addition, respondents reporting childhood victimization indicated increased psychological distress in adulthood. However, stability of reports across a 4-year follow-up period were lower than expected (κ = .38). Implications for the use of retrospective reports of childhood bullying victimization are discussed. (PsycINFO Database Record (c) 2018 APA, all rights reserved).

Development of a self-report questionnaire designed for population-based surveillance of gingivitis in adolescents: assessment of content validity and reliability.

PubMed

Quiroz, Viviana; Reinero, Daniela; Hernández, Patricia; Contreras, Johanna; Vernal, Rolando; Carvajal, Paola

2017-01-01

This study aimed to develop and assess the content validity and reliability of a cognitively adapted self-report questionnaire designed for surveillance of gingivitis in adolescents. Ten predetermined self-report questions evaluating early signs and symptoms of gingivitis were preliminary assessed by a panel of clinical experts. Eight questions were selected and cognitively tested in 20 adolescents aged 12 to 18 years from Santiago de Chile. The questionnaire was then conducted and answered by 178 Chilean adolescents. Internal consistency was measured using the Cronbach's alpha and temporal stability was calculated using the Kappa-index. A reliable final self-report questionnaire consisting of 5 questions was obtained, with a total Cronbach's alpha of 0.73 and a Kappa-index ranging from 0.41 to 0.77 between the different questions. The proposed questionnaire is reliable, with an acceptable internal consistency and a temporal stability from moderate to substantial, and it is promising for estimating the prevalence of gingivitis in adolescents.

Conceptual and measurement issues in early parenting practices research: an epidemiologic perspective.

PubMed

Walker, Lorraine O; Kirby, Russell S

2010-11-01

Early parenting practices are significant to public health because of their linkages to child health outcomes. This paper focuses on the current state of the science regarding conceptual frameworks that incorporate early parenting practices in epidemiologic research and evidence supporting reliability and validity of self-report measures of such practices. Guided by a provisional definition of early parenting practices, literature searches were conducted using PubMed and Sociological Abstracts. Twenty-five published studies that included parent-report measures of early parenting practices met inclusion criteria. Findings on conceptual frameworks were analyzed qualitatively, whereas evidence of reliability and validity were organized into four domains (safety, feeding and oral health, development promotion, and discipline) and summarized in tabular form. Quantitative estimates of measures of reliability and validity were extracted, where available. We found two frameworks incorporating early parenting: one a program theory and the other a predictive model. We found no reported evidence of the reliability or validity of parent-report measures of safety or feeding and oral health practices. Evidence for reliability and validity were reported with greater frequency for development promotion and discipline practices, but report of the most pertinent type of reliability estimation, test-retest reliability, was rare. Failure to examine associations of early parenting practices with any child outcomes within most studies resulted in missed opportunities to indirectly estimate validity of parenting practice measures. Stronger evidence concerning specific measurement properties of early parenting practices is important to advancing maternal-child research, surveillance, and practice.

Self-Reported Sitting Time in New York City Adults, The Physical Activity and Transit Survey, 2010–2011

PubMed Central

Bartley, Katherine F.; Firestone, Melanie J.; Lee, Karen K.; Eisenhower, Donna L.

2015-01-01

Introduction Recent studies have demonstrated the negative health consequences associated with extended sitting time, including metabolic disturbances and decreased life expectancy. The objectives of this study were to characterize sitting time in an urban adult population and assess the validity of a 2-question method of self-reported sitting time. Methods The New York City Health Department conducted the 2010–2011 Physical Activity and Transit Survey (N = 3,597); a subset of participants wore accelerometers for 1 week (n = 667). Self-reported sitting time was assessed from 2 questions on time spent sitting (daytime and evening hours). Sedentary time was defined as accelerometer minutes with less than 100 counts on valid days. Descriptive statistics were used to estimate the prevalence of sitting time by demographic characteristics. Validity of sitting time with accelerometer-measured sedentary time was assessed using Spearman’s correlation and Bland-Altman techniques. All data were weighted to be representative of the New York City adult population based on the 2006–2008 American Community Survey. Results Mean daily self-reported sitting time was 423 minutes; mean accelerometer-measured sedentary time was 490 minutes per day (r = 0.32, P < .001). The mean difference was 49 minutes per day (limits of agreement: −441 to 343). Sitting time was higher in respondents at lower poverty and higher education levels and lower in Hispanics and people who were foreign-born. Conclusion Participants of higher socioeconomic status, who are not typically the focus of health disparities–related research, had the highest sitting times; Hispanics had the lowest levels. Sitting time may be accurately assessed by self-report with the 2-question method for population surveillance but may be limited in accurately characterizing individual-level behavior. PMID:26020549

Self-reported sitting time in New York City adults, the Physical Activity and Transit Survey, 2010-2011.

PubMed

Yi, Stella S; Bartley, Katherine F; Firestone, Melanie J; Lee, Karen K; Eisenhower, Donna L

2015-05-28

Recent studies have demonstrated the negative health consequences associated with extended sitting time, including metabolic disturbances and decreased life expectancy. The objectives of this study were to characterize sitting time in an urban adult population and assess the validity of a 2-question method of self-reported sitting time. The New York City Health Department conducted the 2010-2011 Physical Activity and Transit Survey (N = 3,597); a subset of participants wore accelerometers for 1 week (n = 667). Self-reported sitting time was assessed from 2 questions on time spent sitting (daytime and evening hours). Sedentary time was defined as accelerometer minutes with less than 100 counts on valid days. Descriptive statistics were used to estimate the prevalence of sitting time by demographic characteristics. Validity of sitting time with accelerometer-measured sedentary time was assessed using Spearman's correlation and Bland-Altman techniques. All data were weighted to be representative of the New York City adult population based on the 2006-2008 American Community Survey. Mean daily self-reported sitting time was 423 minutes; mean accelerometer-measured sedentary time was 490 minutes per day (r = 0.32, P < .001). The mean difference was 49 minutes per day (limits of agreement: -441 to 343). Sitting time was higher in respondents at lower poverty and higher education levels and lower in Hispanics and people who were foreign-born. Participants of higher socioeconomic status, who are not typically the focus of health disparities-related research, had the highest sitting times; Hispanics had the lowest levels. Sitting time may be accurately assessed by self-report with the 2-question method for population surveillance but may be limited in accurately characterizing individual-level behavior.

Reliability, validity and responsiveness of the German self-reported foot and ankle score (SEFAS) in patients with foot or ankle surgery.

PubMed

Arbab, Dariusch; Kuhlmann, Katharina; Schnurr, Christoph; Bouillon, Bertil; Lüring, Christian; König, Dietmar

2017-10-10

Patient-reported outcome measures are a critical tool in evaluating the efficacy of orthopedic procedures and are increasingly used in clinical trials to assess outcomes of health care. The intention of this study was to develop and culturally adapt a German version of the Self-reported Foot and Ankle Score (SEFAS) and to evaluate reliability, validity and responsiveness. According to Cross Cultural Adaptation of Self-Reported Measure guidelines forward and backward translation has been performed. The German SEFAS was investigated in 177 consecutive patients. 177 Patients completed the German SEFAS, Foot and Ankle Outcome Score (FAOS), Short-Form 36 and numeric scales for pain and disability (NRS) before and 118 patients 6 months after foot or ankle surgery. Test-Retest reliability, internal consistency, floor and ceiling effects, construct validity and minimal important change were analyzed. The German SEFAS demonstrated excellent test-retest reliability with ICC values of 0.97. Cronbach's alpha (α) value of 0.89 demonstrated strong internal consistency. No floor or ceiling effects were observed for the German version of the SEFAS. As hypothesized SEFAS correlated strongly with FAOS and SF-36 domains. It showed moderate (ES/SRM > 0.5) responsiveness between preoperative assessment and postoperative follow-up. The German version of the SEFAS demonstrated good psychometric properties. It proofed to be a valid and reliable instrument for use in foot and ankle patients. DRKS00007585.

Self-regulated learning and self-directed study in a pre-college sample

PubMed Central

Abar, Beau; Loken, Eric

2009-01-01

Self-regulated learning (SRL) is a multi-dimensional construct that has been difficult to operationalize using traditional, variable-centered methodologies. The current paper takes a person-centered approach to the study of SRL in a sample of 205 high-school students. Using latent profile analysis on self-reports of seven aspects of SRL, three groups were identified: high SRL, low SRL, and average SRL. Student self-reports of goal orientation were used as validation for the profile solution, with the high academic self- regulation group reporting the highest levels of mastery orientation while the low self-regulation group reported highest levels of avoidant orientation. Profiles were also compared on independently collected, behavioral measures of study behaviors, with the highly self-regulated group tending to study more material and for a longer time than less self-regulated individuals. PMID:20161484

Initial validation of a numeric zero to ten scale to measure children's state anxiety.

PubMed

Crandall, Margie; Lammers, Cathy; Senders, Craig; Savedra, Marilyn; Braun, Jerome V

2007-11-01

Although children experience physical and behavioral consequences from anxiety in many health care settings, anxiety assessment and subsequent management is not often performed because of the lack of clinically useful subjective scales. Current state anxiety scales are either observational or multidimensional self-report measures requiring significant clinician and patient time. Because anxiety is subjective, in this pilot study, we evaluated the validity of a self-report numeric 0-10 anxiety scale that is easy to administer to children in the clinical setting. A descriptive correlation research design was used to determine the concurrent validity for a numeric 0-10 anxiety scale with the state portion of the State-Trait Anxiety Inventory for Children (STAIC). During clinic preoperative visits, 60 children, 7-13 yr, provided anxiety scores for the 0-10 scale and the STAIC pre- and posteducation. Simple linear regression and Pearson correlation were performed to determine the strength of the relationship. STAIC was associated with the anxiety scale both preeducation (beta = 1.20, SE[beta] = 0.34, F[1,58] = 12.74, P = 0.0007) and posteducation (beta = 1.97, SE[beta]) = 0.31, F[1,58] = 40.11, P < 0.0001). Correlations were moderate for pre-education (r = 0.424) and posteducation (r = 0.639). This initial study supports the validity of the numeric 0-10 anxiety self-report scale to assess state anxiety in children as young as 7 yr.

Assessment of Differential Item Functioning in the Experiences of Discrimination Index

PubMed Central

Cunningham, Timothy J.; Berkman, Lisa F.; Gortmaker, Steven L.; Kiefe, Catarina I.; Jacobs, David R.; Seeman, Teresa E.; Kawachi, Ichiro

2011-01-01

The psychometric properties of instruments used to measure self-reported experiences of discrimination in epidemiologic studies are rarely assessed, especially regarding construct validity. The authors used 2000–2001 data from the Coronary Artery Risk Development in Young Adults (CARDIA) Study to examine differential item functioning (DIF) in 2 versions of the Experiences of Discrimination (EOD) Index, an index measuring self-reported experiences of racial/ethnic and gender discrimination. DIF may confound interpretation of subgroup differences. Large DIF was observed for 2 of 7 racial/ethnic discrimination items: White participants reported more racial/ethnic discrimination for the “at school” item, and black participants reported more racial/ethnic discrimination for the “getting housing” item. The large DIF by race/ethnicity in the index for racial/ethnic discrimination probably reflects item impact and is the result of valid group differences between blacks and whites regarding their respective experiences of discrimination. The authors also observed large DIF by race/ethnicity for 3 of 7 gender discrimination items. This is more likely to have been due to item bias. Users of the EOD Index must consider the advantages and disadvantages of DIF adjustment (omitting items, constructing separate measures, and retaining items). The EOD Index has substantial usefulness as an instrument that can assess self-reported experiences of discrimination. PMID:22038104

Assessing teachers' positive psychological functioning at work: Development and validation of the Teacher Subjective Wellbeing Questionnaire.

PubMed

Renshaw, Tyler L; Long, Anna C J; Cook, Clayton R

2015-06-01

This study reports on the initial development and validation of the Teacher Subjective Wellbeing Questionnaire (TSWQ) with 2 samples of educators-a general sample of 185 elementary and middle school teachers, and a target sample of 21 elementary school teachers experiencing classroom management challenges. The TSWQ is an 8-item self-report instrument for assessing teachers' subjective wellbeing, which is operationalized via subscales measuring school connectedness and teaching efficacy. The conceptualization and development processes underlying the TSWQ are described, and results from a series of preliminary psychometric and exploratory analyses are reported to establish initial construct validity. Findings indicated that the TSWQ was characterized by 2 conceptually sound latent factors, that both subscales and the composite scale demonstrated strong internal consistency, and that all scales demonstrated convergent validity with self-reported school supports and divergent validity with self-reported stress and emotional burnout. Furthermore, results indicated that TSWQ scores did not differ according to teachers' school level (i.e., elementary vs. middle), but that they did differ according to unique school environment (e.g., 1 middle school vs. another middle school) and teacher stressors (i.e., general teachers vs. teachers experiencing classroom management challenges). Results also indicated that, for teachers experiencing classroom challenges, the TSWQ had strong short-term predictive validity for psychological distress, accounting for approximately half of the variance in teacher stress and emotional burnout. Implications for theory, research, and the practice of school psychology are discussed. (c) 2015 APA, all rights reserved).

Do other-reports of counterproductive work behavior provide an incremental contribution over self-reports? A meta-analytic comparison.

PubMed

Berry, Christopher M; Carpenter, Nichelle C; Barratt, Clare L

2012-05-01

Much of the recent research on counterproductive work behaviors (CWBs) has used multi-item self-report measures of CWB. Because of concerns over self-report measurement, there have been recent calls to collect ratings of employees' CWB from their supervisors or coworkers (i.e., other-raters) as alternatives or supplements to self-ratings. However, little is still known about the degree to which other-ratings of CWB capture unique and valid incremental variance beyond self-report CWB. The present meta-analysis investigates a number of key issues regarding the incremental contribution of other-reports of CWB. First, self- and other-ratings of CWB were moderately to strongly correlated with each other. Second, with some notable exceptions, self- and other-report CWB exhibited very similar patterns and magnitudes of relationships with a set of common correlates. Third, self-raters reported engaging in more CWB than other-raters reported them engaging in, suggesting other-ratings capture a narrower subset of CWBs. Fourth, other-report CWB generally accounted for little incremental variance in the common correlates beyond self-report CWB. Although many have viewed self-reports of CWB with skepticism, the results of this meta-analysis support their use in most CWB research as a viable alternative to other-reports. (PsycINFO Database Record (c) 2012 APA, all rights reserved).

Assessing self-reported disability in a low-literate population with chronic low back pain: cross-cultural adaptation and psychometric testing of Igbo Roland Morris disability questionnaire.

PubMed

Igwesi-Chidobe, Chinonso N; Obiekwe, Chinwe; Sorinola, Isaac O; Godfrey, Emma L

2017-12-14

Cross-culturally adapt and validate the Igbo Roland Morris Disability Questionnaire. Cross-cultural adaptation, test-retest, and cross-sectional psychometric testing. Roland Morris Disability Questionnaire was forward and back translated by clinical/non-clinical translators. An expert committee appraised the translations. Twelve participants with chronic low back pain pre-tested the measure in a rural Nigerian community. Internal consistency using Cronbach's alpha; test-retest reliability using intra-class correlation coefficient and Bland-Altman plot; and minimal detectable change were investigated in a convenient sample of 50 people with chronic low back pain in rural and urban Nigeria. Pearson's correlation analyses using the eleven-point box scale and back performance scale, and exploratory factor analysis were used to examine construct validity in a random sample of 200 adults with chronic low back pain in rural Nigeria. Ceiling and floor effects were investigated in the two samples. Modifications gave the option of interviewer-administration and reflected Nigerian social context. The measure had excellent internal consistency (α = 0.91) and intraclass correlation coefficient (ICC =0.84), moderately high correlations (r > 0.6) with performance-based disability and pain intensity, and a predominant uni-dimensional structure, with no ceiling or floor effects. Igbo Roland Morris Disability Questionnaire is a valid and reliable measure of pain-related disability. Implications for rehabilitation Low back pain is the leading cause of years lived with disability worldwide, and is particularly prevalent in rural Nigeria, but there are no self-report measures to assess its impact due to low literacy rates. This study describes the cross-cultural adaptation and validation of a core self-report back pain specific disability measure in a low-literate Nigerian population. The Igbo Roland Morris Disability Questionnaire is a reliable and valid measure of self-reported disability in Igbo populations as indicated by excellent internal consistency (α = 0.91) and intra-class correlation coefficient (ICC =0.84), moderately high correlations (r > 0.6) with performance-based disability and pain intensity that supports a pain-related disability construct, a predominant one factor structure with no ceiling or floor effects. The measure will be useful for researchers and clinicians examining the factors associated with low back pain disability or the effects of interventions on low back pain disability in this culture. This measure will support global health initiatives concurrently involving people from several cultures or countries, and may inform cross-cultural disability research in other populations.

Screening for Sleep Reduction in Adolescents through Self-Report: Development and Validation of the Sleep Reduction Screening Questionnaire (SRSQ)

ERIC Educational Resources Information Center

Maanen, Annette; Dewald-Kaufmann, Julia F.; Oort, Frans J.; de Bruin, Eduard J.; Smits, Marcel G.; Short, Michelle A.; Gradisar, Michael; Kerkhof, Gerard A.; Meijer, Anne Marie

2014-01-01

Background: Sleep reduction, resulting from insufficient or poor sleep, is a common phenomenon in adolescents. Due to its severe negative psychological and behavioral daytime consequences, it is important to have a short reliable and valid measure to assess symptoms of sleep reduction. Objective: This study aims to validate the Sleep Reduction…

Reliability and validity of a semi-structured DSM-based diagnostic interview module for the assessment of Attention Deficit Hyperactivity Disorder in adult psychiatric outpatients.

PubMed

Gorlin, Eugenia I; Dalrymple, Kristy; Chelminski, Iwona; Zimmerman, Mark

2016-08-30

Despite growing recognition that the symptoms and functional impairments of Attention Deficit/Hyperactivity Disorder (ADHD) persist into adulthood, only a few psychometrically sound diagnostic measures have been developed for the assessment of ADHD in adults, and none have been validated for use in a broad treatment-seeking psychiatric sample. The current study presents the reliability and validity of a semi-structured DSM-based diagnostic interview module for ADHD, which was administered to 1194 adults presenting to an outpatient psychiatric practice. The module showed excellent internal consistency and interrater reliability, good convergent and discriminant validity (as indexed by relatively high correlations with self-report measures of ADHD and ADHD-related constructs and little or no correlation with other, non-ADHD symptom domains), and good construct validity (as indexed by significantly higher rates of psychosocial impairment and self-reported family history of ADHD in individuals who meet criteria for an ADHD diagnosis). This instrument is thus a reliable and valid diagnostic tool for the detection of ADHD in adults presenting for psychiatric evaluation and treatment. Published by Elsevier Ireland Ltd.

Smoking in Pregnancy and Fetal Growth: The Case for More Intensive Assessment.

PubMed

Shisler, Shannon; Eiden, Rina D; Molnar, Danielle S; Schuetze, Pamela; Huestis, Marilyn; Homish, Gregory

2017-05-01

Many studies on prenatal tobacco exposure (PTE) effects have relied on single item retrospective measures of PTE. However, it is unclear how these single item measures may relate to more intensive maternal self-reports and to biological markers of maternal use and/or fetal exposure. It is also unclear whether these measures may be more valid predictors of fetal growth (gestational age, birthweight, head circumference, and birth length). Data were obtained from 258 women during their pregnancy. PTE was assessed by four methods: a single item question, a calendar-based self-report measure from each trimester of pregnancy, maternal salivary cotinine assays, and nicotine and metabolites in infant meconium. We hypothesized that the more intensive measures and biological assays would account for additional variance in birth outcomes, above and beyond the single item measure. The single item self-report measure was not related to fetal growth. However, the more intensive calendar based self-report measure and the biological assays of PTE (ie, maternal salivary assays and infant meconium) were significant predictors of poor fetal growth, even with the single item measure in the model. The negative effects of PTE on important child outcomes may be greatly underestimated in the literature as many studies use single item self-report measures to ascertain PTE. Whereas more intensive self-report measures or biological assays may be cost prohibitive in large scale epidemiological studies, using a combination of measures when possible should be considered given their superiority both identifying prenatal smokers and predicting poor fetal growth. The present work underscores the importance of measurement issues when assessing associations between PTE and fetal growth. Results suggest that we may be greatly underestimating the negative effects of prenatal smoking on fetal growth and other important child outcomes if we rely solely on restricted single item self-report measures of prenatal smoking. Researchers should consider more intensive prospective self-report measures and biological assays as viable and superior alternatives to single item self-report measures. © The Author 2017. Published by Oxford University Press on behalf of the Society for Research on Nicotine and Tobacco. All rights reserved. For permissions, please e-mail: journals.permissions@oup.com.

The Subthreshold Autism Trait Questionnaire (SATQ): Development of a Brief Self-Report Measure of Subthreshold Autism Traits

ERIC Educational Resources Information Center

Kanne, Stephen M.; Wang, Jennifer; Christ, Shawn E.

2012-01-01

The current study was motivated by a need for a self-report questionnaire that assesses a broad range of subthreshold autism traits, is brief and easily administered, and is relevant to the general population. An initial item pool was administered to 1,709 students. Structural validity analysis resulted in a 24-item questionnaire termed the…

Measuring older adults' sedentary time: reliability, validity, and responsiveness.

PubMed

Gardiner, Paul A; Clark, Bronwyn K; Healy, Genevieve N; Eakin, Elizabeth G; Winkler, Elisabeth A H; Owen, Neville

2011-11-01

With evidence that prolonged sitting has deleterious health consequences, decreasing sedentary time is a potentially important preventive health target. High-quality measures, particularly for use with older adults, who are the most sedentary population group, are needed to evaluate the effect of sedentary behavior interventions. We examined the reliability, validity, and responsiveness to change of a self-report sedentary behavior questionnaire that assessed time spent in behaviors common among older adults: watching television, computer use, reading, socializing, transport and hobbies, and a summary measure (total sedentary time). In the context of a sedentary behavior intervention, nonworking older adults (n = 48, age = 73 ± 8 yr (mean ± SD)) completed the questionnaire on three occasions during a 2-wk period (7 d between administrations) and wore an accelerometer (ActiGraph model GT1M) for two periods of 6 d. Test-retest reliability (for the individual items and the summary measure) and validity (self-reported total sedentary time compared with accelerometer-derived sedentary time) were assessed during the 1-wk preintervention period, using Spearman (ρ) correlations and 95% confidence intervals (CI). Responsiveness to change after the intervention was assessed using the responsiveness statistic (RS). Test-retest reliability was excellent for television viewing time (ρ (95% CI) = 0.78 (0.63-0.89)), computer use (ρ (95% CI) = 0.90 (0.83-0.94)), and reading (ρ (95% CI) = 0.77 (0.62-0.86)); acceptable for hobbies (ρ (95% CI) = 0.61 (0.39-0.76)); and poor for socializing and transport (ρ < 0.45). Total sedentary time had acceptable test-retest reliability (ρ (95% CI) = 0.52 (0.27-0.70)) and validity (ρ (95% CI) = 0.30 (0.02-0.54)). Self-report total sedentary time was similarly responsive to change (RS = 0.47) as accelerometer-derived sedentary time (RS = 0.39). The summary measure of total sedentary time has good repeatability and modest validity and is sufficiently responsive to change suggesting that it is suitable for use in interventions with older adults.

Hope Modified the Association between Distress and Incidence of Self-Perceived Medical Errors among Practicing Physicians: Prospective Cohort Study

PubMed Central

Hayashino, Yasuaki; Utsugi-Ozaki, Makiko; Feldman, Mitchell D.; Fukuhara, Shunichi

2012-01-01

The presence of hope has been found to influence an individual's ability to cope with stressful situations. The objective of this study is to evaluate the relationship between medical errors, hope and burnout among practicing physicians using validated metrics. Prospective cohort study was conducted among hospital based physicians practicing in Japan (N = 836). Measures included the validated Burnout Scale, self-assessment of medical errors and Herth Hope Index (HHI). The main outcome measure was the frequency of self-perceived medical errors, and Poisson regression analysis was used to evaluate the association between hope and medical error. A total of 361 errors were reported in 836 physician-years. We observed a significant association between hope and self-report of medical errors. Compared with the lowest tertile category of HHI, incidence rate ratios (IRRs) of self-perceived medical errors of physicians in the highest category were 0.44 (95%CI, 0.34 to 0.58) and 0.54 (95%CI, 0.42 to 0.70) respectively, for the 2nd and 3rd tertile. In stratified analysis by hope score, among physicians with a low hope score, those who experienced higher burnout reported higher incidence of errors; physicians with high hope scores did not report high incidences of errors, even if they experienced high burnout. Self-perceived medical errors showed a strong association with physicians' hope, and hope modified the association between physicians' burnout and self-perceived medical errors. PMID:22530055

A Comparison of Three Different Scoring Methods for Self-Report Measures of Psychological Aggression in a Sample of College Females

PubMed Central

Shorey, Ryan C.; Brasfield, Hope; Febres, Jeniimarie; Cornelius, Tara L.; Stuart, Gregory L.

2012-01-01

Psychological aggression in females’ dating relationships has received increased empirical attention in recent years. However, researchers have used numerous measures of psychological aggression, and various scoring methods with these measures, making it difficult to compare across studies on psychological aggression. In addition, research has yet to examine whether different scoring methods for psychological aggression measures may affect the psychometric properties of these instruments. The current study examined three self-report measures of psychological aggression within a sample of female college students (N = 108), including their psychometric properties when scored using frequency, sum, and variety scores. Results showed that the Revised Conflict Tactics Scales (CTS2) had variable internal consistency depending on the scoring method used and good validity; the Multidimensional Measure of Emotional Abuse (MMEA) and the Follingstad Psychological Aggression Scale (FPAS) both had good internal consistency and validity across scoring methods. Implications of these findings for the assessment of psychological aggression and future research are discussed. PMID:23393957

A comparison of three different scoring methods for self-report measures of psychological aggression in a sample of college females.

PubMed

Shorey, Ryan C; Brasfield, Hope; Febres, Jeniimarie; Cornelius, Tara L; Stuart, Gregory L

2012-01-01

Psychological aggression in females' dating relationships has received increased empirical attention in recent years. However, researchers' have used numerous measures of psychological aggression and various scoring methods with these measures, making it difficult to compare across studies on psychological aggression. In addition, research has yet to examine whether different scoring methods for psychological aggression measures may affect the psychometric properties of these instruments. This study examined three self-report measures of psychological aggression within a sample of female college students (N = 108), including their psychometric properties when scored using frequency, sum, and variety scores. Results showed that the Revised Conflict Tactics Scales (CTS2) had variable internal consistency depending on the scoring method used and good validity; the Multidimensional Measure of Emotional Abuse (MMEA) and the Follingstad Psychological Aggression Scale (FPAS) both had good internal consistency and validity across scoring methods. Implications of these findings for the assessment of psychological aggression and future research are discussed.

Self-reported quality of life measure is reliable and valid in adult patients suffering from schizophrenia with executive impairment.

PubMed

Baumstarck, Karine; Boyer, Laurent; Boucekine, Mohamed; Aghababian, Valérie; Parola, Nathalie; Lançon, Christophe; Auquier, Pascal

2013-06-01

Impaired executive functions are among the most widely observed in patients suffering from schizophrenia. The use of self-reported outcomes for evaluating treatment and managing care of these patients has been questioned. The aim of this study was to provide new evidence about the suitability of self-reported outcome for use in this specific population by exploring the internal structure, reliability and external validity of a specific quality of life (QoL) instrument, the Schizophrenia Quality of Life questionnaire (SQoL18). cross-sectional study. age over 18 years, diagnosis of schizophrenia according to the DSM-IV criteria. sociodemographic (age, gender, and education level) and clinical data (duration of illness, Positive and Negative Syndrome Scale, Calgary Depression Scale for Schizophrenia); QoL (SQoL18); and executive performance (Stroop test, lexical and verbal fluency, and trail-making test). Non-impaired and impaired populations were defined for each of the three tests. For the six groups, psychometric properties were compared to those reported from the reference population assessed in the validation study. One hundred and thirteen consecutive patients were enrolled. The factor analysis performed in the impaired groups showed that the questionnaire structure adequately matched the initial structure of the SQoL18. The unidimensionality of the dimensions was preserved, and the internal/external validity indices were close to those of the non-impaired groups and the reference population. Our study suggests that executive dysfunction did not compromise the reliability or validity of self-reported disease-specific QoL questionnaire. Copyright © 2013 Elsevier B.V. All rights reserved.

Measuring School Climate: An Overview of Measurement Scales

ERIC Educational Resources Information Center

Kohl, Diane; Recchia, Sophie; Steffgen, Georges

2013-01-01

Background: School climate is a heterogeneous concept with a multitude of standardised and validated instruments available to measure it. Purpose: This overview of measurement scales aims to provide researchers with short summaries of some of the self-report instruments in existence, especially in relation to the link between school climate and…

Rethinking Traditional Methods of Survey Validation

ERIC Educational Resources Information Center

Maul, Andrew

2017-01-01

It is commonly believed that self-report, survey-based instruments can be used to measure a wide range of psychological attributes, such as self-control, growth mindsets, and grit. Increasingly, such instruments are being used not only for basic research but also for supporting decisions regarding educational policy and accountability. The…

An Assertiveness Inventory for Adults

ERIC Educational Resources Information Center

Gay, Melvin L.; And Others

1975-01-01

The Adult Self-Expression Scale is a 48-item, self-report measure of assertiveness designed for use with adults in general. Scale was found to have high test-retest reliability and moderate-to-high construct validity, as established by correlations with Adjective Check List scales and by a discriminant analysis procedure. (Author)

Assessing Assertion: An Investigation of Construct Validity and Reliability.

ERIC Educational Resources Information Center

Kern, Jeffrey M.; MacDonald, Marian L.

The reliability and meaning of assertiveness tests were explored using 120 female undergraduates. Several self-report inventories (the College Self-Expression Scale, Conflict Resolution Inventory, and a global rating from one to seven) were administered, as were three anxiety measures (Timed Behavior Checklist, response latency, and response…

The ability of cancer-specific and generic preference-based instruments to discriminate across clinical and self-reported measures of cancer severities

PubMed Central

2011-01-01

Objective To evaluate the validity of cancer-specific and generic preference-based instruments to discriminate across different measures of cancer severities. Methods Patients with breast (n = 66), colorectal (n = 57), and lung (n = 61) cancer completed the EORTC QLQ-C30 and the FACT-G, as well as three generic instruments: the EQ-5D, the SF-6D, and the HUI2/3. Disease severity was quantified using cancer stage, Eastern Cooperative Oncology Group Performance Status (ECOG-PS) score, and self-reported health status. Comparative analyses confirmed the multi-dimensional conceptualization of the instruments in terms of construct and convergent validity. Results In general, the instruments were able to discriminate across severity measures. The instruments demonstrated moderate to strong correlation with each other (r = 0.37-0.73). Not all of the measures could discriminate between different groups of disease severity: the EQ-5D and SF-6D were less discriminative than the HUI2/3 and the cancer-specific instruments. Conclusion The cancer-specific and generic preference-based instruments demonstrated to be valid in discriminating across levels of ECOG-PS scores and self-reported health states. However, the usefulness of the generic instruments may be limited if they are not able to detect small changes in health status within cancer patients. This raises concerns regarding the appropriateness of these instruments when comparing different cancer treatments within an economic evaluation framework. PMID:22123196

Measuring craving: an attempt to connect subjective craving with cue reactivity.

PubMed

Ooteman, Wendy; Koeter, Maarten W J; Vserheul, Roel; Schippers, Gerard M; van den Brink, Wim

2006-01-01

Better insight into craving may contribute to the development of more efficient relapse prevention strategies. Inconsistent findings on the relation between craving and relapse may be due to difficulties in the measurement of craving. These difficulties are accounted for by 3 interrelated problems: lack of consensus regarding the definition of craving, the use of different time frames (craving now vs craving in the past), and lack of concordance between self-reported craving and psychophysiological measures of cue reactivity. The aim of this study is to develop and validate a new self-report questionnaire for the assessment of the core aspects of craving, taking into account different time frames and emphasizing the psychophysiological aspects of craving. It is hypothesized that this questionnaire will show higher concordance with measures of cue reactivity than existing self-report craving questionnaires. Based on a semantic mapping sentence, a 24-item self-report questionnaire was developed: the Jellinek Alcohol Craving Questionnaire (JACQ). The questionnaire was tested in 2 samples of treatment-seeking alcohol-dependent patients (sample A, n = 251; sample B, n = 48). Psychometric properties were examined in sample A and cross-validated in sample B. The associations with psychophysiological and neuroendocrine measures of cue reactivity were studied in sample B. The JACQ consists of 1 dimension with the following 4 aspects: (1) emotional urge, (2) physical sensations, (3) temptation to drink, and (4) uncontrolled thoughts. All (sub)scales had a good internal consistency (alpha = 0.77-0.95) and were highly intercorrelated (r = 0.57-0.86). Craving-past correlated low with craving-now (r = 0.32). Craving-now (sub)scales showed a moderate association with heart rate (0.46-0.49), but not with respiration rate, skin conductance, or cortisol production in saliva following cue exposure. In contrast, craving-past (sub)scales showed a moderate association with cortisol production in saliva (0.15-0.42) following cue exposure. Remarkably, the physical symptoms scale did not show stronger association with psychophysiological and neuroendocrine measures than the other subscales. The JACQ reliably measures 1 dimension including 4 aspects of craving for distinct time frames. Despite the presence of a special subscale for physical sensations, only moderate relationships were found between self-reported craving and biological indicators of cue reactivity. These findings suggest individual differences between alcoholics in the detection and/or reporting of cue-related psychophysiological signs as indicators of cue reactivity. Further research should focus on the nature of these individual differences. In addition, more research is needed on the relative predictive validity of subjective phenotypic indicators of craving (such as self-reported craving) versus objective endophenotypic indicators of craving (such as physiological measures of cue reactivity) for example in the prediction of relapse.

Development and Validation of the Minnesota Borderline Personality Disorder Scale (MBPD)

PubMed Central

Bornovalova, Marina A.; Hicks, Brian M.; Patrick, Christopher J.; Iacono, William G.; McGue, Matt

2011-01-01

While large epidemiological datasets can inform research on the etiology and development of borderline personality disorder (BPD), they rarely include BPD measures. In some cases, however, proxy measures can be constructed using instruments already in these datasets. In this study we developed and validated a self-report measure of BPD from the Multidimensional Personality Questionnaire (MPQ). Items for the new instrument—the Minnesota BPD scale (MBPD)—were identified and refined using three large samples: undergraduates, community adolescent twins, and urban substance users. We determined the construct validity of the MBPD by examining its association with (1) diagnosed BPD, (2) questionnaire reported BPD symptoms, and (3) clinical variables associated with BPD: suicidality, trauma, disinhibition, internalizing distress, and substance use. We also tested the MBPD in two prison inmate samples. Across samples, the MBPD correlated with BPD indices and external criteria, and showed incremental validity above measures of negative affect, thus supporting its construct validity as a measure of BPD. PMID:21467094

Validity of self-reported periodontal measures, demographic characteristics and systemic medical conditions.

PubMed

Chatzopoulos, Georgios S; Cisneros, Alejandro; Sanchez, Miguel; Lunos, Scott; Wolff, Larry F

2018-04-06

The objective of the present study was to assess self-reported periodontal screening questions, demographic characteristics, systemic medical conditions and tobacco use for predicting periodontal disease among individuals seeking dental therapy in a university dental clinic. In this retrospective study, a total of 4,890 randomly selected dental charts were evaluated from among patients who had attended the University of Minnesota School of Dentistry clinics for treatment. Radiographic bone loss measurements were utilized to assess the severity of periodontal disease. Demographic characteristics as well as medical history of the patients were also recorded. Five self-reported periodontal screening questions were included with the range of answers limited to Yes/No. Generalized logit models were used to assess the association between bone loss and the predictors. The sample mean age was 54.1 years and included 52.6% males and 14.9% smokers with a mean number of missing teeth of 3.5. Self-reported tooth mobility, history of "gum treatment" and the importance to keep the teeth as well as age, tobacco use and cancer were statistically significant (p < 0.05) predictors of a radiographic diagnosis of moderate and severe periodontal disease. With respect to severe periodontal disease, significant (p < 0.05) associations were also found with "bleeding while brushing", gender, diabetes, anxiety and arthritis. Self-reported periodontal screening questions as well as demographic characteristics, smoking and systemic medical conditions were significant predictors of periodontal disease and they could be used as valid, economical and practical measures. This article is protected by copyright. All rights reserved. © 2018 American Academy of Periodontology.

The General Assessment of Personality Disorder (GAPD): factor structure, incremental validity of self-pathology, and relations to DSM-IV personality disorders.

PubMed

Hentschel, Annett G; Livesley, W John

2013-01-01

Recent developments in the classification of personality disorder, especially moves toward more dimensional systems, create the need to assess general personality disorder apart from individual differences in personality pathology. The General Assessment of Personality Disorder (GAPD) is a self-report questionnaire designed to evaluate general personality disorder. The measure evaluates 2 major components of disordered personality: self or identity problems and interpersonal dysfunction. This study explores whether there is a single factor reflecting general personality pathology as proposed by the Diagnostic and Statistical Manual of Mental Disorders (5th ed.), whether self-pathology has incremental validity over interpersonal pathology as measured by GAPD, and whether GAPD scales relate significantly to Diagnostic and Statistical Manual of Mental Disorders (4th ed. [DSM-IV]) personality disorders. Based on responses from a German psychiatric sample of 149 participants, parallel analysis yielded a 1-factor model. Self Pathology scales of the GAPD increased the predictive validity of the Interpersonal Pathology scales of the GAPD. The GAPD scales showed a moderate to high correlation for 9 of 12 DSM-IV personality disorders.

Individual differences in cardiorespiratory measures of mental workload: An investigation of negative affectivity and cognitive avoidant coping in pilot candidates.

PubMed

Grassmann, Mariel; Vlemincx, Elke; von Leupoldt, Andreas; Van den Bergh, Omer

2017-03-01

Cardiorespiratory measures provide useful information in addition to well-established self-report measures when monitoring operator capacity. The purpose of our study was to refine the assessment of operator load by considering individual differences in personality and their associations with cardiorespiratory activation. Physiological and self-report measures were analyzed in 115 pilot candidates at rest and while performing a multiple task covering perceptual speed, spatial orientation, and working memory. In the total sample and particularly in individuals with a general tendency to worry a lot, a cognitive avoidant coping style was associated with a smaller task-related increase in heart rate. Negative affectivity was found to moderate the association between cardiac and self-reported arousal. Given that physiological and self-report measures of mental workload are usually combined when evaluating operator load (e.g., in pilot selection and training), our findings suggest that integrating individual differences may reduce unexplained variance and increase the validity of workload assessments. Copyright © 2016 Elsevier Ltd. All rights reserved.

Validation of a theoretically motivated approach to measuring childhood socioeconomic circumstances in the Health and Retirement Study.

PubMed

Vable, Anusha M; Gilsanz, Paola; Nguyen, Thu T; Kawachi, Ichiro; Glymour, M Maria

2017-01-01

Childhood socioeconomic status (cSES) is a powerful predictor of adult health, but its operationalization and measurement varies across studies. Using Health and Retirement Study data (HRS, which is nationally representative of community-residing United States adults aged 50+ years), we specified theoretically-motivated cSES measures, evaluated their reliability and validity, and compared their performance to other cSES indices. HRS respondent data (N = 31,169, interviewed 1992-2010) were used to construct a cSES index reflecting childhood social capital (cSC), childhood financial capital (cFC), and childhood human capital (cHC), using retrospective reports from when the respondent was <16 years (at least 34 years prior). We assessed internal consistency reliability (Cronbach's alpha) for the scales (cSC and cFC), and construct validity, and predictive validity for all measures. Validity was assessed with hypothesized correlates of cSES (educational attainment, measured adult height, self-reported childhood health, childhood learning problems, childhood drug and alcohol problems). We then compared the performance of our validated measures with other indices used in HRS in predicting self-rated health and number of depressive symptoms, measured in 2010. Internal consistency reliability was acceptable (cSC = 0.63, cFC = 0.61). Most measures were associated with hypothesized correlates (for example, the association between educational attainment and cSC was 0.01, p < 0.0001), with the exception that measured height was not associated with cFC (p = 0.19) and childhood drug and alcohol problems (p = 0.41), and childhood learning problems (p = 0.12) were not associated with cHC. Our measures explained slightly more variability in self-rated health (adjusted R2 = 0.07 vs. <0.06) and number of depressive symptoms (adjusted R2 > 0.05 vs. < 0.04) than alternative indices. Our cSES measures use latent variable models to handle item-missingness, thereby increasing the sample size available for analysis compared to complete case approaches (N = 15,345 vs. 8,248). Adopting this type of theoretically motivated operationalization of cSES may strengthen the quality of research on the effects of cSES on health outcomes.

Psychometric properties of the Sinhala version of the PedsQL™ 4.0 Generic Core Scales in early adolescents in Sri Lanka

PubMed Central

2012-01-01

Background The concept Health related Quality of life (HRQOL) is increasingly recognized as an important health outcome measure in clinical and research fields. The present study attempted to evaluate the psychometric properties of the Sinhala version of the Pediatric Quality of Life Inventory™ 4.0 (PedsQL™ 4.0) Generic Core Scales among adolescents in Sri Lanka. Methods The original US PedsQL™ was translated into Sinhala and conceptually validated according to international guidelines. A cross-sectional study was conducted among 142 healthy school going adolescents (12-14 years), their parents (n = 120) and a group of adolescents with asthma who attended asthma clinics (n = 115). Reliability was assessed using Cronbach’s alpha and validity by examining scale structure, exploring inter-scale correlations and comparing across known groups (healthy vs. chronically ill). Results The PedsQL™ Sinhala version was found to be acceptable with minimal missing responses. All scales demonstrated satisfactory reliability. Cronbach’s alpha for the total scale scores was 0.85 for adolescent self-report while for the parent proxy-report for the healthy group it was 0.86. No floor effects were observed. Ceiling effects were noticed in self-report and parent proxy-report for the healthy group. Overall results of the multi trait scaling analysis confirmed the scale structure with 74% item-convergent validity, 88% item-discriminant validity and an overall scaling success of 72%. Moderate to high correlations were shown among the domains of teen self-report (Spearman rho = .37-.54) and between teen self-report and parent proxy-reports (Spearman rho = .41-.57). The PedsQL™ tool was able to discriminate between the quality of life in healthy adolescents and adolescents with asthma. Conclusion The findings support the reliability and validity of the Sinhala version of the PedsQL™ 4.0 Generic Core Scales as a generic instrument to measure HRQOL among early adolescents in Sri Lanka in a population setting. PMID:22947113

A measure of state persecutory ideation for experimental studies.

PubMed

Freeman, Daniel; Pugh, Katherine; Green, Catherine; Valmaggia, Lucia; Dunn, Graham; Garety, Philippa

2007-09-01

Experimental research is increasingly important in developing the understanding of paranoid thinking. An assessment measure of persecutory ideation is necessary for such work. We report the reliability and validity of the first state measure of paranoia: The State Social Paranoia Scale. The items in the measure conform to a recent definition in which persecutory thinking has the 2 elements of feared harm and perpetrator intent. The measure was tested with 164 nonclinical participants and 21 individuals at high risk of psychosis with attenuated positive symptoms. The participants experienced a social situation presented in virtual reality and completed the new measure. The State Social Paranoia Scale was found to have excellent internal reliability, adequate test-retest reliability, clear convergent validity as assessed by both independent interviewer ratings and self-report measures, and showed divergent validity with measures of positive and neutral thinking. The measure of paranoia in a recent social situation has good psychometric properties.

Validity of Cognitive Load Measures in Simulation-Based Training: A Systematic Review.

PubMed

Naismith, Laura M; Cavalcanti, Rodrigo B

2015-11-01

Cognitive load theory (CLT) provides a rich framework to inform instructional design. Despite the applicability of CLT to simulation-based medical training, findings from multimedia learning have not been consistently replicated in this context. This lack of transferability may be related to issues in measuring cognitive load (CL) during simulation. The authors conducted a review of CLT studies across simulation training contexts to assess the validity evidence for different CL measures. PRISMA standards were followed. For 48 studies selected from a search of MEDLINE, EMBASE, PsycInfo, CINAHL, and ERIC databases, information was extracted about study aims, methods, validity evidence of measures, and findings. Studies were categorized on the basis of findings and prevalence of validity evidence collected, and statistical comparisons between measurement types and research domains were pursued. CL during simulation training has been measured in diverse populations including medical trainees, pilots, and university students. Most studies (71%; 34) used self-report measures; others included secondary task performance, physiological indices, and observer ratings. Correlations between CL and learning varied from positive to negative. Overall validity evidence for CL measures was low (mean score 1.55/5). Studies reporting greater validity evidence were more likely to report that high CL impaired learning. The authors found evidence that inconsistent correlations between CL and learning may be related to issues of validity in CL measures. Further research would benefit from rigorous documentation of validity and from triangulating measures of CL. This can better inform CLT instructional design for simulation-based medical training.

Family relationships as an explanatory variable in childhood dental caries: a systematic review of measures.

PubMed

Duijster, D; O'Malley, L; Elison, S; Van Loveren, C; Marcenes, W; Adair, P M; Pine, C M

2013-01-01

It is widely acknowledged that parental beliefs (self-efficacy) about oral health and parental oral health-related behaviours play a fundamental role in the establishment of preventative behaviours that will mitigate against the development of childhood dental caries. However, little attention has been given to the wider perspective of family functioning and family relationships on child oral health. For oral health researchers, exploration of this association requires the use of reliable, valid and appropriate assessment tools to measure family relationships. In order to promote methodologically sound research in oral health, this systematic review aims to provide a guide on self-report psychometric measures of family functioning that may be suitable to utilize when exploring childhood dental caries. This systematic review has identified 29 self-report measures of family functioning and evaluated them in terms of their psychometric support, constructs measured and potential utility for oral health research. The majority of the measures reported adequate levels of reliability and construct validity. Construct evaluation of the measures identified five core domains of family functioning, namely 'communication', 'cohesion/engagement', 'control', 'involvement' and 'authoritative/rigid parenting style'. The constructs were subsequently evaluated with respect to their potential relevance to child oral health. Herewith this review provides a framework to guide future research to explore family functioning in furthering our understanding of the development of childhood dental caries. © 2013 S. Karger AG, Basel.

Electronic self-monitoring of mood using IT platforms in adult patients with bipolar disorder: A systematic review of the validity and evidence.

PubMed

Faurholt-Jepsen, Maria; Munkholm, Klaus; Frost, Mads; Bardram, Jakob E; Kessing, Lars Vedel

2016-01-15

Various paper-based mood charting instruments are used in the monitoring of symptoms in bipolar disorder. During recent years an increasing number of electronic self-monitoring tools have been developed. The objectives of this systematic review were 1) to evaluate the validity of electronic self-monitoring tools as a method of evaluating mood compared to clinical rating scales for depression and mania and 2) to investigate the effect of electronic self-monitoring tools on clinically relevant outcomes in bipolar disorder. A systematic review of the scientific literature, reported according to the Preferred Reporting items for Systematic Reviews and Meta-Analysis (PRISMA) guidelines was conducted. MEDLINE, Embase, PsycINFO and The Cochrane Library were searched and supplemented by hand search of reference lists. Databases were searched for 1) studies on electronic self-monitoring tools in patients with bipolar disorder reporting on validity of electronically self-reported mood ratings compared to clinical rating scales for depression and mania and 2) randomized controlled trials (RCT) evaluating electronic mood self-monitoring tools in patients with bipolar disorder. A total of 13 published articles were included. Seven articles were RCTs and six were longitudinal studies. Electronic self-monitoring of mood was considered valid compared to clinical rating scales for depression in six out of six studies, and in two out of seven studies compared to clinical rating scales for mania. The included RCTs primarily investigated the effect of heterogeneous electronically delivered interventions; none of the RCTs investigated the sole effect of electronic mood self-monitoring tools. Methodological issues with risk of bias at different levels limited the evidence in the majority of studies. Electronic self-monitoring of mood in depression appears to be a valid measure of mood in contrast to self-monitoring of mood in mania. There are yet few studies on the effect of electronic self-monitoring of mood in bipolar disorder. The evidence of electronic self-monitoring is limited by methodological issues and by a lack of RCTs. Although the idea of electronic self-monitoring of mood seems appealing, studies using rigorous methodology investigating the beneficial as well as possible harmful effects of electronic self-monitoring are needed.

The Self-Evaluation Scale-Self-Report (SES-S) Version: Studies of Reliability and Validity

ERIC Educational Resources Information Center

Erford, Bradley T.; Bardhoshi, Gerta; Duncan, Kelly; Voucas, Stephanie; Dewlin, Emily

2017-01-01

The Self-Evaluation Scale-Self-Report version was designed to assess self-concept in students aged 10 to 17 years. Coefficient a was 0.94, and test-retest was 0.87. A unidimensional construct emerged with strong convergent validity with scores on the Piers-Harris 2 (r = 0.77) and Self-Efficacy Self-Report Scale (r = 0.70).

Theoretical framework and methodological development of common subjective health outcome measures in osteoarthritis: a critical review

PubMed Central

Pollard, Beth; Johnston, Marie; Dixon, Diane

2007-01-01

Subjective measures involving clinician ratings or patient self-assessments have become recognised as an important tool for the assessment of health outcome. The value of a health outcome measure is usually assessed by a psychometric evaluation of its reliability, validity and responsiveness. However, psychometric testing involves an accumulation of evidence and has recognised limitations. It has been suggested that an evaluation of how well a measure has been developed would be a useful additional criteria in assessing the value of a measure. This paper explored the theoretical background and methodological development of subjective health status measures commonly used in osteoarthritis research. Fourteen subjective health outcome measures commonly used in osteoarthritis research were examined. Each measure was explored on the basis of their i) theoretical framework (was there a definition of what was being assessed and was it part of a theoretical model?) and ii) methodological development (what was the scaling strategy, how were the items generated and reduced, what was the response format and what was the scoring method?). Only the AIMS, SF-36 and WHOQOL defined what they were assessing (i.e. the construct of interest) and no measure assessed was part of a theoretical model. None of the clinician report measures appeared to have implemented a scaling procedure or described the rationale for the items selected or scoring system. Of the patient self-report measures, the AIMS, MPQ, OXFORD, SF-36, WHOQOL and WOMAC appeared to follow a standard psychometric scaling method. The DRP and EuroQol used alternative scaling methods. The review highlighted the general lack of theoretical framework for both clinician report and patient self-report measures. This review also drew attention to the wide variation in the methodological development of commonly used measures in OA. While, in general the patient self-report measures had good methodological development, the clinician report measures appeared less well developed. It would be of value if new measures defined the construct of interest and, that the construct, be part of theoretical model. By ensuring measures are both theoretically and empirically valid then improvements in subjective health outcome measures should be possible. PMID:17343739

Biological validation of self-reported condom use among sex workers in Guinea.

PubMed

Aho, Joséphine; Koushik, Anita; Diakité, Soumaïla Laye; Loua, Kovana Marcel; Nguyen, Vinh-Kim; Rashed, Sélim

2010-12-01

Self-reported condom use may be prone to social desirability bias. Our aim was to assess the validity of self-reported condom use in a population of female sex workers using prostate specific antigen (PSA) as a gold standard biomarker of recent unprotected vaginal intercourse. We collected data on 223 sex-workers in Conakry, Guinea in order to assess the sensitivity and specificity of self-reported condom use as well as to examine the predictors of discordance between self-report and PSA presence. PSA was detected in 38.4% of samples. Sensitivity of self-reported condom use was 14.6% and its specificity was 94.7%. Self-perceived high risk of HIV infection was the only significant independent predictor of misreported condom use. PSA could be useful to validate self-reported condom use in surveys and to allow a better understanding of factors associated with social desirability in sexual behaviour reporting.

Predictors of unprotected sex among female sex workers in Madagascar: comparing semen biomarkers and self-reported data.

PubMed

Gallo, Maria F; Steiner, Markus J; Hobbs, Marcia M; Weaver, Mark A; Hoke, Theresa Hatzell; Van Damme, Kathleen; Jamieson, Denise J; Macaluso, Maurizio

2010-12-01

Research on the determinants of condom use and condom non-use generally has relied on self-reported data with questionable validity. We identified predictors of recent, unprotected sex among 331 female sex workers in Madagascar using two outcome measures: self-reports of unprotected sex within the past 48 h and detection of prostate-specific antigen (PSA), a biological marker of recent semen exposure. Multivariable logistic regression revealed that self-reported unprotected sex was associated with three factors: younger age, having a sipa (emotional partner) in the prior seven days, and no current use of hormonal contraception. The sole factor related to having PSA detected was prevalent chlamydial infection (adjusted odds ratio, 4.5; 95% confidence interval, 2.0-10.1). Differences in predictors identified suggest that determinants of unprotected sex, based on self-reported behaviors, might not correlate well with risk of semen exposure. Caution must be taken when interpreting self-reported sexual behavior measures or when adjusting for them in analyses evaluating interventions for the prevention of HIV/STIs.

Self-perceived Coparenting of Nonresident Fathers: Scale Development and Validation.

PubMed

Dyer, W Justin; Fagan, Jay; Kaufman, Rebecca; Pearson, Jessica; Cabrera, Natasha

2017-11-16

This study reports on the development and validation of the Fatherhood Research and Practice Network coparenting perceptions scale for nonresident fathers. Although other measures of coparenting have been developed, this is the first measure developed specifically for low-income, nonresident fathers. Focus groups were conducted to determine various aspects of coparenting. Based on this, a scale was created and administered to 542 nonresident fathers. Participants also responded to items used to examine convergent and predictive validity (i.e., parental responsibility, contact with the mother, father self-efficacy and satisfaction, child behavior problems, and contact and engagement with the child). Factor analyses and reliability tests revealed three distinct and reliable perceived coparenting factors: undermining, alliance, and gatekeeping. Validity tests suggest substantial overlap between the undermining and alliance factors, though undermining was uniquely related to child behavior problems. The alliance and gatekeeping factors showed strong convergent validity and evidence for predictive validity. Taken together, results suggest this relatively short measure (11 items) taps into three coparenting dimensions significantly predictive of aspects of individual and family life. © 2017 Family Process Institute.

Validity of self-reported height and weight and derived body mass index in middle-aged and elderly individuals in Australia.

PubMed

Ng, Suan Peng; Korda, Rosemary; Clements, Mark; Latz, Isabel; Bauman, Adrian; Bambrick, Hilary; Liu, Bette; Rogers, Kris; Herbert, Nicol; Banks, Emily

2011-12-01

Body mass index (BMI) is an important measure of adiposity. While BMI derived from self-reported data generally agrees well with that derived from measured values, evidence from Australia is limited, particularly for the elderly. We compared self-reported with measured height and weight in a random sample of 608 individuals aged ≥ 45 from the 45 and Up Study, an Australian population-based cohort study. We assessed degree of agreement and correlation between measures, and calculated sensitivity and specificity to quantify BMI category misclassification. On average, in males and females respectively, height was overestimated by 1.24 cm (95% CI: 0.75-1.72) and 0.59 cm (0.26-0.92); weight was underestimated by 1.68 kg (-1.99- -1.36) and 1.02 kg (-1.24- -0.80); and BMI based on self-reported measures was underestimated by 0.90 kg/m2 (-1.09- -0.70) and 0.60 kg/m2 (-0.75- -0.45). Underestimation increased with increasing measured BMI. There were strong correlations between self-reported and measured height, weight and BMI (r=0.95, 0.99 and 0.95, respectively, p<0.001). While there was excellent agreement between BMI categories from self-reported and measured data (kappa=0.80), obesity prevalence was underestimated. Findings did not differ substantially between middle-aged and elderly participants. Self-reported data on height and weight quantify body size appropriately in middle-aged and elderly individuals for relative measures, such as quantiles of BMI. However, caution is necessary when reporting on absolute BMI and standard BMI categories, based on self-reported data, particularly since use of such data is likely to result in underestimation of the prevalence of obesity. © 2011 The Authors. ANZJPH © 2011 Public Health Association of Australia.

Psychometric properties of the modified RESIDE physical activity questionnaire among low-income overweight women.

PubMed

Jones, Sydney A; Evenson, Kelly R; Johnston, Larry F; Trost, Stewart G; Samuel-Hodge, Carmen; Jewell, David A; Kraschnewski, Jennifer L; Keyserling, Thomas C

2015-01-01

This study explored the criterion-related validity and test-retest reliability of the modified RESIDential Environment physical activity questionnaire and whether the instrument's validity varied by body mass index, education, race/ethnicity, or employment status. Validation study using baseline data collected for randomized trial of a weight loss intervention. Participants recruited from health departments wore an ActiGraph accelerometer and self-reported non-occupational walking, moderate and vigorous physical activity on the modified RESIDential Environment questionnaire. We assessed validity (n=152) using Spearman correlation coefficients, and reliability (n=57) using intraclass correlation coefficients. When compared to steps, moderate physical activity, and bouts of moderate/vigorous physical activity measured by accelerometer, these questionnaire measures showed fair evidence for validity: recreational walking (Spearman correlation coefficients 0.23-0.36), total walking (Spearman correlation coefficients 0.24-0.37), and total moderate physical activity (Spearman correlation coefficients 0.18-0.36). Correlations for self-reported walking and moderate physical activity were higher among unemployed participants and women with lower body mass indices. Generally no other variability in the validity of the instrument was found. Evidence for reliability of RESIDential Environment measures of recreational walking, total walking, and total moderate physical activity was substantial (intraclass correlation coefficients 0.56-0.68). Evidence for questionnaire validity and reliability varied by activity domain and was strongest for walking measures. The questionnaire may capture physical activity less accurately among women with higher body mass indices and employed participants. Capturing occupational activity, specifically walking at work, may improve questionnaire validity. Copyright © 2014 Sports Medicine Australia. Published by Elsevier Ltd. All rights reserved.

A Scaled-Projective Measure of Interpersonal Values

ERIC Educational Resources Information Center

Kilmann, Ralph H.

1975-01-01

The Kilmann Insight Test is a measure of the interpersonal value constructs. That is how the individual perceives and interprets the desirable and undesirable features of interpersonal behavior. The validity of the test is investigated by explaining its relationship to a self-report measure assessing similar values. (DEP)

Concurrent Validity of the Millon Clinical Multiaxial Inventory Depression Scales.

ERIC Educational Resources Information Center

Goldberg, Joel O.; And Others

1987-01-01

Compared two new measures of depression (Millon Multiaxial Inventory Dysthymia and Major Depression subscales) with two established instruments: Beck Depression Inventory, a self-report measure which emphasizes the cognitive-affective aspects of depression, and Hamilton Rating Scale for Depression, an interview measure that emphasizes somatic…

How to Measure Nothing

ERIC Educational Resources Information Center

Rhemtulla, Mijke; Borsboom, Denny; van Bork, Riet

2017-01-01

In his focus article, "Rethinking Traditional Methods of Survey Validation" in this v15 n2 2017 issue of "Journal Measurement: Interdisciplinary Research and Perspectives," Andrew Maul writes that it is commonly believed that self-report, survey-based instruments can be used to measure a wide range of psychological attributes,…

Development and validation of the Measure of Indigenous Racism Experiences (MIRE)

PubMed Central

Paradies, Yin C; Cunningham, Joan

2008-01-01

Background In recent decades there has been increasing evidence of a relationship between self-reported racism and health. Although a plethora of instruments to measure racism have been developed, very few have been described conceptually or psychometrically Furthermore, this research field has been limited by a dearth of instruments that examine reactions/responses to racism and by a restricted focus on African American populations. Methods In response to these limitations, the 31-item Measure of Indigenous Racism Experiences (MIRE) was developed to assess self-reported racism for Indigenous Australians. This paper describes the development of the MIRE together with an opportunistic examination of its content, construct and convergent validity in a population health study involving 312 Indigenous Australians. Results Focus group research supported the content validity of the MIRE, and inter-item/scale correlations suggested good construct validity. A good fit with a priori conceptual dimensions was demonstrated in factor analysis, and convergence with a separate item on discrimination was satisfactory. Conclusion The MIRE has considerable utility as an instrument that can assess multiple facets of racism together with responses/reactions to racism among indigenous populations and, potentially, among other ethnic/racial groups. PMID:18426602

Self-informant Agreement for Personality and Evaluative Person Descriptors: Comparing Methods for Creating Informant Measures.

PubMed

Simms, Leonard J; Zelazny, Kerry; Yam, Wern How; Gros, Daniel F

2010-05-01

Little attention typically is paid to the way self-report measures are translated for use in self-informant agreement studies. We studied two possible methods for creating informant measures: (a) the traditional method in which self-report items were translated from the first- to the third-person and (b) an alternative meta-perceptual method in which informants were directed to rate their perception of the targets' self-perception. We hypothesized that the latter method would yield stronger self-informant agreement for evaluative personality dimensions measured by indirect item markers. We studied these methods in a sample of 303 undergraduate friendship dyads. Results revealed mean-level differences between methods, similar self-informant agreement across methods, stronger agreement for Big Five dimensions than for evaluative dimensions, and incremental validity for meta-perceptual informant rating methods. Limited power reduced the interpretability of several sparse acquaintanceship effects. We conclude that traditional informant methods are appropriate for most personality traits, but meta-perceptual methods may be more appropriate when personality questionnaire items reflect indirect indicators of the trait being measured, which is particularly likely for evaluative traits.

Self-informant Agreement for Personality and Evaluative Person Descriptors: Comparing Methods for Creating Informant Measures

PubMed Central

Simms, Leonard J.; Zelazny, Kerry; Yam, Wern How; Gros, Daniel F.

2011-01-01

Little attention typically is paid to the way self-report measures are translated for use in self-informant agreement studies. We studied two possible methods for creating informant measures: (a) the traditional method in which self-report items were translated from the first- to the third-person and (b) an alternative meta-perceptual method in which informants were directed to rate their perception of the targets’ self-perception. We hypothesized that the latter method would yield stronger self-informant agreement for evaluative personality dimensions measured by indirect item markers. We studied these methods in a sample of 303 undergraduate friendship dyads. Results revealed mean-level differences between methods, similar self-informant agreement across methods, stronger agreement for Big Five dimensions than for evaluative dimensions, and incremental validity for meta-perceptual informant rating methods. Limited power reduced the interpretability of several sparse acquaintanceship effects. We conclude that traditional informant methods are appropriate for most personality traits, but meta-perceptual methods may be more appropriate when personality questionnaire items reflect indirect indicators of the trait being measured, which is particularly likely for evaluative traits. PMID:21541262

A validity and reliability study of the Turkish Multidimensional Assessment of Fatigue (MAF) scale in chronic musculoskeletal physical therapy patients.

PubMed

Yildirim, Yücel; Ergin, Gülbin

2013-01-01

Fatigue is primarily a subjective experience and self-report is the most common approach used to measure fatigue. Numerous self-report instruments have been developed to measure fatigue. Unfortunately, each of these measures was tailored for the situation in which fatigue was studied. Therefore, the aim of this study was to determine the reliability and validity of the Turkish language version of the Multidimensional Assessment of Fatigue Scale (MAF-T) in chronic musculoskeletal physical therapy patients. The MAF-T was supplied by the MAPI Research Institute, and 69 chronic musculoskeletal physical therapy patients were evaluated. To validate MAF-T, all participants completed the MAF-T and Short Form-36 (SF-36). The MAF was administered again one week later to assess test-retest reliability. Using Cronbach α, the internal consistency reliability of the MAF-T was 0.90, the Intraclass Correlation Coefficient (ICC) reliability was 0.96. Item-discriminant validity was calculated between r=0.14 and r=0.82. The correlations between the total scores of the MAF-T scale and the subscale scores of SF-36 were negative and significant (p< 0.01). The MAF-T is a valid and reliable scale for assessing fatigue in chronic musculoskeletal physical therapy patients.

[Development the Japanese of the Self-Compassionate Reactions Inventory].

PubMed

Miyagawa, Yuki; Taniguchi, Junichi

2016-04-01

Self-compassion is defined as being compassionate towards the self in times of suffering, and is composed of the following three components: self-kindness, common humanity, and mindfulness. This article reports the development of the Japanese version of the Self-Compassionate Reactions Inventory (SCRI-J). The SCRI-J measures self-compassion based on the degree to which people choose self-compassionate reactions to 8 hypothetical hardships. Study 1: (N = 179) showed that the SCRI-J had sufficient internal consistency. In terms of its validity, results showed a positive correlation between the SCRI-J and the Japanese version of the Self-Compassion Scale, supporting its concurrent validity. In addition, the SCRI-J was positively correlated with self-esteem and negatively correlated with psychological stress responses. Moreover, the association between the SCRI-J and stress responses remained significant when the effect of self-esteem was removed. In Study 2 (N = 90), the SCRI-J demonstrated high test-retest reliability over 3 weeks. Overall, the present study indicates that the SCRI-J has sufficient reliability and validity as a new scale for self-compassion.

A self-report measure for the ICD-11 dimensional trait model proposal: The personality inventory for ICD-11.

PubMed

Oltmanns, Joshua R; Widiger, Thomas A

2018-02-01

Proposed for the 11th edition of the World Health Organization's International Classification of Diseases (ICD-11) is a dimensional trait model for the classification of personality disorder (Tyrer, Reed, & Crawford, 2015). The ICD-11 proposal consists of 5 broad domains: negative affective, detachment, dissocial, disinhibition, and anankastic (Mulder, Horwood, Tyrer, Carter, & Joyce, 2016). Several field trials have examined this proposal, yet none has included a direct measure of the trait model. The purpose of the current study was to develop and provide initial validation for the Personality Inventory for ICD-11 (PiCD), a self-report measure of this proposed 5-domain maladaptive trait model. Item selection and scale construction proceeded through 3 initial data collections assessing potential item performance. Two subsequent studies were conducted for scale validation. In Study 1, the PiCD was evaluated in a sample of 259 MTurk participants (who were or had been receiving mental health treatment) with respect to 2 measures of general personality structure: The Eysenck Personality Questionnaire-Revised and the 5-Dimensional Personality Test. In Study 2, the PiCD was evaluated in an additional sample of 285 participants with respect to 2 measures of maladaptive personality traits: The Personality Inventory for DSM-5 and the Computerized Adaptive Test for Personality Disorders. Study 3 provides an item-level exploratory structural equation model with the combined samples from Studies 1 and 2. The results are discussed with respect to the validity of the measure and the potential benefits for future research in having a direct, self-report measure of the ICD-11 trait proposal. (PsycINFO Database Record (c) 2018 APA, all rights reserved).

Meaninglessness in terminally ill cancer patients: a validation study and nurse education intervention trial.

PubMed

Morita, Tatsuya; Murata, Hisayuki; Hirai, Kei; Tamura, Keiko; Kataoka, Jun; Ohnishi, Hideki; Akizuki, Nobuya; Kurihara, Yukie; Akechi, Tatsuo; Uchitomi, Yosuke

2007-08-01

Recent empirical studies revealed that fostering patients' perception of meaning in their life is an essential task for palliative care clinicians. However, few studies have reported the effects of training programs for nurses specifically aimed at improving skills to relieve the meaninglessness of terminally ill cancer patients, and we have had no specific measurement instruments. The primary aims of this study were 1) to validate measurement tools to quantify nurses' self-reported practice and attitudes toward caring for terminally ill cancer patients feeling meaninglessness and 2) to explore the effects of the five-hour educational workshop focusing on meaninglessness on nurses' self-reported practice, attitudes toward caring for such patients, confidence, burnout, death anxiety, and meaning of life. A quasi-experimental pre-post questionnaire survey was performed on 147 nurses. The questionnaire was distributed before the intervention workshop and one and six months after. The workshop consisted of lecture, role-play, and the exercise of assessment and care planning based on two vignette verbatim records. First, using the first questionnaire sample and an additional sample of 20 nurses for the test-retest examination, we validated a six-item Self-Reported Practice scale, and an eight-item Attitudes Toward Caring for Patients Feeling Meaninglessness scale with three subscales (Willingness to Help, Positive Appraisal, and Helplessness). The nurses also completed a scale to assess confidence in caring for terminally ill patients with meaninglessness, the Maslach Burnout Inventory, the Death Attitude Inventory, the Frommelt Attitudes Toward Care of the Dying scale, the Self-Reported Practice Score in General Communication, and the three pain-related items from the Palliative Care Quiz for Nursing. For the Self-Reported Practice scale and the subscales of the Attitudes Toward Caring for Patients Feeling Meaninglessness scale, the Cronbach's alpha coefficients were 0.63-0.91, and the intra-class correlations were 0.89-0.94. The Self-Reported Practice scale significantly, but moderately, correlated with the Self-Reported Practice Score in General Communication (P=0.41). The Willingness to Help and Helplessness subscales significantly but weakly correlated with the Frommelt scale (P=-0.27, 0.21). Both scales did not correlate or minimally correlated with the Palliative Care Quiz for Nursing (P<0.20). The construct validity was confirmed using factor analysis. At the follow-up, of 147 nurses who participated in this workshop, 91 (62%) and 80 (54%) nurses responded. Self-reported practice and confidence significantly improved, whereas helplessness, emotional exhaustion, and death anxiety significantly decreased. The percentages of nurses who evaluated this program as "useful" or "very useful" were 79% (to understand the conceptual framework in caring for terminally ill patients with meaninglessness), 73% (to help in self-disclosing nurses' personal beliefs, values, and life goals), and 80% (to help in learning how to provide care for patients with meaninglessness). The Self-Reported Practice scale and the Attitudes Toward Caring for Patients Feeling Meaninglessness scale are reliable and valid tools to specifically quantify nurses' self-reported practice and attitudes toward caring for terminally ill cancer patients feeling meaninglessness of life. The five-hour workshop appeared to have a modest but significant beneficial effect on nurse-reported practice, attitudes, and confidence in providing care for terminally ill cancer patients feeling meaninglessness. Further educational intervention trials with control groups are promising.

Validity and reliability of a modified english version of the physical activity questionnaire for adolescents.

PubMed

Aggio, Daniel; Fairclough, Stuart; Knowles, Zoe; Graves, Lee

2016-01-01

Adaptation of physical activity self-report questionnaires is sometimes required to reflect the activity behaviours of diverse populations. The processes used to modify self-report questionnaires though are typically underreported. This two-phased study used a formative approach to investigate the validity and reliability of the Physical Activity Questionnaire for Adolescents (PAQ-A) in English youth. Phase one examined test content and response process validity and subsequently informed a modified version of the PAQ-A. Phase two assessed the validity and reliability of the modified PAQ-A. In phase one, focus groups (n = 5) were conducted with adolescents (n = 20) to investigate test content and response processes of the original PAQ-A. Based on evidence gathered in phase one, a modified version of the questionnaire was administered to participants (n = 169, 14.5 ± 1.7 years) in phase two. Internal consistency and test-retest reliability were assessed using Cronbach's alpha and intra-class correlations, respectively. Spearman correlations were used to assess associations between modified PAQ-A scores and accelerometer-derived physical activity, self-reported fitness and physical activity self-efficacy. Phase one revealed that the original PAQ-A was unrepresentative for English youth and that item comprehension varied. Contextual and population/cultural-specific modifications were made to the PAQ-A for use in the subsequent phase. In phase two, modified PAQ-A scores had acceptable internal consistency (α = 0.72) and test-retest reliability (ICC = 0.78). Modified PAQ-A scores were significantly associated with objectively assessed moderate-to-vigorous physical activity (r = 0.39), total physical activity (r = 0.42), self-reported fitness (r = 0.35), and physical activity self-efficacy (r = 0.32) (p ≤ 0.01). The modified PAQ-A had acceptable internal consistency and test-retest reliability. Modified PAQ-A scores displayed weak-to-moderate correlations with objectively measured physical activity, self-reported fitness, and self-efficacy providing evidence of satisfactory criterion and construct validity, respectively. Further testing with more diverse English samples is recommended to provide a more complete assessment of the tool.

Accuracy and usefulness of BMI measures based on self-reported weight and height: findings from the NHANES & NHIS 2001-2006.

PubMed

Stommel, Manfred; Schoenborn, Charlotte A

2009-11-19

The Body Mass Index (BMI) based on self-reported height and weight ("self-reported BMI") in epidemiologic studies is subject to measurement error. However, because of the ease and efficiency in gathering height and weight information through interviews, it remains important to assess the extent of error present in self-reported BMI measures and to explore possible adjustment factors as well as valid uses of such self-reported measures. Using the combined 2001-2006 data from the continuous National Health and Nutrition Examination Survey, discrepancies between BMI measures based on self-reported and physical height and weight measures are estimated and socio-demographic predictors of such discrepancies are identified. Employing adjustments derived from the socio-demographic predictors, the self-reported measures of height and weight in the 2001-2006 National Health Interview Survey are used for population estimates of overweight & obesity as well as the prediction of health risks associated with large BMI values. The analysis relies on two-way frequency tables as well as linear and logistic regression models. All point and variance estimates take into account the complex survey design of the studies involved. Self-reported BMI values tend to overestimate measured BMI values at the low end of the BMI scale (< 22) and underestimate BMI values at the high end, particularly at values > 28. The discrepancies also vary systematically with age (younger and older respondents underestimate their BMI more than respondents aged 42-55), gender and the ethnic/racial background of the respondents. BMI scores, adjusted for socio-demographic characteristics of the respondents, tend to narrow, but do not eliminate misclassification of obese people as merely overweight, but health risk estimates associated with variations in BMI values are virtually the same, whether based on self-report or measured BMI values. BMI values based on self-reported height and weight, if corrected for biases associated with socio-demographic characteristics of the survey respondents, can be used to estimate health risks associated with variations in BMI, particularly when using parametric prediction models.

Measuring disability: a systematic review of the validity and reliability of the Global Activity Limitations Indicator (GALI).

PubMed

Van Oyen, Herman; Bogaert, Petronille; Yokota, Renata T C; Berger, Nicolas

2018-01-01

GALI or Global Activity Limitation Indicator is a global survey instrument measuring participation restriction. GALI is the measure underlying the European indicator Healthy Life Years (HLY). Gali has a substantial policy use within the EU and its Member States. The objective of current paper is to bring together what is known from published manuscripts on the validity and the reliability of GALI. Following the PRISMA guidelines, two search strategies (PUBMED, Google Scholar) were combined to identify manuscripts published in English with publication date 2000 or beyond. Articles were classified as reliability studies, concurrent or predictive validity studies, in national or international populations. Four cross-sectional studies (of which 2 international) studied how GALI relates to other health measures (concurrent validity). A dose-response effect by GALI severity level on the association with the other health status measures was observed in the national studies. The 2 international studies (SHARE, EHIS) concluded that the odds of reporting participation restriction was higher in subjects with self-reported or observed functional limitations. In SHARE, the size of the Odds Ratio's (ORs) in the different countries was homogeneous, while in EHIS the size of the ORs varied more strongly. For the predictive validity, subjects were followed over time (4 studies of which one international). GALI proved, both in national and international data, to be a consistent predictor of future health outcomes both in terms of mortality and health care expenditure. As predictors of mortality, the two distinct health concepts, self-rated health and GALI, acted independently and complementary of each other. The one reliability study identified reported a sufficient reliability of GALI. GALI as inclusive one question instrument fits all conceptual characteristics specified for a global measure on participation restriction. In none of the studies, included in the review, there was evidence of a failing validity. The review shows that GALI has a good and sufficient concurrent and predictive validity, and reliability.

Internal Factor Structure and Convergent Validity Evidence: The Self-Report Version of Self-Regulation Strategy Inventory

ERIC Educational Resources Information Center

Cleary, Timothy J.; Dembitzer, Leah; Kettler, Ryan J.

2015-01-01

Using a sample of 348 middle school students, we gathered evidence regarding the internal consistency of scores, as well as the internal factor structure and convergent validity evidence for inferences from a self-report questionnaire called the Self-Regulation Strategy Inventory-Self Report. Confirmatory factor analysis revealed that the fit…

Psychometric properties of seven self-report measures of posttraumatic stress disorder in college students with mixed civilian trauma exposure.

PubMed

Adkins, Jennifer W; Weathers, Frank W; McDevitt-Murphy, Meghan; Daniels, Jennifer B

2008-12-01

In this study psychometric properties of seven self-report measures of posttraumatic stress disorder (PTSD) were compared. The seven scales evaluated were the Davidson Trauma Scale (DTS), the PTSD Checklist (PCL), the Posttraumatic Stress Diagnostic Scale (PDS), the Civilian Mississippi Scale (CMS), the Impact of Event Scale-Revised (IES-R), the Penn Inventory for Posttraumatic Stress Disorder (Penn), and the PK scale of the MMPI-2 (PK). Participants were 239 (79 male and 160 female) trauma-exposed undergraduates. All seven measures exhibited good test-retest reliability and internal consistency. The PDS, PCL and DTS demonstrated the best convergent validity; the IES-R, PDS, and PCL demonstrated the best discriminant validity; and the PDS, PCL, and IES-R demonstrated the best diagnostic utility. Overall, results most strongly support the use of the PDS and the PCL for the assessment of PTSD in this population.

Virtue or Pretense? Looking behind Self-Declared Innocence in Doping

PubMed Central

Petróczi, Andrea; Aidman, Eugene V.; Hussain, Iltaf; Deshmukh, Nawed; Nepusz, Tamás; Uvacsek, Martina; Tóth, Miklós; Barker, James; Naughton, Declan P.

2010-01-01

Background Social science studies of doping practices in sport rely predominantly on self-reports. Studies of psychoactive drug use indicate that self-reporting is characterised by under-reporting. Likewise doping practice is likely to be equally under-reported, if not more so. This calls for more sophisticated methods for such reporting and for independent, objective validation of its results. The aims of this study were: i) to contrast self-reported doping use with objective results from chemical hair analysis and ii) to investigate the influence of the discrepancy on doping attitudes, social projection, descriptive norms and perceived pressure to use doping. Methodology/Principal Findings A doping attitudes questionnaire was developed and combined with a response latency-based implicit association test and hair sample analysis for key doping substances in 14 athletes selected from a larger sample (N = 82) to form contrast comparison groups. Results indicate that patterns of group differences in social projection, explicit attitude about and perceived pressure to use doping, vary depending on whether the user and non-user groups are defined by self-report or objectively verified through hair analysis. Thus, self-confessed users scored higher on social projection, explicit attitude to doping and perceived pressure. However, when a doping substance was detected in the hair of an athlete who denied doping use, their self-report evidenced extreme social desirability (negative attitude, low projection and low perceived pressure) and contrasted sharply with a more positive estimate of their implicit doping attitude. Conclusions/Significance Hair analysis for performance enhancing substances has shown considerable potential in validating athletes' doping attitude estimations and admissions of use. Results not only confirm the need for improved self-report methodology for future research in socially-sensitive domains but also indicate where the improvements are likely to come from: as chemical validation remains expensive, a more realistic promise for large scale studies and online data collection efforts is held by measures of implicit social cognition. PMID:20463978

Validating indicators of treatment response: application to trichotillomania.

PubMed

Nelson, Samuel O; Rogers, Kate; Rusch, Natalie; McDonough, Lauren; Malloy, Elizabeth J; Falkenstein, Martha J; Banis, Maria; Haaga, David A F

2014-09-01

Different studies of the treatment of trichotillomania (TTM) have used varying standards to determine the proportion of patients who obtain clinically meaningful benefits, but there is little information on the similarity of results yielded by these methods or on their comparative validity. Data from a stepped-care (Step 1: Web-based self-help; Step 2: Individual behavior therapy; N = 60) treatment study of TTM were used to evaluate 7 potential standards: complete abstinence, ≥ 25% symptom reduction, recovery of normal functioning, and clinical significance (recovery + statistically reliable change), each of the last 3 being measured by self-report (Massachusetts General Hospital Hairpulling Scale; MGH-HPS) or interview (Psychiatric Institute Trichotillomania Scale). Depending on the metric, response rates ranged from 25 to 68%. All standards were significantly associated with one another, though less strongly for the 25% symptom reduction metrics. Concurrent (with deciding to enter Step 2 treatment) and predictive (with 3-month follow-up treatment satisfaction, TTM-related impairment, quality of life, and diagnosis) validity results were variable but generally strongest for clinical significance as measured via self-report. Routine reporting of the proportion of patients who make clinically significant improvement on the MGH-HPS, supplemented by data on complete abstinence, would bolster the interpretability of TTM treatment outcome findings. PsycINFO Database Record (c) 2014 APA, all rights reserved.

The Premature Ejaculation Profile: validation of self-reported outcome measures for research and practice.

PubMed

Patrick, Donald L; Giuliano, François; Ho, Kai Fai; Gagnon, Dennis D; McNulty, Pauline; Rothman, Margaret

2009-02-01

To evaluate the reliability and validity of the Premature Ejaculation Profile (PEP), a self-reported outcome instrument for evaluating domains of PE and its treatment, comprised of four single-item measures, a profile, and an index score. Data were from men participating in observational studies in the USA (PE, 207 men; non-PE, 1380) and Europe (PE, 201; non-PE, 914) and from men with PE (1238) participating in a phase III randomized, placebo-controlled clinical trial of dapoxetine. The PEP contains four measures: perceived control over ejaculation, personal distress related to ejaculation, satisfaction with sexual intercourse, and interpersonal difficulty related to ejaculation, each assessed on five-point response scales. Test-retest reliability, known-groups validity, and ability to detect a patient-reported global impression of change (PGI) in condition were evaluated for the individual PEP measures and a PEP index score (the mean of all four measures). Profile analysis was conducted using multivariate analysis of variance. All PEP measures showed acceptable reliability (intraclass correlation coefficients ranged from 0.66 to 0.83) and mean scores for all measures differed significantly between PE and non-PE groups (P < 0.001). Men who reported a reduction in PE with treatment in the phase III trial had significantly greater scores on each of the four measures. The PEP profiles of men with and without PE differed significantly (P < 0.001) in both observational studies; higher levels of PGI were associated with higher PEP profiles (P < 0.001). The PEP index score also showed acceptable reliability and was significantly different between the PE and non-PE groups (P < 0.001). Men who reported an improvement in PE with treatment in the phase III trial had significantly greater PEP index scores. In the phase III trial, nausea was the most common adverse event with dapoxetine. The PEP provides a reliable, valid, and interpretable measure for use in monitoring outcomes of men with PE.

A comparison of the validity of the five-factor model (FFM) personality disorder prototypes. Using FFM self-report and interview measures.

PubMed

Miller, Joshua D; Bagby, R Michael; Pilkonis, Paul A

2005-12-01

Recent studies have demonstrated that personality disorders (PDs) can be assessed via a prototype-matching technique, which enables researchers and clinicians to match an individual's five-factor model (FFM) personality profile to an expert-generated prototype. The current study examined the relations between these prototype scores, using interview and self-report data, and PD symptoms in an outpatient sample (N = 115). Both sets of PD prototype scores demonstrated significant convergent validity with PD symptom counts, suggesting that the FFM PD prototype scores are appropriate for use with both sources of data.

Construct Validity Evidence for Single-Response Items to Estimate Physical Activity Levels in Large Sample Studies

ERIC Educational Resources Information Center

Jackson, Allen W.; Morrow, James R., Jr.; Bowles, Heather R.; FitzGerald, Shannon J.; Blair, Steven N.

2007-01-01

Valid measurement of physical activity is important for studying the risks for morbidity and mortality. The purpose of this study was to examine evidence of construct validity of two similar single-response items assessing physical activity via self-report. Both items are based on the stages of change model. The sample was 687 participants (men =…

Transcultural and psychometric validation of the Dispositional Resilience Scale (DRS-15) in Chinese adult women.

PubMed

Wong, Janet Yuen-Ha; Fong, Daniel Yee-Tak; Choi, Anna Wai-Man; Chan, Claudia Kor-Yee; Tiwari, Agnes; Chan, Ko Ling; Lai, Vincent; Logan, Tk; Bartone, Paul

2014-11-01

The aim of this study was to report translation and transcultural adaptation of the 15-item Dispositional Resilience Scale in traditional Chinese (C-DRS-15) and evaluate its psychometric properties. The DRS is a self-report instrument that measures psychological hardiness. We followed an international standard of cross-cultural translation and validation of patient-reported outcome measures to create the Chinese version. Then, the translated C-DRS-15 was validated on 542 Chinese women from a population-based sample in Hong Kong. The internal consistency and criterion-related validity were investigated. Exploratory and confirmatory factor analysis revealed that the C-DRS-15 was supported by a modified three-factor structure in our Chinese sample (RMSEA = .06, CFI = .94, TLI = .92, and SRMR = .06). The reliability (Cronbach's α coefficient = .78) and validity were satisfactory. Total resilience score was negatively correlated with depression (p < .001), with non-depressed women scoring higher on the C-DRS-15. The C-DRS-15 was demonstrated to be a reliable and valid measurement to assess hardiness in Chinese women.

The Feasibility of Using Questionnaires and Accelerometers to Measure Physical Activity and Sedentary Behavior Among Inpatient Adults With Mental Illness.

PubMed

Fraser, Sarah J; Chapman, Justin J; Brown, Wendy J; Whiteford, Harvey A; Burton, Nicola W

2016-05-01

The aim of this study was to assess the feasibility of using questionnaires and accelerometers to measure physical activity and sedentary behavior among inpatient adults with mental illness. Participants completed a physical activity and sitting time questionnaire and wore an accelerometer for 7 consecutive days. Feasibility was assessed in terms of participant engagement, self-reported ease/ difficulty of completing study components, extreme self-report data values and adherence to accelerometer wear time criteria. Ease/difficulty ratings were examined by level of distress. 177 inpatients were invited to the study, 101 completed the questionnaires and 36 provided valid accelerometry data. Participants found it more difficult to complete sitting time and physical activity questionnaires than to wear the accelerometer during waking hours (z = 3.787, P < .001; z = 2.824, P = .005 respectively). No significant differences were found in ease/ difficulty ratings by level of distress for any of the study components. Extreme values for self-reported sitting time were identified in 27% of participants. Inpatient adults with mental illness can engage with self-report and objective methods of measuring physical activity and sedentary behavior. They were initially less willing to participate in objective measurement, which may however be more feasible than self-report measures.

Construct validity of self-reported historical physical activity.

PubMed

Bowles, Heather R; FitzGerald, Shannon J; Morrow, James R; Jackson, Allen W; Blair, Steven N

2004-08-01

The purpose of this study was to determine the construct-related validity of self-reported historical walking, running, and jogging (WRJ) activity on the basis of data from the Aerobics Center Longitudinal Study (Dallas, Texas). A total of 4,100 men and 963 women underwent at least one medical examination between 1976 and 1985 and completed a follow-up questionnaire in 1986. Levels of glucose, cholesterol, and triglycerides, resting systolic blood pressure, body mass index (weight (kg)/height (m)(2)), and cardiorespiratory fitness were measured at the time of the medical examination. The follow-up questionnaire assessed WRJ and other strenuous activities for each year from 1976 through 1985. Data analysis included Spearman and partial correlations, analysis of variance, analysis of covariance, and t tests. Results indicated significant correlations between recalled WRJ and treadmill times for each year throughout the 10-year period (r = 0.40-0.61). Participants were classified as historically either sufficiently physically active to receive a health benefit or insufficiently active for a health benefit. Engaging in sufficient levels of historical WRJ was associated with higher treadmill times and lower body mass indices for men and women and lower triglyceride levels for men. Self-reported historical WRJ can be assessed with reasonable validity in comparison with measured treadmill performance, with no decay in accuracy of reporting for up to 10 years in the past.

How young can children reliably and validly self-report their health-related quality of life?: an analysis of 8,591 children across age subgroups with the PedsQL 4.0 Generic Core Scales.

PubMed

Varni, James W; Limbers, Christine A; Burwinkle, Tasha M

2007-01-03

The last decade has evidenced a dramatic increase in the development and utilization of pediatric health-related quality of life (HRQOL) measures in an effort to improve pediatric patient health and well-being and determine the value of healthcare services. The emerging paradigm shift toward patient-reported outcomes (PROs) in clinical trials has provided the opportunity to further emphasize the value and essential need for pediatric patient self-reported outcomes measurement. Data from the PedsQL DatabaseSM were utilized to test the hypothesis that children as young as 5 years of age can reliably and validly report their HRQOL. The sample analyzed represented child self-report age data on 8,591 children ages 5 to 16 years from the PedsQL 4.0 Generic Core Scales DatabaseSM. Participants were recruited from general pediatric clinics, subspecialty clinics, and hospitals in which children were being seen for well-child checks, mild acute illness, or chronic illness care (n = 2,603, 30.3%), and from a State Children's Health Insurance Program (SCHIP) in California (n = 5,988, 69.7%). Items on the PedsQL 4.0 Generic Core Scales had minimal missing responses for children as young as 5 years old, supporting feasibility. The majority of the child self-report scales across the age subgroups, including for children as young as 5 years, exceeded the minimum internal consistency reliability standard of 0.70 required for group comparisons, while the Total Scale Scores across the age subgroups approached or exceeded the reliability criterion of 0.90 recommended for analyzing individual patient scale scores. Construct validity was demonstrated utilizing the known groups approach. For each PedsQL scale and summary score, across age subgroups, including children as young as 5 years, healthy children demonstrated a statistically significant difference in HRQOL (better HRQOL) than children with a known chronic health condition, with most effect sizes in the medium to large effect size range. The results demonstrate that children as young as the 5 year old age subgroup can reliably and validly self-report their HRQOL when given the opportunity to do so with an age-appropriate instrument. These analyses are consistent with recent FDA guidelines which require instrument development and validation testing for children and adolescents within fairly narrow age groupings and which determine the lower age limit at which children can provide reliable and valid responses across age categories.

Development and Validation of a Multifactorial Treatment Outcome Measure for Eating Disorders.

ERIC Educational Resources Information Center

Anderson, Drew A.; Williamson, Donald A.; Duchmann, Erich G.; Gleaves, David H.; Barbin, Jane M.

1999-01-01

Developed a brief self-report inventory to evaluate treatment outcome for anorexia and bulimia nervosa, the Multifactorial Assessment of Eating Disorders, and evaluated the instrument in a series of studies involving 1,054 women. Results support a stable factor structure and satisfactory reliability and validity, and establish normative data. (SLD)

Incremental Validity of the MMPI-2 PSY-5 Scales in Assessing Self-Reported Personality Disorder Criteria

ERIC Educational Resources Information Center

Wygant, Dustin B.; Sellbom, Martin; Graham, John R.; Schenk, Paul W.

2006-01-01

The Minnesota Multiphasic Personality Inventory-2 (MMPI-2) Personality Psychopathology-Five (PSY-5) scales were developed to measure abnormal personality symptomatology. The present study examines the incremental validity of the PSY-5 scales beyond the clinical and content scales in assessing criteria associated with personality disorders. The…

How Can We Improve the Measurement of "Non-Academic" Competencies?

ERIC Educational Resources Information Center

Halpin, Peter F.

2017-01-01

The target paper, "Rethinking Traditional Methods of Survey Validation" (Andrew Maul), raises some interesting critical ideas, both old and new, about the validation of self-report surveys. As indicated by Dr. Maul, recent policy initiatives in the United States (e.g., ESSA) have led to a demand for assessments of…

College and Career Readiness Assessment: Validation of the Key Cognitive Strategies Framework

ERIC Educational Resources Information Center

Lombardi, Allison R.; Conley, David T.; Seburn, Mary A.; Downs, Andrew M.

2013-01-01

In this study, the authors examined the psychometric properties of the key cognitive strategies (KCS) within the CollegeCareerReady[TM] School Diagnostic, a self-report measure of critical thinking skills intended for high school students. Using a cross-validation approach, an exploratory factor analysis was conducted with a randomly selected…

An Evaluation of the Psychache Scale on an Offender Population

ERIC Educational Resources Information Center

Mills, Jeremy F.; Green, Kate; Reddon, John R.

2005-01-01

This study examined the generalizability of a self-report measure of psychache to an offender population. The factor structure, construct validity, and criterion validity of the Psychache Scale was assessed on 136 male prison inmates. The results showed the Psychache Scale has a single underlying factor structure and to be strongly associated with…

Bullying Participant Behaviors Questionnaire (BPBQ): Establishing a Reliable and Valid Measure

ERIC Educational Resources Information Center

Demaray, Michelle Kilpatrick; Summers, Kelly Hodgson; Jenkins, Lyndsay N.; Becker, Lisa Davidson

2016-01-01

The current study further establishes the reliability and validity of the Bullying Participant Behaviors Questionnaire (BPBQ), a self-report survey that allows for an examination of participation in various bullying participant role behaviors including bully, assistant to the bully, victim, defender of the victim, and outsider. The study included…

Assessment of Perceived Parental Psychological Control in Chinese Adolescents in Hong Kong

ERIC Educational Resources Information Center

Shek, Daniel T. L.

2006-01-01

Objective: There is no validated self-report measure of parental psychological control in the Chinese culture. The reliability and validity of the Chinese Paternal Psychological Control Scale (CPPCS) and Chinese Maternal Psychological Control Scale (CMPCS) were examined. Method: A total of 3,017 Chinese secondary school students responded to the…

Reliability, Validity and Utility of a Multiple Intelligences Assessment for Career Planning.

ERIC Educational Resources Information Center

Shearer, C. Branton

"The Multiple Intelligences Developmental Assessment Scales" (MIDAS) is a self- (or other-) completed instrument which is based upon the theory of multiple intelligences. The validity, reliability, and utility data regarding the MIDAS are reported here. The measure consists of 7 main scales and 24 subscales which summarize a person's intellectual…

Development and Validation of a Multiple Intelligences Assessment Scale for Children.

ERIC Educational Resources Information Center

Shearer, C. Branton

Since Howard Gardner proposed the theory of multiple intelligences as an alternative to the unitary concept of general intelligence, educators have been searching for an acceptable method of assessment. To help with this search, three studies that describe the development and validation of a self- (and parent-) report measure of children's…

The Academic Diligence Task (ADT): Assessing Individual Differences in Effort on Tedious but Important Schoolwork

PubMed Central

Galla, Brian M.; Plummer, Benjamin D.; White, Rachel E.; Meketon, David; D’Mello, Sidney K.; Duckworth, Angela L.

2014-01-01

The current study reports on the development and validation of the Academic Diligence Task (ADT), designed to assess the tendency to expend effort on academic tasks which are tedious in the moment but valued in the long-term. In this novel online task, students allocate their time between solving simple math problems (framed as beneficial for problem solving skills) and, alternatively, playing Tetris or watching entertaining videos. Using a large sample of high school seniors (N = 921), the ADT demonstrated convergent validity with self-report ratings of Big Five conscientiousness and its facets, self-control and grit, as well as discriminant validity from theoretically unrelated constructs, such as Big Five extraversion, openness, and emotional stability, test anxiety, life satisfaction, and positive and negative affect. The ADT also demonstrated incremental predictive validity for objectively measured GPA, standardized math and reading achievement test scores, high school graduation, and college enrollment, over and beyond demographics and intelligence. Collectively, findings suggest the feasibility of online behavioral measures to assess noncognitive individual differences that predict academic outcomes. PMID:25258470

The Academic Diligence Task (ADT): Assessing Individual Differences in Effort on Tedious but Important Schoolwork.

PubMed

Galla, Brian M; Plummer, Benjamin D; White, Rachel E; Meketon, David; D'Mello, Sidney K; Duckworth, Angela L

2014-10-01

The current study reports on the development and validation of the Academic Diligence Task (ADT), designed to assess the tendency to expend effort on academic tasks which are tedious in the moment but valued in the long-term. In this novel online task, students allocate their time between solving simple math problems (framed as beneficial for problem solving skills) and, alternatively, playing Tetris or watching entertaining videos. Using a large sample of high school seniors ( N = 921), the ADT demonstrated convergent validity with self-report ratings of Big Five conscientiousness and its facets, self-control and grit, as well as discriminant validity from theoretically unrelated constructs, such as Big Five extraversion, openness, and emotional stability, test anxiety, life satisfaction, and positive and negative affect. The ADT also demonstrated incremental predictive validity for objectively measured GPA, standardized math and reading achievement test scores, high school graduation, and college enrollment, over and beyond demographics and intelligence. Collectively, findings suggest the feasibility of online behavioral measures to assess noncognitive individual differences that predict academic outcomes.

A Pilot Study Comparing Observational and Questionnaire Surrogate Measures of Pesticide Exposure Among Residents Impacted by the Ecuadorian Flower Industry.

PubMed

Handal, Alexis J; McGough-Maduena, Alison; Páez, Maritza; Skipper, Betty; Rowland, Andrew S; Fenske, Richard A; Harlow, Siobán D

2015-01-01

Self-reported measures of residential pesticide exposure are commonly used in epidemiological studies, especially when financial and logistical resources are limited. However, self-reporting is prone to misclassification bias. This pilot study assesses the agreement between self-report of residential pesticide exposure with direct observation measures, in an agricultural region of Ecuador, as a cross-validation method in 26 participants (16 rose workers and 10 controls), with percent agreement and kappa statistics calculated. Proximity of homes to nearby flower farms was found to have only fair agreement (kappa =.35). The use of discarded plastics (kappa =.06) and wood (kappa =.13) were found to have little agreement. Results indicate that direct observation or measurement may provide more accurate appraisals of residential exposures, such as proximity to industrial farmland and the use of discarded materials obtained from the flower farms.

Assessing children's empathy through a Spanish adaptation of the Basic Empathy Scale: parent's and child's report forms.

PubMed

Sánchez-Pérez, Noelia; Fuentes, Luis J; Jolliffe, Darrick; González-Salinas, Carmen

2014-01-01

The aim of the current research was to study cognitive and affective empathy in children aged 6-12 years old, and their associations with children's family environment and social adjustment. For this purpose, we developed the Spanish version of the Basic Empathy Scale (BES), self- and parent-report forms. Factorial analyses confirmed a two-component model of empathy in both self- and parent-report forms. Concordance between parent-child measures of empathy was low for cognitive and affective factors. Analyses of variance on the cognitive and affective components brought a significant effect of age for self-reported cognitive empathy, with older children scoring higher than younger ones. Gender brought out a significant principal effect for self-reported affective empathy, with girls scoring higher than boys. No other main effects were found for age and gender for the rest of the factors analyzed. Children's empathy was associated with socioeconomic status and other family socialization processes, as well as children' social behaviors. Overall the new measures provided a coherent view of empathy in middle childhood and early adolescence when measured through self and parent reports, and illustrate the similarity of the validity of the BES in a European-Spanish culture.

Development and Initial Validation of an Instrument to Measure Physicians' Use of, Knowledge about, and Attitudes Toward Computers

PubMed Central

Cork, Randy D.; Detmer, William M.; Friedman, Charles P.

1998-01-01

This paper describes details of four scales of a questionnaire—“Computers in Medical Care”—measuring attributes of computer use, self-reported computer knowledge, computer feature demand, and computer optimism of academic physicians. The reliability (i.e., precision, or degree to which the scale's result is reproducible) and validity (i.e., accuracy, or degree to which the scale actually measures what it is supposed to measure) of each scale were examined by analysis of the responses of 771 full-time academic physicians across four departments at five academic medical centers in the United States. The objectives of this paper were to define the psychometric properties of the scales as the basis for a future demonstration study and, pending the results of further validity studies, to provide the questionnaire and scales to the medical informatics community as a tool for measuring the attitudes of health care providers. Methodology: The dimensionality of each scale and degree of association of each item with the attribute of interest were determined by principal components factor analysis with othogonal varimax rotation. Weakly associated items (factor loading <.40) were deleted. The reliability of each resultant scale was computed using Cronbach's alpha coefficient. Content validity was addressed during scale construction; construct validity was examined through factor analysis and by correlational analyses. Results: Attributes of computer use, computer knowledge, and computer optimism were unidimensional, with the corresponding scales having reliabilities of.79,.91, and.86, respectively. The computer-feature demand attribute differentiated into two dimensions: the first reflecting demand for high-level functionality with reliability of.81 and the second demand for usability with reliability of.69. There were significant positive correlations between computer use, computer knowledge, and computer optimism scale scores and respondents' hands-on computer use, computer training, and self-reported computer sophistication. In addition, items posited on the computer knowledge scale to be more difficult generated significantly lower scores. Conclusion: The four scales of the questionnaire appear to measure with adequate reliability five attributes of academic physicians' attitudes toward computers in medical care: computer use, self-reported computer knowledge, demand for computer functionality, demand for computer usability, and computer optimism. Results of initial validity studies are positive, but further validation of the scales is needed. The URL of a downloadable HTML copy of the questionnaire is provided. PMID:9524349

Patient-reported outcomes in borderline personality disorder.

PubMed

Hasler, Gregor; Hopwood, Christopher J; Jacob, Gitta A; Brändle, Laura S; Schulte-Vels, Thomas

2014-06-01

Patient-reported outcome (PRO) refers to measures that emphasize the subjective view of patients about their health-related conditions and behaviors. Typically, PROs include self-report questionnaires and clinical interviews. Defining PROs for borderline personality disorder (BPD) is particularly challenging given the disorder's high symptomatic heterogeneity, high comorbidity with other psychiatric conditions, highly fluctuating symptoms, weak correlations between symptoms and functional outcomes, and lack of valid and reliable experimental measures to complement self-report data. Here, we provide an overview of currently used BPD outcome measures and discuss them from clinical, psychometric, experimental, and patient perspectives. In addition, we review the most promising leads to improve BPD PROs, including the DSM-5 Section III, the Recovery Approach, Ecological Momentary Assessments, and novel experimental measures of social functioning that are associated with functional and social outcomes.

Functional outcomes assessment in shoulder surgery

PubMed Central

Wylie, James D; Beckmann, James T; Granger, Erin; Tashjian, Robert Z

2014-01-01

The effective evaluation and management of orthopaedic conditions including shoulder disorders relies upon understanding the level of disability created by the disease process. Validated outcome measures are critical to the evaluation process. Traditionally, outcome measures have been physician derived objective evaluations including range of motion and radiologic evaluations. However, these measures can marginalize a patient’s perception of their disability or outcome. As a result of these limitations, patient self-reported outcomes measures have become popular over the last quarter century and are currently primary tools to evaluate outcomes of treatment. Patient reported outcomes measures can be general health related quality of life measures, health utility measures, region specific health related quality of life measures or condition specific measures. Several patients self-reported outcomes measures have been developed and validated for evaluating patients with shoulder disorders. Computer adaptive testing will likely play an important role in the arsenal of measures used to evaluate shoulder patients in the future. The purpose of this article is to review the general health related quality-of-life measures as well as the joint-specific and condition specific measures utilized in evaluating patients with shoulder conditions. Advances in computer adaptive testing as it relates to assessing dysfunction in shoulder conditions will also be reviewed. PMID:25405091

Self-Perceived Employability: Construction and Initial Validation of a Scale for University Students

ERIC Educational Resources Information Center

Rothwell, Andrew; Herbert, Ian; Rothwell, Frances

2008-01-01

This paper reports the development of a research instrument to examine the expectations and self-perceptions of employability of business undergraduates (bachelor degree students) in three UK universities, and examines relationships with other measures. The scale was found to have a satisfactory internal reliability coefficient for an untested…

Physical activity problem-solving inventory for adolescents: development and initial validation.

PubMed

Thompson, Debbe; Bhatt, Riddhi; Watson, Kathy

2013-08-01

Youth encounter physical activity barriers, often called problems. The purpose of problem solving is to generate solutions to overcome the barriers. Enhancing problem-solving ability may enable youth to be more physically active. Therefore, a method for reliably assessing physical activity problem-solving ability is needed. The purpose of this research was to report the development and initial validation of the physical activity problem-solving inventory for adolescents (PAPSIA). Qualitative and quantitative procedures were used. The social problem-solving inventory for adolescents guided the development of the PAPSIA scale. Youth (14- to 17-year-olds) were recruited using standard procedures, such as distributing flyers in the community and to organizations likely to be attended by adolescents. Cognitive interviews were conducted in person. Adolescents completed pen and paper versions of the questionnaire and/or scales assessing social desirability, self-reported physical activity, and physical activity self-efficacy. An expert panel review, cognitive interviews, and a pilot study (n = 129) established content validity. Construct, concurrent, and predictive validity were also established (n = 520 youth). PAPSIA is a promising measure for assessing youth physical activity problem-solving ability. Future research will assess its validity with objectively measured physical activity.

An examination of the Psychopathic Personality Inventory's nomological network: a meta-analytic review.

PubMed

Miller, Joshua D; Lynam, Donald R

2012-07-01

Since its publication, the Psychopathic Personality Inventory and its revision (Lilienfeld & Andrews, 1996; Lilienfeld & Widows, 2005) have become increasingly popular such that it is now among the most frequently used self-report inventories for the assessment of psychopathy. The current meta-analysis examined the relations between the two PPI factors (factor 1: Fearless Dominance; factor 2: Self-Centered Impulsivity), as well as their relations with other validated measures of psychopathy, internalizing and externalizing forms of psychopathology, general personality traits, and antisocial personality disorder symptoms. Across 61 samples reported in 49 publications, we found support for the convergent and criterion validity of both PPI factor 2 and the PPI total score. Much weaker validation was found for PPI factor 1, which manifested limited convergent validity and a pattern of correlations with central criterion variables that was inconsistent with many conceptualizations of psychopathy. PsycINFO Database Record (c) 2012 APA, all rights reserved.

Is self-reporting workplace activity worthwhile? Validity and reliability of occupational sitting and physical activity questionnaire in desk-based workers.

PubMed

Pedersen, Scott J; Kitic, Cecilia M; Bird, Marie-Louise; Mainsbridge, Casey P; Cooley, P Dean

2016-08-19

With the advent of workplace health and wellbeing programs designed to address prolonged occupational sitting, tools to measure behaviour change within this environment should derive from empirical evidence. In this study we measured aspects of validity and reliability for the Occupational Sitting and Physical Activity Questionnaire that asks employees to recount the percentage of work time they spend in the seated, standing, and walking postures during a typical workday. Three separate cohort samples (N = 236) were drawn from a population of government desk-based employees across several departmental agencies. These volunteers were part of a larger state-wide intervention study. Workplace sitting and physical activity behaviour was measured both subjectively against the International Physical Activity Questionnaire, and objectively against ActivPal accelerometers before the intervention began. Criterion validity and concurrent validity for each of the three posture categories were assessed using Spearman's rank correlation coefficients, and a bias comparison with 95 % limits of agreement. Test-retest reliability of the survey was reported with intraclass correlation coefficients. Criterion validity for this survey was strong for sitting and standing estimates, but weak for walking. Participants significantly overestimated the amount of walking they did at work. Concurrent validity was moderate for sitting and standing, but low for walking. Test-retest reliability of this survey proved to be questionable for our sample. Based on our findings we must caution occupational health and safety professionals about the use of employee self-report data to estimate workplace physical activity. While the survey produced accurate measurements for time spent sitting at work it was more difficult for employees to estimate their workplace physical activity.

The risk-taking and self-harm inventory for adolescents: development and psychometric evaluation.

PubMed

Vrouva, Ioanna; Fonagy, Peter; Fearon, Pasco R M; Roussow, Trudie

2010-12-01

In this study, we report on the development and psychometric evaluation of the Risk-Taking (RT) and Self-Harm (SH) Inventory for Adolescents (RTSHIA), a self-report measure designed to assess adolescent RT and SH in community and clinical settings. 651 young people from secondary schools in England ranging in age from 11.6 years to 18.7 years and 71 young people referred to mental health services for SH behavior in London between the ages of 11.9 years and 17.5 years completed the RTSHIA along with standardized measures of adolescent psychopathology. Two factors emerged from the principal axis factoring, and RT and SH were further validated by a confirmatory factor analysis as related, but different, constructs, rather than elements of a single continuum. Inter-item and test-retest reliabilities were high for both components (Cronbach's α = .85, ru = .90; Cronbach's α .93, ru = .87), and considerable evidence emerged in support of the measure's convergent, concurrent, and divergent validity. The findings are discussed with regard to potential usefulness of the RTSHIA for research and clinical purposes with adolescents.

Measurement of perceived functions of non-suicidal self-injury for Chinese adolescents.

PubMed

Leong, Choi Hong; Wu, Anise M S; Poon, Mary Man-Yee

2014-01-01

Due to the lack of validated assessment tools for motives of non-suicidal self-injury behaviors in the Chinese contexts, this study aims to evaluate the psychometric properties of the Chinese version of the Functional Assessment of Self-Mutilation (C-FASM). A total of 345 secondary school students (mean age = 11.41 years), who reported non-suicidal self-injury in the past year, voluntarily participated in the questionnaire survey. Confirmatory factor analysis results supported a second-order model of 4 motivational factors. The overall scale scores had significant correlations with depression, anxiety, impulsiveness, self-esteem, social support, and suicidal ideation. The internal consistency of the scale was also satisfactory. The C-FASM is a valid and reliable instrument for assessing non-suicidal self-injury among nonclinical Chinese adolescents.

Development and Validation of a Measure of Maladaptive Social-Evaluative Beliefs Characteristic of Social Anxiety Disorder in Youth: The Report of Youth Social Cognitions (RYSC).

PubMed

Wong, Quincy J J; Certoma, Sarah P; McLellan, Lauren F; Halldorsson, Brynjar; Reyes, Natasha; Boulton, Kelsie; Hudson, Jennifer L; Rapee, Ronald M

2017-12-28

Recent research has started to examine the applicability of influential adult models of the maintenance of social anxiety disorder (SAD) to youth. This research is limited by the lack of psychometrically validated measures of underlying constructs that are developmentally appropriate for youth. One key construct in adult models of SAD is maladaptive social-evaluative beliefs. The current study aimed to develop and validate a measure of these beliefs in youth, known as the Report of Youth Social Cognitions (RYSC). The RYSC was developed with a clinical sample of youth with anxiety disorders (N = 180) and cross-validated in a community sample of youth (N = 305). In the clinical sample, the RYSC exhibited a 3-factor structure (negative evaluation, revealing self, and positive impression factors), good internal consistency, and construct validity. In the community sample, the 3-factor structure and the internal consistency of the RYSC were replicated, but the test of construct validity showed that the RYSC had similarly strong associations with social anxiety and depressed affect. The RYSC had good test-retest reliability overall, although the revealing self subscale showed lower temporal stability which improved when only older participants were considered (age ≥9 years). The RYSC in general was also shown to discriminate between youth with and without SAD although the revealing self subscale again performed suboptimally but improved when only older participants were considered. These findings provide psychometric support for the RYSC and justifies its use with youth in research and clinical settings requiring the assessment of maladaptive social-evaluative beliefs. (PsycINFO Database Record (c) 2017 APA, all rights reserved).

Validity and reliability of the attention deficit hyperactivity disorder self-report scale (ASRS-v1.1) in a clinical sample with eating disorders.

PubMed

Carlucci, Samantha; Ivanova, Iryna; Bissada, Hany; Tasca, Giorgio A

2017-08-01

Individuals with eating disorders (EDs) commonly experience comorbid attention deficit hyperactivity disorder (ADHD). The shared features of EDs and ADHD, such as inattention, impulsivity and hyperactivity, may exacerbate ED symptomatology and pose challenges to treatment. It is important to screen patients with EDs for symptoms of ADHD to optimize their treatment outcomes. However, the psychometrics of common measures of ADHD have not yet been examined within an ED population. An example of such a measure is the ADHD self-report scale (ASRS-v1.1) symptom checklist, which identifies the presence of ADHD symptoms. This study reports a psychometric study of the ASRS-v1.1 in a clinical sample of 500 adults with an ED. A confirmatory factor analysis indicated the ASRS-v1.1 maintained its two-factor structure of inattention and impulsivity/hyperactivity. The item loadings demonstrated path invariance across ED diagnostic groups indicating construct validity. Further, the subscales exhibited good internal consistency and they were significantly correlated with other measures of impulsivity indicating convergent validity. The ED sample had significantly higher mean scores than published nonclinical norms indicating predictive validity, but the ASRS-v1.1 scores were not significantly different among ED diagnostic groups. Results suggest the ASRS-v1.1 is a valid and reliable screening tool for identifying symptoms of ADHD among adults seeking treatment for ED. Copyright © 2017 Elsevier Ltd. All rights reserved.

Student information literacy: psychometric validation of a self-efficacy report.

PubMed

Brown, Gavin T L

2005-06-01

Psychometric characteristics of the Student Information Literacy Self-efficacy Report based on responses from 498 students ages 9 to 12 years are reported. Students report their self-efficacy (confidence and difficulty) in 11 different phases of being information literate, i.e., developing a topic, planning, self-management, locating sources, selecting sources, retrieving information, analysing information, evaluating information, synthesising knowledge, presenting knowledge, and self-evaluation using a positively packed rating scale. The data were strongly internally consistent (Cronbach alpha=.95) with a test-retest reliability of .78. The 11 phases, factors measured by a matching pair of self-efficacy questions, were confirmed (chi2=529.68; df= 198; RMSEA =.058; TLI=.940). Ratings were correlated low with teachers' ratings and test scores of information literacy skills and moderately correlated with academic self-concept. The test provides unique information about students' self-efficacy for information literacy. Its use in classrooms is warranted.

[Self-assessment of BMI data : verification of the practicability of a correction formula on a sample of 11- to 13-year-old girls].

PubMed

Wick, K; Hölling, H; Schlack, R; Bormann, B; Brix, C; Sowa, M; Strauss, B; Berger, U

2011-06-01

The decision to measure or to ask about data concerning height and weight in order to calculate body mass index (BMI) has an influence on the economy and validity of the measurements. Although self-reported information is less expensive, this information may possibly have a bias on the determined prevalences of different weight groups. Using representative data from the KiGGS study with a comparison of directly measured and self-reported BMI data, Kurth and Ellert (2010) developed two correction formulas for prevalences resulting from self-reported information. The aim of the study was to examine the practicability of the proposed correction formulas on our own data concerning self-reported BMI data of 11- to 13-year-old girls (n=1,271) and to assess the plausibility of the corrected measurements. As a result, the prevalences of our own data changed in the expected direction both for underweight and for overweight. Both formulas were found to be practicable, the consideration of the subjective weight status (formula 2) resulted in a greater change in prevalences compared to the first correction formula.

What Do You Think You Are Measuring? A Mixed-Methods Procedure for Assessing the Content Validity of Test Items and Theory-Based Scaling

PubMed Central

Koller, Ingrid; Levenson, Michael R.; Glück, Judith

2017-01-01

The valid measurement of latent constructs is crucial for psychological research. Here, we present a mixed-methods procedure for improving the precision of construct definitions, determining the content validity of items, evaluating the representativeness of items for the target construct, generating test items, and analyzing items on a theoretical basis. To illustrate the mixed-methods content-scaling-structure (CSS) procedure, we analyze the Adult Self-Transcendence Inventory, a self-report measure of wisdom (ASTI, Levenson et al., 2005). A content-validity analysis of the ASTI items was used as the basis of psychometric analyses using multidimensional item response models (N = 1215). We found that the new procedure produced important suggestions concerning five subdimensions of the ASTI that were not identifiable using exploratory methods. The study shows that the application of the suggested procedure leads to a deeper understanding of latent constructs. It also demonstrates the advantages of theory-based item analysis. PMID:28270777

Psychometric data of a questionnaire to measure cyberbullying bystander behavior and its behavioral determinants among adolescents.

PubMed

DeSmet, A; Bastiaensens, S; Van Cleemput, K; Poels, K; Vandebosch, H; Deboutte, G; Herrewijn, L; Malliet, S; Pabian, S; Van Broeckhoven, F; De Troyer, O; Deglorie, G; Van Hoecke, S; Samyn, K; De Bourdeaudhuij, I

2018-06-01

.This paper describes the items, scale validity and scale reliability of a self-report questionnaire that measures bystander behavior in cyberbullying incidents among adolescents, and its behavioral determinants. Determinants included behavioral intention, behavioral attitudes, moral disengagement attitudes, outcome expectations, self-efficacy, subjective norm and social skills. Questions also assessed (cyber-)bullying involvement. Validity and reliability information is based on a sample of 238 adolescents (M age=13.52 years, SD=0.57). Construct validity was assessed using Confirmatory Factor Analysis (CFA) or Exploratory Factor Analysis (EFA) in Mplus7 software. Reliability (Cronbach Alpha, α) was assessed in SPSS, version 22. Data and questionnaire are included in this article. Further information can be found in DeSmet et al. (2018) [1].

Sexual function and quality of life in genitourinary medicine (GUM) outpatients and preliminary validation of a self-report questionnaire measure.

PubMed

Daker-White, Gavin; Crowley, Tessa

2003-05-01

A cross-sectional questionnaire survey of 216 men and 191 women attending a genitourinary medicine (GUM) clinic was undertaken to explore the relationship between sexual symptoms and quality of sexual life, and to test the psychometric validity of a pilot self-report measure of Sexual Function and Quality of Sexual Life (SFQoSL). Statistical comparisons were made with three reference groups: volunteers attending GUM for psychosexual counselling, outpatients at an Obstetrics and Gynaecology Department, and staff. Exploratory principal components analysis (with varimax rotation) of questionnaire item responses suggested an 11 (in women) and 13 (in men) factor solution, incorporating four multi-item scales. Internal consistency (Cronbach's alpha) of core items was 0.84 in 186 women (19 items) and 0.87 in 210 men (22 items). Construct validity was supported in comparisons with reference groups using one-way analysis of variance and post-hoc Scheffé testing. Overall, 116 (54%) male and 132 (69%) female GUM outpatients had scores indicating sexual dysfunction. Thirty-seven (17%) men reported erectile dysfunction; 54 (28%) women reported vaginal dryness affecting sex; 48 (25%) women reported genital changes affecting sex; 45 (21%) men and 64 (34%) women reported problems reaching orgasm.

Development of, and initial validity evidence for, the referee self-efficacy scale: a multistudy report.

PubMed

Myers, Nicholas D; Feltz, Deborah L; Guillén, Félix; Dithurbide, Lori

2012-12-01

The purpose of this multistudy report was to develop, and then to provide initial validity evidence for measures derived from, the Referee Self-Efficacy Scale. Data were collected from referees (N = 1609) in the United States (n = 978) and Spain (n = 631). In Study 1 (n = 512), a single-group exploratory structural equation model provided evidence for four factors: game knowledge, decision making, pressure, and communication. In Study 2 (n = 1153), multiple-group confirmatory factor analytic models provided evidence for partial factorial invariance by country, level of competition, team gender, and sport refereed. In Study 3 (n = 456), potential sources of referee self-efficacy information combined to account for a moderate or large amount of variance in each dimension of referee self-efficacy with years of referee experience, highest level refereed, physical/mental preparation, and environmental comfort, each exerting at least two statistically significant direct effects.

Validation of an instrument to measure tutor performance in promoting self-directed learning by using confirmatory factor analysis.

PubMed

Amador Fierros, Genoveva; Montesinos-López, Osval Antonio; Alcaráz Moreno, Noemí

2016-04-01

This work sought to validate and propose an instrument to measure the performance of tutors in promoting self-directed learning in students involved in processes of problem-based learning. Confirmatory factor analysis (CFA) was applied to validate the instrument composed of 60 items and six factors (self-assessment of learning gaps within the United Nations specific context: self-assessment, reflexion, critical thinking, administration of information, group skills), using a sample of 207 students from a total of 279, which comprise the student population of the Faculty of Nursing at Universidad de Colima in Mexico. (2007). The CFA results demonstrated that the instrument is acceptable to measure performance of tutors in promoting self-directed learning, given that all the indicators, variances, covariances, and thresholds are statistically significant. The instrument permits obtaining students' opinions on how much professors contribute for them to develop each of the 60 skills described in the scale. Lastly, the results could report if professors are placing more emphasis in some areas than in other areas they should address during the problem-based learning (PBL) process, or if definitely their actions are removed from the premises of PBL, information that will be useful for school management in decision making on the direction of teaching as a whole.

Time cost of diabetes: Development of a questionnaire to assess time spent on diabetes self-care.

PubMed

Chernyak, Nadja; Jülich, Fabian; Kasperidus, Julia; Stephan, Astrid; Begun, Alexander; Kaltheuner, Matthias; Icks, Andrea

2017-01-01

Methods to measure patient time spent on health-related activities are currently not well elaborated or standardized. The purpose of this study was to develop a recall questionnaire measuring patient time devoted to diabetes self-care and to examine its feasibility and validity under field conditions. The initial questionnaire was developed on the basis of instruments frequently used to assess self-care behavior in patients with diabetes, evaluated in two focus groups with patients with type 2 diabetes (N=15) and tested in a random sample of patients with type 2 diabetes (N=178). To assess the validity of the questionnaire, four hypotheses about expected differences in self-care time across various patient sub-groups were tested. The final questionnaire includes thirteen items estimating time spent on regular diabetes-related activities undertaken in the previous seven days. 78% of respondents completed the questionnaire without item non-response or other evident problems. As hypothesized, respondents receiving insulin treatment, those with poor self-rated health and those with diabetes-related emotional distress (PAID-5 score ≥8) reported spending more time on diabetes self-care than the rest of the sample. Contrary to our assumption, no differences in time spent on diabetes self-care between employed and retired individuals were detected by the questionnaire. The recall questionnaire measuring patient time devoted to a broad range of regular diabetes self-care activities was developed and its feasibility was proved under field conditions. Ideally, the questionnaire should be further validated within a variety of populations. Exploration of the convergent validity between the recall method and prospective diary may be also useful. Copyright © 2017 Elsevier Inc. All rights reserved.

Measuring the youth bullying experience: a systematic review of the psychometric properties of available instruments.

PubMed

Vessey, Judith; Strout, Tania D; DiFazio, Rachel L; Walker, Allison

2014-12-01

Bullying is a significant problem in schools and measuring this concept remains problematic. The purposes of this study were to (1) identify the published self-report measures developed to assess youth bullying; (2) evaluate their psychometric properties and instrument characteristics; and (3) evaluate the quality of identified psychometric papers evaluating youth bullying measures. A systematic review of the literature was conducted using 4 electronic databases. Data extraction and appraisal of identified instruments were completed using a standardized method and Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) guidelines. Thirty-one articles describing 27 self-report instruments were evaluated in our analysis. Quality assessments ranged from 18% to 91%, with 6 papers reaching or exceeding a quality score of 75%. Limited evidence supporting the reliability, validity, and responsiveness of existing youth bullying measures was identified. Evidence supporting the psychometric soundness of the instruments identified was limited. Many measures were in early development and additional evaluation is necessary to validate their psychometric properties. A pool of instruments possesses acceptable initial psychometric dependability for selected assessment purposes. These findings have significant implications for assessing youth bullying and designing and evaluating school-based interventions. © 2014, American School Health Association.

The Anaclitic-Introjective Depression Assessment: Development and preliminary validity of an observer-rated measure.

PubMed

Rost, Felicitas; Luyten, Patrick; Fonagy, Peter

2018-03-01

The two-configurations model developed by Blatt and colleagues offers a comprehensive conceptual and empirical framework for understanding depression. This model suggests that depressed patients struggle, at different developmental levels, with issues related to dependency (anaclitic issues) or self-definition (introjective issues), or a combination of both. This paper reports three studies on the development and preliminary validation of the Anaclitic-Introjective Depression Assessment, an observer-rated assessment tool of impairments in relatedness and self-definition in clinical depression based on the item pool of the Shedler-Westen Assessment Procedure. Study 1 describes the development of the measure using expert consensus rating and Q-methodology. Studies 2 and 3 report the assessment of its psychometric properties, preliminary reliability, and validity in a sample of 128 patients diagnosed with treatment-resistant depression. Four naturally occurring clusters of depressed patients were identified using Q-factor analysis, which, overall, showed meaningful and theoretically expected relationships with anaclitic/introjective prototypes as formulated by experts, as well as with clinical, social, occupational, global, and relational functioning. Taken together, findings reported in this paper provide preliminary evidence for the reliability and validity of the Anaclitic-Introjective Depression Assessment, an observer-rated measure that allows the detection of important nuanced differentiations between and within anaclitic and introjective depression. Copyright © 2017 John Wiley & Sons, Ltd.

Measuring Cross-Cultural Supernatural Beliefs with Self- and Peer-Reports.

PubMed

Bluemke, Matthias; Jong, Jonathan; Grevenstein, Dennis; Mikloušić, Igor; Halberstadt, Jamin

2016-01-01

Despite claims about the universality of religious belief, whether religiosity scales have the same meaning when administered inter-subjectively-or translated and applied cross-culturally-is currently unknown. Using the recent "Supernatural Belief Scale" (SBS), we present a primer on how to verify the strong assumptions of measurement invariance required in research on religion. A comparison of two independent samples, Croatians and New Zealanders, showed that, despite a sophisticated psychometric model, measurement invariance could be demonstrated for the SBS except for two noninvariant intercepts. We present a new approach for inspecting measurement invariance across self- and peer-reports as two dependent samples. Although supernatural beliefs may be hard to observe in others, the measurement model was fully invariant for Croatians and their nominated peers. The results not only establish, for the first time, a valid measure of religious supernatural belief across two groups of different language and culture, but also demonstrate a general invariance test for distinguishable dyad members nested within the same targets. More effort needs to be made to design and validate cross-culturally applicable measures of religiosity.

Measuring Cross-Cultural Supernatural Beliefs with Self- and Peer-Reports

PubMed Central

Bluemke, Matthias; Jong, Jonathan; Grevenstein, Dennis; Mikloušić, Igor; Halberstadt, Jamin

2016-01-01

Despite claims about the universality of religious belief, whether religiosity scales have the same meaning when administered inter-subjectively–or translated and applied cross-culturally–is currently unknown. Using the recent “Supernatural Belief Scale” (SBS), we present a primer on how to verify the strong assumptions of measurement invariance required in research on religion. A comparison of two independent samples, Croatians and New Zealanders, showed that, despite a sophisticated psychometric model, measurement invariance could be demonstrated for the SBS except for two noninvariant intercepts. We present a new approach for inspecting measurement invariance across self- and peer-reports as two dependent samples. Although supernatural beliefs may be hard to observe in others, the measurement model was fully invariant for Croatians and their nominated peers. The results not only establish, for the first time, a valid measure of religious supernatural belief across two groups of different language and culture, but also demonstrate a general invariance test for distinguishable dyad members nested within the same targets. More effort needs to be made to design and validate cross-culturally applicable measures of religiosity. PMID:27760206

The validity of socioeconomic status measures among adolescents based on self-reported information about parents occupations, FAS and perceived SES; implication for health related quality of life studies.

PubMed

Svedberg, P; Nygren, J M; Staland-Nyman, C; Nyholm, M

2016-04-29

Research has shown inconsistencies in results and difficulties in conceptualization of assessment of socioeconomic status (SES) among adolescents. The aim of this study was thus to test the validity of self-reported information on SES in two age-groups (11-13 and 14-16 years old) in an adolescent population and to evaluate its relationship to self-reported health related quality of life (HRQOL). Different measures of SES commonly used in research in relation to HRQOL were tested in this study; parent's occupations status, family material affluence status (FAS) and perceived SES. A cross-sectional study, with a sample of 948 respondents (n = 467, 11-13 years old and n = 481, 14-16 years old) completed questionnaires about SES and HRQOL. The adolescents' completion rates were used, with chi2-test, to investigate differences between gender and age-group. Correlation was used for convergent validity and ANOVA for concurrent validity. We found a low completion rate for both fathers' (41.7 %) and mothers' (37.5 %) occupation status, and a difference in completion rate between gender and age-groups. FAS had the highest completion rate (100 %) compared to parent's occupations status and perceived SES. The convergent validity between the SES-indicators was weak (Spearman correlation coefficient below 0.3), suggesting that the indicators measured different dimensions of SES. Both FAS and perceived SES showed a gradient in mean HRQOL between low and high SES in relation to HRQOL, this was significant only for perceived SES (p < 0.01, both age-groups). This study indicates the need for considering different approaches to measures of SES among adolescences and when evaluating SES in relation to HRQOL. Further research is needed to investigate sustainable ways to measure SES, delineating the relevance of tangible measures of education, occupation and income in relation to the perceived socioeconomic status in comparison with others in immediate social networks and in society at large.

The development and initial psychometric evaluation of a measure assessing adherence to prescribed exercise: the Exercise Adherence Rating Scale (EARS).

PubMed

Newman-Beinart, Naomi A; Norton, Sam; Dowling, Dominic; Gavriloff, Dimitri; Vari, Chiara; Weinman, John A; Godfrey, Emma L

2017-06-01

There is no gold standard for measuring adherence to prescribed home exercise. Self-report diaries are commonly used however lack of standardisation, inaccurate recall and self-presentation bias limit their validity. A valid and reliable tool to assess exercise adherence behaviour is required. Consequently, this article reports the development and psychometric evaluation of the Exercise Adherence Rating Scale (EARS). Development of a questionnaire. Secondary care in physiotherapy departments of three hospitals. A focus group consisting of 8 patients with chronic low back pain (CLBP) and 2 physiotherapists was conducted to generate qualitative data. Following on from this, a convenience sample of 224 people with CLBP completed the initial 16-item EARS for purposes of subsequent validity and reliability analyses. Construct validity was explored using exploratory factor analysis and item response theory. Test-retest reliability was assessed 3 weeks later in a sub-sample of patients. An item pool consisting of 6 items was found suitable for factor analysis. Examination of the scale structure of these 6 items revealed a one factor solution explaining a total of 71% of the variance in adherence to exercise. The six items formed a unidimensional scale that showed good measurement properties, including acceptable internal consistency and high test-retest reliability. The EARS enables the measurement of adherence to prescribed home exercise. This may facilitate the evaluation of interventions promoting self-management for both the prevention and treatment of chronic conditions. Copyright © 2017 Chartered Society of Physiotherapy. Published by Elsevier Ltd. All rights reserved.

Dispositional Insight Scale: Development and Validation of a Tool That Measures Propensity toward Insight in Problem Solving

ERIC Educational Resources Information Center

Ovington, Linda A.; Saliba, Anthony J.; Goldring, Jeremy

2016-01-01

This article reports the development of a brief self-report measure of dispositional insight problem solving, the Dispositional Insight Scale (DIS). From a representative Australian database, 1,069 adults (536 women and 533 men) completed an online questionnaire. An exploratory and confirmatory factor analysis revealed a 5-item scale, with all…

Application of implicit attitude measures to the blood donation context.

PubMed

Warfel, Regina M; France, Christopher R; France, Janis L

2012-02-01

Past blood donation research has relied on explicit (self-report) measures to understand blood donation motivations, but has not yet considered the inherent implicit or automatic processing involved in decision-making. This study addresses this limitation by introducing and validating two novel implicit measures of blood donation attitudes. Healthy young adults (n = 253) performed both image and word versions of a Single Target Implicit Association Test (ST-IAT) and then completed self-report measures of blood donation attitudes, blood and needle fears, social desirability, and donation intention. These results affirmed the validity of the blood donation ST-IATs in at least three ways. First, as expected, nondonors demonstrated more negative implicit donation attitudes than donors. Second, the implicit measures were significantly related in expected directions with explicit measures of donation attitudes as well as blood and needle fears. Finally, implicit donation attitudes were significantly related to donation intention, and the Image ST-IAT (but not the Word ST-IAT) significantly enhanced prediction of donation intention over and above needle fears and marginally enhanced prediction over and above blood fears. Image and word versions of the blood donation ST-IAT offer a valid method of assessing underlying automatic attitudes toward blood donation. © 2012 American Association of Blood Banks.

Validation of the Neighborhood Environment Walkability Scale (NEWS) items using geographic information systems.

PubMed

Adams, Marc A; Ryan, Sherry; Kerr, Jacqueline; Sallis, James F; Patrick, Kevin; Frank, Lawrence D; Norman, Gregory J

2009-01-01

Concurrent validity of Neighborhood Environment Walkability Scale (NEWS) items was evaluated with objective measures of the built environment using geographic information systems (GIS). A sample of 878 parents of children 10 to 16 years old (mean age 43.5 years, SD = 6.8, 34.8% non-White, 63.8% overweight) completed NEWS and the International Physical Activity Questionnaire. GIS was used to develop 1-mile street network buffers around participants' residences. GIS measures of the built environment within participants' buffers included percent of commercial and institutional land uses; number of schools and colleges, recreational facilities, parks, transit stops, and trees; land topography; and traffic congestion. Except for trees and traffic, concordance between the NEWS and GIS measures were significant, with weak to moderate effect sizes (r = -0.09 to -0.36, all P < or = 01). After participants were stratified by physical activity level, stronger concordance was observed among active participants for some measures. A sensitivity analysis of self-reported distance to 15 neighborhood destinations found a 20-minute (compared with 10- or 30-minute) walking threshold generally had the strongest correlations with GIS measures. These findings provide evidence of the concurrent validity of self-reported built environment items with objective measures. Physically active adults may be more knowledgeable about their neighborhood characteristics.

The International Index of Erectile Function: a methodological critique and suggestions for improvement.

PubMed

Yule, Morag; Davison, Joyce; Brotto, Lori

2011-01-01

The International Index of Erectile Function is a well-worded and psychometrically valid self-report questionnaire widely used as the standard for the evaluation of male sexual function. However, some conceptual and statistical problems arise when using the measure with men who are not sexually active. These problems are illustrated using 2 empirical examples, and the authors provide recommended solutions to further strengthen the efficacy and validity of this measure.

The Self-Description Inventory+, Part 1: Factor Structure and Convergent Validity Analyses

DTIC Science & Technology

2013-07-01

measures 12 scales of personality. The current report examines the possibility of replacing the EQ with a Five Factor Model ( FFM ) measure of...Checklist. Our results show that the SDI + has scales that are intercorrelated in a manner consistent with the FFM (Experiment 1), a factor structure...met the criteria showing it to be an FFM instrument, we will conduct concurrent validity research to determine if the SDI+ has greater predictive

The content and process of self-stigma in people with mental illness.

PubMed

Chan, Kevin K S; Mak, Winnie W S

2017-01-01

Although many individuals with mental illness may self-concur with the "content" of stigmatizing thoughts at some point in their lives, they may have varying degrees of habitual recurrence of such thoughts, which could exacerbate their experience of self-stigma and perpetuate its damaging effects on their mental health. Although it is important to understand the "process" of how self-stigmatizing thoughts are sustained and perpetuated over time, no research to date has conceptualized and distinguished the habitual process of self-stigma from its cognitive content. Thus, the present study aims to develop and validate a measure of the habitual process of self-stigma-the Self-stigmatizing Thinking's Automaticity and Repetition Scale (STARS). In this study, 189 individuals with mental illness completed the STARS, along with several explicit (self-report) and implicit (response latency) measures of theoretically related constructs. Consistent with theories of mental habit, an exploratory factor analysis of the STARS items identified a 2-factor structure that represents the repetition (4 items) and automaticity (4 items) of self-stigmatization. The reliability of the STARS was supported by a Cronbach's α of .90, and its validity was supported by its significant correlations with theoretical predictors (content of self-stigma, experiential avoidance, and lack of mindfulness), expected outcomes (decreased self-esteem, life satisfaction, and recovery), and the Brief Implicit Association Tests measuring the automatic processing of self-stigmatizing information. With the validation of the STARS, future research can consider both the content and process of self-stigma so that a richer picture of its development, perpetuation, and influence can be captured. (PsycINFO Database Record (c) 2017 APA, all rights reserved).

The Psychological Inventory of Criminal Thinking Styles and Psychopathy Checklist: screening version as incrementally valid predictors of recidivism.

PubMed

Walters, Glenn D

2009-12-01

A follow-up of 107 male federal prison inmates previously tested with the Psychological Inventory of Criminal Thinking Styles (PICTS) and Psychopathy Checklist: Screening Version (PCL:SV) was conducted to test the incremental validity of both measures. The PICTS General Criminal Thinking (GCT) score was found to predict general recidivism and serious recidivism when age, prior charges, and the PCL:SV were controlled. The PCL:SV, on the other hand, failed to predict general and serious recidivism when age, prior charges, and the PICTS were controlled. These findings support the hypothesis that content-relevant self-report measures like the PICTS are capable of predicting crime-relevant outcomes above and beyond the contributions of basic demographic variables like age, criminal history, and such popular non-self-report rating procedures as the PCL:SV.

Development of a measure of student self-evaluation of physics exam performance

NASA Astrophysics Data System (ADS)

Hagedorn, Eric Anthony

The central purpose of this study was to provide preliminary evidence of the reliability and validity of the SEVSI - P (Self- evaluation scaled instrument - physics). This instrument, designed to measure student self-evaluation of physics exam performance, was developed in congruence with social cognitive theory. Self-evaluation in this study is defined to consist of two of the three subprocesses of self-regulation: self-observation and judgmental process. As such, the SEVSI - P consists of two subscales, one measuring the frequency and types of self-observations made during a physics exam and one measuring the frequency and types of judgmental comparisons made after an exam. Data from 621 completed surveys, voluntarily taken by first semester algebra/trigonometry based physics students at six Midwestern universities and one Southern university, were analyzed for reliability and factorial validity. Cronbach alphas of .71 and .83 for the self-observation and judgment subscales, respectively, indicate acceptable reliability for the instrument. Confirmatory factor analysis indicates the acceptability of the hypothesis that the data analyzed could have indeed been obtained from the proposed two factor model (self-observation and judgment). The results of this confirmatory factor analysis provide preliminary construct validity for this instrument. A number of theoretically related items were included on the SEVSI - P form to elicity information about the use of goals and pre-planned strategies, actions taken in response to previous poor performances, and emotional responses to performance. A correlational analysis of these items along with the self-observation and judgment subscale scores provided a limited degree of convergent validity for the two subscales. Analyses of variance were done to determine the presence of differences in scoring patterns based on gender or reported ethnic origin. These results indicate slightly higher judgment subscale scores for women and members of minority groups. The implications of these differences are suggested as warranting future research. Future uses of the SEVSI - P include classroom use to assist students self-evaluate their exam performances in order to increase their achievement. Future research using the SEVSI - P to determine the causal relationships between self-evaluation, actual achievement, and other social cognitive constructs such as self-efficacy are suggested.

Brief Psychometric Analysis of the Self-Efficacy Parent Report Scale (SEPRS)

ERIC Educational Resources Information Center

Erford, Bradley T.; Gavin, Kate

2013-01-01

The Self-Efficacy Parent-Report Scale was designed to assess parent perceptions of self-efficacy of their children aged 7 to 17 years. Internal aspects of validity indicated a marginal fit of the data to the unidimensional model. External facets of validity indicated the Self-Efficacy Parent-Report Scale had excellent convergent and discriminant…

Development of a coping with stress scale for a non-western population of children and adolescents.

PubMed

Gökler DanIşman, Ilgın; Yıldız, Nejla; Yiğit, İbrahim

2017-11-01

In the related literature numerous instruments have been developed to measure children and adolescents' coping with stress. Considering the cultural differences in individuals' choice for coping strategies, along with the limitations of the existing measures of coping for children and adolescents (e.g., being derived from coping measures developed for adults; unrepresentative samples with limited age range, etc.), the current study aimed to construct a self-report coping scale for a non-western population of children and adolescents. The study design included both qualitative and quantitative methodology. Three consecutive studies were conducted for the development and validation of the Children and Adolescents' Coping with Stress Scale (CACSS), a self-report measure assessing coping strategies of children and adolescents aged from 9 to 18 in response to self-identified stressors. Exploratory and confirmatory factor analyses resulted in a 61-item CACSS with 10 factors. The scale appears to have a clear factor structure; sufficient temporal stability; and good convergent, discriminant, and construct validity. By addressing limitations of existing coping scales, CACSS is believed to contribute to the literature as a developmentally appropriate and multidimensional tool.

Emotional Eating Is Not What You Think It Is and Emotional Eating Scales Do Not Measure What You Think They Measure

PubMed Central

Bongers, Peggy; Jansen, Anita

2016-01-01

In eating research, it is common practice to group people into different eater types, such as emotional, external and restrained eaters. This categorization is generally based on scores on self-report questionnaires. However, recent studies have started to raise questions about the validity of such questionnaires. In the realm of emotional eating, a considerable number of studies, both in the lab and in naturalistic settings, fail to demonstrate increased food intake in emotional situations in self-described emotional eaters. The current paper provides a review of experimental and naturalistic studies investigating the relationships between self-reported emotional eater status, mood, and food consumption. It is concluded that emotional eating scales lack predictive and discriminative validity; they cannot be assumed to measure accurately what they intend to measure, namely increased food intake in response to negative emotions. The review is followed by a discussion of alternative interpretations of emotional eating scores that have been suggested in the past few years, i.e., concerned eating, uncontrolled eating, a tendency to attribute overeating to negative affect, and cue-reactive eating. PMID:28008323

A Multimethod Multitrait Validity Assessment of Self-Construal in Japan, Korea, and the United States

ERIC Educational Resources Information Center

Bresnahan, Mary J.; Levine, Timothy R.; Shearman, Sachiyo Morinaga; Lee, Sun Young; Park, Cheong-Yi; Kiyomiya, Toru

2005-01-01

A large number of previous studies have used self-construal to predict communication outcomes. Recent evidence, however, suggests that validity problems may exist in self-construal measurement. The current study conducted a multimethod multitrait (Campbell & Fiske, 1959) validation study of self-construal measures with data (total N = 578)…

[Validity of anthropometric measurements and weight perceptions reported by relatives of children under 4 years old].

PubMed

Patiño-Villena, Begoña; Chirlaque, María Dolores; Salmerón, Diego; González, Eduardo; Navarro, Carmen

2016-01-01

To assess the validity of weight and height measurements reported by parents and the perception of their children's weight status in order to assess the prevalence of overweight children under 4 years old. Cross-sectional study. Anthropometric data was collected by self-report questionnaires completed by parents of children 3-45 months old: 1) information from paediatric check-ups (gold standard); 2) information reported from the home environment; and 3) data from individual perceptions. WHO standards were used. Reported height was underestimated, thus reported weight/height and BMI/age were overestimated. Overweight prevalence according to paediatric check-ups was 18.6%, compared to 26.5% reported prevalence, showing a moderate concordance (Kappa: 0.47 [0.34-0.60]), 70% sensitivity and 84% specificity. Subjective perception was 11.2%, representing 30% sensitivity and 93% specificity. The reported information has little validity for population-based studies, as height is underestimated and overweight status is not correctly perceived due to distortion of individual perception. Questionnaires must be validated and awareness raised among families. Copyright © 2016 SESPAS. Published by Elsevier Espana. All rights reserved.

The Childhood Cancer Survivor Study-Neurocognitive Questionnaire (CCSS-NCQ) Revised: Item Response Analysis and Concurrent Validity

PubMed Central

Kenzik, Kelly M.; Huang, I-Chan; Brinkman, Tara M.; Baughman, Brandon; Ness, Kirsten K.; Shenkman, Elizabeth A.; Hudson, Melissa M.; Robison, Leslie L.; Krull, Kevin R.

2014-01-01

Objective Childhood cancer survivors are at risk for neurocognitive impairment related to cancer diagnosis or treatment. This study refined and further validated the Childhood Cancer Survivor Study Neurocognitive Questionnaire (CCSS-NCQ), a scale developed to screen for impairment in long-term survivors of childhood cancer. Method Items related to task efficiency, memory, organization and emotional regulation domains were examined using item response theory (IRT). Data were collected from 833 adult survivors of childhood cancer in the St. Jude Lifetime Cohort Study who completed self-report and direct neurocognitive testing. The revision process included: 1) content validity mapping of items to domains, 2) constructing a revised CCSS-NCQ, 3) selecting items within specific domains using IRT, and 4) evaluating concordance between the revised CCSS-NCQ and direct neurocognitive assessment. Results Using content and measurement properties, 32 items were retained (8 items in 4 domains). Items captured low to middle levels of neurocognitive concerns. The latent domain scores demonstrated poor convergent/divergent validity with the direct assessments. Adjusted effect sizes (Cohen's d) for agreement between self-reported memory and direct memory assessment were moderate for total recall (ES=0.66), long-term memory (ES=0.63), and short-term memory (ES=0.55). Effect sizes between self-rated task efficiency and direct assessment of attention were moderate for focused attention (ES=0.70) and attention span (ES=0.50), but small for sustained attention (ES=0.36). Cranial radiation therapy and female gender were associated with lower self-reported neurocognitive function. Conclusion The revised CCSS-NCQ demonstrates adequate measurement properties for assessing day-to-day neurocognitive concerns in childhood cancer survivors, and adds useful information to direct assessment. PMID:24933482