Interpersonal and Affective Dimensions of Psychopathic Traits in Adolescents: Development and Validation of a Self-Report Instrument

ERIC Educational Resources Information Center

Houghton, Stephen; Hunter, Simon C.; Khan, Umneea; Tan, Carol

2013-01-01

We report the development and psychometric evaluations of a self-report instrument designed to screen for psychopathic traits among mainstream community adolescents. Tests of item functioning were initially conducted with 26 adolescents. In a second study the new instrument was administered to 150 high school adolescents, 73 of who had school…

Validity of Guatemalan Mother's Self-Reported Breast-Feeding Practices of 3-Month-Old Infants.

PubMed

Mazariegos, Monica; Slater, Christine; Ramirez-Zea, Manuel

2016-12-01

Breast-feeding practices (BFPs) can be assessed by interviewing the mother about current feeding practices and with a 24-hour recall. It is crucial to establish the accuracy of these methods, which are commonly used by public health decision makers to design health policies aimed at increasing exclusive breast-feeding rates. We aimed to validate 2 self-report BFP instruments using the dose-to-mother deuterium oxide turnover technique (DMDOT) as the reference method. Breast-feeding practices were assessed by interviewing the mother about current feeding practices and with a 24-hour recall in 36 Guatemalan mother-infant pairs. The validity of these instruments was assessed using DMDOT as the reference method. Both self-report instruments overestimated exclusively breast-fed (EBF) infants. Infants classified as EBF were 50% by the reported current feeding practice, 61% by the 24-hour recall, and only 36% using DMDOT. Sensitivity to detect EBF infants from the mother's self-report was 92% (95% CI: 62%-99%) while from the 24-hour recall was 100% (95% CI: 72%-100%, P < .01). However, specificity for both instruments was low, at 74% (95% CI: 51%-89%) for reported current feeding practice and at 61% (95% CI: 39%-79%) for the 24-hour recall (P < .01). Both reported current feeding practice and the 24-hour recall instruments overestimated exclusive breast-feeding. Nevertheless, the use of reported current feeding practice provided more accurate data to assess BFPs in a public health setting. Furthermore, population-based surveys should consider the overestimation of exclusive breast-feeding caused when using these BFP instruments. © The Author(s) 2016.

Development and Validation of an Instrument to Measure Students' Motivation and Self-Regulation in Science Learning

NASA Astrophysics Data System (ADS)

Velayutham, Sunitadevi; Aldridge, Jill; Fraser, Barry

2011-10-01

Students' motivational beliefs and self-regulatory practices have been identified as instrumental in influencing the engagement of students in the learning process. An important aim of science education is to empower students by nurturing the belief that they can succeed in science learning and to cultivate the adaptive learning strategies required to help to bring about that success. This article reports the development and validation of an instrument to measure salient factors related to the motivation and self-regulation of students in lower secondary science classrooms. The development of the instrument involved identifying key determinants of students' motivation and self-regulation in science learning based on theoretical and research underpinnings. Once the instrument was developed, a pilot study involving 52 students from two Grade 8 science classes was undertaken. Quantitative data were collected from 1,360 students in 78 classes across Grades 8, 9, and 10, in addition to in-depth qualitative information gathered from 10 experienced science teachers and 12 Grade 8 students. Analyses of the data suggest that the survey has strong construct validity when used with lower secondary students. This survey could be practically valuable as a tool for gathering information that may guide classroom teachers in refocusing their teaching practices and help to evaluate the effectiveness of intervention programmes.

Screening for frailty in older adults using a self-reported instrument.

PubMed

Nunes, Daniella Pires; Duarte, Yeda Aparecida de Oliveira; Santos, Jair Lício Ferreira; Lebrão, Maria Lúcia

2015-01-01

OBJECTIVE To validate a screening instrument using self-reported assessment of frailty syndrome in older adults. METHODS This cross-sectional study used data from the Saúde, Bem-estar e Envelhecimento study conducted in Sao Paulo, SP, Southeastern Brazil. The sample consisted of 433 older adult individuals (≥ 75 years) assessed in 2009. The self-reported instrument can be applied to older adults or their proxy respondents and consists of dichotomous questions directly related to each component of the frailty phenotype, which is considered the gold standard model: unintentional weight loss, fatigue, low physical activity, decreased physical strength, and decreased walking speed. The same classification proposed in the phenotype was utilized: not frail (no component identified); pre-frail (presence of one or two components), and frail (presence of three or more components). Because this is a screening instrument, "process of frailty" was included as a category (pre-frail and frail). Cronbach's α was used in psychometric analysis to evaluate the reliability and validity of the criterion, the sensitivity, the specificity, as well as positive and negative predictive values. Factor analysis was used to assess the suitability of the proposed number of components. RESULTS Decreased walking speed and decreased physical strength showed good internal consistency (α = 0.77 and 0.72, respectively); however, low physical activity was less satisfactory (α = 0.63). The sensitivity and specificity for identifying pre-frail individuals were 89.7% and 24.3%, respectively, while those for identifying frail individuals were 63.2% and 71.6%, respectively. In addition, 89.7% of the individuals from both the evaluations were identified in the "process of frailty" category. CONCLUSIONS The self-reported assessment of frailty can identify the syndrome among older adults and can be used as a screening tool. Its advantages include simplicity, rapidity, low cost, and ability to be used

Screening for frailty in older adults using a self-reported instrument

PubMed Central

Nunes, Daniella Pires; Duarte, Yeda Aparecida de Oliveira; Santos, Jair Lício Ferreira; Lebrão, Maria Lúcia

2015-01-01

OBJECTIVE To validate a screening instrument using self-reported assessment of frailty syndrome in older adults. METHODS This cross-sectional study used data from the Saúde, Bem-estar e Envelhecimento study conducted in Sao Paulo, SP, Southeastern Brazil. The sample consisted of 433 older adult individuals (≥ 75 years) assessed in 2009. The self-reported instrument can be applied to older adults or their proxy respondents and consists of dichotomous questions directly related to each component of the frailty phenotype, which is considered the gold standard model: unintentional weight loss, fatigue, low physical activity, decreased physical strength, and decreased walking speed. The same classification proposed in the phenotype was utilized: not frail (no component identified); pre-frail (presence of one or two components), and frail (presence of three or more components). Because this is a screening instrument, “process of frailty” was included as a category (pre-frail and frail). Cronbach’s α was used in psychometric analysis to evaluate the reliability and validity of the criterion, the sensitivity, the specificity, as well as positive and negative predictive values. Factor analysis was used to assess the suitability of the proposed number of components. RESULTS Decreased walking speed and decreased physical strength showed good internal consistency (α = 0.77 and 0.72, respectively); however, low physical activity was less satisfactory (α = 0.63). The sensitivity and specificity for identifying pre-frail individuals were 89.7% and 24.3%, respectively, while those for identifying frail individuals were 63.2% and 71.6%, respectively. In addition, 89.7% of the individuals from both the evaluations were identified in the “process of frailty” category. CONCLUSIONS The self-reported assessment of frailty can identify the syndrome among older adults and can be used as a screening tool. Its advantages include simplicity, rapidity, low cost, and ability to

Validity of a brief self-report instrument for assessing compliance with physical activity guidelines amongst adolescents.

PubMed

Ridgers, Nicola D; Timperio, Anna; Crawford, David; Salmon, Jo

2012-03-01

To examine the validity of a brief self-report questionnaire for assessing physical activity, and compliance and non-compliance with moderate-to-vigorous physical activity (MVPA) recommendations in Australian adolescents against accelerometry. Cross-sectional study. MVPA of 203 adolescents (124 females, 79 males) aged 15-17 years was objectively assessed for 8 consecutive days using uni-axial accelerometers and calculated using age-specific cut-points. Adolescents self-reported the number of days (0-7) they were physically active for a total of at least 60 min/day (1) over the past 7 days and (2) over a typical week. Compliance with physical activity recommendations was defined as (1) 5 and (2) 7 days of self-reported MVPA (of at least 60 min/day), and (3) ≥60 min MVPA per average day, and (4) >60 min MVPA on every day according to accelerometry. Spearman's Rho correlations analysed the association between accelerometry-derived MVPA/day and self-reported MVPA days/week for the whole sample, sex and weight status. Percent agreement determined the proportion of adolescents correctly identified as not meeting physical activity recommendations (specificity) or as meeting physical activity recommendations (sensitivity) according to the self-report questionnaire. Moderate to large correlations were found between the self-report and accelerometer data (0.2-0.51) across population subgroups. The percent agreement between the self-report and accelerometry data was good for specificity; however, the sensitivity was low, potentially due to poor compliance with recommendations. Compared to accelerometry, the brief MVPA self-report questionnaire appears to have acceptable validity for measuring non-compliance with physical activity recommendations in 15-17 year old adolescents. Copyright © 2011 Sports Medicine Australia. Published by Elsevier Ltd. All rights reserved.

Validation of an instrument to measure tutor performance in promoting self-directed learning by using confirmatory factor analysis.

PubMed

Amador Fierros, Genoveva; Montesinos-López, Osval Antonio; Alcaráz Moreno, Noemí

2016-04-01

This work sought to validate and propose an instrument to measure the performance of tutors in promoting self-directed learning in students involved in processes of problem-based learning. Confirmatory factor analysis (CFA) was applied to validate the instrument composed of 60 items and six factors (self-assessment of learning gaps within the United Nations specific context: self-assessment, reflexion, critical thinking, administration of information, group skills), using a sample of 207 students from a total of 279, which comprise the student population of the Faculty of Nursing at Universidad de Colima in Mexico. (2007). The CFA results demonstrated that the instrument is acceptable to measure performance of tutors in promoting self-directed learning, given that all the indicators, variances, covariances, and thresholds are statistically significant. The instrument permits obtaining students' opinions on how much professors contribute for them to develop each of the 60 skills described in the scale. Lastly, the results could report if professors are placing more emphasis in some areas than in other areas they should address during the problem-based learning (PBL) process, or if definitely their actions are removed from the premises of PBL, information that will be useful for school management in decision making on the direction of teaching as a whole.

Development and Validation of a Multicultural Consciousness Instrument

ERIC Educational Resources Information Center

Dean, Shannon R.

2017-01-01

Developing multiculturally competent citizens is at the forefront of the espoused mission of higher education. The purpose of this study was to develop and validate a self-report instrument to measure traditional-age (18-to 24-year-old) college students' multicultural consciousness (e.g., awareness of self, knowledge of difference, and…

Evaluation of the measurement properties of self-reported health-related work-functioning instruments among workers with common mental disorders.

PubMed

Abma, Femke I; van der Klink, Jac J L; Terwee, Caroline B; Amick, Benjamin C; Bültmann, Ute

2012-01-01

During the past decade, common mental disorders (CMD) have emerged as a major public and occupational health problem in many countries. Several instruments have been developed to measure the influence of health on functioning at work. To select appropriate instruments for use in occupational health practice and research, the measurement properties (eg, reliability, validity, responsiveness) must be evaluated. The objective of this study is to appraise critically and compare the measurement properties of self-reported health-related work-functioning instruments among workers with CMD. A systematic review was performed searching three electronic databases. Papers were included that: (i) mainly focused on the development and/or evaluation of the measurement properties of a self-reported health-related work-functioning instrument; (ii) were conducted in a CMD population; and (iii) were fulltext original papers. Quality appraisal was performed using the consensus-based standards for the selection of health status measurement instruments (COSMIN) checklist. Five papers evaluating measurement properties of five self-reported health-related work-functioning instruments in CMD populations were included. There is little evidence available for the measurement properties of the identified instruments in this population, mainly due to low methodological quality of the included studies. The available evidence on measurement properties is based on studies of poor-to-fair methodological quality. Information on a number of measurement properties, such as measurement error, content validity, and cross-cultural validity is still lacking. Therefore, no evidence-based decisions and recommendations can be made for the use of health-related work functioning instruments. Studies of high methodological quality are needed to properly assess the existing instruments' measurement properties.

An overview of self-administered health literacy instruments.

PubMed

O Neill, Braden; Gonçalves, Daniela; Ricci-Cabello, Ignacio; Ziebland, Sue; Valderas, Jose

2014-01-01

With the increasing recognition of health literacy as a worldwide research priority, the development and refinement of indices to measure the construct is an important area of inquiry. Furthermore, the proliferation of online resources and research means that there is a growing need for self-administered instruments. We undertook a systematic overview to identify all published self-administered health literacy assessment indices to report their content and considerations associated with their administration. A primary aim of this study was to assist those seeking to employ a self-reported health literacy index to select one that has been developed and validated for an appropriate context, as well as with desired administration characteristics. Systematic searches were carried out in four electronic databases, and studies were included if they reported the development and/or validation of a novel health literacy assessment measure. Data were systematically extracted on key characteristics of the instruments: breadth of construct ("generic" vs. "content- or context- specific" health literacy), whether it was an original instrument or a derivative, country of origin, administration characteristics, age of target population (adult vs. pediatric), and evidence for validity. 35 articles met the inclusion criteria. There were 27 original instruments (27/35; 77.1%) and 8 derivative instruments (8/35; 22.9%). 22 indices measured "general" health literacy (22/35; 62.9%) while the remainder measured condition- or context- specific health literacy (13/35; 37.1%). Most health literacy measures were developed in the United States (22/35; 62.9%), and about half had adequate face, content, and construct validity (16/35; 45.7%). Given the number of measures available for many specific conditions and contexts, and that several have acceptable validity, our findings suggest that the research agenda should shift towards the investigation and elaboration of health literacy as a

Validation of an Instrument to Measure Students' Motivation and Self-Regulation towards Technology Learning

ERIC Educational Resources Information Center

Liou, Pey-Yan; Kuo, Pei-Jung

2014-01-01

Background: Few studies have examined students' attitudinal perceptions of technology. There is no appropriate instrument to measure senior high school students' motivation and self-regulation toward technology learning among the current existing instruments in the field of technology education. Purpose: The present study is to validate an…

Criterion-related validity of self-reported stair climbing in older adults.

PubMed

Higueras-Fresnillo, Sara; Esteban-Cornejo, Irene; Gasque, Pablo; Veiga, Oscar L; Martinez-Gomez, David

2018-02-01

Stair climbing is an activity of daily living that might contribute to increase levels of physical activity (PA). To date, there is no study examining the validity of climbing stairs assessed by self-report. The aim of this study was, therefore, to examine the validity of estimated stair climbing from one question included in a common questionnaire compared to a pattern-recognition activity monitor in older adults. A total of 138 older adults (94 women), aged 65-86 years (70.9 ± 4.7 years), from the IMPACT65 + study participated in this validity study. Estimates of stair climbing were obtained from the European Prospective Investigation into Cancer and Nutrition (EPIC) PA questionnaire. An objective assessment of stair climbing was obtained with the Intelligent Device for Energy Expenditure and Activity (IDEEA) monitor. The correlation between both methods to assess stair climbing was fair (ρ = 0.22, p = 0.008 for PA energy expenditure and ρ = 0.26, p = 0.002 for duration). Mean differences between self-report and the IDEEA were 7.96 ± 10.52 vs. 9.88 ± 3.32 METs-min/day for PA energy expenditure, and 0.99 ± 1.32 vs. 1.79 ± 2.02 min/day for duration (both Wilcoxon test p < 0.001). Results from the Bland-Altman analysis indicate that bias between both instruments were -1.91 ± 10.30 METs-min/day and -0.80 ± 1.99 min/day, and corresponding limits of agreement for the two instruments were from 18.27 to -22.10 METs-min/day and from 3.09 to -4.70 min/day, respectively. Our results indicate that self-reported stair climbing has modest validity to accurately rank old age participants, and underestimates both PAEE and its duration, as compared with an objectively measured method.

Validation of the COURAGE Built Environment Self-Reported Questionnaire.

PubMed

Raggi, Alberto; Quintas, Rui; Bucciarelli, Paola; Franco, Maria Grazia; Andreotti, Alessandra; Miret, Marta; Zawisza, Katarzyna; Olaya, Beatriz; Chatterji, Somnath; Sainio, Päivi; Frisoni, Giovanni Battista; Martinuzzi, Andrea; Minicuci, Nadia; Power, Mick; Leonardi, Matilde

2014-01-01

The built environment (BE) impacts on people's disability and health, in terms of overweight, depression, alcohol abuse, poor self-rated health and presence of psychological symptoms; it is reasonable to assume that BE also impacts on participation levels. This paper presents the validation of the COURAGE Built Environment Self-Reported Questionnaire (CBE-SR), an instrument designed to evaluate BE in the context of health and disability. Subjects participating to COURAGE, a cross-sectional study conducted on 10,800 citizens of Poland, Finland and Spain, completed a protocol inclusive of the CBE-SR. Psychometric properties and factor structure were analysed, and factor scores created. Gender differences, differences between persons from different age groups and persons reporting the environment as facilitating, hindering or neutral were calculated. Eight items were deleted so that the final version of CBE-SR comprises 19 items. Cronbach's alpha ranged from 0.743 to 0.906, and test-retest stability was demonstrated for the majority of items. Four subscales were identified: Usability of the neighbourhood environment; Hindrance of walkable environment; Easiness of use of public buildings, places and facilities; and Risk of accidents and usability of the living place. Younger respondents reported their neighbourhood as more usable but perceived walkways as more hindering and public buildings as less easy to use; gender differences were almost inexistent. The CBE-SR is a four-scale instrument with good psychometric properties that measures the person-environment interaction. It is sensitive across age groups and is consistent with the subject's overall judgement of the degree to which the environment is facilitating or hindering. Poor built environments have a negative impact on the level of a person's participation. However, instruments measuring the person-environment interaction are lacking. The CBE-SR is a valid and reliable instrument that researchers can use to

Measuring children's self-reported sport participation, risk perception and injury history: development and validation of a survey instrument.

PubMed

Siesmaa, Emma J; Blitvich, Jennifer D; White, Peta E; Finch, Caroline F

2011-01-01

Despite the health benefits associated with children's sport participation, the occurrence of injury in this context is common. The extent to which sport injuries impact children's ongoing involvement in sport is largely unknown. Surveys have been shown to be useful for collecting children's injury and sport participation data; however, there are currently no published instruments which investigate the impact of injury on children's sport participation. This study describes the processes undertaken to assess the validity of two survey instruments for collecting self-reported information about child cricket and netball related participation, injury history and injury risk perceptions, as well as the reliability of the cricket-specific version. Face and content validity were assessed through expert feedback from primary and secondary level teachers and from representatives of peak sporting bodies for cricket and netball. Test-retest reliability was measured using a sample of 59 child cricketers who completed the survey on two occasions, 3-4 weeks apart. Based on expert feedback relating to face and content validity, modification and/or deletion of some survey items was undertaken. Survey items with low test-retest reliability (κ≤0.40) were modified or deleted, items with moderate reliability (κ=0.41-0.60) were modified slightly and items with higher reliability (κ≥0.61) were retained, with some undergoing minor modifications. This is the first survey of its kind which has been successfully administered to cricketers aged 10-16 years to collect information about injury risk perceptions and intentions for continued sport participation. Implications for its generalisation to other child sport participants are discussed. Copyright © 2010 Sports Medicine Australia. Published by Elsevier Ltd. All rights reserved.

Development and validation of self-reported line drawings for assessment of knee malalignment and foot rotation: a cross-sectional comparative study

PubMed Central

2010-01-01

Background For large scale epidemiological studies clinical assessments and radiographs can be impractical and expensive to apply to more than just a sample of the population examined. The study objectives were to develop and validate two novel instruments for self-reported knee malalignment and foot rotation suitable for use in questionnaire studies of knee pain and osteoarthritis. Methods Two sets of line drawings were developed using similar methodology. Each instrument consisted of an explanatory question followed by a set of drawings showing straight alignment, then two each at 7.5° angulation and 15° angulation in the varus/valgus (knee) and inward/outward (foot) directions. Forty one participants undertaking a community study completed the instruments on two occasions. Participants were assessed once by a blinded expert clinical observer with demonstrated excellent reproducibility. Validity was assessed by sensitivity, specificity and likelihood ratio (LR) using the observer as the reference standard. Reliability was assessed using weighted kappa (κ). Knee malalignment was measured on 400 knee radiographs. General linear model was used to assess for the presence of a linear increase in knee alignment angle (measured medially) from self-reported severe varus to mild varus, straight, mild valgus and severe valgus deformity. Results Observer reproducibility (κ) was 0.89 and 0.81 for the knee malalignment and foot rotation instruments respectively. Self-reported participant reproducibility was also good for the knee (κ 0.73) and foot (κ 0.87) instruments. Validity was excellent for the knee malalignment instrument, with a sensitivity of 0.74 (95%CI 0.54, 0.93) and specificity of 0.97 (95%CI 0.94, 1.00). Similarly the foot rotation instrument was also found to have high sensitivity (0.92, 95%CI 0.83, 1.01) and specificity (0.96, 95%CI 0.93, 1.00). The knee alignment angle increased progressively from self reported severe varus to mild varus, straight, mild

Development and Validation of Scores from an Instrument Measuring Student Test-Taking Motivation

ERIC Educational Resources Information Center

Eklof, Hanna

2006-01-01

Using the expectancy-value model of achievement motivation as a basis, this study's purpose is to develop, apply, and validate scores from a self-report instrument measuring student test-taking motivation. Sampled evidence of construct validity for the present sample indicates that a number of the items in the instrument could be used as an…

Use of the Environment and Policy Evaluation and Observation as a Self-Report Instrument (EPAO-SR) to measure nutrition and physical activity environments in child care settings: validity and reliability evidence.

PubMed

Ward, Dianne S; Mazzucca, Stephanie; McWilliams, Christina; Hales, Derek

2015-09-26

Early care and education (ECE) centers are important settings influencing young children's diet and physical activity (PA) behaviors. To better understand their impact on diet and PA behaviors as well as to evaluate public health programs aimed at ECE settings, we developed and tested the Environment and Policy Assessment and Observation - Self-Report (EPAO-SR), a self-administered version of the previously validated, researcher-administered EPAO. Development of the EPAO-SR instrument included modification of items from the EPAO, community advisory group and expert review, and cognitive interviews with center directors and classroom teachers. Reliability and validity data were collected across 4 days in 3-5 year old classrooms in 50 ECE centers in North Carolina. Center teachers and directors completed relevant portions of the EPAO-SR on multiple days according to a standardized protocol, and trained data collectors completed the EPAO for 4 days in the centers. Reliability and validity statistics calculated included percent agreement, kappa, correlation coefficients, coefficients of variation, deviations, mean differences, and intraclass correlation coefficients (ICC), depending on the response option of the item. Data demonstrated a range of reliability and validity evidence for the EPAO-SR instrument. Reporting from directors and classroom teachers was consistent and similar to the observational data. Items that produced strongest reliability and validity estimates included beverages served, outside time, and physical activity equipment, while items such as whole grains served and amount of teacher-led PA had lower reliability (observation and self-report) and validity estimates. To overcome lower reliability and validity estimates, some items need administration on multiple days. This study demonstrated appropriate reliability and validity evidence for use of the EPAO-SR in the field. The self-administered EPAO-SR is an advancement of the measurement of ECE

Evaluating the validity of self-reported smoking in Mexican adolescents

PubMed Central

Valladolid-López, María del Carmen; Barrientos-Gutiérrez, Tonatiuh; Reynales-Shigematsu, Luz Myriam; Thrasher, James F; Peláez-Ballestas, Ingris; Lazcano-Ponce, Eduardo; Hernández-Ávila, Mauricio

2015-01-01

Objectives We aimed to evaluate the validity of the self-reported smoking indicator used in the Global Youth Tobacco Survey (GYTS). Setting 43 middle and high-school classrooms from 26 schools were selected from Mexico City and Cuernavaca, Morelos. Participants A total of 1257 students provided both a questionnaire and a urine sample. Primary and secondary outcome Sensitivity and specificity of self-reported smoking compared to urinary cotinine. Validity indices were evaluated by subgroups of gender, social acceptability of smoking (ie, smoking parents or friends) and smoking frequency. Results Sensitivity and specificity for current smoking were 93.2% and 81.7%, respectively. Validity indices remained stable across gender. Parental smoking status moderated the validity of self-report, which had lower sensitivity in adolescents with non-smoking parents (86.7%) than in adolescents with smoking parents (96.6%). Sensitivity and specificity increased with smoking frequency. Conclusions This first validation study of self-reported current smoking used in the GYTS among Mexican adolescents suggests that self-reported smoking in the past 30 days is a valid and stable indicator of current smoking behaviour. This measure appears suitable for public health research and surveillance. PMID:26453588

Shared decision making in Swedish community mental health services - an evaluation of three self-reporting instruments.

PubMed

Rosenberg, David; Schön, Ulla-Karin; Nyholm, Maria; Grim, Katarina; Svedberg, Petra

2017-04-01

Despite the potential impact of shared decision making on users satisfaction with care and quality in health care decisions, there is a lack of knowledge and skills regarding how to work with shared decision making among health care providers. The aim of this study was to evaluate the psychometric properties of three instruments that measure varied dimensions of shared decision making, based on self-reports by clients, in a Swedish community mental health context. The study sample consisted of 121 clients with experience of community mental health care, and involved in a wide range of decisions regarding both social support and treatment. The questionnaires were examined for face and content validity, internal consistency, test-retest reliability and construct validity. The instruments displayed good face and content validity, satisfactory internal consistency and a moderate to good level of stability in test-retest reliability with fair to moderate construct correlations, in a sample of clients with serious mental illness and experience of community mental health services in Sweden. The questionnaires are considered to be relevant to the decision making process, user-friendly and appropriate in a Swedish community mental health care context. They functioned well in settings where non-medical decisions, regarding social and support services, are the primary focus. The use of instruments that measure various dimensions of the self-reported experience of clients, can be a key factor in developing knowledge of how best to implement shared decision making in mental health services.

Validation of Self-Reported Cognitive Problems with Objective ...

EPA Pesticide Factsheets

There is a lack of validation of self-reported cognitive problems with objective neuropsychological measures. The validity of four self-reported cognitive items from a health questionnaire (HQ) and the Symptoms Checklist 90-Revised (SCL-90-R) was examined with objective clinical neuropsychological test performance in 147 manganese (Mn) exposed residents. These residents were from two Ohio towns exposed to ambient air-Mn from an industrial source with modeled average air-Mn concentrations of 0.54 µg/m3 (range: 0.01-4.58) and were part of a larger study of cognitive, motor, tremor abnormalities and their relationship to Mn exposure.The primarily white (94.6%) participants (aged 30-64) lived in the towns for at least 10 years (range: 10-64) and had 13.9 years of education, on average. In the last 7 days before testing, 94 (64.4%) participants self-reported concentration problems and 105 (71.8%) self-reported memory problems. After adjusting for age and education, participants who self-reported cognitive problems did not perform worse on the objective neuropsychological measures than those who reported not having problems, except on 1 of 17 neuropsychological tests (Stroop Color). Greater levels of depression and female sex predicted having more self-reported cognitive problems. Higher education was associated with fewer self-reported cognitive problems. Measures of Mn in air, blood, hair, and toenails were not associated with subjective cognitive self-reported p

The ability of cancer-specific and generic preference-based instruments to discriminate across clinical and self-reported measures of cancer severities

PubMed Central

2011-01-01

Objective To evaluate the validity of cancer-specific and generic preference-based instruments to discriminate across different measures of cancer severities. Methods Patients with breast (n = 66), colorectal (n = 57), and lung (n = 61) cancer completed the EORTC QLQ-C30 and the FACT-G, as well as three generic instruments: the EQ-5D, the SF-6D, and the HUI2/3. Disease severity was quantified using cancer stage, Eastern Cooperative Oncology Group Performance Status (ECOG-PS) score, and self-reported health status. Comparative analyses confirmed the multi-dimensional conceptualization of the instruments in terms of construct and convergent validity. Results In general, the instruments were able to discriminate across severity measures. The instruments demonstrated moderate to strong correlation with each other (r = 0.37-0.73). Not all of the measures could discriminate between different groups of disease severity: the EQ-5D and SF-6D were less discriminative than the HUI2/3 and the cancer-specific instruments. Conclusion The cancer-specific and generic preference-based instruments demonstrated to be valid in discriminating across levels of ECOG-PS scores and self-reported health states. However, the usefulness of the generic instruments may be limited if they are not able to detect small changes in health status within cancer patients. This raises concerns regarding the appropriateness of these instruments when comparing different cancer treatments within an economic evaluation framework. PMID:22123196

An instrument measuring prospective mathematics teacher self-regulated learning: validity and reliability

NASA Astrophysics Data System (ADS)

Nugroho, A. A.; Juniati, D.; Siswono, T. Y. E.

2018-03-01

Self Regulated Learning (SRL) is an individual's ability to achieve academic goals by controlling behavior, motivate yourself and use cognitive in learning, so it is important for a teacher especially teachers of mathematics related to the ability of management, design, implementation of learning and evaluation of learning outcomes. The purpose of the research is to develop an instrument to describe the SRL of a prospective mathematics teacher. Data were collected by (1) the study of the theory of SRL produced the indicator SRL used to design the questionnaire SRL; (2) analysis of the questionnaire SRL obtained from several References; and (3) development stage of the SRL questionnaire through validity test of content and empirical validation. The study involved 2 content experts in mathematics, 1 linguist, and 92 prospective mathematics teachers. The results of the research on content validity test based on Indonesian expert and 2 content experts indicate that the content can assess the indicator of the SRL and feasible to be used, in the test of legibility of two prospective mathematics teacher concluded that the instrument has a language that can be understood by the prospective teacher of mathematics and on empirical validation involving 92 prospective mathematics teacher generate data that of 65 statements there are 3 invalid statements. Reliability calculation shows high category that values 0,93. The conclusion is the SRL instrument developed for the prospective mathematics teacher.

Protocol for the design of an instrument to measure preadolescent children's self-report of covert aggression and bullying

PubMed Central

Nelson, Helen Jean; Kendall, Garth Edward; Burns, Sharyn; Schonert-Reichl, Kimberly

2015-01-01

Introduction Covert bullying in schools is associated with a range of academic, social, emotional and physical health problems. Much research has focused on bullying, but there remains a gap in understanding about covert aggression and how to most accurately and reliably measure children's own reports of this behaviour. This paper reviews relevant literature and outlines a research project that aims to develop a self-report instrument that effectively measures covert aggression and bullying. It is anticipated that this research will result in a standardised instrument that is suitable for exploring preadolescent children's experiences of covert aggressive behaviour. The data collected by the instrument will enhance health and education professionals understanding of covert bullying behaviours and will inform the design and evaluation of interventions. Methods and analysis Relational developmental systems theory will guide the design of an online self-report instrument. The first phase of the project will include a critical review of the research literature, focus groups with children aged 8–12 years (grades 4–6) in Perth, Western Australia, and expert review. The instrument will be explored for content and face validity prior to the assessment of convergent and discriminant validity, internal consistency and test-retest reliability. Ethics and dissemination The study has been approved by the Curtin University of Human Research Ethics Committee (RDHS-38-15) and by the Executive Principal of the participating school. PMID:26553834

Measuring social science concepts in pharmacy education research: From definition to item analysis of self-report instruments.

PubMed

Cor, M Ken

Interpreting results from quantitative research can be difficult when measures of concepts are constructed poorly, something that can limit measurement validity. Social science steps for defining concepts, guidelines for limiting construct-irrelevant variance when writing self-report questions, and techniques for conducting basic item analysis are reviewed to inform the design of instruments to measure social science concepts in pharmacy education research. Based on a review of the literature, four main recommendations emerge: These include: (1) employ a systematic process of conceptualization to derive nominal definitions; (2) write exact and detailed operational definitions for each concept, (3) when creating self-report questionnaires, write statements and select scales to avoid introducing construct-irrelevant variance (CIV); and (4) use basic item analysis results to inform instrument revision. Employing recommendations that emerge from this review will strengthen arguments to support measurement validity which in turn will support the defensibility of study finding interpretations. An example from pharmacy education research is used to contextualize the concepts introduced. Copyright © 2017 Elsevier Inc. All rights reserved.

Multitrait-Multimethod Analyses of Two Self-Concept Instruments.

ERIC Educational Resources Information Center

Marsh, Herbert W.; Smith, Ian D.

1982-01-01

The multidimensionality of self-concept and the use of factor analysis in the development of self-concept instruments are supported in multitrait-multimethod analyses of the Sears and Coopersmith instruments. Convergent validity and discriminate validity of subscales in factor analysis and multitrait-multimethod analysis of longitudinal data are…

School Self-Evaluation Instruments and Cognitive Validity. Do Items Capture What They Intend to?

ERIC Educational Resources Information Center

Faddar, Jerich; Vanhoof, Jan; De Maeyer, Sven

2017-01-01

School self-evaluation (SSE) often makes use of questionnaires in order to sketch a picture of the school. How respondents cognitively process questionnaire items determines the validity of SSE results. Still, one readily assumes that respondents interpret and answer items as intended by the instrument developer (referred to as cognitive…

The development and validation of an instrument to measure preservice teachers' self-efficacy in regard to the teaching of science as inquiry

NASA Astrophysics Data System (ADS)

Dira-Smolleck, Lori

The purpose of this study was to develop, validate and establish the reliability of an instrument that measures preservice teachers' self-efficacy in regard to the teaching of science as inquiry. The instrument (TSI) is based upon the work of Bandura, Riggs, and Enochs & Riggs (1990). The study used Bandura's theoretical framework in that the instrument uses the self-efficacy construct to explore the beliefs of prospective elementary science teachers with regards to the teaching of science through inquiry: specifically, the two dimensions of self-efficacy beliefs defined by Bandura: personal self-efficacy and outcome expectancy. Self-efficacy in regard to the teaching of science as inquiry was measured through the use of a 69-item Likert scale instrument designed by the author of the study. A 13-step plan was designed and followed in the process of developing the instrument. Using the results from Chronbach Alpha and Analysis of Variance, a 69-item instrument was found to achieve the greatest balance across the construct validity, reliability and item balance with the Essential Elements of Classroom Inquiry content matrix. Based on the standardized development processes used and the associated evidence, the TSI appears to be a content and construct valid instrument, with high internal reliability for use with prospective elementary teachers to assess self-efficacy beliefs in regard to the teaching of science as inquiry. Implications for research, policy and practice are also discussed.

Pooled results from 5 validation studies of dietary self-report instruments using recovery biomarkers for potassium and sodium intake.

PubMed

Freedman, Laurence S; Commins, John M; Moler, James E; Willett, Walter; Tinker, Lesley F; Subar, Amy F; Spiegelman, Donna; Rhodes, Donna; Potischman, Nancy; Neuhouser, Marian L; Moshfegh, Alanna J; Kipnis, Victor; Arab, Lenore; Prentice, Ross L

2015-04-01

We pooled data from 5 large validation studies (1999-2009) of dietary self-report instruments that used recovery biomarkers as referents, to assess food frequency questionnaires (FFQs) and 24-hour recalls (24HRs). Here we report on total potassium and sodium intakes, their densities, and their ratio. Results were similar by sex but were heterogeneous across studies. For potassium, potassium density, sodium, sodium density, and sodium:potassium ratio, average correlation coefficients for the correlation of reported intake with true intake on the FFQs were 0.37, 0.47, 0.16, 0.32, and 0.49, respectively. For the same nutrients measured with a single 24HR, they were 0.47, 0.46, 0.32, 0.31, and 0.46, respectively, rising to 0.56, 0.53, 0.41, 0.38, and 0.60 for the average of three 24HRs. Average underreporting was 5%-6% with an FFQ and 0%-4% with a single 24HR for potassium but was 28%-39% and 4%-13%, respectively, for sodium. Higher body mass index was related to underreporting of sodium. Calibration equations for true intake that included personal characteristics provided improved prediction, except for sodium density. In summary, self-reports capture potassium intake quite well but sodium intake less well. Using densities improves the measurement of potassium and sodium on an FFQ. Sodium:potassium ratio is measured much better than sodium itself on both FFQs and 24HRs. Published by Oxford University Press on behalf of the Johns Hopkins Bloomberg School of Public Health 2015. This work is written by (a) US Government employee(s) and is in the public domain in the US.

The Differentiation of Self Inventory: Development and Initial Validation.

ERIC Educational Resources Information Center

Skowron, Elizabeth A.; Friedlander, Myrna L.

The development and initial validation of a new self-report instrument, the Differentiation of Self Inventory (DSI), are presented. The DSI represents the first attempt to create a multidimensional measure of differentiation based on Bowen Theory, focusing specifically on adults (aged over 25 years), their current significant relationships, and…

Development and validation of a primary sclerosing cholangitis-specific patient-reported outcomes instrument: The PSC PRO.

PubMed

Younossi, Zobair M; Afendy, Arian; Stepanova, Maria; Racila, Andrei; Nader, Fatema; Gomel, Rachel; Safer, Ricky; Lenderking, William R; Skalicky, Anne; Kleinman, Leah; Myers, Robert P; Subramanian, G Mani; McHutchison, John G; Levy, Cynthia; Bowlus, Christopher L; Kowdley, Kris; Muir, Andrew J

2017-11-20

Primary sclerosing cholangitis (PSC) is a chronic liver disease associated with inflammation and biliary fibrosis that leads to cholangitis, cirrhosis, and impaired quality of life. Our objective was to develop and validate a PSC-specific patient-reported outcome (PRO) instrument. We developed a 42-item PSC PRO instrument that contains two modules (Symptoms and Impact of Symptoms) and conducted an external validation. Reliability and validity were evaluated using clinical data and a battery of other validated instruments. Test-retest reliability was assessed in a subgroup of patients who repeated the PSC PRO after the first administration. One hundred two PSC subjects (44 ± 13 years; 32% male, 74% employed, 39% with cirrhosis, 14% with a history of decompensated cirrhosis, 38% history of depression, and 68% with inflammatory bowel disease [IBD]) completed PSC PRO and other PRO instruments (Short Form 36 V2 [SF-36], Chronic Liver Disease Questionnaire [CLDQ], Primary Biliary Cholangitis - 40 [PBC-40], and five dimensions [5-D Itch]). PSC PRO demonstrated excellent internal consistency (Cronbach alphas, 0.84-0.94) and discriminant validity (41 of 42 items had the highest correlations with their own domains). There were good correlations between PSC PRO domains and relevant domains of SF-36, CLDQ, and PBC-40 (R = 0.69-0.90; all P < 0.0001), but lower (R = 0.31-0.60; P < 0.001) with 5-D Itch. Construct validity showed that PSC PRO can differentiate patients according to the presence and severity of cirrhosis and history of depression (P < 0.05), but not by IBD (P > 0.05). Test-retest reliability was assessed in 53 subjects who repeated PSC PRO within a median (interquartile range) of 37 (27-47) days. There was excellent reliability for most domains with intraclass correlations (0.71-0.88; all P < 0.001). PSC PRO is a self-administered disease-specific instrument developed according to U.S. Food and Drug Administration guidelines. This preliminary validation study

Measuring adolescents' HRQoL via self reports and parent proxy reports: an evaluation of the psychometric properties of both versions of the KINDL-R instrument.

PubMed

Erhart, Michael; Ellert, Ute; Kurth, Bärbel-Maria; Ravens-Sieberer, Ulrike

2009-08-26

Several instruments are available to assess children's health-related quality of life (HRQoL) based on self reports as well as proxy reports from parents. Previous studies have found only low-to-moderate agreement between self and proxy reports, but few studies have explicitly compared the psychometric qualities of both. This study compares the reliability, factorial validity and convergent and known group validity of the self-report and parent-report versions of the HRQoL KINDL-R questionnaire for children and adolescents. Within the nationally representative cross-sectional German Health Interview and Examination Survey for Children and Adolescents (KiGGS), 6,813 children and adolescents aged 11 to 17 years completed the KINDL-R generic HRQoL instrument while their parents answered the KINDL proxy version (both in paper-and-pencil versions). Cronbach's alpha and confirmatory factor-analysis models (linear structural equation model) were obtained. Convergent and discriminant validity were assessed by calculating the Pearson's correlation coefficient for the Strengths and Difficulties Questionnaire. Known-groups differences were examined (ANOVA) for obese children and children with a lower familial socio-economic status. The parent reports achieved slightly higher Cronbach's alpha values for the total score (0.86 vs. 0.83) and most sub-scores. Confirmatory factor analysis revealed an acceptable fit of the six-dimensional measurement model of the KINDL for the parent (RMSEA=0.07) and child reports (RMSEA=0.06). Factorial invariance across the two versions did not hold with regards to the pattern of loadings, the item errors and the covariation between latent concepts. However the magnitude of the differences was rather small. The parent report version achieved slightly higher convergent validity (r=0.44-0.63 vs. r=0.33-0.59) in the Strengths and Difficulties Questionnaire. No clear differences were observed for known-groups validity. Our study showed that parent

Validity of self-reported mechanical demands for occupational epidemiologic research of musculoskeletal disorders

PubMed Central

Barrero, Lope H; Katz, Jeffrey N; Dennerlein, Jack T

2012-01-01

Objectives To describe the relation of the measured validity of self-reported mechanical demands (self-reports) with the quality of validity assessments and the variability of the assessed exposure in the study population. Methods We searched for original articles, published between 1990 and 2008, reporting the validity of self-reports in three major databases: EBSCOhost, Web of Science, and PubMed. Identified assessments were classified by methodological characteristics (eg, type of self-report and reference method) and exposure dimension was measured. We also classified assessments by the degree of comparability between the self-report and the employed reference method, and the variability of the assessed exposure in the study population. Finally, we examined the association of the published validity (r) with this degree of comparability, as well as with the variability of the exposure variable in the study population. Results Of the 490 assessments identified, 75% used observation-based reference measures and 55% tested self-reports of posture duration and movement frequency. Frequently, validity studies did not report demographic information (eg, education, age, and gender distribution). Among assessments reporting correlations as a measure of validity, studies with a better match between the self-report and the reference method, and studies conducted in more heterogeneous populations tended to report higher correlations [odds ratio (OR) 2.03, 95% confidence interval (95% CI) 0.89–4.65 and OR 1.60, 95% CI 0.96–2.61, respectively]. Conclusions The reported data support the hypothesis that validity depends on study-specific factors often not examined. Experimentally manipulating the testing setting could lead to a better understanding of the capabilities and limitations of self-reported information. PMID:19562235

Validation of self-reported anthropometrics in the Adventist Health Study 2

PubMed Central

2011-01-01

Background Relying on self-reported anthropometric data is often the only feasible way of studying large populations. In this context, there are no studies assessing the validity of anthropometrics in a mostly vegetarian population. The objective of this study was to evaluate the validity of self-reported anthropometrics in the Adventist Health Study 2 (AHS-2). Methods We selected a representative sample of 911 participants of AHS-2, a cohort of over 96,000 adult Adventists in the USA and Canada. Then we compared their measured weight and height with those self-reported at baseline. We calculated the validity of the anthropometrics as continuous variables, and as categorical variables for the definition of obesity. Results On average, participants underestimated their weight by 0.20 kg, and overestimated their height by 1.57 cm resulting in underestimation of body mass index (BMI) by 0.61 kg/m2. The agreement between self-reported and measured BMI (as a continuous variable), as estimated by intraclass correlation coefficient, was 0.97. The sensitivity of self-reported BMI to detect obesity was 0.81, the specificity 0.97, the predictive positive value 0.93, the predictive negative value 0.92, and the Kappa index 0.81. The percentage of absolute agreement for each category of BMI (normoweight, overweight, and obese) was 83.4%. After multivariate analyses, predictors of differences between self-reported and measured BMI were obesity, soy consumption and the type of dietary pattern. Conclusions Self-reported anthropometric data showed high validity in a representative subsample of the AHS-2 being valid enough to be used in epidemiological studies, although it can lead to some underestimation of obesity. PMID:21466678

Validation of self-reported anthropometrics in the Adventist Health Study 2.

PubMed

Bes-Rastrollo, Maira; Sabaté, Joan; Jaceldo-Siegl, Karen; Fraser, Gary E

2011-04-05

Relying on self-reported anthropometric data is often the only feasible way of studying large populations. In this context, there are no studies assessing the validity of anthropometrics in a mostly vegetarian population. The objective of this study was to evaluate the validity of self-reported anthropometrics in the Adventist Health Study 2 (AHS-2). We selected a representative sample of 911 participants of AHS-2, a cohort of over 96,000 adult Adventists in the USA and Canada. Then we compared their measured weight and height with those self-reported at baseline. We calculated the validity of the anthropometrics as continuous variables, and as categorical variables for the definition of obesity. On average, participants underestimated their weight by 0.20 kg, and overestimated their height by 1.57 cm resulting in underestimation of body mass index (BMI) by 0.61 kg/m(2). The agreement between self-reported and measured BMI (as a continuous variable), as estimated by intraclass correlation coefficient, was 0.97. The sensitivity of self-reported BMI to detect obesity was 0.81, the specificity 0.97, the predictive positive value 0.93, the predictive negative value 0.92, and the Kappa index 0.81. The percentage of absolute agreement for each category of BMI (normoweight, overweight, and obese) was 83.4%. After multivariate analyses, predictors of differences between self-reported and measured BMI were obesity, soy consumption and the type of dietary pattern. Self-reported anthropometric data showed high validity in a representative subsample of the AHS-2 being valid enough to be used in epidemiological studies, although it can lead to some underestimation of obesity.

The Self-Presentation Motives for Physical Activity Questionnaire: Instrument Development and Preliminary Construct Validity Evidence.

PubMed

Howle, Timothy C; Dimmock, James A; Whipp, Peter R; Jackson, Ben

2015-06-01

With the aim of advancing the literature on impression management in physical activity settings, we developed a theoretically derived 2 by 2 instrument that was designed to measure different types of context-specific self-presentation motives. Following item generation and expert review (Study 1), the instrument was completed by 206 group exercise class attendees (Study 2) and 463 high school physical education students (Study 3). Our analyses supported the intended factor structure (i.e., reflecting acquisitive-agentic, acquisitive-communal, protective-agentic, and protective-communal motives). We found some support for construct validity, and the self-presentation motives were associated with variables of theoretical and applied interest (e.g., impression motivation and construction, social anxiety, social and achievement goals, efficacy beliefs, engagement). Taken together, the results indicate that the Self-presentation Motives for Physical Activity Questionnaire (SMPAQ) may be useful for measuring various types of self-presentation motives in physical activity settings.

Contextual Differential Item Functioning: Examining the Validity of Teaching Self-Efficacy Instruments Using Hierarchical Generalized Linear Modeling

ERIC Educational Resources Information Center

Zhao, Jing

2012-01-01

The purpose of the study is to further investigate the validity of instruments used for collecting preservice teachers' perceptions of self-efficacy adapting the three-level IRT model described in Cheong's study (2006). The focus of the present study is to investigate whether the polytomously-scored items on the preservice teachers' self-efficacy…

Pooled Results From 5 Validation Studies of Dietary Self-Report Instruments Using Recovery Biomarkers for Energy and Protein Intake

PubMed Central

Freedman, Laurence S.; Commins, John M.; Moler, James E.; Arab, Lenore; Baer, David J.; Kipnis, Victor; Midthune, Douglas; Moshfegh, Alanna J.; Neuhouser, Marian L.; Prentice, Ross L.; Schatzkin, Arthur; Spiegelman, Donna; Subar, Amy F.; Tinker, Lesley F.; Willett, Walter

2014-01-01

We pooled data from 5 large validation studies of dietary self-report instruments that used recovery biomarkers as references to clarify the measurement properties of food frequency questionnaires (FFQs) and 24-hour recalls. The studies were conducted in widely differing US adult populations from 1999 to 2009. We report on total energy, protein, and protein density intakes. Results were similar across sexes, but there was heterogeneity across studies. Using a FFQ, the average correlation coefficients for reported versus true intakes for energy, protein, and protein density were 0.21, 0.29, and 0.41, respectively. Using a single 24-hour recall, the coefficients were 0.26, 0.40, and 0.36, respectively, for the same nutrients and rose to 0.31, 0.49, and 0.46 when three 24-hour recalls were averaged. The average rate of under-reporting of energy intake was 28% with a FFQ and 15% with a single 24-hour recall, but the percentages were lower for protein. Personal characteristics related to under-reporting were body mass index, educational level, and age. Calibration equations for true intake that included personal characteristics provided improved prediction. This project establishes that FFQs have stronger correlations with truth for protein density than for absolute protein intake, that the use of multiple 24-hour recalls substantially increases the correlations when compared with a single 24-hour recall, and that body mass index strongly predicts under-reporting of energy and protein intakes. PMID:24918187

[Reliability and construct validity of an instrument to asses the Self-perception of Family Health Status].

PubMed

Lima Rodríguez, Joaquín Salvador; Lima Serrano, Marta; Jiménez Picón, Nerea; Domínguez Sánchez, Isabel

2012-10-01

Family health determines and it is determined by family´s capacity to function effectively as a biosocial unit in a given culture and society. The main of study has been to test reliability and construct validity of an instrument to asses the Self-perception of Family Health Status. We validated its content by an on-line Dephi panel with experts. We surveyed 258 families in them homes or in primary health centres from Seville, Spain. We administered the instrument that has five Likert scales: Family climate, Family integrity, Family functioning, and Family resistance. We tested reliability by Cronbach Alpha and construct validity by exploratory factor analysis. The five scales obtained values α between 0.73 for the Family Climate and 0.89 for Family Integrity. They showed evidence of one-dimensional interpretation after factor analysis, a) all items got weights r>0.30 in first factor before rotations, b) the first factor explained a significant proportion of variance before rotations, and c) the total variance explained by the main factors extracted was greater than 50%. The scales showed their reliability and validity. They could be employed to assess the self-perception of family health status.

The Self-Evaluation Scale-Self-Report (SES-S) Version: Studies of Reliability and Validity

ERIC Educational Resources Information Center

Erford, Bradley T.; Bardhoshi, Gerta; Duncan, Kelly; Voucas, Stephanie; Dewlin, Emily

2017-01-01

The Self-Evaluation Scale-Self-Report version was designed to assess self-concept in students aged 10 to 17 years. Coefficient a was 0.94, and test-retest was 0.87. A unidimensional construct emerged with strong convergent validity with scores on the Piers-Harris 2 (r = 0.77) and Self-Efficacy Self-Report Scale (r = 0.70).

Instrument for assessing mobile technology acceptability in diabetes self-management: a validation and reliability study.

PubMed

Frandes, Mirela; Deiac, Anca V; Timar, Bogdan; Lungeanu, Diana

2017-01-01

Nowadays, mobile technologies are part of everyday life, but the lack of instruments to assess their acceptability for the management of chronic diseases makes their actual adoption for this purpose slow. The objective of this study was to develop a survey instrument for assessing patients' attitude toward and intention to use mobile technology for diabetes mellitus (DM) self-management, as well as to identify sociodemographic characteristics and quality of life factors that affect them. We first conducted the documentation and instrument design phases, which were subsequently followed by the pilot study and instrument validation. Afterward, the instrument was administered 103 patients (median age: 37 years; range: 18-65 years) diagnosed with type 1 or type 2 DM, who accepted to participate in the study. The reliability and construct validity were assessed by computing Cronbach's alpha and using factor analysis, respectively. The instrument included statements about the actual use of electronic devices for DM management, interaction between patient and physician, attitude toward using mobile technology, and quality of life evaluation. Cronbach's alpha was 0.9 for attitude toward using mobile technology and 0.97 for attitude toward using mobile device applications for DM self-management. Younger patients (Spearman's ρ =-0.429; P <0.001) with better glycemic control (Spearman's ρ =-0.322; P <0.001) and higher education level (Kendall's τ =0.51; P <0.001) had significantly more favorable attitude toward using mobile assistive applications for DM control. Moreover, patients with a higher quality of life presented a significantly more positive attitude toward using modern technology (Spearman's ρ =0.466; P <0.001). The instrument showed good reliability and internal consistency, making it suitable for measuring the acceptability of mobile technology for DM self-management. Additionally, we found that even if most of the patients showed positive attitude toward

Instrument for assessing mobile technology acceptability in diabetes self-management: a validation and reliability study

PubMed Central

Frandes, Mirela; Deiac, Anca V; Timar, Bogdan; Lungeanu, Diana

2017-01-01

Background Nowadays, mobile technologies are part of everyday life, but the lack of instruments to assess their acceptability for the management of chronic diseases makes their actual adoption for this purpose slow. Objective The objective of this study was to develop a survey instrument for assessing patients’ attitude toward and intention to use mobile technology for diabetes mellitus (DM) self-management, as well as to identify sociodemographic characteristics and quality of life factors that affect them. Methods We first conducted the documentation and instrument design phases, which were subsequently followed by the pilot study and instrument validation. Afterward, the instrument was administered 103 patients (median age: 37 years; range: 18–65 years) diagnosed with type 1 or type 2 DM, who accepted to participate in the study. The reliability and construct validity were assessed by computing Cronbach’s alpha and using factor analysis, respectively. Results The instrument included statements about the actual use of electronic devices for DM management, interaction between patient and physician, attitude toward using mobile technology, and quality of life evaluation. Cronbach’s alpha was 0.9 for attitude toward using mobile technology and 0.97 for attitude toward using mobile device applications for DM self-management. Younger patients (Spearman’s ρ=−0.429; P<0.001) with better glycemic control (Spearman’s ρ=−0.322; P<0.001) and higher education level (Kendall’s τ=0.51; P<0.001) had significantly more favorable attitude toward using mobile assistive applications for DM control. Moreover, patients with a higher quality of life presented a significantly more positive attitude toward using modern technology (Spearman’s ρ=0.466; P<0.001). Conclusion The instrument showed good reliability and internal consistency, making it suitable for measuring the acceptability of mobile technology for DM self-management. Additionally, we found that even

Leadership: validation of a self-report scale: comment on Dussault, Frenette, and Fernet (2013).

PubMed

Chakrabarty, Subhra

2014-10-01

In a recent study, Dussault, Frenette, and Fernet (2013) developed a 21-item self-report instrument to measure leadership based on Bass's (1985) transformational/transactional leadership paradigm. The final specification included a third-order dimension (leadership), two second-order dimensions (transactional leadership and transformational leadership), and a first-order dimension (laissez-faire leadership). This note focuses on the need for assessing convergent and discriminant validity of the scale, and on ruling out the potential for common method bias.

Motivation and Pleasure Scale-Self-Report (MAP-SR): Validation of the German version of a self-report measure for screening negative symptoms in schizophrenia.

PubMed

Engel, Maike; Lincoln, Tania Marie

2016-02-01

Validated self-report instruments could provide a time efficient screening method for negative symptoms in people with schizophrenia. The aim of this study was to examine the psychometric properties of a German version of the Motivation and Pleasure Scale-Self-Report (MAP-SR) which is based on the Clinical Assessment Interview for Negative Symptoms (CAINS). In- and outpatients (N=50) with schizophrenia or schizoaffective disorder were assessed with standardized interviews and questionnaires on negative and positive symptoms and general psychopathology in schizophrenia, depression, and global functioning. The German version of the MAP-SR showed high internal consistency. Convergent validity was supported by significant correlations between the MAP-SR with the experience sub-scale of the CAINS and the negative symptom sub-scale of the Positive and Negative Syndrome Scale. The MAP-SR also exhibited discriminant validity indicated by its non-significant correlations with positive symptoms and general psychopathology, which is in line with the findings for the original version of the MAP-SR. However, the MAP-SR correlated moderately with depression. The German MAP-SR appears to be a valid and suitable diagnostic tool for the identification of negative symptoms in schizophrenia. Copyright © 2015 Elsevier Inc. All rights reserved.

The Smoking Outcome Expectation Scale and Anti-Smoking Self-Efficacy Scale for Early Adolescents: Instrument Development and Validation

ERIC Educational Resources Information Center

Chen, Chen-Ju; Yeh, Ming-Chen; Tang, Fu-In; Yu, Shu

2015-01-01

Smoking-related outcome expectation and self-efficacy have been found to be associated with adolescent smoking initiation. There is, however, a lack of appropriate instruments to investigate early adolescents' smoking outcome expectations and antismoking self-efficacy. The purpose of this study was to develop and validate the Smoking Outcome…

An Integrative Review of Self-Efficacy Measurement Instruments in Youth with Type 1 Diabetes (T1DM)

PubMed Central

Rasbach, Lisa; Jenkins, Carolyn; Laffel, Lori

2014-01-01

Purpose The purpose of this study is to assess the extant literature on instruments used to measure self-efficacy in youth with type 1 diabetes (T1DM) and their caregivers and to critically evaluate these measurements. Methods An integrative review (2003–2013) was conducted searching PsycINFO, Cumulative Index to Nursing and Allied Health Literature (CINAHL), and U.S. National Library of Medicine PubMed service (PubMed) databases using key words diabetes, type 1 diabetes, and self-efficacy. The authors reviewed the resulting294 references for inclusion criteria of (a) sample of youth with T1DM or sample of caregivers of youth with T1DM, (b) description of the self-efficacy instrument as primary research, and (c) the instrument measured self-efficacy specifically related to diabetes management. Forty-five articles out of the initial 294 met criteria. Results Of the 45 articles, 10 different self-efficacy instruments were identified. The primary theoretical framework used was Bandura’s social cognitive theory and model of self-efficacy. Most participants were white middle class T1DM youth. Evaluations to assess validity often were not reported; however, a majority of studies reported high internal consistency of the instruments. Conclusions Sample homogeneity could limit the applicability of results to certain patient populations. Further psychometric analysis, including validity assessments, should be conducted in more diverse samples. Development of valid and reliable instruments for measuring self-efficacy that are sensitive to change across a wider caregiver base over time is necessary. While this review examined reliable and valid instruments used in research, future opportunities include evaluation of measuring self-efficacy in T1DM youth exposed to recent advances in diabetes management technologies. PMID:25216655

Validity of LIDAS (LIfetime Depression Assessment Self-report): a self-report online assessment of lifetime major depressive disorder.

PubMed

Bot, M; Middeldorp, C M; de Geus, E J C; Lau, H M; Sinke, M; van Nieuwenhuizen, B; Smit, J H; Boomsma, D I; Penninx, B W J H

2017-01-01

There is a paucity of valid, brief instruments for the assessment of lifetime major depressive disorder (MDD) that can be used in, for example, large-scale genomics, imaging or biomarker studies on depression. We developed the LIfetime Depression Assessment Self-report (LIDAS), which assesses lifetime MDD diagnosis according to DSM criteria, and is largely based on the widely used Composite International Diagnostic Interview (CIDI). Here, we tested the feasibility and determined the sensitivity and specificity for measuring lifetime MDD with this new questionnaire, with a regular CIDI as reference. Sensitivity and specificity analyses of the online lifetime MDD questionnaire were performed in adults with (n = 177) and without (n = 87) lifetime MDD according to regular index CIDIs, selected from the Netherlands Study of Depression and Anxiety (NESDA) and Netherlands Twin Register (NTR). Feasibility was tested in an additional non-selective, population-based sample of NTR participants (n = 245). Of the 753 invited persons, 509 (68%) completed the LIDAS, of which 419 (82%) did this online. User-friendliness of the instrument was rated high. Median completion time was 6.2 min. Sensitivity and specificity for lifetime MDD were 85% [95% confidence interval (CI) 80-91%] and 80% (95% CI 72-89%), respectively. This LIDAS instrument gave a lifetime MDD prevalence of 20.8% in the population-based sample. Measuring lifetime MDD with an online instrument was feasible. Sensitivity and specificity were adequate. The instrument gave a prevalence of lifetime MDD in line with reported population prevalences. LIDAS is a promising tool for rapid determination of lifetime MDD status in large samples, such as needed for genomics studies.

The Development and Validation of an Instrument to Measure Preservice Teachers' Self-Efficacy in Regard to The Teaching of Science as Inquiry

NASA Astrophysics Data System (ADS)

Dira Smolleck, Lori; Zembal-Saul, Carla; Yoder, Edgar P.

2006-06-01

The purpose of this study was to develop, validate, and establish the reliability of an instrument that measures preservice teachers' self-efficacy in regard to the teaching of science as inquiry. The instrument, Teaching Science as Inquiry (TSI), is based upon the work of Bandura (1977, 1981, 1982, 1986, 1989, 1995, 1997), Riggs (1988), and Enochs and Riggs (1990). Self-efficacy in regard to the teaching of science as inquiry was measured through the use of a 69-item Likert-type scale instrument designed by the author of the study. Based on the standardized development processes used and the associated evidence, the TSI appears to be a content and construct valid instrument with high internal reliability for use with preservice elementary teachers to assess self-efficacy beliefs in regard to the teaching of science as inquiry.

The Development and Validation of an Instrument to Measure Preservice Teachers' Self-Efficacy in Regard to The Teaching of Science as Inquiry

NASA Astrophysics Data System (ADS)

Smolleck, Lori Dira; Zembal-Saul, Carla; Yoder, Edgar P.

2006-06-01

The purpose of this study was to develop, validate, and establish the reliability of an instrument that measures preservice teachers' self-efficacy in regard to the teaching of science as inquiry. The instrument, Teaching Science as Inquiry (TSI), is based upon the work of Bandura (1977, 1981, 1982, 1986, 1989, 1995, 1997), Riggs (1988), and Enochs and Riggs (1990). Self-efficacy in regard to the teaching of science as inquiry was measured through the use of a 69-item Likert-type scale instrument designed by the author of the study. Based on the standardized development processes used and the associated evidence, the TSI appears to be a content and construct valid instrument with high internal reliability for use with preservice elementary teachers to assess self-efficacy beliefs in regard to the teaching of science as inquiry.

The development and validation of the Self-Efficacy Beliefs about Equitable Science Teaching and learning instrument for prospective elementary teachers

NASA Astrophysics Data System (ADS)

Ritter, Jennifer M.

1999-12-01

The purpose of this study was to develop, validate and establish the reliability of an instrument to assess the self-efficacy beliefs of prospective elementary teachers with regards to science teaching and learning for diverse learners. The study used Bandura's theoretical framework, in that the instrument would use the self-efficacy construct to explore the beliefs of prospective elementary science teachers with regards to science teaching and learning to diverse learners: specifically the two dimensions of self-efficacy beliefs defined by Bandura (1977): personal self-efficacy and outcome expectancy. A seven step plan was designed and followed in the process of developing the instrument, which was titled the Self-Efficacy Beliefs about Equitable Science Teaching or SEBEST. Diverse learners as recognized by Science for All Americans (1989) are "those who in the past who have largely been bypassed in science and mathematics education: ethnic and language minorities and girls" (p. xviii). That definition was extended by this researcher to include children from low socioeconomic backgrounds based on the research by Gomez and Tabachnick (1992). The SEBEST was administered to 226 prospective elementary teachers at The Pennsylvania State University. Using the results from factor analyses, Coefficient Alpha, and Chi-Square a 34 item instrument was found to achieve the greatest balance across the construct validity, reliability and item balance with the content matrix. The 34 item SEBEST was found to load purely on four factors across the content matrix thus providing evidence construct validity. The Coefficient Alpha reliability for the 34 item SEBEST was .90 and .82 for the PSE sub-scale and .78 for the OE sub-scale. A Chi-Square test (X2 = 2.7 1, df = 7, p > .05) was used to confirm that the 34 items were balanced across the Personal Self-Efficacy/Outcome Expectancy and Ethnicity/LanguageMinority/Gender Socioeconomic Status/dimensions of the content matrix. Based on

Validation of Self-Reported Anthropometrics in Female College Freshmen.

PubMed

Leone, Ryan J; Morgan, Amy L; Ludy, Mary-Jon

Most investigations concerning the validity of self-reported anthropometrics focus on weight, height, and body mass index. This study extends those investigations by exploring the impact of self-reporting bias on the disease risk indicators of waist circumference and body fat percentage. Female college freshmen (n=128) self-reported weight and height, then underwent measurements for weight, height, waist circumference, and body fat percentage. Self-reporting bias was defined as self-reported minus directly-assessed anthropometric value. Despite no differences in self-reported versus directly-assessed weight or height for the total group, students with high waist circumference and excess fat under-reported their weight by 2.3±4.4 lb (p<0.05). Self-reporting bias was negatively correlated with waist circumference (r=-0.362; p<0.001) and body fat percentage (r=-0.317; p<0.001). Although many female college freshmen accurately represent their weight, those with excess fat and waist circumference under-reported their weight. This may lead to missed opportunities for risk identification, prevention, and intervention.

Validation of Self-Reported Anthropometrics in Female College Freshmen

PubMed Central

LEONE, RYAN J.; MORGAN, AMY L.; LUDY, MARY-JON

2016-01-01

Most investigations concerning the validity of self-reported anthropometrics focus on weight, height, and body mass index. This study extends those investigations by exploring the impact of self-reporting bias on the disease risk indicators of waist circumference and body fat percentage. Female college freshmen (n=128) self-reported weight and height, then underwent measurements for weight, height, waist circumference, and body fat percentage. Self-reporting bias was defined as self-reported minus directly-assessed anthropometric value. Despite no differences in self-reported versus directly-assessed weight or height for the total group, students with high waist circumference and excess fat under-reported their weight by 2.3±4.4 lb (p<0.05). Self-reporting bias was negatively correlated with waist circumference (r=−0.362; p<0.001) and body fat percentage (r=−0.317; p<0.001). Although many female college freshmen accurately represent their weight, those with excess fat and waist circumference under-reported their weight. This may lead to missed opportunities for risk identification, prevention, and intervention. PMID:27293506

Biological validation of self-reported condom use among sex workers in Guinea.

PubMed

Aho, Joséphine; Koushik, Anita; Diakité, Soumaïla Laye; Loua, Kovana Marcel; Nguyen, Vinh-Kim; Rashed, Sélim

2010-12-01

Self-reported condom use may be prone to social desirability bias. Our aim was to assess the validity of self-reported condom use in a population of female sex workers using prostate specific antigen (PSA) as a gold standard biomarker of recent unprotected vaginal intercourse. We collected data on 223 sex-workers in Conakry, Guinea in order to assess the sensitivity and specificity of self-reported condom use as well as to examine the predictors of discordance between self-report and PSA presence. PSA was detected in 38.4% of samples. Sensitivity of self-reported condom use was 14.6% and its specificity was 94.7%. Self-perceived high risk of HIV infection was the only significant independent predictor of misreported condom use. PSA could be useful to validate self-reported condom use in surveys and to allow a better understanding of factors associated with social desirability in sexual behaviour reporting.

Validity of self-reported anthropometry in adult Mexican women.

PubMed

Ortiz-Panozo, Eduardo; Yunes-Díaz, Elsa; Lajous, Martin; Romieu, Isabelle; Monge, Adriana; López-Ridaura, Ruy

2017-01-01

To compare direct and self-reported anthropometry in Mexican women. Women aged 30-72 years, participating in the Mexican Teachers' Cohort, completed a questionnaire with their anthropometric data in 2006-2008. After eleven months (median time), technicians performed anthropometry in 3756 participants. We calculated correlations and multivariable-adjusted mean differences between direct and self-reported anthropometric measures. Correlations between direct and self-reported anthropometric measures ranged from 0.78 (waist circumference) to 0.93 (weight). On average, women over-reported their height by 2.2 cm and underreported their weight, body mass index (BMI) and waist and hip circumferences by 1.3 kg, 1.3 kg/m2, 1.8 cm and 1.9 cm, respectively. Errors in self-reported anthropometry increased with rising measured BMI and were also independently associated with age, education and socioeconomic status. Self-reported anthropometry is sufficiently valid for epidemiological purposes in adult Mexican women. Errors in self-reported anthropometry might result in underestimation of the prevalence of overweight and obesity.

Antecedents of Mathematics Self-Efficacy Beliefs for Middle and High School Students: An Instrument Validation Study

ERIC Educational Resources Information Center

Freed, Mark R.

2013-01-01

There were three primary purposes for this study. First, I investigated the psychometric properties of the Sources of Middle School Mathematics Self-Efficacy (SMMSE) scale (Usher, 2007; Usher & Pajares, 2009) with high school students. Validation for expanded use of the SMMSE scale was achieved by assessing the instrument's psychometric…

Developing self-concept instrument for pre-service mathematics teachers

NASA Astrophysics Data System (ADS)

Afgani, M. W.; Suryadi, D.; Dahlan, J. A.

2018-01-01

This study aimed to develop self-concept instrument for undergraduate students of mathematics education in Palembang, Indonesia. Type of this study was development research of non-test instrument in questionnaire form. A Validity test of the instrument was performed with construct validity test by using Pearson product moment and factor analysis, while reliability test used Cronbach’s alpha. The instrument was tested by 65 undergraduate students of mathematics education in one of the universities at Palembang, Indonesia. The instrument consisted of 43 items with 7 aspects of self-concept, that were the individual concern, social identity, individual personality, view of the future, the influence of others who become role models, the influence of the environment inside or outside the classroom, and view of the mathematics. The result of validity test showed there was one invalid item because the value of Pearson’s r was 0.107 less than the critical value (0.244; α = 0.05). The item was included in social identity aspect. After the invalid item was removed, Construct validity test with factor analysis generated only one factor. The Kaiser-Meyer-Olkin (KMO) coefficient was 0.846 and reliability coefficient was 0.91. From that result, we concluded that the self-concept instrument for undergraduate students of mathematics education in Palembang, Indonesia was valid and reliable with 42 items.

Cross-sectional validation of the Aging Perceptions Questionnaire: a multidimensional instrument for assessing self-perceptions of aging

PubMed Central

Barker, Maja; O'Hanlon, Ann; McGee, Hannah M; Hickey, Anne; Conroy, Ronan M

2007-01-01

Background Self-perceptions of aging have been implicated as independent predictors of functional disability and mortality in older adults. In spite of this, research on self-perceptions of aging is limited. One reason for this is the absence of adequate measures. Specifically, there is a need to develop a measure that is theoretically-derived, has good psychometric properties, and is multidimensional in nature. The present research seeks to address this need by adopting the Self-Regulation Model as a framework and using it to develop a comprehensive, multi-dimensional instrument for assessing self-perceptions of aging. This study describes the validation of this newly-developed instrument, the Aging Perceptions Questionnaire (APQ). Methods Participants were 2,033 randomly selected community-dwelling older (+65 yrs) Irish adults who completed the APQ alongside measures of physical and psychological health. The APQ assesses self-perceptions of aging along eight distinct domains or subscales; seven of these examine views about own aging, these are: timeline chronic, timeline cyclical, consequences positive, consequences negative, control positive, control negative, and emotional representations; the eighth domain is the identity domain and this examines the experience of health-related changes. Results Mokken scale analysis showed that the majority of items within the views about aging subscales were strongly scalable. Confirmatory factor analysis also indicated that the model provided a good fit for the data. Overall, subscales had good internal reliabilities. Hierarchical linear regression was conducted to investigate the independent contribution of APQ subscales to physical and psychological health and in doing so determine the construct validity of the APQ. Results showed that self-perceptions of aging were independently related to physical and psychological health. Mediation testing also supported a role for self-perceptions of aging as partial mediators in the

Validity of injecting drug users' self report of hepatitis A, B, and C.

PubMed

Schlicting, Erin G; Johnson, Mark E; Brems, Christiane; Wells, Rebecca S; Fisher, Dennis G; Reynolds, Grace

2003-01-01

To test the validity of drug users self-reports of diseases associated with drug use, in this case hepatitis A, B, and C. Injecting drug users (n = 653) were recruited and asked whether they had been diagnosed previously with hepatitis A, B, and/or C. These self-report data were compared to total hepatitis A antibody, hepatitis B core antibody, and hepatitis C antibody seromarkers as a means of determining the validity of the self-reported information. Anchorage, Alaska. Criteria for inclusion included being at least 18-years old; testing positive on urinalysis for cocaine metabolites, amphetamine, or morphine; having visible signs of injection (track marks). Serological testing for hepatitis A, B, and C. Findings indicate high specificity, low sensitivity, and low kappa coefficients for all three self-report measures. Subgroup analyses revealed significant differences in sensitivity associated with previous substance abuse treatment experience for hepatitis B self-report and with gender for hepatitis C self-report. Given the low sensitivity, the validity of drug users, self-reported information on hepatitis should be considered with caution.

Validity of self-reported exposure to shift work.

PubMed

Härmä, Mikko; Koskinen, Aki; Ropponen, Annina; Puttonen, Sampsa; Karhula, Kati; Vahtera, Jussi; Kivimäki, Mika

2017-03-01

To evaluate the validity of widely used questionnaire items on work schedule using objective registry data as reference. A cohort study of hospital employees who responded to a self-administered questionnaire on work schedule in 2008, 2012 and 2014 and were linked to individual-level pay-roll-based records on work shifts. For predictive validity, leisure-time fatigue was assessed. According to the survey data in 2014 (n=8896), 55% of the day workers had at least 1 year of earlier shift work experience. 8% of the night shift workers changed to day work during the follow-up. Using pay-roll data as reference, questions on 'shift work with night shifts' and 'permanent night work' showed high sensitivity (96% and 90%) and specificity (92% and 97%). Self-reported 'regular day work' showed moderate sensitivity (73%), but high specificity (99%) and 'shift work without night shifts' showed low sensitivity (62%) and moderate specificity (87%). In multivariate logistic regression analysis, the age-adjusted, sex-adjusted and baseline fatigue-adjusted association between 'shift work without night shifts' and leisure-time fatigue was lower for self-reported compared with objective assessment (1.30, 95% CI 0.94 to 1.82, n=1707 vs 1.89, 95% CI 1.06 to 3.39, n=1627). In contrast, shift work with night shifts, compared with permanent day work, was similarly associated with fatigue in the two assessments (2.04, 95% CI 1.62 to 2.57, n=2311 vs 1.82, 95% CI 1.28 to 2.58, n=1804). The validity of self-reported assessment of shift work varies between work schedules. Exposure misclassification in self-reported data may contribute to bias towards the null in shift work without night shifts. Published by the BMJ Publishing Group Limited. For permission to use (where not already granted under a licence) please go to http://www.bmj.com/company/products-services/rights-and-licensing/.

Creation and validation of the self-efficacy instrument for physical education teacher education majors toward inclusion.

PubMed

Block, Martin E; Hutzler, Yeshayahu; Barak, Sharon; Klavina, Aija

2013-04-01

The purpose was to validate a self-efficacy (SE) instrument toward including students with disability in physical education (PE). Three scales referring to intellectual disabilities (ID), physical disabilities (PD), or visual impairments (VI) were administered to 486 physical education teacher education (PETE) majors. The sample was randomly split, and exploratory and confirmatory factor analyses (EFA and CFA, respectively) were conducted. After deleting items that did not meet inclusion criteria, EFA item loadings ranged from 0.53 to 0.91, and Cronbach's alpha reliability was high (for ID = .86, PD = .90, and VI = .92). CFA showed that the ID scale demonstrated good goodness-of-fit, whereas in the PD and in the VI scales demonstrated moderate fit. Thus, the content and construct validity of the instrument was supported.

Validity and reproducibility of self-reported working hours among Japanese male employees.

PubMed

Imai, Teppei; Kuwahara, Keisuke; Miyamoto, Toshiaki; Okazaki, Hiroko; Nishihara, Akiko; Kabe, Isamu; Mizoue, Tetsuya; Dohi, Seitaro

2016-07-22

Working long hours is a potential health hazard. Although self-reporting of working hours in various time frames has been used in epidemiologic studies, its validity is unclear. The objective of this study was to examine the validity and reproducibility of self-reported working hours among Japanese male employees. The participants were 164 male employees of four large-scale companies in Japan. For validity, the Spearman correlation between self-reported working hours in the second survey and the working hours recorded by the company was calculated for the following four time frames: daily working hours, monthly overtime working hours in the last month, average overtime working hours in the last 3 months, and the frequency of long working months (≥45 h/month) within the last 12 months. For reproducibility, the intraclass correlation between the first (September 2013) and second surveys (December 2013) was calculated for each of the four time frames. The Spearman correlations between self-reported working hours and those based on company records were 0.74, 0.81, 0.85, and 0.89 for daily, monthly, 3-monthly, and yearly time periods, respectively. The intraclass correlations for self-reported working hours between the two questionnaire surveys were 0.63, 0.66, 0.73, and 0.87 for the respective time frames. The results of the present study among Japanese male employees suggest that the validity of self-reported working hours is high for all four time frames, whereas the reproducibility is moderate to high.

Self-reported personality disorder in the children in the community sample: convergent and prospective validity in late adolescence and adulthood.

PubMed

Crawford, Thomas N; Cohen, Patricia; Johnson, Jeffrey G; Kasen, Stephanie; First, Michael B; Gordon, Kathy; Brook, Judith S

2005-02-01

Approximately 800 youths from the Children in the Community Study (Cohen & Cohen, 1996) have been assessed prospectively for over 20 years to study personality disorders (PDs) in adolescents and young adults. In this article we evaluate the Children in the Community Self-Report (CIC-SR) Scales, which were designed to assess DSM-IV PDs using self-reported prospective data from this longitudinal sample. To evaluate convergent validity, we assessed concordance between the CIC-SR Scales and the Structured Clinical Interview for DSM-IV Personality Disorders (SCID-II; First, Gibbon, Spitzer, Williams, & Benjamin, 1995) in 644 participants at mean age 33. To assess predictive validity, we used CIC-SR Scales at mean age 22 to predict subsequent CIC-SR and SCID-II Personality Questionnaire scores at mean age 33. In these analyses the CIC-SR Scales matched or exceeded benchmarks established in previous comparisons between self-report instruments and structured clinical interviews. Unlike other self-report scales, the CIC-SR did not appear to overestimate diagnoses when compared with SCID-II clinical diagnoses.

Incremental Validity of the Durand Adaptive Psychopathic Traits Questionnaire Above Self-Report Psychopathy Measures in Community Samples.

PubMed

Durand, Guillaume

2018-05-03

Although highly debated, the notion of the existence of an adaptive side to psychopathy is supported by some researchers. Currently, 2 instruments assessing psychopathic traits include an adaptive component, which might not cover the full spectrum of adaptive psychopathic traits. The Durand Adaptive Psychopathic Traits Questionnaire (DAPTQ; Durand, 2017 ) is a 41-item self-reported instrument assessing adaptive traits known to correlate with the psychopathic personality. In this study, I investigated in 2 samples (N = 263 and N = 262) the incremental validity of the DAPTQ over the Psychopathic Personality Inventory-Short Form (PPI-SF) and the Triarchic Psychopathy Measure (TriPM) using multiple criterion measures. Results showed that the DAPTQ significantly increased the predictive validity over the PPI-SF on 5 factors of the HEXACO. Additionally, the DAPTQ provided incremental validity over both the PPI-SF and the TriPM on measures of communication adaptability, perceived stress, and trait anxiety. Overall, these results support the validity of the DAPTQ in community samples. Directions for future studies to further validate the DAPTQ are discussed.

Reliability and validity of two self-report measures of cognitive flexibility.

PubMed

Johnco, Carly; Wuthrich, Viviana M; Rapee, Ronald M

2014-12-01

Neuropsychological testing currently represents the gold standard in assessing cognitive flexibility. However, this format presents some challenges in terms of time and skills required for administration, scoring, and interpretation. Two self-report measures of cognitive flexibility have been developed to measure aspects of cognitive flexibility in everyday settings, although neither has been validated in an older sample. In this study, we investigated the psychometric properties of 2 self-report measures of cognitive flexibility, the Cognitive Flexibility Inventory (CFI; Dennis & Vander Wal, 2010) and the Cognitive Flexibility Scale (CFS; Martin & Rubin, 1995), against neuropsychological measures of cognitive flexibility in a clinical sample of 47 older adults with comorbid anxiety and depression and a nonclinical sample of 53 community-dwelling older adults. Internal consistency was good for the CFS and CFI in all samples. The clinical sample reported poorer cognitive flexibility than did the nonclinical sample on self-report measures and performed more poorly on some neuropsychological measures. There was evidence of convergent validity between the 2 self-report measures but little relationship between the self-report and neuropsychological measures of cognitive flexibility, suggesting that self-report measures assess a different aspect of cognitive flexibility than does neuropsychological testing. Divergent validity was weak from measures of anxiety and depression in the combined and nonclinical samples but acceptable in the clinical sample. Results suggest that these measures are suitable for use with an older adult sample but do not assess the same aspects of cognitive flexibility as are assessed by neuropsychological assessment. (c) 2014 APA, all rights reserved.

Validity and reliability of the Self-Reported Physical Fitness (SRFit) survey.

PubMed

Keith, NiCole R; Clark, Daniel O; Stump, Timothy E; Miller, Douglas K; Callahan, Christopher M

2014-05-01

An accurate physical fitness survey could be useful in research and clinical care. To estimate the validity and reliability of a Self-Reported Fitness (SRFit) survey; an instrument that estimates muscular fitness, flexibility, cardiovascular endurance, BMI, and body composition (BC) in adults ≥ 40 years of age. 201 participants completed the SF-36 Physical Function Subscale, International Physical Activity Questionnaire (IPAQ), Older Adults' Desire for Physical Competence Scale (Rejeski), the SRFit survey, and the Rikli and Jones Senior Fitness Test. BC, height and weight were measured. SRFit survey items described BC, BMI, and Senior Fitness Test movements. Correlations between the Senior Fitness Test and the SRFit survey assessed concurrent validity. Cronbach's Alpha measured internal consistency within each SRFit domain. SRFit domain scores were compared with SF-36, IPAQ, and Rejeski survey scores to assess construct validity. Intraclass correlations evaluated test-retest reliability. Correlations between SRFit and the Senior Fitness Test domains ranged from 0.35 to 0.79. Cronbach's Alpha scores were .75 to .85. Correlations between SRFit and other survey scores were -0.23 to 0.72 and in the expected direction. Intraclass correlation coefficients were 0.79 to 0.93. All P-values were 0.001. Initial evaluation supports the SRFit survey's validity and reliability.

Validity and reproducibility of self-reported working hours among Japanese male employees

PubMed Central

Imai, Teppei; Kuwahara, Keisuke; Miyamoto, Toshiaki; Okazaki, Hiroko; Nishihara, Akiko; Kabe, Isamu; Mizoue, Tetsuya; Dohi, Seitaro

2016-01-01

Objective: Working long hours is a potential health hazard. Although self-reporting of working hours in various time frames has been used in epidemiologic studies, its validity is unclear. The objective of this study was to examine the validity and reproducibility of self-reported working hours among Japanese male employees. Methods: The participants were 164 male employees of four large-scale companies in Japan. For validity, the Spearman correlation between self-reported working hours in the second survey and the working hours recorded by the company was calculated for the following four time frames: daily working hours, monthly overtime working hours in the last month, average overtime working hours in the last 3 months, and the frequency of long working months (≥45 h/month) within the last 12 months. For reproducibility, the intraclass correlation between the first (September 2013) and second surveys (December 2013) was calculated for each of the four time frames. Results: The Spearman correlations between self-reported working hours and those based on company records were 0.74, 0.81, 0.85, and 0.89 for daily, monthly, 3-monthly, and yearly time periods, respectively. The intraclass correlations for self-reported working hours between the two questionnaire surveys were 0.63, 0.66, 0.73, and 0.87 for the respective time frames. Conclusions: The results of the present study among Japanese male employees suggest that the validity of self-reported working hours is high for all four time frames, whereas the reproducibility is moderate to high. PMID:27265530

Validity and reliability of Patient-Reported Outcomes Measurement Information System (PROMIS) Instruments in Osteoarthritis

PubMed Central

Broderick, Joan E.; Schneider, Stefan; Junghaenel, Doerte U.; Schwartz, Joseph E.; Stone, Arthur A.

2013-01-01

Objective Evaluation of known group validity, ecological validity, and test-retest reliability of four domain instruments from the Patient Reported Outcomes Measurement System (PROMIS) in osteoarthritis (OA) patients. Methods Recruitment of an osteoarthritis sample and a comparison general population (GP) through an Internet survey panel. Pain intensity, pain interference, physical functioning, and fatigue were assessed for 4 consecutive weeks with PROMIS short forms on a daily basis and compared with same-domain Computer Adaptive Test (CAT) instruments that use a 7-day recall. Known group validity (comparison of OA and GP), ecological validity (comparison of aggregated daily measures with CATs), and test-retest reliability were evaluated. Results The recruited samples matched (age, sex, race, ethnicity) the demographic characteristics of the U.S. sample for arthritis and the 2009 Census for the GP. Compliance with repeated measurements was excellent: > 95%. Known group validity for CATs was demonstrated with large effect sizes (pain intensity: 1.42, pain interference: 1.25, and fatigue: .85). Ecological validity was also established through high correlations between aggregated daily measures and weekly CATs (≥ .86). Test-retest validity (7-day) was very good (≥ .80). Conclusion PROMIS CAT instruments demonstrated known group and ecological validity in a comparison of osteoarthritis patients with a general population sample. Adequate test-retest reliability was also observed. These data provide encouraging initial data on the utility of these PROMIS instruments for clinical and research outcomes in osteoarthritis patients. PMID:23592494

Internal Factor Structure and Convergent Validity Evidence: The Self-Report Version of Self-Regulation Strategy Inventory

ERIC Educational Resources Information Center

Cleary, Timothy J.; Dembitzer, Leah; Kettler, Ryan J.

2015-01-01

Using a sample of 348 middle school students, we gathered evidence regarding the internal consistency of scores, as well as the internal factor structure and convergent validity evidence for inferences from a self-report questionnaire called the Self-Regulation Strategy Inventory-Self Report. Confirmatory factor analysis revealed that the fit…

Text mining a self-report back-translation.

PubMed

Blanch, Angel; Aluja, Anton

2016-06-01

There are several recommendations about the routine to undertake when back translating self-report instruments in cross-cultural research. However, text mining methods have been generally ignored within this field. This work describes a text mining innovative application useful to adapt a personality questionnaire to 12 different languages. The method is divided in 3 different stages, a descriptive analysis of the available back-translated instrument versions, a dissimilarity assessment between the source language instrument and the 12 back-translations, and an item assessment of item meaning equivalence. The suggested method contributes to improve the back-translation process of self-report instruments for cross-cultural research in 2 significant intertwined ways. First, it defines a systematic approach to the back translation issue, allowing for a more orderly and informed evaluation concerning the equivalence of different versions of the same instrument in different languages. Second, it provides more accurate instrument back-translations, which has direct implications for the reliability and validity of the instrument's test scores when used in different cultures/languages. In addition, this procedure can be extended to the back-translation of self-reports measuring psychological constructs in clinical assessment. Future research works could refine the suggested methodology and use additional available text mining tools. (PsycINFO Database Record (c) 2016 APA, all rights reserved).

Validity of self-reported history of Chlamydia trachomatis infection.

PubMed

Frisse, Ann C; Marrazzo, Jeanne M; Tutlam, Nhial T; Schreiber, Courtney A; Teal, Stephanie B; Turok, David K; Peipert, Jeffrey F

2017-04-01

Chlamydia trachomatis infection is common and largely asymptomatic in women. If untreated, it can lead to sequelae such as pelvic inflammatory disease and infertility. It is unknown whether a patient's self-reported history of Chlamydia trachomatis infection is a valid marker of past infection. Our objective was to evaluate the validity of women's self-reported history of Chlamydia trachomatis infection compared with Chlamydia trachomatis serology, a marker for previous infection. We analyzed data from the Fertility After Contraception Termination study. We compared participants' survey responses with the question, "Have you ever been told by a health care provider that you had Chlamydia?" to serological test results indicating the presence or absence of antibodies to Chlamydia trachomatis as assessed by a microimmunofluorescence assay. Prevalence of past infection, sensitivity, specificity, predictive values, and likelihood ratios were calculated. The Cohen's kappa statistic was computed to assess agreement between self-report and serology. Among 409 participants, 108 (26%) reported having a history of Chlamydia trachomatis infection, whereas 146 (36%) had positive serological test results. Relative to positive microimmunofluorescence assay, the sensitivity and specificity of self-reported history of Chlamydia trachomatis infection were 52.1% (95% confidence interval, 43.6-60.4%) and 87.8% (95% confidence interval, 83.3-91.5%), respectively. The positive predictive value of the self-report was 70.4% (95% confidence interval, 60.8-78.8%), and the negative predictive value was 76.7% (95% confidence interval, 71.6-81.4%). The likelihood ratio was found to be 4.28. Agreement between self-report and serology was found to be moderate (kappa = 0.42, P < .001). Self-reported history of Chlamydia trachomatis infection commonly yields false-negative and false-positive results. When definitive status of past Chlamydia trachomatis infection is needed, serology should be

Validation of the HIV/AIDS Stigma Instrument - PLWA (HASI-P).

PubMed

Holzemer, William L; Uys, Leana R; Chirwa, Maureen L; Greeff, Minrie; Makoae, Lucia N; Kohi, Thecla W; Dlamini, Priscilla S; Stewart, Anita L; Mullan, Joseph; Phetlhu, René D; Wantland, Dean; Durrheim, Kevin

2007-09-01

This article describes the development and testing of a quantitative measure of HIV/AIDS stigma as experienced by people living with HIV/AIDS. This instrument is designed to measure perceived stigma, create a baseline from which to measure changes in stigma over time, and track potential progress towards reducing stigma. It was developed in three phases from 2003-2006: generating items based on results of focus group discussions; pilot testing and reducing the original list of items; and validating the instrument. Data for all phases were collected from five African countries: Lesotho, Malawi, South Africa, Swaziland and Tanzania. The instrument was validated with a sample of 1,477 persons living with HIV/AIDS from all of the five countries. The sample had a mean age of 36.1 years and 74.1% was female. The participants reported they knew they were HIV positive for an average of 3.4 years and 46% of the sample was taking antiretroviral medications. A six factor solution with 33 items explained 60.72% of the variance. Scale alpha reliabilities were examined and items that did not contribute to scale reliability were dropped. The factors included: Verbal Abuse (8 items, alpha=0.886); Negative Self-Perception (5 items, alpha=0.906); Health Care Neglect (7 items, alpha=0.832); Social Isolation (5 items, alpha=0.890); Fear of Contagion (6 items, alpha=0.795); and Workplace Stigma (2 items, alpha=0.758). This article reports on the development and validation of a new measure of stigma, HIV/AIDS Stigma Instrument - PLWA (HASI-P) providing evidence that supports adequate content and construct validity, modest concurrent validity, and acceptable internal consistency reliability for each of the six subscales and total score. The scale is available is several African languages.

Measuring Pre-Service Teachers' Self-Efficacy in Tutoring Children in Primary Mathematics: An Instrument

ERIC Educational Resources Information Center

Bjerke, Annette Hessen; Eriksen, Elisabeta

2016-01-01

This article reports on the use of Rasch modelling to develop and validate an instrument measuring self-efficacy in tutoring children in primary mathematics (SETcPM). In response to the literature on teacher efficacy, the 20-item instrument aims to inform teacher educators, and is designed for novice pre-service teachers (nPSTs) preparing to teach…

Norms and Construct Validity of the Rosenberg Self-Esteem Scale in Canadian High School Populations: Implications for Counselling.

ERIC Educational Resources Information Center

Bagley, Christopher; Bolitho, Floyd; Bertrand, Lorne

1997-01-01

Reports on instrument validity regarding self-esteem among high school students (N=2,108) in the Province of Alberta. Results indicate significant variation of mean scores across age-groups within female students even though females had significantly lower self-esteem than males. Findings support the reliability of the self-esteem instrument. (RJM)

The Motivation and Pleasure Scale-Self-Report (MAP-SR): reliability and validity of a self-report measure of negative symptoms.

PubMed

Llerena, Katiah; Park, Stephanie G; McCarthy, Julie M; Couture, Shannon M; Bennett, Melanie E; Blanchard, Jack J

2013-07-01

The Clinical Assessment Interview for Negative Symptoms (CAINS) is an empirically developed interview measure of negative symptoms. Building on prior work, this study examined the reliability and validity of a self-report measure based on the CAINS-the Motivation and Pleasure Scale-Self-Report (MAP-SR)-that assesses the motivation and pleasure domain of negative symptoms. Thirty-seven participants with schizophrenia or schizoaffective disorder completed the 18-item MAP-SR, the CAINS, and other measures of functional outcome. Item analyses revealed three items that performed poorly. The revised 15-item MAP-SR demonstrated good internal consistency and convergent validity with the clinician-rated Motivation and Pleasure scale of the CAINS, as well as good discriminant validity, with little association with psychotic symptoms or depression/anxiety. MAP-SR scores were related to social anhedonia, social closeness, and clinician-rated social functioning. The MAP-SR is a promising self-report measure of severity of negative symptoms. Copyright © 2013 Elsevier Inc. All rights reserved.

Validation of Self-Reported Cognitive Problems with Objective Neuropsychological Performance in Manganese-Exposed Residents

EPA Science Inventory

There is a lack of validation of self-reported cognitive problems with objective neuropsychological measures. The validity of four self-reported cognitive items from a health questionnaire (HQ) and the Symptoms Checklist 90-Revised (SCL-90-R) was examined with objective clinical ...

Development and validation of a new self-report instrument for measuring sedentary behaviors and light-intensity physical activity in adults.

PubMed

Barwais, Faisal Awad; Cuddihy, Thomas F; Washington, Tracy; Tomson, L Michaud; Brymer, Eric

2014-08-01

Low levels of physical activity and high levels of sedentary behavior (SB) are major public health concerns. This study was designed to develop and validate the 7-day Sedentary (S) and Light Intensity Physical Activity (LIPA) Log (7-day SLIPA Log), a self-report measure of specific daily behaviors. To develop the log, 62 specific SB and LIPA behaviors were chosen from the Compendium of Physical Activities. Face-to-face interviews were conducted with 32 sedentary volunteers to identify domains and behaviors of SB and LIPA. To validate the log, a further 22 sedentary adults were recruited to wear the GT3x for 7 consecutive days and nights. Pearson correlations (r) between the 7-day SLIPA Log and GT3x were significant for sedentary (r = .86, P < .001), for LIPA (r = .80, P < .001). Lying and sitting postures were positively correlated with GT3x output (r = .60 and r = .64, P < .001, respectively). No significant correlation was found for standing posture (r = .14, P = .53).The kappa values between the 7-day SLIPA Log and GT3x variables ranged from 0.09 to 0.61, indicating poor to good agreement. The 7-day SLIPA Log is a valid self-report measure of SB and LIPA in specific behavioral domains.

Autism Spectrum Disorders and Self-Reports: Testing Validity and Reliability Using the NEO-PI-R

ERIC Educational Resources Information Center

Hesselmark, Eva; Eriksson, Jonna M.; Westerlund, Joakim; Bejerot, Susanne

2015-01-01

Although self-reported measures are frequently used to assess adults with autism spectrum disorders (ASD), the validity of self-reports is under-researched in ASD. The core symptoms of ASD may negatively affect the psychometric properties of self-reported measures. The aim of the present study was to test the validity and reliability of…

Validation and calibration of HeadCount, a self-report measure for quantifying heading exposure in soccer players.

PubMed

Catenaccio, E; Caccese, J; Wakschlag, N; Fleysher, R; Kim, N; Kim, M; Buckley, T A; Stewart, W F; Lipton, R B; Kaminski, T; Lipton, M L

2016-01-01

The long-term effects of repetitive head impacts due to heading are an area of increasing concern, and exposure must be accurately measured; however, the validity of self-report of cumulative soccer heading is not known. In order to validate HeadCount, a 2-week recall questionnaire, the number of player-reported headers was compared to the number of headers observed by trained raters for a men's and a women's collegiate soccer teams during an entire season of competitive play using Spearman's correlations and intraclass correlation coefficients (ICCs), and calibrated using a generalized estimating equation. The average Spearman's rho was 0.85 for men and 0.79 for women. The average ICC was 0.75 in men and 0.38 in women. The calibration analysis demonstrated that men tend to report heading accurately while women tend to overestimate. HeadCount is a valid instrument for tracking heading behaviour, but may have to be calibrated in women.

Validity of smoke alarm self-report measures and reasons for over-reporting.

PubMed

Stepnitz, Rebecca; Shields, Wendy; McDonald, Eileen; Gielen, Andrea

2012-10-01

Many residential fire deaths occur in homes with no or non-functioning smoke alarms (SAs). Self-reported SA coverage is high, but studies have found varying validity for self-report measures. The authors aim to: (1) determine over-reporting of coverage, (2) describe socio-demographic correlates of over-reporting and (3) report reasons for over-reporting. The authors surveyed 603 households in a large, urban area about fire safety behaviours and then tested all SAs in the home. 23 participants who over-reported their SA coverage were telephoned and asked about why they had misreported. Full coverage was reported in 70% of households but observed in only 41%, with a low positive predictive value (54.2%) for the self-report measure. Most over-reporters assumed alarms were working because they were mounted or did not think a working alarm in a basement or attic was needed to be fully protected. If alarms cannot be tested, researchers or those counselling residents on fire safety should carefully probe self-reported coverage. Our findings support efforts to equip more homes with hard-wired or 10 year lithium battery alarms to reduce the need for user maintenance.

Validation of Self-Report on Smoking among University Students in Korea

ERIC Educational Resources Information Center

Lee, Chung Yul; Shin, Sunmi; Lee, Hyeon Kyeong; Hong, Yoon Mi

2009-01-01

Objective: To validate the self-reported smoking status of Korean university students. Methods: Subjects included 322 Korean university in Korea, who participated in an annual health screening. Data on smoking were collected through a self-reported questionnaire and urine test. The data were analyzed by the McNemar test. Results: In the…

Validation of an instrument for mathematics enhancement teaching efficacy of Pacific Northwest agricultural educators

NASA Astrophysics Data System (ADS)

Jansen, Daniel J.

Teacher efficacy continues to be an important area of study in educational research. This study tested an instrument designed to assess the perceived efficacy of agricultural education teachers when engaged in lessons involving mathematics instruction. The study population of Oregon and Washington agricultural educators utilized in the validation of the instrument revealed important demographic findings and specific results related to teacher efficacy for the study population. An instrument was developed from the assimilation of three scales previously used and validated in efficacy research. Participants' mathematics teaching efficacy was assessed using a portion of the Mathematics Teaching Efficacy Beliefs Instrument (MTEBI), and personal mathematics efficacy was evaluated by the mathematics self-belief instrument which was derived from the Betz and Hackett's Mathematics Self-Efficacy Scale. The final scale, the Teachers' Sense of Efficacy Scale (TSES) created by Tschannen-Moran and Woolfolk Hoy, examined perceived personal teaching efficacy. Structural equation modeling was used as the statistical analyses tool to validate the instrument and examine correlations between efficacy constructs used to determine potential professional development needs of the survey population. As part of the data required for validation of the Mathematics Enhancement Teaching Efficacy instrument, demographic information defining the population of Oregon and Washington agricultural educators was obtained and reported. A hypothetical model derived from teacher efficacy literature was found to be an acceptable model to verify construct validity and determine strength of correlations between the scales that defined the instrument. The instrument produced an alpha coefficient of .905 for reliability. Both exploratory and confirmatory factor analyses were used to verify construct and discriminate validity. Specifics results related to the survey population of agricultural educators

Factor analyses of an Adult Epilepsy Self-Management Measurement Instrument (AESMMI).

PubMed

Escoffery, Cam; Bamps, Yvan; LaFrance, W Curt; Stoll, Shelley; Shegog, Ross; Buelow, Janice; Shafer, Patricia; Thompson, Nancy J; McGee, Robin E; Hatfield, Katherine

2015-09-01

The purpose of this study was to test the psychometric properties of an enhanced Adult Epilepsy Self-Management Measurement Instrument (AESMMI). An instrument of 113 items, covering 10 a priori self-management domains, was generated through a multiphase process, based on a review of the literature, validated epilepsy and other chronic condition self-management scales and expert input. Reliability and exploratory factor analyses were conducted on data collected from 422 adults with epilepsy. The instrument was reduced to 65 items, converging on 11 factors: Health-care Communication, Coping, Treatment Management, Seizure Tracking, Social Support, Seizure Response, Wellness, Medication Adherence, Safety, Stress Management, and Proactivity. Exploratory factors supported the construct validity for 6 a priori domains, albeit with significant changes in the retained items or in their scope and 3 new factors. One a priori domain was split in 2 subscales pertaining to treatment. The configuration of the 11 factors provides additional insight into epilepsy self-management behaviors. Internal consistency reliability of the 65-item instrument was high (α=.935). Correlations with independent measures of health status, quality of life, depression, seizure severity, and life impact of epilepsy further validated the instrument. This instrument shows potential for use in research and clinical settings and for assessing intervention outcomes and self-management behaviors in adults with epilepsy. Copyright © 2015 Elsevier Inc. All rights reserved.

Construct Validation of the Self-Efficacy Teaching and Knowledge Instrument for Science Teachers-Revised (SETAKIST-R): Lessons Learned

ERIC Educational Resources Information Center

Pruski, Linda A.; Blanco, Sharon L.; Riggs, Rosemary A.; Grimes, Kandi K.; Fordtran, Chase W.; Barbola, Gina M.; Cornell, John E.; Lichtenstein, Michael J.

2013-01-01

Described herein is the academic lineage and independent validation of the Self-Efficacy Teaching and Knowledge Instrument for Science Teachers-Revised (SETAKIST-R). Data from 334 K-12 science teachers were analyzed using Partial Credit Rasch models. Principal components analysis on the person-item residuals suggest two latent dimensions:…

Assessing the Validity of Self-Reported Stress-Related Growth

ERIC Educational Resources Information Center

Frazier, Patricia A.; Kaler, Matthew E.

2006-01-01

The purpose of these studies was to assess the validity of self-reported stress-related growth (SRG). In Study 1, individuals with breast cancer (n = 70) generally did not report greater well-being than a matched comparison group (n = 70). In Study 2, there were no significant differences in well-being between undergraduate students who said that…

Development and Validation of the Guided Group Discussion Self-Estimate Inventory (GGD-SEI).

ERIC Educational Resources Information Center

Martin, David; Campbell, Bill

1998-01-01

A 19-item self-report measure was designed to promote increased self-awareness of a group leader's perceived ability to facilitate small group discussion. Results of analysis show high reliability and validity. The instrument, developed for use within education and training settings, provides a useful measure of guided small-group discussion…

Validity of self-reported stroke in elderly African Americans, Caribbean Hispanics, and Whites.

PubMed

Reitz, Christiane; Schupf, Nicole; Luchsinger, José A; Brickman, Adam M; Manly, Jennifer J; Andrews, Howard; Tang, Ming X; DeCarli, Charles; Brown, Truman R; Mayeux, Richard

2009-07-01

The validity of a self-reported stroke remains inconclusive. To validate the diagnosis of self-reported stroke using stroke identified by magnetic resonance imaging (MRI) as the standard. Community-based cohort study of nondemented, ethnically diverse elderly persons in northern Manhattan. High-resolution quantitative MRIs were acquired for 717 participants without dementia. Sensitivity and specificity of stroke by self-report were examined using cross-sectional analyses and the chi(2) test. Putative relationships between factors potentially influencing the reporting of stroke, including memory performance, cognitive function, and vascular risk factors, were assessed using logistic regression models. Subsequently, all analyses were repeated, stratified by age, sex, ethnic group, and level of education. In analyses of the whole sample, sensitivity of stroke self-report for a diagnosis of stroke on MRI was 32.4%, and specificity was 78.9%. In analyses stratified by median age (80.1 years), the validity between reported stroke and detection of stroke on MRI was significantly better in the younger than the older age group (for all vascular territories: sensitivity and specificity, 36.7% and 81.3% vs 27.6% and 26.2%; P = .02). Impaired memory, cognitive skills, or language ability and the presence of hypertension or myocardial infarction were associated with higher rates of false-negative results. Using brain MRI as the standard, specificity and sensitivity of stroke self-report are low. Accuracy of self-report is influenced by age, presence of vascular disease, and cognitive function. In stroke research, sensitive neuroimaging techniques rather than stroke self-report should be used to determine stroke history.

The reliability, validity, and accuracy of self-reported absenteeism from work: a meta-analysis.

PubMed

Johns, Gary; Miraglia, Mariella

2015-01-01

Because of a variety of access limitations, self-reported absenteeism from work is often employed in research concerning health, organizational behavior, and economics, and it is ubiquitous in large scale population surveys in these domains. Several well established cognitive and social-motivational biases suggest that self-reports of absence will exhibit convergent validity with records-based measures but that people will tend to underreport the behavior. We used meta-analysis to summarize the reliability, validity, and accuracy of absence self-reports. The results suggested that self-reports of absenteeism offer adequate test-retest reliability and that they exhibit reasonably good rank order convergence with organizational records. However, people have a decided tendency to underreport their absenteeism, although such underreporting has decreased over time. Also, self-reports were more accurate when sickness absence rather than absence for any reason was probed. It is concluded that self-reported absenteeism might serve as a valid measure in some correlational research designs. However, when accurate knowledge of absolute absenteeism levels is essential, the tendency to underreport could result in flawed policy decisions. PsycINFO Database Record (c) 2014 APA, all rights reserved.

Validity of self-reported solar UVR exposure compared with objectively measured UVR exposure.

PubMed

Glanz, Karen; Gies, Peter; O'Riordan, David L; Elliott, Tom; Nehl, Eric; McCarty, Frances; Davis, Erica

2010-12-01

Reliance on verbal self-report of solar exposure in skin cancer prevention and epidemiologic studies may be problematic if self-report data are not valid due to systematic errors in recall, social desirability bias, or other reasons. This study examines the validity of self-reports of exposure to ultraviolet radiation (UVR) compared to objectively measured exposure among children and adults in outdoor recreation settings in 4 regions of the United States. Objective UVR exposures of 515 participants were measured using polysulfone film badge UVR dosimeters on 2 days. The same subjects provided self-reported UVR exposure data on surveys and 4-day sun exposure diaries, for comparison to their objectively measured exposure. Dosimeter data showed that lifeguards had the greatest UVR exposure (24.5% of weekday ambient UVR), children the next highest exposures (10.3% ambient weekday UVR), and parents had the lowest (6.6% ambient weekday UVR). Similar patterns were observed in self-report data. Correlations between diary reports and dosimeter findings were fair to good and were highest for lifeguards (r = 0.38-0.57), followed by parents (r = 0.28-0.29) and children (r = 0.18-0.34). Correlations between survey and diary measures were moderate to good for lifeguards (r = 0.20-0.54) and children (r = 0.35-0.53). This is the largest study of its kind to date, and supports the utility of self-report measures of solar UVR exposure. Overall, self-reports of sun exposure produce valid measures of UVR exposure among parents, children, and lifeguards who work outdoors. ©2010 AACR.

Self-reported quality of life measure is reliable and valid in adult patients suffering from schizophrenia with executive impairment.

PubMed

Baumstarck, Karine; Boyer, Laurent; Boucekine, Mohamed; Aghababian, Valérie; Parola, Nathalie; Lançon, Christophe; Auquier, Pascal

2013-06-01

Impaired executive functions are among the most widely observed in patients suffering from schizophrenia. The use of self-reported outcomes for evaluating treatment and managing care of these patients has been questioned. The aim of this study was to provide new evidence about the suitability of self-reported outcome for use in this specific population by exploring the internal structure, reliability and external validity of a specific quality of life (QoL) instrument, the Schizophrenia Quality of Life questionnaire (SQoL18). cross-sectional study. age over 18 years, diagnosis of schizophrenia according to the DSM-IV criteria. sociodemographic (age, gender, and education level) and clinical data (duration of illness, Positive and Negative Syndrome Scale, Calgary Depression Scale for Schizophrenia); QoL (SQoL18); and executive performance (Stroop test, lexical and verbal fluency, and trail-making test). Non-impaired and impaired populations were defined for each of the three tests. For the six groups, psychometric properties were compared to those reported from the reference population assessed in the validation study. One hundred and thirteen consecutive patients were enrolled. The factor analysis performed in the impaired groups showed that the questionnaire structure adequately matched the initial structure of the SQoL18. The unidimensionality of the dimensions was preserved, and the internal/external validity indices were close to those of the non-impaired groups and the reference population. Our study suggests that executive dysfunction did not compromise the reliability or validity of self-reported disease-specific QoL questionnaire. Copyright © 2013 Elsevier B.V. All rights reserved.

Just Ask Me: Convergent Validity of Self-Reported Measures of Music Participation

ERIC Educational Resources Information Center

Elpus, Kenneth

2017-01-01

The purpose of this study was to determine the convergent validity of self-reported and objective measures of school music ensemble participation. Self-reported survey responses to a question about high school music ensemble participation and administrative data in the form of high school transcript-indicated ensemble enrollments were compared…

Validation of self-reported cannabis dose and potency: an ecological study.

PubMed

van der Pol, Peggy; Liebregts, Nienke; de Graaf, Ron; Korf, Dirk J; van den Brink, Wim; van Laar, Margriet

2013-10-01

To assess the reliability and validity of self-reported cannabis dose and potency measures. Cross-sectional study comparing self-reports with objective measures of amount of cannabis and delta-9-tetrahydrocannabinol (THC) concentration. Ecological study with assessments at participants' homes or in a coffee shop. Young adult frequent cannabis users (n = 106) from the Dutch Cannabis Dependence (CanDep) study. The objectively measured amount of cannabis per joint (dose in grams) was compared with self-reported estimates using a prompt card and average number of joints made from 1 g of cannabis. In addition, objectively assessed THC concentration in the participant's cannabis was compared with self-reported level of intoxication, subjective estimate of cannabis potency and price per gram of cannabis. Objective estimates of doses per joint (0.07-0.88 g/joint) and cannabis potency (1.1-24.7%) varied widely. Self-reported measures of dose were imprecise, but at group level, average dose per joint was estimated accurately with the number of joints made from 1 g [limit of agreement (LOA) = -0.02 g, 95% confidence interval (CI) = -0.29; 0.26], whereas the prompt card resulted in serious underestimation (LOA = 0.14 g, 95% CI = -0.10; 0.37). THC concentration in cannabis was associated with subjective potency ['average' 3.77% (P = 0.002) and '(very) strong' 5.13% more THC (P < 0.001) than '(very) mild' cannabis] and with cannabis price (about 1% increase in THC concentration per euro spent on 1 g of cannabis, P < 0.001), but not with level of intoxication. Self-report measures relating to cannabis use appear at best to be associated weakly with objective measures. Of the self-report measures, number of joints per gram, cannabis price and subjective potency have at least some validity. © 2013 Society for the Study of Addiction.

Psychosocial measures used to assess the effectiveness of school-based nutrition education programs: review and analysis of self-report instruments for children 8 to 12 years old.

PubMed

Hernández-Garbanzo, Yenory; Brosh, Joanne; Serrano, Elena L; Cason, Katherine L; Bhattarai, Ranju

2013-01-01

To identify the psychometric properties of evaluation instruments that measure mediators of dietary behaviors in school-aged children. Systematic search of scientific databases limited to 1999-2010. Psychometric properties related to development and testing of self-report instruments for children 8-12 years old. Systematic search of 189 articles and review of 15 instruments (20 associated articles) meeting the inclusion criteria. Search terms used included children, school, nutrition, diet, nutrition education, and evaluation. Fourteen studies used a theoretical framework to guide the instrument's development. Knowledge and self-efficacy were the most commonly used psychosocial measures. Twelve instruments focused on specific nutrition-related behaviors. Eight instruments included over 40 items and used age-appropriate response formats. Acceptable reliability properties were most commonly reported for attitude and self-efficacy measures. Although most of the instruments were reviewed by experts (n = 8) and/or pilot-tested (n = 9), only 7 were tested using both rigorous types of validity and with low-income youth. Results from this review suggest that additional research is needed to develop more robust psychosocial measures for dietary behaviors, for low-income youth audiences. Copyright © 2013 Society for Nutrition Education and Behavior. Published by Elsevier Inc. All rights reserved.

Psychometric validation of a condom self-efficacy scale in Korean.

PubMed

Cha, EunSeok; Kim, Kevin H; Burke, Lora E

2008-01-01

When an instrument is translated for use in cross-cultural research, it needs to account for cultural factors without distorting the psychometric properties of the instrument. To validate the psychometric properties of the condom self-efficacy scale (CSE) originally developed for American adolescents and young adults after translating the scale to Korean (CSE-K) to determine its suitability for cross-cultural research among Korean college students. A cross-sectional, correlational design was used with an exploratory survey methodology through self-report questionnaires. A convenience sample of 351 students, aged 18 to 25 years, were recruited at a university in Seoul, Korea. The participants completed the CSE-K and the intention of condom use scales after they were translated from English to Korean using a combined translation technique. A demographic and sex history questionnaire, which included an item to assess actual condom usage, was also administered. Mean, variance, reliability, criterion validity, and factorial validity using confirmatory factor analysis were assessed in the CSE-K. Norms for the CSE-K were similar, but not identical, to norms for the English version. The means of all three subscales were lower for the CSE-K than for the original CSE; however, the obtained variance in CSE-K was roughly similar with the original CSE. The Cronbach's alpha coefficient for the total scale was higher for the CSE-K (.91) than that for either the CSE (.85) or CSE in Thai (.85). Criterion validity and construct validity of the CSE-K were confirmed. The CSE-K was a reliable and valid scale in measuring condom self-efficacy among Korean college students. The findings suggest that the CSE was an appropriate instrument to conduct cross-cultural research on sexual behavior in adolescents and young adults.

Validity and Reliability of a Parental Self-Efficacy Instrument in the Healthy School Start Prevention Trial of Childhood Obesity

ERIC Educational Resources Information Center

Bohman, Benjamin; Nyberg, Gisela; Sundblom, Elinor; Schäfer Elinder, Liselotte

2014-01-01

Introduction: Measures of parental self-efficacy (PSE) for healthy dietary or physical activity (PA) behaviors in children have been used in several studies; however, further psychometric validation of PSE for these behaviors is needed. The purpose of the present study was to evaluate the psychometric properties of a new PSE instrument. Methods:…

Validating the Factor Structure of the Self-Report Psychopathy Scale in a Community Sample

ERIC Educational Resources Information Center

Mahmut, Mehmet K.; Menictas, Con; Stevenson, Richard J.; Homewood, Judi

2011-01-01

Currently, there is no standard self-report measure of psychopathy in community-dwelling samples that parallels the most commonly used measure of psychopathy in forensic and clinical samples, the Psychopathy Checklist. A promising instrument is the Self-Report Psychopathy scale (SRP), which was derived from the original version the Psychopathy…

Translation and validation of the Self-care of Heart Failure Index into Persian.

PubMed

Siabani, Soraya; Leeder, Stephen R; Davidson, Patricia M; Najafi, Farid; Hamzeh, Behrooz; Solimani, Akram; Siahbani, Sara; Driscoll, Tim

2014-01-01

Chronic heart failure (CHF) is a common burdensome health problem worldwide. Self-care improves outcomes in patients with CHF. The Self-care of Heart Failure Index (SCHFI) is a well-known scale for assessing self-care. A reliable, valid, and culturally acceptable instrument is needed to develop and test self-care interventions in Iran. We sought to translate and validate the Persian version of SCHFI v 6.2 (pSCHFI). We translated the SCHFI into Persian (pSCHFI) using standardized methods. The reliability was evaluated by assessing Cronbach's α coefficient. Expert opinion, discussion with patients, and confirmatory factor analysis were used to assess face validity, content validity, and construct validity, respectively. The analysis, using 184 participants, showed acceptable internal consistency and construct validity for the 3 subscales of pSCHFI-self-care maintenance, self-care management, and self-care self-confidence. The pSCHFI is a valid instrument with an acceptable reliability for evaluating self-care in Persian patients with heart failure.

Construct validity of self-reported historical physical activity.

PubMed

Bowles, Heather R; FitzGerald, Shannon J; Morrow, James R; Jackson, Allen W; Blair, Steven N

2004-08-01

The purpose of this study was to determine the construct-related validity of self-reported historical walking, running, and jogging (WRJ) activity on the basis of data from the Aerobics Center Longitudinal Study (Dallas, Texas). A total of 4,100 men and 963 women underwent at least one medical examination between 1976 and 1985 and completed a follow-up questionnaire in 1986. Levels of glucose, cholesterol, and triglycerides, resting systolic blood pressure, body mass index (weight (kg)/height (m)(2)), and cardiorespiratory fitness were measured at the time of the medical examination. The follow-up questionnaire assessed WRJ and other strenuous activities for each year from 1976 through 1985. Data analysis included Spearman and partial correlations, analysis of variance, analysis of covariance, and t tests. Results indicated significant correlations between recalled WRJ and treadmill times for each year throughout the 10-year period (r = 0.40-0.61). Participants were classified as historically either sufficiently physically active to receive a health benefit or insufficiently active for a health benefit. Engaging in sufficient levels of historical WRJ was associated with higher treadmill times and lower body mass indices for men and women and lower triglyceride levels for men. Self-reported historical WRJ can be assessed with reasonable validity in comparison with measured treadmill performance, with no decay in accuracy of reporting for up to 10 years in the past.

The Chinese Version of the Self-Report Family Inventory: Reliability and Validity.

ERIC Educational Resources Information Center

Shek, Daniel T. L.; Lai, Kelly Y. C.

2001-01-01

Reliability and validity of Chinese Self-Report Family Inventory (C-SFI) were examined in three studies. Study 1 showed C-SFI was temporally stable and internally consistent. Study 2 indicated C-SFI could discriminate between clinical and nonclinical groups. Study 3 gave support for internal consistency, concurrent validity and construct validity.…

Validity and concordance between self-reported and clinical diagnosis of hypertension among elderly residents in northeastern Brazil.

PubMed

de Menezes, Tarciana Nobre; Oliveira, Elaine Cristina Tôrres; de Sousa Fischer, Milena Abreu Tavares

2014-02-01

Self-reported information has been used as an easy and quick method to estimate the prevalence of systemic hypertension in populations. However, verification of whether self-reports of the disease are consistent with clinical diagnosis is essential for proper use of this information. This study aimed to verify the validity and concordance between self-reported and clinical diagnosis of hypertension in the elderly population of a city in northeastern Brazil. This was a cross-sectional and population-based study. The prevalence of diagnosed and self-reported hypertension and the validity and concordance between self-reported and clinical diagnosis and their distribution according to demographic and socioeconomic variables were assessed. The validity of self-reported hypertension was determined by sensitivity, specificity, and positive and negative predictive value. Overall, 795 elderly patients were evaluated (69.1% women). There was a high prevalence of hypertension among the elderly (diagnosed: 75.1%, 95% confidence interval (CI) = 71.1%-77.9%; self-reported: 59.7%, 95% CI = 56.3%-63.1%). For self-reported hypertension, sensitivity was substantial (77.1%), specificity was excellent (93.4%), positive predictive value was excellent (97.3%), and negative predictive value was moderate (57.2%). There was a moderate concordance between self-reported and clinical diagnosis of hypertension (kappa = 0.59; P < 0.001). Reasonable validity and moderate concordance of self-reported information on hypertension was observed, which reinforces the idea that this information can be used as strategy for detecting the disease prevalence in this population. However, because of nonachievement of excellence in the validity and reliability of the measured blood pressure, this information should be carefully considered for the strategic planning of health services.

Content validity--establishing and reporting the evidence in newly developed patient-reported outcomes (PRO) instruments for medical product evaluation: ISPOR PRO good research practices task force report: part 1--eliciting concepts for a new PRO instrument.

PubMed

Patrick, Donald L; Burke, Laurie B; Gwaltney, Chad J; Leidy, Nancy Kline; Martin, Mona L; Molsen, Elizabeth; Ring, Lena

2011-12-01

The importance of content validity in developing patient reported outcomes (PRO) instruments is stressed by both the US Food and Drug Administration and the European Medicines Agency. Content validity is the extent to which an instrument measures the important aspects of concepts that developers or users purport it to assess. A PRO instrument measures the concepts most significant and relevant to a patient's condition and its treatment. For PRO instruments, items and domains as reflected in the scores of an instrument should be important to the target population and comprehensive with respect to patient concerns. Documentation of target population input in item generation, as well as evaluation of patient understanding through cognitive interviewing, can provide the evidence for content validity. Developing content for, and assessing respondent understanding of, newly developed PRO instruments for medical product evaluation will be discussed in this two-part ISPOR PRO Good Research Practices Task Force Report. Topics include the methods for generating items, documenting item development, coding of qualitative data from item generation, cognitive interviewing, and tracking item development through the various stages of research and preparing this tracking for submission to regulatory agencies. Part 1 covers elicitation of key concepts using qualitative focus groups and/or interviews to inform content and structure of a new PRO instrument. Part 2 covers the instrument development process, the assessment of patient understanding of the draft instrument using cognitive interviews and steps for instrument revision. The two parts are meant to be read together. They are intended to offer suggestions for good practices in planning, executing, and documenting qualitative studies that are used to support the content validity of PRO instruments to be used in medical product evaluation. Copyright © 2011 International Society for Pharmacoeconomics and Outcomes Research (ISPOR

Vietnamese Version of Diabetes Self-Management Instrument: Development and Psychometric Testing.

PubMed

Dao-Tran, Tiet-Hanh; Anderson, Debra J; Chang, Anne M; Seib, Charrlotte; Hurst, Cameron

2017-04-01

Self-management plays a vital role in diabetes management for adults with type 2 diabetes (T2DM). While there are many people with T2DM in Vietnam, clinical understanding of diabetes self-management (DSM) in this context is limited due to the lack of a valid measurement instrument. Translation and back-translation processes were used to translate the Diabetes Self-Management Instrument (DSMI) into Vietnamese. Then, translation equivalence, face validity, construct validity, and internal consistency were assessed in a sample of 198 Vietnamese adults with T2DM. The Cronbach's alpha of the V-DSMI was .92, with a number of significant inter-item correlations. The Vietnamese version of the Diabetes Self-Management Instrument (V-DSMI) retained the meaning of the original English version, and the language of the V-DSMI was clearly understandable to adults with T2DM in Vietnam. Confirmatory factor analysis supported the goodness of fit between the data and the previously identified factor structure. These results indicated that the V-DSMI is acceptable for use with Vietnamese adults with T2DM in further practice and research. However, future studies would be beneficial to determine the test-retest reliability and criterion validity of the V-DSMI. © 2016 Wiley Periodicals, Inc. © 2016 Wiley Periodicals, Inc.

Validity of self-reported family history of cancer: A systematic literature review on selected cancers.

PubMed

Fiederling, Jonas; Shams, Ahmad Zia; Haug, Ulrike

2016-10-01

Evidence regarding validity of self-reported family history of cancer (FHC) has been reviewed only for breast, colorectal, prostate, ovarian, endometrial and uterine cancer. We aimed to systematically review studies assessing validity of self-reported family history for the remaining cancer sites. We searched the Medline database for relevant studies published by January 2016. We extracted information on the study design and the positive predictive value (PPV) of self-reported FHC, defined as the proportion of reported cancer diagnoses among relatives that was confirmed by a reference standard (as a measure of over-reporting). We also extracted information on sensitivity of self-reported FHC (as a measure of underreporting). Overall, 21 studies were included that provided information on the PPV of self-reported FHC for relevant cancers and four studies also provided information on sensitivity. The PPV was highest (mostly >70%) for pancreatic, lung, thyroid and urinary system cancers and for leukemia and lymphoma, while it was lowest for stomach and liver cancer. Sensitivity was highest (>70%) for pancreatic cancer, lung cancer, brain cancer, melanoma, leukemia and lymphoma. For several cancers, sample sizes were low and the number of studies limited, particularly regarding sensitivity of self-reported FHC. In conclusion, for some cancers (e.g., pancreatic cancer, lung cancer, leukemia, lymphoma) self-reported FHC can be considered sufficiently valid to be useful, for example, in preventive counseling. For several cancers, it is not sufficiently studied or the pattern is inconsistent. This needs to be taken into account when using self-reported information about FHC in clinical practice or epidemiological research. © 2016 UICC.

The Culturally Responsive Classroom Management Self-Efficacy Scale: Development and Initial Validation

ERIC Educational Resources Information Center

Siwatu, Kamau Oginga; Putman, S. Michael; Starker-Glass, Tehia V.; Lewis, Chance W.

2017-01-01

This article reports on the development and initial validation of the Culturally Responsive Classroom Management Self-Efficacy Scale. Data from 380 preservice and inservice teachers were used to examine the psychometric properties of the instrument. Exploratory factor analysis results suggested a one-factor structure consisting of 35 items and the…

Readability and Comprehension of Self-Report Binge Eating Measures

PubMed Central

Richards, Lauren K.; McHugh, R. Kathryn; Pratt, Elizabeth M.; Thompson-Brenner, Heather

2013-01-01

The validity of self-report binge eating instruments among individuals with limited literacy is uncertain. This study aims to evaluate reading grade level and multiple domains of comprehension of 13 commonly used self-report assessments of binge eating for use in low-literacy populations. We evaluated self-report binge eating measures with respect to reading grade levels, measure length, formatting and linguistic problems. Results: All measures were written at a reading grade level higher than is recommended for patient materials (above the 5th to 6th grade level), and contained several challenging elements related to comprehension. Correlational analyses suggested that readability and comprehension elements were distinct contributors to measure difficulty. Individuals with binge eating who have low levels of educational attainment or limited literacy are often underrepresented in measure validation studies. Validity of measures and accurate assessment of symptoms depends on an individual's ability to read and comprehend instructions and items, and these may be compromised in populations with lower levels of literacy. PMID:23557814

Validity of self-reported height and weight in 4808 EPIC-Oxford participants.

PubMed

Spencer, Elizabeth A; Appleby, Paul N; Davey, Gwyneth K; Key, Timothy J

2002-08-01

To assess the validity of self-reported height and weight by comparison with measured height and weight in a sample of middle-aged men and women, and to determine the extent of misclassification of body mass index (BMI) arising from differences between self-reported and measured values. Analysis of self-reported and measured height and weight data from participants in the Oxford cohort of the European Prospective Investigation into Cancer and Nutrition (EPIC-Oxford). Four thousand eight hundred and eight British men and women aged 35-76 years. Spearman rank correlations between self-reported and measured height, weight and BMI were high (r > 0.9, P < 0.0001). Height was overestimated by a mean of 1.23 (95% confidence interval (CI) 1.11-1.34) cm in men and 0.60 (0.51-0.70) cm in women; the extent of overestimation was greater in older men and women, shorter men and heavier women. Weight was underestimated by a mean of 1.85 (1.72-1.99) kg in men and 1.40 (1.31-1.49) kg in women; the extent of underestimation was greater in heavier men and women, but did not vary with age or height. Using standard categories of BMI, 22.4% of men and 18.0% of women were classified incorrectly based on self-reported height and weight. After correcting the self-reported values using predictive equations derived from a 10% sample of subjects, misclassification decreased to 15.2% in men and 13.8% in women. Self-reported height and weight data are valid for identifying relationships in epidemiological studies. In analyses where anthropometric factors are the primary variables of interest, measurements in a representative sample of the study population can be used to improve the accuracy of estimates of height, weight and BMI.

Validity of Self-Reported Concentration and Memory Problems: Relationship with Neuropsychological Assessment and Depression

EPA Science Inventory

Background: This study investigated the validity of self-reported concentration and memory problems (CMP) in residents environmentally exposed to manganese (Mn). Method: Self-report of CMP from a health questionnaire (HQ) and the Symptoms Checklist-90-Revised (SCL-90-R) was com...

Validity and Reliability of a New Instrument to Measure Cancer-Related Fatigue in Adolescents

PubMed Central

Hinds, Pamela S.; Hockenberry, Marilyn; Tong, Xin; Rai, Shesh N.; Gattuso, Jamie S.; McCarthy, Kathleen; Pui, Ching-Hon; Srivastava, Deo Kumar

2008-01-01

Adolescents undergoing treatment for cancer rate fatigue as their most prevalent and intense cancer- and treatment-related effect. Parents and staff rate it similarly. Despite its reported prevalence, intensity, and distressing effects, cancer-related fatigue in adolescents is not routinely assessed during or after cancer treatment. We contend that the insufficient clinical attention is primarily due to the lack of a reliable and valid self-report instrument with which adolescent cancer-related fatigue can be measured. Our aim was to determine the reliability and construct validity of a new instrument and its ability to measure change in fatigue over time. Initial testing involved 64 adolescents undergoing curative treatment of cancer who completed the Fatigue Scale-Adolescent (FS-A) at two to four key points in treatment in one of four studies. Internal consistency estimates ranged from 0.67 to 0.95. Validity estimates involving the FS-A with the parent version ranged from 0.13 to 0.76; estimates involving the staff version and the Reynolds Depression Scale were 0.27 and 0.87 respectively. Additional validity findings included significant fatigue differences between anemic and non-anemic patients (P = 0.042) and the emergence of four factors in an exploratory factor analysis. Findings further indicate that the FS-A can be used to measure change over time (t = 2.55, P <0.01). In summary, the FS-A has moderate to strong reliability and impressive validity coefficients for a new research instrument. PMID:17629669

Self-Efficacy for Learning Mathematics Asynchronously: Instrument Refinement and the Relationship to Mathematics Achievement

ERIC Educational Resources Information Center

Hodges, Charles; Jones, R. Caroline; Prater, Alyssa

2014-01-01

The purpose of this paper is to report the results of a two-part study. Study 1 was conducted to refine and validate a survey instrument, SELMA (Hodges, 2008), used to measure learners' self-efficacy toward learning mathematics in online or technology-intensive, asynchronous learning environments. Study 2 was conducted to investigate the…

Validity of self-reported weight and height: a cross-sectional study among Malaysian adolescents.

PubMed

Kee, C C; Lim, K H; Sumarni, M G; Teh, C H; Chan, Y Y; Nuur Hafizah, M I; Cheah, Y K; Tee, E O; Ahmad Faudzi, Y; Amal Nasir, M

2017-06-02

Self-reported weight and height are commonly used in lieu of direct measurements of weight and height in large epidemiological surveys due to inevitable constraints such as budget and human resource. However, the validity of self-reported weight and height, particularly among adolescents, needs to be verified as misreporting could lead to misclassification of body mass index and therefore overestimation or underestimation of the burden of BMI-related diseases. The objective of this study was to determine the validity of self-reported weight and height among Malaysian secondary school children. Both self-reported and directly measured weight and height of a subgroup of 663 apparently healthy schoolchildren from the Malaysian Adolescent Health Risk Behaviour (MyAHRB) survey 2013/2014 were analysed. Respondents were required to report their current body weight and height via a self-administrative questionnaire before they were measured by investigators. The validity of self-reported against directly measured weight and height was examined using intraclass correlation coefficient (ICC), the Bland-Altman plot and weighted Kappa statistics. There was very good intraclass correlation between self-reported and directly measured weight [r = 0.96, 95% confidence interval (CI): 0.93, 0.97] and height (r = 0.94, 95% CI: 0.90, 0.96). In addition the Bland-Altman plots indicated that the mean difference between self-reported and direct measurement was relatively small. The mean difference (self-reported minus direct measurements) was, for boys: weight, -2.1 kg; height, -1.6 cm; BMI, -0.44 kg/m 2 and girls: weight, -1.2 kg; height, -0.9 cm; BMI, -0.3 kg/m 2 . However, 95% limits of agreement were wide which indicated substantial discrepancies between self-reported and direct measurements method at the individual level. Nonetheless, the weighted Kappa statistics demonstrated a substantial agreement between BMI status categorised based on self-reported weight and height

The Development and Validation of a Two-Tiered Multiple-Choice Instrument to Identify Alternative Conceptions in Earth Science

ERIC Educational Resources Information Center

Mangione, Katherine Anna

2010-01-01

This study was to determine reliability and validity for a two-tiered, multiple- choice instrument designed to identify alternative conceptions in earth science. Additionally, this study sought to identify alternative conceptions in earth science held by preservice teachers, to investigate relationships between self-reported confidence scores and…

Validation of an instrument to measure older adults' expectations regarding movement (ERM).

PubMed

Dahodwala, Nabila; Karlawish, Jason; Shea, Judy A; Zubritsky, Cynthia; Stern, Matthew; Mandell, David S

2012-01-01

Many individuals with Parkinson's disease are not diagnosed and treated. Attitudes about aging and related help-seeking may affect the timely diagnosis of Parkinson's disease. Our objectives were to develop measures of older adults' expectations regarding movement with aging, specifically related to parkinsonism, and their beliefs about seeking healthcare for the diagnosis and treatment of parkinsonism. We established content and face validity from interviews with experts, review of the literature, and pre-testing with key informants. Two 9-item instruments resulted: Expectations Regarding Movement (ERM) and Healthcare Seeking Beliefs for parkinsonism (HSB). These instruments were administered to 210 older adults at senior centers to investigate internal consistency and construct validity. 192 (91%) of the older adults completed more than 90% of the survey. The mean age was 76; 17 (9%) reported parkinsonism. Both scales demonstrated good internal consistency (α = 0.90). Factor analysis supported construct validity of the ERM and HSB scores. Older age, lower education, worse self-reported health and African American race each were associated with lower ERM scores, but not HSB scores. The ERM, a brief measure of expectations regarding movement with aging, shows reliability and validity. This scale may be useful in identifying older adults at increased risk for under-identification of Parkinson's disease. Further work is needed to measure healthcare seeking for parkinsonism.

Validation of Self-reported Diagnosis of Gestational Diabetes at 6-weeks Postpartum.

PubMed

Hinkle, Stefanie N; Rawal, Shristi; Zhu, Yeyi; Grewal, Jagteshwar; Albert, Paul S; Zhang, Cuilin

2017-09-01

Self-report is often used in identifying gestational diabetes events in epidemiologic studies; however, validity data are limited, with little to no data on self-reported severity or treatment. We aimed to assess the validity of self-reported gestational diabetes diagnosis and evaluate the accuracy of glucose diagnosis results and gestational diabetes treatment self-reported at 6-week postpartum. Data were from 82 and 83 women with and without gestational diabetes, respectively, within the prospective National Institute Child Health and Human Development Fetal Growth Studies-Singletons (2009-2013). Medical record data were considered the gold standard. Sensitivity was 95% (95% confidence interval [CI] = 88, 98), and specificity was 100% (95% CI = 96, 100); four women with gestational diabetes incorrectly reported not having the disease, and none of the women without gestational diabetes reported having gestational diabetes. Sensitivity did not vary substantially across maternal characteristics including race/ethnicity. For women who attempted to recall their values (84/159 women), self-reported glucose challenge test results did not differ from the medical records (median difference: 0; interquartile range: 0-0 mg/dl). Medical records indicated that 42 (54%) of 78 women with confirmed gestational diabetes were treated by diet only and 33 (42%) were treated by medication. All 42 women with diet-treated gestational diabetes correctly reported having had diet and lifestyle modification, and 28 (85%) of 33 women with medication-treated gestational diabetes indicated postpartum that they had medication treatment. At 6-week postpartum, regardless of race/ethnicity or socioeconomic status, women accurately recalled whether they had gestational diabetes and, as applicable, their treatment method.

Instruments to assess self-care among healthy children: A systematic review of measurement properties.

PubMed

Urpí-Fernández, Ana-María; Zabaleta-Del-Olmo, Edurne; Montes-Hidalgo, Javier; Tomás-Sábado, Joaquín; Roldán-Merino, Juan-Francisco; Lluch-Canut, María-Teresa

2017-12-01

To identify, critically appraise and summarize the measurement properties of instruments to assess self-care in healthy children. Assessing self-care is a proper consideration for nursing practice and nursing research. No systematic review summarizes instruments of measurement validated in healthy children. Psychometric review in accordance with the COnsensus-based Standards for the selection of health Measurement INstruments (COSMIN) panel. MEDLINE, CINAHL, PsycINFO, Web of Science and Open Grey were searched from their inception to December 2016. Validation studies with a healthy child population were included. Search was not restricted by language. Two reviewers independently assessed the methodological quality of included studies using the COSMIN checklist. Eleven studies were included in the review assessing the measurement properties of ten instruments. There was a maximum of two studies per instrument. None of the studies evaluated the properties of test-retest reliability, measurement error, criterion validity and responsiveness. Internal consistency and structural validity were rated as "excellent" or "good" in four studies. Four studies were rated as "excellent" in content validity. Cross-cultural validity was rated as "poor" in the two studies (three instruments) which cultural adaptation was carried out. The evidence available does not allow firm conclusions about the instruments identified in terms of reliability and validity. Future research should focus on generate evidence about a wider range of measurement properties of these instruments using a rigorous methodology, as well as instrument testing on different countries and child population. © 2017 John Wiley & Sons Ltd.

Validity of parent's self-reported responses to home safety questions.

PubMed

Osborne, Jodie M; Shibl, Rania; Cameron, Cate M; Kendrick, Denise; Lyons, Ronan A; Spinks, Anneliese B; Sipe, Neil; McClure, Roderick J

2016-09-01

The aim of the study was to describe the validity of parent's self-reported responses to questions on home safety practices for children of 2-4 years. A cross-sectional validation study compared parent's self-administered responses to items in the Home Injury Prevention Survey with home observations undertaken by trained researchers. The relationship between the questionnaire and observation results was assessed using percentage agreement, sensitivity, specificity, positive predictive value, negative predictive value and intraclass correlation coefficients. Percentage agreements ranged from 44% to 100% with 40 of the total 45 items scoring higher than 70%. Sensitivities ranged from 0% to 100%, with 27 items scoring at least 70%. Specificities also ranged from 0% to 100%, with 33 items scoring at least 70%. As such, the study identified a series of self-administered home safety questions that have sensitivities, specificities and predictive values sufficiently high to allow the information to be useful in research and injury prevention practice.

A prospective study of the validity of self-reported use of specific types of dental services.

PubMed

Gilbert, Gregg H; Rose, John S; Shelton, Brent J

2003-01-01

The purpose of this study was to quantify the validity of self-reported receipt of dental services in 10 categories, using information from dental charts as the "gold standard." The Florida Dental Care Study was a prospective cohort study of a diverse sample of adults. In-person interviews were conducted at baseline and at 24 and 48 months following baseline, with telephone interviews at six-month intervals in between. Participants reported new dental visits, reason(s) for the visit(s), and specific service(s) received. For the present study, self-reported data were compared with data from patients' dental charts. Percent concordance between self-report and dental charts ranged from 82% to 100%, while Kappa values ranged from 0.33 to 0.91. Bivariate multiple logistic regressions were performed for each of the service categories, with two outcomes: self-reported service receipt and service receipt determined from the dental chart. Parameter estimate intervals overlapped for each of the four hypothesized predictors of service receipt (age group, sex, "race" defined as non-Hispanic African American vs. non-Hispanic white, and annual household income < 20,000 US dollars vs. > or = 20,000 US dollars), although for five of the 10 service categories, there were differences in conclusions about statistical significance for certain predictors. The validity of self-reported use of dental services ranged from poor to excellent, depending upon the service type. Regression estimates using either the self-reported or chart-validated measure yielded similar results overall, but conclusions about key predictors of service use differed in some instances. Self-reported dental service use is valid for some, but not all, service types.

Examining the validity of self-reports on scales measuring students' strategic processing.

PubMed

Samuelstuen, Marit S; Bråten, Ivar

2007-06-01

Self-report inventories trying to measure strategic processing at a global level have been much used in both basic and applied research. However, the validity of global strategy scores is open to question because such inventories assess strategy perceptions outside the context of specific task performance. The primary aim was to examine the criterion-related and construct validity of the global strategy data obtained with the Cross-Curricular Competencies (CCC) scale. Additionally, we wanted to compare the validity of these data with the validity of data obtained with a task-specific self-report inventory focusing on the same types of strategies. The sample included 269 10th-grade students from 12 different junior high schools. Global strategy use as assessed with the CCC was compared with task-specific strategy use reported in three different reading situations. Moreover, relationships between scores on the CCC and scores on measures of text comprehension were examined and compared with relationships between scores on the task-specific strategy measure and the same comprehension measures. The comparison between the CCC strategy scores and the task-specific strategy scores suggested only modest criterion-related validity for the data obtained with the global strategy inventory. The CCC strategy scores were also not related to the text comprehension measures, indicating poor construct validity. In contrast, the task-specific strategy scores were positively related to the comprehension measures, indicating good construct validity. Attempts to measure strategic processing at a global level seem to have limited validity and utility.

Self-administered health literacy instruments for people with diabetes: systematic review of measurement properties.

PubMed

Lee, Eun-Hyun; Kim, Chun-Ja; Lee, Jiyeon; Moon, Seung Hei

2017-09-01

The aims of this study were to identify all available self-administered instruments measuring health literacy in people with diabetes and to determine the current instrument that is the most appropriate for applying to this population in both practice and research. A systematic review of measurement properties. MEDLINE, EMBASE and CINAHL electronic databases from their inception up to 28 March 2016. The methodological quality of each included study was assessed using the COnsensus-based Standards for the selection of health Measurement INstruments checklist. The reported results for measurement properties in the studies were assessed according to Terwee's quality criteria. Thirteen self-administered instruments measuring health literacy in people with diabetes were identified, of which six (44%) were diabetes-specific instruments. The instruments that covered the broadest contents of health literacy were the Health Literacy Scale and Health Literacy Questionnaire. The (test-retest) reliability, measurement error and responsiveness were not evaluated for any instrument, while internal consistency and hypothesis testing validity were the most frequently assessed measurement properties. With the current evidence, the Health Literacy Scale may be the most appropriate instrument for patients with diabetes in practice and research. However, the structural validity of this scale needs to be further established, particularly in other language versions. It is also recommended to use the Diabetes Numeracy Test-15 along with the Health Literacy Scale to complement the lack of numeracy measures in the Health Literacy Scale. © 2017 John Wiley & Sons Ltd.

Validity of Self-reported Sleep Bruxism among Myofascial Temporomandibular Disorder Patients and Controls

PubMed Central

Raphael, Karen G.; Janal, Malvin N.; Sirois, David A.; Dubrovsky, Boris; Klausner, Jack J.; Krieger, Ana C.; Lavigne, Gilles J.

2015-01-01

Sleep bruxism (SB), primarily involving rhythmic grinding of the teeth during sleep, has been advanced as a causal or maintenance factor for a variety of orofacial problems, including temporomandibular disorders (TMD). Since laboratory polysomnographic (PSG) assessment is extremely expensive and time-consuming, most research testing this belief has relied on patient self-report of SB. The current case-control study examined the accuracy of those self-reports relative to laboratory-based PSG assessment of SB in a large sample of women suffering from chronic myofascial TMD (n=124) and a demographically matched control group without TMD (n=46). A clinical research coordinator administered a structured questionnaire to assess self-reported SB. Participants then spent two consecutive nights in a sleep laboratory. Audiovisual and electromyographic data from the second night were scored to assess whether participants met criteria for presence of 2 or more (2+) rhythmic masticatory muscle activity episodes accompanied by grinding sounds, moderate SB, or severe SB, using previously validated research scoring standards. Contingency tables were constructed to assess positive and negative predictive values, sensitivity and specificity, and 95% confidence intervals surrounding the point estimates. Results showed that self-report significantly predicted 2+ grinding sounds during sleep for TMD cases. However, self-reported SB failed to significantly predict presence or absence of either moderate or severe SB as assessed by PSG, for both cases and controls. These data show that self-report of tooth grinding awareness is highly unlikely to be a valid indicator of true SB. Studies relying on self-report to assess SB must be viewed with extreme caution. PMID:26010126

Validity of self-reported sleep bruxism among myofascial temporomandibular disorder patients and controls.

PubMed

Raphael, K G; Janal, M N; Sirois, D A; Dubrovsky, B; Klausner, J J; Krieger, A C; Lavigne, G J

2015-10-01

Sleep bruxism (SB), primarily involving rhythmic grinding of the teeth during sleep, has been advanced as a causal or maintenance factor for a variety of oro-facial problems, including temporomandibular disorders (TMD). As laboratory polysomnographic (PSG) assessment is extremely expensive and time-consuming, most research testing this belief has relied on patient self-report of SB. The current case-control study examined the accuracy of those self-reports relative to laboratory-based PSG assessment of SB in a large sample of women suffering from chronic myofascial TMD (n = 124) and a demographically matched control group without TMD (n = 46). A clinical research coordinator administered a structured questionnaire to assess self-reported SB. Participants then spent two consecutive nights in a sleep laboratory. Audiovisual and electromyographic data from the second night were scored to assess whether participants met criteria for the presence of 2 or more (2+) rhythmic masticatory muscle activity episodes accompanied by grinding sounds, moderate SB, or severe SB, using previously validated research scoring standards. Contingency tables were constructed to assess positive and negative predictive values, sensitivity and specificity, and 95% confidence intervals surrounding the point estimates. Results showed that self-report significantly predicted 2+ grinding sounds during sleep for TMD cases. However, self-reported SB failed to significantly predict the presence or absence of either moderate or severe SB as assessed by PSG, for both cases and controls. These data show that self-report of tooth grinding awareness is highly unlikely to be a valid indicator of true SB. Studies relying on self-report to assess SB must be viewed with extreme caution. © 2015 John Wiley & Sons Ltd.

Validity assessment of self-reported medication use by comparing to pharmacy insurance claims

PubMed Central

Fujita, Misuzu; Sato, Yasunori; Nagashima, Kengo; Takahashi, Sho; Hata, Akira

2015-01-01

Objectives In Japan, an annual health check-up and health promotion guidance programme was established in 2008 in accordance with the Act on Assurance of Medical Care for the Elderly. A self-reported questionnaire on medication use is a required item in this programme and has been used widely, but its validity has not been assessed. The aim of this study was to evaluate the validity of this questionnaire by comparing self-reported usage to pharmacy insurance claims. Setting This is a population-based validation study. Self-reported medication use for hypertension, diabetes and dyslipidaemia is the evaluated measurement. Data on pharmacy insurance claims are used as a reference standard. Participants Participants were 54 712 beneficiaries of the National Health Insurance of Chiba City. Primary and secondary outcome measures Sensitivity, specificity and κ statistics of the self-reported medication-use questionnaire for predicting actual prescriptions during 1 month (that of the check-up) and 3 months (that of the check-up and the previous 2 months) were calculated. Results Sensitivity and specificity scores of questionnaire data for predicting insurance claims covering 3 months were, respectively, 92.4% (95% CI 91.9 to 92.8) and 86.4% (95% CI 86.0 to 86.7) for hypertension, 82.6% (95% CI 81.1 to 84.0) and 98.5% (95% CI 98.4 to 98.6) for diabetes, and 86.2% (95% CI 85.5 to 86.8) and 91.0% (95% CI 90.8 to 91.3) for dyslipidaemia. Corresponding κ statistics were 70.9% (95% CI 70.1 to 71.7), 77.1% (95% CI 76.2 to 77.9) and 69.8% (95% CI 68.9 to 70.6). The specificity was significantly higher for questionnaire data covering 3 months compared with data covering 1 month for all 3 conditions. Conclusions Self-reported questionnaire data on medication use had sufficiently high validity for further analyses. Item responses showed close agreement with actual prescriptions, particularly those covering 3 months. PMID:26553839

The validation of a self-report measure and physical activity of Australian Aboriginal and Torres Strait Islander and non-Indigenous rural children.

PubMed

Gwynn, Josephine D; Hardy, Louise L; Wiggers, John H; Smith, Wayne T; D'Este, Catherine A; Turner, Nicole; Cochrane, Janine; Barker, Daniel J; Attia, John R

2010-07-01

To validate a self-report measure of physical activity for both Australian Aboriginal and Torres Strait Islander and non-Indigenous rural children, and to describe their physical activity participation. In this cross-sectional study, 84 Aboriginal and Torres Strait Islander and 146 non-Indigenous children aged 10-12 years old completed the Many Rivers Physical Activity Recall Questionnaire (MRPARQ), a modified version of the Adolescent Physical Activity Recall Questionnaire (APARQ). A sub-group (n=86) wore an accelerometer for seven consecutive days in order to validate the instrument. Pearson and Intra Class Correlation coefficients between the survey and acceleromtery for weekdays only are 0.31 and 0.16, respectively, for Aboriginal and Torres Strait Islander children, and 0.38 and 0.31, respectively, for non-Indigenous children, and demonstrate a modest (p<0.05) correlation. Self-reported MVPA for Aboriginal and Torres Strait Islander children is between 162 and 172 minutes/day, and is 125 minutes by accelerometer; for non-Indigenous children MVPA is between 123 and 149 minutes (survey) and 107 minutes (accelerometer). Australian Aboriginal and Torres Strait Islander children's self-report of physical activity is at least as valid as non-Indigenous children, given culturally appropriate support; they tend to be more active than non-Indigenous children. The MRPARQ can be administered with Aboriginal and Torres Strait Islander and non-Indigenous children.

Development and preliminary testing of a self-rating instrument to measure self-directed learning ability of nursing students.

PubMed

Cheng, Su-Fen; Kuo, Chien-Lin; Lin, Kuan-Chia; Lee-Hsieh, Jane

2010-09-01

With the growing trend of preparing students for lifelong learning, the theory of self-directed learning (SDL) has been increasingly applied in the context of higher education. In order to foster lifelong learning, abilities among nursing students, faculties need to have an appropriate instrument to measure the SDL abilities of nursing students. The objectives of this study were to develop an instrument to measure the SDL abilities of nursing students and to test the validity and reliability of this instrument. This study was conducted in 4 phases. In Phase 1, based on a review of the literature, the researchers developed an instrument to measure SDL. In Phase 2, two rounds of the Delphi study were conducted, to determine the content validity of the instrument. In Phase 3, a convenience sample of 1072 nursing students from two representative schools across three different types of nursing programs were recruited to test the construct validity of the Self-Directed Learning Instrument (SDLI). Finally, in Phase 4, the internal consistency and reliability of the instrument were tested. The resulting SDLI consists of 20 items across the following four domains: learning motivation, planning and implementing, self-monitoring, and interpersonal, communication. The final model in confirmatory factor analysis revealed that this 20-item SDLI indicated a good fit of the model. The value of Cronbach's alpha for the total scale was .916 and for the four domains were .801, .861, .785, and .765, respectively. The SDLI is a valid and reliable instrument for identifying student SDL abilities. It is available to students in nursing and similar medical programs to evaluate their own SDL. This scale may also enable nursing faculty to assess students' SDL status, design better lesson plans and curricula, and, implement appropriate teaching strategies for nursing students in order to foster the growth of lifelong learning abilities. Copyright (c) 2010 Elsevier Ltd. All rights reserved.

Construction and validation of the Self-care Assessment Instrument for patients with type 2 diabetes mellitus.

PubMed

Mendonça, Simonize Cunha Barreto de; Zanetti, Maria Lúcia; Sawada, Namie Okino; Barreto, Ikaro Daniel de Carvalho; Andrade, Joseilze Santos de; Otero, Liudmila Miyar

2017-06-05

to construct and validate the contents of the Self-care Assessment instrument for patients with type 2 diabetes mellitus. methodological study, based on Orem's General Theory of Nursing. The empirical categories and the items of the instrument were elucidated through a focus group. The content validation process was performed by seven specialists and the semantic analysis by 14 patients. The Content Validity Indices of the items, ≥0.78, and of the scale, ≥0.90, were considered excellent. the instrument contains 131 items in six dimensions corresponding to the health deviation self-care requisites. Regarding the maintenance, a Content Validity Index of 0.98 was obtained for the full set of items, and, regarding the relevance, Content Validity Indices ≥0.80 were obtained for the majority of the assessed psychometric criteria. the instrument showed evidence of content validity. construir e validar o conteúdo do instrumento Avaliação do Autocuidado para pacientes com diabetes mellitus tipo 2. estudo metodológico, fundamentado na Teoria Geral de Enfermagem de Orem. As categorias empíricas e os itens do instrumento foram elucidados por meio de grupo focal. O processo de validação de conteúdo foi realizado por sete especialistas e a análise semântica por 14 pacientes. Foram considerados como excelente Índice de Validade de Conteúdo dos itens ≥ 0,78 e da escala ≥ 0,90. o instrumento contém seis dimensões correspondentes aos requisitos de autocuidado para o desvio da saúde, desmembradas em 131 itens. Quanto à permanência, obteve-se para o conjunto total de itens Índice de Validade de Conteúdo de 0,98, e quanto à adequação Índice de Validade de Conteúdo ≥ 0,80 para maioria dos critérios psicométricos avaliados. o instrumento mostrou evidências de validade de conteúdo. construir y validar el contenido del instrumento Evaluación del Autocuidado para pacientes con diabetes mellitus tipo 2. estudio metodológico, fundamentado en la Teor

Variability and validity of intimate partner violence reporting by couples in Tanzania

PubMed Central

Steven, Ester; Reich, Naomi; Badi, Lilian; Messersmith, Lisa

2018-01-01

In recent years, major global institutions have amplified their efforts to address intimate partner violence (IPV) against women—a global health and human rights violation affecting 15–71% of reproductive aged women over their lifetimes. Still, some scholars remain concerned about the validity of instruments used for IPV assessment in population-based studies. In this paper, we conducted two validation analyses using novel data from 450 women-men dyads across nine villages in Northern Tanzania. First, we examined the level of inter-partner agreement in reporting of men’s physical, sexual, emotional and economic IPV against women in the last three and twelve months prior to the survey, ever in the relationship, and during pregnancy. Second, we conducted a convergent validity analysis to compare the relative efficacy of men’s self-reports of perpetration and women’s of victimization as a valid indicator of IPV against Tanzanian women using logistic regression models with village-level clustered errors. We found that, for every violence type across the recall periods of the last three months, the last twelve months and ever in the relationship, at least one in three couples disagreed about IPV occurrences in the relationship. Couples’ agreement about physical, sexual and economic IPV during pregnancy was high with 86–93% of couples reporting concordantly. Also, men’s self-reported perpetration had statistically significant associations with at least as many validated risk factors as had women’s self-reported victimization. This finding suggests that men’s self-reports are at least as valid as women’s as an indicator of IPV against women in Northern Tanzania. We recommend more validation studies are conducted in low-income countries, and that data on relationship factors affecting IPV reports and reporting are made available along with data on IPV occurrences. Keywords: Intimate partner violence; measurement; validity; survey research; Tanzania

Patient-Reported Outcome Instruments for Surgical and Traumatic Scars: A Systematic Review of their Development, Content, and Psychometric Validation.

PubMed

Mundy, Lily R; Miller, H Catherine; Klassen, Anne F; Cano, Stefan J; Pusic, Andrea L

2016-10-01

Patient-reported outcomes (PROs) are of growing importance in research and clinical care and may be used as primary outcomes or as compliments to traditional surgical outcomes. In assessing the impact of surgical and traumatic scars, PROs are often the most meaningful. To assess outcomes from the patient perspective, rigorously developed and validated PRO instruments are essential. The authors conducted a systematic literature review to identify PRO instruments developed and/or validated for patients with surgical and/or non-burn traumatic scars. Identified instruments were assessed for content, development process, and validation under recommended guidelines for PRO instrument development. The systematic review identified 6534 articles. After review, we identified four PRO instruments meeting inclusion criteria: patient and observer scar assessment scale (POSAS), bock quality of life questionnaire for patients with keloid and hypertrophic scarring (Bock), patient scar assessment questionnaire (PSAQ), and patient-reported impact of scars measure (PRISM). Common concepts measured were symptoms and psychosocial well-being. Only PSAQ had a dedicated appearance domain. Qualitative data were used to inform content for the PSAQ and PRISM, and a modern psychometric approach (Rasch Measurement Theory) was used to develop PRISM and to test POSAS. Overall, PRISM demonstrated the most rigorous design and validation process, however, was limited by the lack of a dedicated appearance domain. PRO instruments to evaluate outcomes in scars exist but vary in terms of concepts measured and psychometric soundness. This review discusses the strengths and weaknesses of existing instruments, highlighting the need for future scar-focused PRO instrument development. This journal requires that authors assign a level of evidence to each article. For a full description of these Evidence-Based Medicine ratings, please refer to Table of Contents or the online Instructions to Authors www

Readability and comprehension of self-report binge eating measures.

PubMed

Richards, Lauren K; McHugh, R Kathryn; Pratt, Elizabeth M; Thompson-Brenner, Heather

2013-04-01

The validity of self-report binge eating instruments among individuals with limited literacy is uncertain. This study aims to evaluate reading grade level and multiple domains of comprehension of 13 commonly used self-report assessments of binge eating for use in low-literacy populations. We evaluated self-report binge eating measures with respect to reading grade levels, measure length, formatting and linguistic problems. All measures were written at a reading grade level higher than is recommended for patient materials (above the 5th to 6th grade level), and contained several challenging elements related to comprehension. Correlational analyses suggested that readability and comprehension elements were distinct contributors to measure difficulty. Individuals with binge eating who have low levels of educational attainment or limited literacy are often underrepresented in measure validation studies. Validity of measures and accurate assessment of symptoms depend on an individual's ability to read and comprehend instructions and items, and these may be compromised in populations with lower levels of literacy. Copyright © 2013 Elsevier Ltd. All rights reserved.

Adolescent self-report and parent proxy-report of health-related quality of life: an analysis of validity and reliability of PedsQL 4.0 among a sample of Malaysian adolescents and their parents.

PubMed

Kaartina, Sanker; Chin, Yit Siew; Fara Wahida, Rezali; Woon, Fui Chee; Hiew, Chu Chien; Zalilah, Mohd Shariff; Mohd Nasir, Mohd Taib

2015-04-08

The Pediatric Quality of Life Inventory Generic Core Scales (PedsQL) 4.0 is a generalized assessment of health-related quality of life (HRQoL) based on adolescent self-report and parent proxy-report. This study aims to determine the construct validity and reliability of PedsQL 4.0 among a sample of Malaysian adolescents and parents. A cross-sectional study was carried out at three selected public schools in the state of Selangor. A total of 379 Malaysian adolescents completed the PedsQL 4.0 adolescent self-report and 218 (55.9%) parents completed the PedsQL 4.0 parent proxy-report. Weight and height of adolescents were measured and BMI-for-age by sex was used to determine their body weight status. There were 50.8% male and 49.2% female adolescents who participated in this study (14.25 ± 1.23 years). The prevalence of overweight and obesity (25.8%) was four times higher than the prevalence of severe thinness and thinness (6.1%). Construct validity was analyzed using Confirmatory Factor Analysis (CFA). Based on CFA, adolescent self-report and parent proxy-report met the criteria of convergent validity (factor loading > 0.5, Average Variance Extracted (AVE) > 0.5, Construct Reliability > 0.7) and showed good fit to the data. The adolescent self-report and parent proxy-report exhibited discriminant validity as the AVE values were larger than the R(2) values. Cronbach's alpha coefficients of the adolescent self-report (α = 0.862) and parent proxy-report (α = 0.922) showed these instruments are reliable. Parents perceived the HRQoL of adolescents was poorer compared to the perception of the adolescent themselves (t = 5.92, p < 0.01). There was no significant difference in total HRQoL score between male and female adolescents (t = 0.858, p > 0.05). Parent proxy-report was negatively associated with the adolescents' BMI-for-age (r = -0.152, p < 0.05) whereas no significant association was found between adolescent self-report and BMI-for-age (r = 0.001, p > 0

Construct Validation of the Self-Efficacy Teaching and Knowledge Instrument for Science Teachers-Revised (SETAKIST-R): Lessons Learned

NASA Astrophysics Data System (ADS)

Pruski, Linda A.; Blanco, Sharon L.; Riggs, Rosemary A.; Grimes, Kandi K.; Fordtran, Chase W.; Barbola, Gina M.; Cornell, John E.; Lichtenstein, Michael J.

2013-11-01

Described herein is the academic lineage and independent validation of the Self-Efficacy Teaching and Knowledge Instrument for Science Teachers-Revised (SETAKIST-R). Data from 334 K-12 science teachers were analyzed using Partial Credit Rasch models. Principal components analysis on the person-item residuals suggest two latent dimensions: Knowledge and Teaching Self-Efficacies. Item-fit statistics were used to select items for each subscale. Person and item separation (reliability) indices were quite low, and we noted disordered response patterns on the person-item maps that revealed problems with item content and/or scaling for both subscales. These issues include the presence of: verbal negatives, ambiguous modifiers, counter-intuitive scaling, and an "undecided/uncertain" option. The SETAKIST-R, in its current form, cannot be recommended as a measure of science teacher self-efficacy.

Use of existing patient-reported outcome (PRO) instruments and their modification: the ISPOR Good Research Practices for Evaluating and Documenting Content Validity for the Use of Existing Instruments and Their Modification PRO Task Force Report.

PubMed

Rothman, Margaret; Burke, Laurie; Erickson, Pennifer; Leidy, Nancy Kline; Patrick, Donald L; Petrie, Charles D

2009-01-01

Patient-reported outcome (PRO) instruments are used to evaluate the effect of medical products on how patients feel or function. This article presents the results of an ISPOR task force convened to address good clinical research practices for the use of existing or modified PRO instruments to support medical product labeling claims. The focus of the article is on content validity, with specific reference to existing or modified PRO instruments, because of the importance of content validity in selecting or modifying an existing PRO instrument and the lack of consensus in the research community regarding best practices for establishing and documenting this measurement property. Topics addressed in the article include: definition and general description of content validity; PRO concept identification as the important first step in establishing content validity; instrument identification and the initial review process; key issues in qualitative methodology; and potential threats to content validity, with three case examples used to illustrate types of threats and how they might be resolved. A table of steps used to identify and evaluate an existing PRO instrument is provided, and figures are used to illustrate the meaning of content validity in relationship to instrument development and evaluation. RESULTS & RECOMMENDATIONS: Four important threats to content validity are identified: unclear conceptual match between the PRO instrument and the intended claim, lack of direct patient input into PRO item content from the target population in which the claim is desired, no evidence that the most relevant and important item content is contained in the instrument, and lack of documentation to support modifications to the PRO instrument. In some cases, careful review of the threats to content validity in a specific application may be reduced through additional well documented qualitative studies that specifically address the issue of concern. Published evidence of the content

[Rosenberg self-esteem scale: validation in a representative sample of Chilean adults].

PubMed

Rojas-Barahona, Cristian A; Zegers, Beatriz; Förster, Carla E

2009-06-01

Self-esteem is positively associated to the well being of people and could be a good mental health indicator. To determine the reliability and validity of the Rosenberg Self-esteem Scale in a Chilean adult sample. The instrument was applied to 473 subjects living in the Metropolitan Region of Santiago, evenly distributed according to gender, age, educational level and income. The Neugarten Life Satisfaction index (LSI-A) was also applied to the sample. Cronbach's alpha for reliability of the scale was 0.754. There was no gender bias and factor analysis grouped items into two factors (5 positive and 5 negative). The instrument had a correlation of 0.455 with the LSI-A. The Rosenberg Self-esteem Scale meets the criteria for validity and reliability of a quality instrument to measure self-esteem in Chile.

[How valid are student self-reports of bullying in schools?].

PubMed

Morbitzer, Petra; Spröber, Nina; Hautzinger, Martin

2009-01-01

In this study we examine the reliability and validity of students' self-reports about bullying and victimization in schools. 208 5th class students of four "middle schools" in Southern Germany filled in the Bully-Victim-Questionnaire (Olweus, 1989, adapted by Lösel, Bliesener, Averbeck, 1997) and the School Climate Survey (Brockenborough, 2001) to assess the prevalence of bullying/victimization, and to evaluate attitudes towards aggression and support for victims. By using reliability and validity criteria, one third (31%) of the questionnaires was classified as "unreliable/invalid". Mean comparisons of the "unreliable/invalid" group and the "valid" group of the subscales concerning bullying/victimization found significant differences. The "unreliable/invalid" group stated higher values of bullying and victimization. Based on the "unreliable/invalid" questionnaires more students could be identified as bullies/victims or bully-victims. The prevalence of bullying/victimization in the whole sample was reduced if "unreliable/invalid" questionnaires were excluded. The results are discussed in the framework of theories about the presentation of the self ("impression management', "social desirability") and systematic response patterns ("extreme response bias").

Assessing Self-Regulated Strategies for School Writing: Cross-Cultural Validation of a Triadic Measure

ERIC Educational Resources Information Center

Malpique, Anabela Abreu; Veiga Simão, Ana Margarida

2015-01-01

This study reports on the construction of a questionnaire to assess ninth-grade students' use of self-regulated strategies for school writing tasks. Exploratory and confirmatory factorial analyses were conducted to validate the factor structure of the instrument. The initial factor analytic stage (n = 296) revealed a 13-factor scale, accounting…

Reliability and Validity of a New Physical Activity Self-Report Measure for Younger Children

ERIC Educational Resources Information Center

Belton, Sarahjane; Mac Donncha, Ciaran

2010-01-01

The purpose of this study was to assess the test-retest reliability and validity of a new Youth Physical Activity Self-Report measure. Heart rate and direct observation were employed as criterion measures with a sample of 79 children (aged 7-9 years). Spearman's rho correlation between self reported activity intensity and heart rate was 0.87 for…

Validity of Self-Reported Physical Fitness and Body Mass Index in a Military Population.

PubMed

Martin, Robyn C; Grier, Tyson; Canham-Chervak, Michelle; Anderson, Morgan K; Bushman, Timothy T; DeGroot, David W; Jones, Bruce H

2016-01-01

Many epidemiological studies rely on valid physical fitness data. The purpose of this investigation was to assess the validity of self-reported Army Physical Fitness Test (APFT) data and determine whether men and women recall APFT performance differently. U.S. Army soldiers (N = 1,047) completed a survey, including questions on height, weight, and most recent APFT performance. Height, weight, and APFT performance were also obtained from unit records. The mean ± SDs for unit and self-reported push-up repetitions were 63.5 ± 13.1 and 66.3 ± 14.0 for men and 37.7 ± 12.8 and 40.2 ± 12.8 for women, respectively. The mean ± SD for unit- and self-reported sit-up repetitions were 66.3 ± 11.4 and 68.1 ± 12.1 for men and 64.2 ± 13.6 and 66.5 ± 12.9 for women, respectively. The mean ± SD unit- and self-reported 2-mile run times were 15.2 ± 1.8 and 14.9 ± 1.6 minutes for men, and 18.0 ± 2.9 and 17.4 ± 1.9 minutes for women, respectively. Unit- and self-reported body mass indices (BMIs) (calculated by height and weight) were 26.4 ± 3.4 and 26.3 ± 3.6 for men and 24.6 ± 2.8 and 24.2 ± 3.3 for women. Correlations between unit- and self-reported scores for push-ups, sit-ups, 2-mile run, height, weight, and BMI were 0.82, 0.78, 0.85, 0.87, 0.97, and 0.88 for men and 0.86, 0.84, 0.87, 0.78, 0.98, and 0.78 for women, respectively. On average, men and women slightly overreported performance on the APFT and overestimated height, resulting in underestimated BMI. There was no difference in recall ability between men and women (p > 0.05). The very good to excellent correlations (r = 0.78-0.98) between unit- and self-reported scores indicate that self-reported data are valid for capturing physical fitness performance in this population.

Variability and validity of intimate partner violence reporting by couples in Tanzania.

PubMed

Halim, Nafisa; Steven, Ester; Reich, Naomi; Badi, Lilian; Messersmith, Lisa

2018-01-01

In recent years, major global institutions have amplified their efforts to address intimate partner violence (IPV) against women-a global health and human rights violation affecting 15-71% of reproductive aged women over their lifetimes. Still, some scholars remain concerned about the validity of instruments used for IPV assessment in population-based studies. In this paper, we conducted two validation analyses using novel data from 450 women-men dyads across nine villages in Northern Tanzania. First, we examined the level of inter-partner agreement in reporting of men's physical, sexual, emotional and economic IPV against women in the last three and twelve months prior to the survey, ever in the relationship, and during pregnancy. Second, we conducted a convergent validity analysis to compare the relative efficacy of men's self-reports of perpetration and women's of victimization as a valid indicator of IPV against Tanzanian women using logistic regression models with village-level clustered errors. We found that, for every violence type across the recall periods of the last three months, the last twelve months and ever in the relationship, at least one in three couples disagreed about IPV occurrences in the relationship. Couples' agreement about physical, sexual and economic IPV during pregnancy was high with 86-93% of couples reporting concordantly. Also, men's self-reported perpetration had statistically significant associations with at least as many validated risk factors as had women's self-reported victimization. This finding suggests that men's self-reports are at least as valid as women's as an indicator of IPV against women in Northern Tanzania. We recommend more validation studies are conducted in low-income countries, and that data on relationship factors affecting IPV reports and reporting are made available along with data on IPV occurrences.

Systematic review of the psychometric properties and theoretical grounding of instruments evaluating self-care in people with type 2 diabetes mellitus.

PubMed

Caro-Bautista, Jorge; Martín-Santos, Francisco Javier; Morales-Asencio, Jose Miguel

2014-06-01

To determine the psychometric properties and theoretical grounding of instruments that evaluate self-care behaviour or barriers in people with type 2 diabetes. There are many instruments designed to evaluate self-care behaviour or barriers in this population, but knowledge about their psychometric validation processes is lacking. Systematic review. We conducted a search for psychometric or validation studies published between January 1990-December 2012. We carried out searches in Pubmed, CINAHL, PsycINFO, ProQuolid, BibliPRO and Google SCHOLAR to identify instruments that evaluated self-care behaviours or barriers to diabetes self-care. We conducted a systematic review with the following inclusion criteria: Psychometric or clinimetric validation studies that included patients with type 2 diabetes (exclusively or partially) and which analysed self-care behaviour or barriers to self-care and proxies like self-efficacy or empowerment, from a multidimensional approach. Language: Spanish or English. Two authors independently assessed the quality of the studies and extracted data using Terwee's proposed criteria: psychometrics properties, dimensionality, theoretical ground and population used for validation through each included instrument. Sixteen instruments achieved the inclusion criteria for the review. We detected important methodological flaws in many of the selected instruments. Only the Self-management Profile for Type 2 Diabetes and Problem Areas in Diabetes Scale met half of Terwee's quality criteria. There are no instruments for identifying self-care behaviours or barriers elaborated with a strong validation process. Further research should be carried out to provide patients, clinicians and researchers with valid and reliable instruments that are methodologically solid and theoretically grounded. © 2013 John Wiley & Sons Ltd.

Development, validity and reliability of the short multidimensional positive mental health instrument.

PubMed

Vaingankar, Janhavi Ajit; Subramaniam, Mythily; Abdin, Edimansyah; Picco, Louisa; Chua, Boon Yiang; Eng, Goi Khia; Sambasivam, Rajeswari; Shafie, Saleha; Zhang, Yunjue; Chong, Siow Ann

2014-06-01

The 47-item positive mental health (PMH) instrument measures the level of PMH in multiethnic adult Asian populations. This study aimed to (1) develop a short PMH instrument and (2) establish its validity and reliability among the adult Singapore population. Two separate studies were conducted among adult community-dwelling Singapore residents of Chinese, Malay or Indian ethnicity where participants completed self-administered questionnaires. In the first study, secondary data analysis was conducted using confirmatory factor analysis (CFA) to shorten the PMH instrument. In the second study, the newly developed short PMH instrument and other scales were administered to 201 residents to establish its factor structure, validity and reliability. A 20-item short PMH instrument fulfilling a higher-order six-factor structure was developed following secondary analysis. The mean age of the participants in the second study was 41 years and about 53% were women. One item with poor factor loading was further removed to generate a 19-item version of the PMH instrument. CFA demonstrated a first-order six-factor model of the short PMH instrument. The PMH-19 instrument and its subscales fulfilled criterion validity hypotheses. Internal consistency and test-retest reliability of the PMH-19 instrument were high (Cronbach's α coefficient = 0.87; intraclass correlation coefficient = 0.93, respectively). The 19-item PMH instrument is multidimensional, valid and reliable, and most importantly, with its reduced administration time, the short PMH instrument can be used to measure and evaluate PMH in Asian communities.

Item Development and Validity Testing for a Self- and Proxy Report: The Safe Driving Behavior Measure

PubMed Central

Classen, Sherrilene; Winter, Sandra M.; Velozo, Craig A.; Bédard, Michel; Lanford, Desiree N.; Brumback, Babette; Lutz, Barbara J.

2010-01-01

OBJECTIVE We report on item development and validity testing of a self-report older adult safe driving behaviors measure (SDBM). METHOD On the basis of theoretical frameworks (Precede–Proceed Model of Health Promotion, Haddon’s matrix, and Michon’s model), existing driving measures, and previous research and guided by measurement theory, we developed items capturing safe driving behavior. Item development was further informed by focus groups. We established face validity using peer reviewers and content validity using expert raters. RESULTS Peer review indicated acceptable face validity. Initial expert rater review yielded a scale content validity index (CVI) rating of 0.78, with 44 of 60 items rated ≥0.75. Sixteen unacceptable items (≤0.5) required major revision or deletion. The next CVI scale average was 0.84, indicating acceptable content validity. CONCLUSION The SDBM has relevance as a self-report to rate older drivers. Future pilot testing of the SDBM comparing results with on-road testing will define criterion validity. PMID:20437917

Development and Initial Validation of an Instrument for Human Capital Planning

ERIC Educational Resources Information Center

Zula, Kenneth J.; Chermack, Thomas J.

2008-01-01

This article reports on development and validation of an instrument for use in human capital approaches for organizational planning. The article describes use of a team of subject matter experts in developing a measure of human capital planning, and use of exploratory factor analysis techniques to validate the resulting instrument. These data were…

Validity of self-reported exposure to second-hand smoke in hospitality venues.

PubMed

Galán, Iñaki; Mayo, Elga; López, María J; Pérez-Ríos, Mónica; Fu, Marcela; Martínez-Sánchez, Jose M; Schiaffino, Anna; Moncada, Albert; Montes, Agustín; Nebot, Manel; Fernández, Esteve

2014-08-01

The aim was to assess the validity of self-reported exposure to second-hand smoke (SHS) in 50 hospitality venues of Madrid (Spain) in 2010, taking as a reference vapour-phase nicotine measured by active sampling. The questions posed in the questionnaire permitted distinguishing between the different levels of SHS. However, the moderate relationship found (Spearman׳s correlation=0.387, p<0.001) suggests that intensity of exposure to SHS in hospitality venues, based solely on self-reported information, should be used with caution. Copyright © 2014 Elsevier Inc. All rights reserved.

The Faculty Self-Reported Assessment Survey (FRAS): Differentiating Faculty Knowledge and Experience in Assessment

PubMed Central

Hanauer, David I.; Bauerle, Cynthia

2015-01-01

Science, technology, engineering, and mathematics education reform efforts have called for widespread adoption of evidence-based teaching in which faculty members attend to student outcomes through assessment practice. Awareness about the importance of assessment has illuminated the need to understand what faculty members know and how they engage with assessment knowledge and practice. The Faculty Self-Reported Assessment Survey (FRAS) is a new instrument for evaluating science faculty assessment knowledge and experience. Instrument validation was composed of two distinct studies: an empirical evaluation of the psychometric properties of the FRAS and a comparative known-groups validation to explore the ability of the FRAS to differentiate levels of faculty assessment experience. The FRAS was found to be highly reliable (α = 0.96). The dimensionality of the instrument enabled distinction of assessment knowledge into categories of program design, instrumentation, and validation. In the known-groups validation, the FRAS distinguished between faculty groups with differing levels of assessment experience. Faculty members with formal assessment experience self-reported higher levels of familiarity with assessment terms, higher frequencies of assessment activity, increased confidence in conducting assessment, and more positive attitudes toward assessment than faculty members who were novices in assessment. These results suggest that the FRAS can reliably and validly differentiate levels of expertise in faculty knowledge of assessment. PMID:25976653

Assessing the accuracy of self-reported self-talk

PubMed Central

Brinthaupt, Thomas M.; Benson, Scott A.; Kang, Minsoo; Moore, Zaver D.

2015-01-01

As with most kinds of inner experience, it is difficult to assess actual self-talk frequency beyond self-reports, given the often hidden and subjective nature of the phenomenon. The Self-Talk Scale (STS; Brinthaupt et al., 2009) is a self-report measure of self-talk frequency that has been shown to possess acceptable reliability and validity. However, no research using the STS has examined the accuracy of respondents’ self-reports. In the present paper, we report a series of studies directly examining the measurement of self-talk frequency and functions using the STS. The studies examine ways to validate self-reported self-talk by (1) comparing STS responses from 6 weeks earlier to recent experiences that might precipitate self-talk, (2) using experience sampling methods to determine whether STS scores are related to recent reports of self-talk over a period of a week, and (3) comparing self-reported STS scores to those provided by a significant other who rated the target on the STS. Results showed that (1) overall self-talk scores, particularly self-critical and self-reinforcing self-talk, were significantly related to reports of context-specific self-talk; (2) high STS scorers reported talking to themselves significantly more often during recent events compared to low STS scorers, and, contrary to expectations, (3) friends reported less agreement than strangers in their self-other self-talk ratings. Implications of the results for the validity of the STS and for measuring self-talk are presented. PMID:25999887

Readability of Self-Report Alcohol Misuse Measures

PubMed Central

McHugh, R Kathryn; Sugarman, Dawn E; Kaufman, Julia S; Park, Sara; Weiss, Roger D; Greenfield, Shelly F

2014-01-01

Objective: Self-report measures of alcohol misuse and alcohol use disorders are valuable assessment tools for both research and clinical practice settings. However, readability is often overlooked when establishing the validity of these measures, which may result in measures written at a reading-grade level that is higher than the ability level of many potential respondents. The aim of the current study was to estimate the reading-grade level of validated measures of alcohol misuse and associated problems. Method: A total of 45 measures were identified, and reading-grade level was calculated using three validated readability formulas. Results: The majority of measures were written above the recommended reading-grade level for patient materials (5th–6th grade), with particularly poor readability for measure instructions. Conclusions: Given that many self-report alcohol misuse measures are written at a high reading-grade level, the consideration of readability is important when selecting measures for use in research and practice settings. Moreover, the development or modification of measures to target low-literacy populations may facilitate the broader applicability of these instruments. PMID:24650827

Reliability, validity and responsiveness of the German self-reported foot and ankle score (SEFAS) in patients with foot or ankle surgery.

PubMed

Arbab, Dariusch; Kuhlmann, Katharina; Schnurr, Christoph; Bouillon, Bertil; Lüring, Christian; König, Dietmar

2017-10-10

Patient-reported outcome measures are a critical tool in evaluating the efficacy of orthopedic procedures and are increasingly used in clinical trials to assess outcomes of health care. The intention of this study was to develop and culturally adapt a German version of the Self-reported Foot and Ankle Score (SEFAS) and to evaluate reliability, validity and responsiveness. According to Cross Cultural Adaptation of Self-Reported Measure guidelines forward and backward translation has been performed. The German SEFAS was investigated in 177 consecutive patients. 177 Patients completed the German SEFAS, Foot and Ankle Outcome Score (FAOS), Short-Form 36 and numeric scales for pain and disability (NRS) before and 118 patients 6 months after foot or ankle surgery. Test-Retest reliability, internal consistency, floor and ceiling effects, construct validity and minimal important change were analyzed. The German SEFAS demonstrated excellent test-retest reliability with ICC values of 0.97. Cronbach's alpha (α) value of 0.89 demonstrated strong internal consistency. No floor or ceiling effects were observed for the German version of the SEFAS. As hypothesized SEFAS correlated strongly with FAOS and SF-36 domains. It showed moderate (ES/SRM > 0.5) responsiveness between preoperative assessment and postoperative follow-up. The German version of the SEFAS demonstrated good psychometric properties. It proofed to be a valid and reliable instrument for use in foot and ankle patients. DRKS00007585.

Self-Report Measures of Juvenile Psychopathic Personality Traits: A Comparative Review

ERIC Educational Resources Information Center

Vaughn, Michael G.; Howard, Matthew O.

2005-01-01

The authors evaluated self-report instruments currently being used to assess children and adolescents with psychopathic personality traits with respect to their reliability, validity, and research utility. Comprehensive searches across multiple computerized bibliographic databases were conducted and supplemented with manual searches. A total of 30…

[Measurement properties of self-report questionnaires published in Korean nursing journals].

PubMed

Lee, Eun-Hyun; Kim, Chun-Ja; Kim, Eun Jung; Chae, Hyun-Ju; Cho, Soo-Yeon

2013-02-01

The purpose of this study was to evaluate measurement properties of self-report questionnaires for studies published in Korean nursing journals. Of 424 Korean nursing articles initially identified, 168 articles met the inclusion criteria. The methodological quality of the measurements used in the studies and interpretability were assessed using the COnsensus-based Standards for the selection of health Measurement INstruments (COSMIN) checklist. It consists of items on internal consistency, reliability, measurement error, content validity, construct validity including structural validity, hypothesis testing, cross-cultural validity, and criterion validity, and responsiveness. For each item of the COSMIN checklist, measurement properties are rated on a four-point scale: excellent, good, fair, and poor. Each measurement property is scored with worst score counts. All articles used the classical test theory for measurement properties. Internal consistency (72.6%), construct validity (56.5%), and content validity (38.2%) were most frequently reported properties being rated as 'excellent' by COSMIN checklist, whereas other measurement properties were rarely reported. A systematic review of measurement properties including interpretability of most instruments warrants further research and nursing-focused checklists assessing measurement properties should be developed to facilitate intervention outcomes across Korean studies.

Reliability and Construct Validity of the Patient-Reported Outcomes Measurement Information System (PROMIS) Instruments in Women with Fibromyalgia.

PubMed

Merriwether, Ericka N; Rakel, Barbara A; Zimmerman, Miriam B; Dailey, Dana L; Vance, Carol G T; Darghosian, Leon; Golchha, Meenakshi; Geasland, Katherine M; Chimenti, Ruth; Crofford, Leslie J; Sluka, Kathleen A

2017-08-01

The Patient-Reported Outcomes Measurement Information System (PROMIS) was developed to standardize measurement of clinically relevant patient-reported outcomes. This study evaluated the reliability and construct validity of select PROMIS static short-form (SF) instruments in women with fibromyalgia. Analysis of baseline data from the Fibromyalgia Activity Study with TENS (FAST), a randomized controlled trial of the efficacy of transcutaneous electrical nerve stimulation. Dual site, university-based outpatient clinics. Women aged 20 to 67 years diagnosed with fibromyalgia. Participants completed the Revised Fibromyalgia Impact Questionnaire (FIQR) and 10 PROMIS static SF instruments. Internal consistency was calculated using Cronbach alpha. Convergent validity was examined against the FIQR using Pearson correlation and multiple regression analysis. PROMIS static SF instruments had fair to high internal consistency (Cronbach α = 0.58 to 0.94, P  < 0.05). PROMIS 'physical function' domain score was highly correlated with FIQR 'function' score (r = -0.73). The PROMIS 'total' score was highly correlated with the FIQR total score (r = -0.72). Correlations with FIQR total score of each of the three PROMIS domain scores were r = -0.65 for 'physical function,' r = -0.63 for 'global,' and r = -0.57 for 'symptom' domain. PROMIS 'physical function,' 'global,' and 'symptom' scores explained 58% of the FIQR total score variance. Select PROMIS static SF instruments demonstrate convergent validity with the FIQR, a legacy measure of fibromyalgia disease severity. These results highlight the potential utility of select PROMIS static SFs for assessment and tracking of patient-reported outcomes in fibromyalgia. © 2016 American Academy of Pain Medicine. All rights reserved. For permissions, please e-mail: journals.permissions@oup.com

Validity and reliability of self-reported diabetes in the Atherosclerosis Risk in Communities Study.

PubMed

Schneider, Andrea L C; Pankow, James S; Heiss, Gerardo; Selvin, Elizabeth

2012-10-15

The objective of this study was to assess the validity of prevalent and incident self-reported diabetes compared with multiple reference definitions and to assess the reliability (repeatability) of a self-reported diagnosis of diabetes. Data from 10,321 participants in the Atherosclerosis Risk in Communities (ARIC) Study who attended visit 4 (1996-1998) were analyzed. Prevalent self-reported diabetes was compared with reference definitions defined by fasting glucose and medication use obtained at visit 4. Incident self-reported diabetes was assessed during annual follow-up telephone calls and was compared with reference definitions defined by fasting glucose, hemoglobin A1c, and medication use obtained during an in-person visit attended by a subsample of participants (n = 1,738) in 2004-2005. The sensitivity of prevalent self-reported diabetes ranged from 58.5% to 70.8%, and specificity ranged from 95.6% to 96.8%, depending on the reference definition. Similarly, the sensitivity of incident self-reported diabetes ranged from 55.9% to 80.4%, and specificity ranged from 84.5% to 90.6%. Percent positive agreement of self-reported diabetes during 9 years of repeat assessments ranged from 92.7% to 95.4%. Both prevalent self-reported diabetes and incident self-reported diabetes were 84%-97% specific and 55%-80% sensitive as compared with reference definitions using glucose and medication criteria. Self-reported diabetes was >92% reliable over time.

Discriminant Validity of Self-Reported Emotional Intelligence: A Multitrait-Multisource Study

ERIC Educational Resources Information Center

Joseph, Dana L.; Newman, Daniel A.

2010-01-01

A major stumbling block for emotional intelligence (EI) research has been the lack of adequate evidence for discriminant validity. In a sample of 280 dyads, self- and peer-reports of EI and Big Five personality traits were used to confirm an a priori four-factor model for the Wong and Law Emotional Intelligence Scale (WLEIS) and a five-factor…

Measurement properties of instruments evaluating self-care and related concepts in people with chronic obstructive pulmonary disease: A systematic review.

PubMed

Clari, Marco; Matarese, Maria; Alvaro, Rosaria; Piredda, Michela; De Marinis, Maria Grazia

2016-01-01

The use of valid and reliable instruments for assessing self-care is crucial for the evaluation of chronic obstructive pulmonary disease (COPD) management programs. The aim of this review is to evaluate the measurement properties and theoretical foundations of instruments for assessing self-care and related concepts in people with COPD. A systematic review was conducted of articles describing the development and validation of self-care instruments. The methodological quality of the measurement properties was assessed using the COSMIN checklist. Ten studies were included evaluating five instruments: three for assessing self-care and self-management and two for assessing self-efficacy. The COPD Self-Efficacy Scale was the most studied instrument, but due to poor study methodological quality, evidence about its measurement properties is inconclusive. Evidence from the COPD Self-Management Scale is more promising, but only one study tested its properties. Due to inconclusive evidence of their measurement properties, no instrument can be recommended for clinical use. Copyright © 2016 Elsevier Inc. All rights reserved.

Using breath carbon monoxide to validate self-reported tobacco smoking in remote Australian Indigenous communities.

PubMed

Maclaren, David J; Conigrave, Katherine M; Robertson, Jan A; Ivers, Rowena G; Eades, Sandra; Clough, Alan R

2010-02-20

This paper examines the specificity and sensitivity of a breath carbon monoxide (BCO) test and optimum BCO cutoff level for validating self-reported tobacco smoking in Indigenous Australians in Arnhem Land, Northern Territory (NT). In a sample of 400 people (>/=16 years) interviewed about tobacco use in three communities, both self-reported smoking and BCO data were recorded for 309 study participants. Of these, 249 reported smoking tobacco within the preceding 24 hours, and 60 reported they had never smoked or had not smoked tobacco for >/=6 months. The sample was opportunistically recruited using quotas to reflect age and gender balances in the communities where the combined Indigenous populations comprised 1,104 males and 1,215 females (>/=16 years). Local Indigenous research workers assisted researchers in interviewing participants and facilitating BCO tests using a portable hand-held analyzer. A BCO cutoff of >/=7 parts per million (ppm) provided good agreement between self-report and BCO (96.0% sensitivity, 93.3% specificity). An alternative cutoff of >/=5 ppm increased sensitivity from 96.0% to 99.6% with no change in specificity (93.3%). With data for two self-reported nonsmokers who also reported that they smoked cannabis removed from the analysis, specificity increased to 96.6%. In these disadvantaged Indigenous populations, where data describing smoking are few, testing for BCO provides a practical, noninvasive, and immediate method to validate self-reported smoking. In further studies of tobacco smoking in these populations, cannabis use should be considered where self-reported nonsmokers show high BCO.

Development and validation of a screening instrument for bipolar spectrum disorder: the Mood Disorder Questionnaire.

PubMed

Hirschfeld, R M; Williams, J B; Spitzer, R L; Calabrese, J R; Flynn, L; Keck, P E; Lewis, L; McElroy, S L; Post, R M; Rapport, D J; Russell, J M; Sachs, G S; Zajecka, J

2000-11-01

Bipolar spectrum disorders, which include bipolar I, bipolar II, and bipolar disorder not otherwise specified, frequently go unrecognized, undiagnosed, and untreated. This report describes the validation of a new brief self-report screening instrument for bipolar spectrum disorders called the Mood Disorder Questionnaire. A total of 198 patients attending five outpatient clinics that primarily treat patients with mood disorders completed the Mood Disorder Questionnaire. A research professional, blind to the Mood Disorder Questionnaire results, conducted a telephone research diagnostic interview by means of the bipolar module of the Structured Clinical Interview for DSM-IV. A Mood Disorder Questionnaire screening score of 7 or more items yielded good sensitivity (0.73) and very good specificity (0.90). The Mood Disorder Questionnaire is a useful screening instrument for bipolar spectrum disorder in a psychiatric outpatient population.

Volpe Aircraft Noise Certification Instrumentation Validation, Data Submittal Guidance; [Addendum to Letter Report V324-FB48B3-LR2

DOT National Transportation Integrated Search

2017-09-15

This addendum to Volpe Letter Report V324-FB48B3-LR2 provides guidance for applicants submitting data and information for validation of noise measurement, recording, and analysis instrumentation systems. Such validation is required by Federal Aviatio...

An implicit non-self-report measure of attitudes to speeding: development and validation.

PubMed

Hatfield, Julie; Fernandes, Ralston; Faunce, Gavin; Job, R F Soames

2008-03-01

Speeding is a major contributor to road trauma and attitudes toward speeding are hypothesised to be a key determinant of the behaviour. Attitudinal research is limited by reliance on self-report measures and the attendant possibility of reporting biases. The Implicit Association Test (IAT) aims to measure attitudes without reliance on self-report, by assessing the association between a target-concept and an evaluation, in terms of reaction time for compatible versus non-compatible pairings. The present research aimed to develop and evaluate an IAT to measure attitudes to speeding. Forty-five licensed drivers completed the speed-related IAT, and drove a driving simulator. Participants also completed a questionnaire that assessed self-reported attitudes to speeding, and several variables theoretically related to attitudes, including speeding behaviour. Observed IAT results suggested that attitudes toward speeding are negative, and were generally consistent with results derived from the simulated driving and self-reported behaviours, beliefs, and attitudes. Thus, the speed-related IAT appears to be a valid measure of attitudes toward speeding, which might be used to measure attitudes in road safety research without reliance on self-report.

Examination of the validity and reliability of the French version of the Brief Self-Control Scale

PubMed Central

Brevers, Damien; Foucart, Jennifer; Verbanck, Paul; Turel, Ofir

2017-01-01

This study aims to develop and to validate a French version of the Brief Self-Control Scale (BSCS; Tangney et al., 2004). This instrument is usually applied as a unidimensional self-report measure for assessing trait self-control, which captures one’s dispositional ability to resist short-term temptation in order to reach more valuable long-term goals. Data were collected from two independent samples of French-speaking individuals (n1 = 287; n2 = 160). Results indicated that the French version of the BSCS can be treated as unidimensional, like the original questionnaire. Data also showed consistent acceptable reliability and reasonable test-retest stability. Acceptable external validity of constructs was supported by relationships with self-reported measures of impulsivity (UPPS), including urgency, lack of premeditation, and lack of perseverance. Overall, the findings suggest that the average score of the French version of the BSCS is a viable option for assessing trait self-control in French speaking populations. PMID:29200467

Examination of the validity and reliability of the French version of the Brief Self-Control Scale.

PubMed

Brevers, Damien; Foucart, Jennifer; Verbanck, Paul; Turel, Ofir

2017-10-01

This study aims to develop and to validate a French version of the Brief Self-Control Scale (BSCS; Tangney et al., 2004). This instrument is usually applied as a unidimensional self-report measure for assessing trait self-control, which captures one's dispositional ability to resist short-term temptation in order to reach more valuable long-term goals. Data were collected from two independent samples of French-speaking individuals ( n 1 = 287; n 2 = 160). Results indicated that the French version of the BSCS can be treated as unidimensional, like the original questionnaire. Data also showed consistent acceptable reliability and reasonable test-retest stability. Acceptable external validity of constructs was supported by relationships with self-reported measures of impulsivity (UPPS), including urgency, lack of premeditation, and lack of perseverance. Overall, the findings suggest that the average score of the French version of the BSCS is a viable option for assessing trait self-control in French speaking populations.

Development, validation, and factorial comparison of the McGill Self-Efficacy of Learners For Inquiry Engagement (McSELFIE) survey in natural science disciplines

NASA Astrophysics Data System (ADS)

Ibrahim, Ahmed; Aulls, Mark W.; Shore, Bruce M.

2016-11-01

Sociocognitive theory [Bandura, A. (1986). Social foundations of thought and action: A social cognitive theory. Englewood Cliffs, NJ: Prentice Hall; Bandura, A. (1989). Human agency in social cognitive theory. American Psychologist, 44, 1175-1184. doi:10.1037/0003-066x.44.9.1175; Bandura, A. (1991). Social cognitive theory of self-regulation. Organizational Behavior and Human Decision Processes, 50, 248-287. doi:10.1016/0749-5978(91)90022-L] accords high importance to the mechanisms of human agency and how they are exercised through self-efficacy. In this paper, we developed and validated the McGill Self-Efficacy For Inquiry Engagement (McSELFIE) instrument with undergraduate students in natural science disciplines. We defined inquiry engagement as carrying out the practices of science (POS) that are supported by students' personality characteristics (SPCs) and that result in achieving inquiry-learning outcomes (ILOs). Based on these theoretical perspectives, the McSELFIE is a 60-item, learner-focused survey that addresses three components that are theoretically important for engaging in scientific inquiry: (a) SPCs, (b) ILOs, and (c) POS. Evidence for construct and content validity were obtained by using experts' judgments and confirmatory factor analysis with a sample of 110 undergraduate students enrolled in science disciplines. Internal consistency of the factors and instrument was also examined. The McSELFIE instrument is a reliable and valid instrument for measuring science undergraduate students' self-efficacy for inquiry engagement. Matched pairs analyses were conducted among the instruments' factors. Students reported the highest self-efficacy for openness, applying knowledge, and carrying out investigations. Students reported the lowest self-efficacy for extraversion, understanding metacognitive knowledge, and planning investigations. Theoretical and practical implications are discussed.

Validity of Self-Reported Pedometer Steps per Day in College Students

ERIC Educational Resources Information Center

Overstreet, Brittany Star; Crouter, Scott E.; Butler, George A.; Springer, Cary M.; Bassett, David R.

2016-01-01

The purpose of this article was to examine the validity of self-reported pedometer steps/day. Forty-seven participants were provided a New Lifestyles NL-2000 (NL-2000; Lees Summit, MO, USA) pedometer and a physical activity (PA) diary for 3 weeks, but not informed of the data-storing capabilities. For weeks 2 and 3, each participant was given a…

Reliability and validity of a Tutorial Group Effectiveness Instrument.

PubMed

Singaram, Veena S; Van Der Vleuten, Cees P M; Van Berkel, Henk; Dolmans, Diana H J M

2010-01-01

Tutorial group effectiveness is essential for the success of learning in problem-based learning (PBL). Less effective and dysfunctional groups compromise the quality of students learning in PBL. This article aims to report on the reliability and validity of an instrument aimed at measuring tutorial group effectiveness in PBL. The items within the instrument are clustered around motivational and cognitive factors based on Slavin's theoretical framework. A confirmatory factor analysis (CFA) was carried out to estimate the validity of the instrument. Furthermore, generalizability studies were conducted and alpha coefficients were computed to determine the reliability and homogeneity of each factor. The CFA indicated that a three-factor model comprising 19 items showed a good fit with the data. Alpha coefficients per factor were high. The findings of the generalizability studies indicated that at least 9-10 student responses are needed in order to obtain reliable data at the tutorial group level. The instrument validated in this study has the potential to provide faculty and students with diagnostic information and feedback about student behaviors that enhance and hinder tutorial group effectiveness.

Development and preliminary validation of a self-report measure of psychopathic personality traits in noncriminal populations.

PubMed

Lilienfeld, S O; Andrews, B P

1996-06-01

Research on psychopathology has been hindered by persisting difficulties and controversies regarding its assessment. The primary goals of this set of studies were to (a) develop, and initiate the construct validation of, a self-report measure that assesses the major personality traits of psychopathy in noncriminal populations and (b) clarify the nature of these traits via an exploratory approach to test construction. This measure, the Psychopathic Personality Inventory (PPI), was developed by writing items to assess a large number of personality domains relevant to psychopathy and performing successive item-level factor analyses and revisions on three undergraduate samples. The PPI total score and its eight subscales were found to possess satisfactory internal consistency and test-retest reliability. In four studies with undergraduates, the PPI and its subscales exhibited a promising pattern of convergent and discriminant validity with self-report, psychiatric interview, observer rating, and family history data. In addition, the PPI total score demonstrated incremental validity relative to several commonly used self-report psychopathy-related measures. Future construct validation studies, unresolved conceptual issues regarding the assessment of psychopathy, and potential research uses of the PPI are outlined.

Assessing the validity of self-reported community benefit expenditures: evidence from not-for-profit hospitals in California.

PubMed

Rauscher, Simone; Vyzas, Mark

2012-01-01

In its revised Form 990 Schedule H, the Internal Revenue Service requires not-for-profit hospitals to provide detailed financial information on their community benefits, yet no standardized reporting guidelines exist for how these activities should be quantified. As a result, little is known currently about whether a hospital's self-reported community benefit expenditures provide an accurate picture of its commitment to serving the community. To assess the validity of hospitals' self-reported community benefit expenditures. Data for this study came from California hospitals. Self-reported community benefit expenditures were derived from hospitals' annual community benefit reports for the year 2009. Bivariate correlation analysis was used to compare self-reported expenditures to a set of indicators of hospitals' charitable activity. Of the 218 private, not-for-profit California hospitals that were required to submit community benefit reports for 2009, 91 (42%) provided sufficient information for our analysis. California hospitals' self-reported community benefit expenditures were strongly correlated with indicators of charitable activity. Hospitals that reported higher community benefit expenditures engaged in more charitable activities than hospitals that reported lower levels of community benefit spending. Expenditure information from California hospitals' community benefit reports was found to be a valid indicator of charitable activity. Self-reported community benefit spending may thus provide a fairly accurate picture of a hospital's commitment to serving its community, despite the lack of standardized reporting guidelines.

Validity of questionnaire self-reports on computer, mouse and keyboard usage during a four-week period.

PubMed

Mikkelsen, Sigurd; Vilstrup, Imogen; Lassen, Christina Funch; Kryger, Ann Isabel; Thomsen, Jane Frølund; Andersen, Johan Hviid

2007-08-01

To examine the validity and potential biases in self-reports of computer, mouse and keyboard usage times, compared with objective recordings. A study population of 1211 people was asked in a questionnaire to estimate the average time they had worked with computer, mouse and keyboard during the past four working weeks. During the same period, a software program recorded these activities objectively. The study was part of a one-year follow-up study from 2000-1 of musculoskeletal outcomes among Danish computer workers. Self-reports on computer, mouse and keyboard usage times were positively associated with objectively measured activity, but the validity was low. Self-reports explained only between a quarter and a third of the variance of objectively measured activity, and were even lower for one measure (keyboard time). Self-reports overestimated usage times. Overestimation was large at low levels and declined with increasing levels of objectively measured activity. Mouse usage time proportion was an exception with a near 1:1 relation. Variability in objectively measured activity, arm pain, gender and age influenced self-reports in a systematic way, but the effects were modest and sometimes in different directions. Self-reported durations of computer activities are positively associated with objective measures but they are quite inaccurate. Studies using self-reports to establish relations between computer work times and musculoskeletal pain could be biased and lead to falsely increased or decreased risk estimates.

Psychometric evaluation of a new instrument to measure disease self-management of the early stage chronic kidney disease patients.

PubMed

Lin, Chiu-Chu; Wu, Chia-Chen; Wu, Li-Min; Chen, Hsing-Mei; Chang, Shu-Chen

2013-04-01

This study aims to develop a valid and reliable chronic kidney disease self-management instrument (CKD-SM) for assessing early stage chronic kidney disease patients' self-management behaviours. Enhancing early stage chronic kidney disease patients' self-management plays a key role in delaying the progression of chronic kidney disease. Healthcare provider understanding of early stage chronic kidney disease patients' self-management behaviours can help develop effective interventions. A valid and reliable instrument for measuring chronic kidney disease patients' self-management behaviours is needed. A cross-sectional descriptive study collected data for principal components analysis with oblique rotation. Mandarin- or Taiwanese-speaking adults with chronic kidney disease (n=252) from two medical centres and one regional hospital in Southern Taiwan completed the CKD-SM. Construct validity was evaluated by exploratory factor analysis. Internal consistency and test-retest reliability were estimated by Cronbach's alpha and Pearson correlation coefficients. Four factors were extracted and labelled self-integration, problem-solving, seeking social support and adherence to recommended regimen. The four factors accounted for 60.51% of the total variance. Each factor showed acceptable internal reliability with Cronbach's alpha from 0.77-0.92. The test-retest correlations for the CKD-SM was 0.72. The psychometric quality of the CKD-SM instrument was satisfactory. Research to conduct a confirmatory factor analysis to further validate this new instrument's construct validity is recommended. The CKD-SM instrument is useful for clinicians who wish to identify the problems with self-management among chronic kidney disease patients early. Self-management assessment will be helpful to develop intervention tailored to the needs of the chronic kidney disease population. © 2013 Blackwell Publishing Ltd.

Instruments evaluating the self-directed learning abilities among nursing students and nurses: a systematic review of psychometric properties.

PubMed

Cadorin, Lucia; Bressan, Valentina; Palese, Alvisa

2017-11-25

Modern healthcare institutions are continuously changing, and Self-Directed Learning (SDL) abilities are considered a prerequisite for both nursing students and nurses in order to be proactive about these demanding challenges. To date, no systematic reviews of existing instruments aimed at detecting and critically evaluating SDL abilities have been published. Therefore, the aims of this review are: 1) identify the instruments for assessment of SDL abilities among nursing students and nurses; 2) critically evaluate the methodological studies quality; and 3) compare the psychometric properties of the available instruments. A psychometric-systematic-review was performed. CDSR, CINAHL, ERIC, MEDLINE, PROSPERO, SCOPUS databases were searched without restrictions in time and setting. All primary studies involving nursing students or nurses, written in English and aimed at validating SDL assessment tools, were included. Studies retrieved were evaluated according to the COnsensus-based-Standards for the selection of health Measurement-INstruments (COSMIN) panel. Study inclusion, data extraction and quality assessment were performed by researchers independently. Eleven studies were included and four tools based on Knowles's theory have emerged: 1) the Self-Directed Learning Readiness Scale; 2) the Self-Directed Learning Readiness Scale for Nursing Education; 3) the Self-Rating Scale of Self-Directed Learning, and 4) the Self-Directed Learning Instrument. A few psychometric properties have been considered in each study, from two to four out of the ten required. The quality of the methodologies used was in general, from fair to poor with the exception of one instrument (the Self-Directed-Learning-Instrument). The psychometric proprieties that emerged across the tools were good in general: the Cronbach α was from 0.73 to 0.91; structural validities have also reported good indexes both in the explorative and in the confirmative factor analyses. On the basis of the findings

Reliability and Validity of the Self Efficacy Expectations and Outcome Expectations After ICD Implantation Scales

PubMed Central

Dougherty, Cynthia M.; Johnston, Sandra K.; Thompson, Elaine Adams

2009-01-01

The purpose of this study was to assess the reliability and validity characteristics of two new scales that measure self-efficacy expectations (SE-ICD) and outcome expectations (OE-ICD) in survivors (n=168) of sudden cardiac arrest (SCA), all of whom received an implantable cardioverter defibrillator (ICD). Cronbach's alpha reliability demonstrated good internal consistency (SE-ICD α = 0.93 and OE-ICD α = 0.81). Correlations with other self-efficacy instruments (general self-efficacy and social self-efficacy) were consistently high. The instruments were responsive to change across time with effect sizes of 0.46 for SE-ICD, and 0.26 for OE-ICD. These reliable, valid, and responsive instruments for measurement of self-efficacy expectations and outcome expectations after an ICD can be used in research and clinical settings. PMID:17693214

Accumulation of Content Validation Evidence for the Critical Thinking Self-Assessment Scale.

PubMed

Nair, Girija Gopinathan; Hellsten, Laurie-Ann M; Stamler, Lynnette Leeseberg

2017-04-01

Critical thinking skills (CTS) are essential for nurses; assessing students' acquisition of these skills is a mandate of nursing curricula. This study aimed to develop a self-assessment instrument of critical thinking skills (Critical Thinking Self-Assessment Scale [CTSAS]) for students' self-monitoring. An initial pool of 196 items across 6 core cognitive skills and 16 subskills were generated using the American Philosophical Association definition of CTS. Experts' content review of the items and their ratings provided evidence of content relevance using the item-level content validity index (I-CVI) and Aiken's content validity coefficient (VIk). 115 items were retained (range of I-CVI values = .70 to .94 and range of VIk values = .69-.95; significant at p< .05). The CTSAS is the first CTS instrument designed specifically for self-assessment purposes.

Validity of Exercise Measures in Adults with Anorexia Nervosa: The EDE, Compulsive Exercise Test and Other Self-Report Scales.

PubMed

Young, Sarah; Touyz, Stephen; Meyer, Caroline; Arcelus, Jon; Rhodes, Paul; Madden, Sloane; Pike, Kathleen; Attia, Evelyn; Crosby, Ross D; Wales, Jackie; Hay, Phillipa

2017-05-01

Compulsive exercise is a prominent feature for the majority of patients with Anorexia Nervosa (AN), but there is a dearth of research evaluating assessment instruments. This study assessed the concurrent validity of the exercise items of the Eating Disorder Examination (EDE) and Eating Disorder Examination-Questionnaire (EDE-Q), with the Compulsive Exercise Test (CET) and other self-report exercise measures in patients with AN. We also aimed to perform validation of the CET in an adult clinical sample. The sample consisted of 78 adults with AN, recruited for the randomized controlled trial "Taking a LEAP forward in the treatment of anorexia nervosa." At baseline, participants completed the EDE, EDE-Q, CET, Reasons for Exercise Inventory (REI), Commitment to Exercise Scale (CES) and Exercise Beliefs Questionnaire (EBQ). Correlational and regression analyses were performed. EDE exercise days and exercise time per day were positively correlated with each other and with all CET subscales (except Lack of exercise enjoyment), CES mean, EBQ total and REI total. Exercise time per day was associated with a higher EDE global score. The CET demonstrated good concurrent validity with the CES, the REI and the EBQ. Of the self-reports, the CET explained the greatest variance in eating disorder psychopathology and demonstrated good to excellent reliability in this sample. The EDE and EDE-Q demonstrated good concurrent validity with the CET. Further research is required to evaluate the CET's factor structure in a large clinical sample. However, the CET has demonstrated strong clinical utility in adult patients with AN. © 2016 Wiley Periodicals, Inc.(Int J Eat Disord 2017; 50:533-541). © 2016 Wiley Periodicals, Inc.

DEVELOPMENT AND VALIDATION OF A NEW SELF-REPORT MEASURE OF PAIN BEHAVIORS

PubMed Central

Cook, Karon F.; Keefe, Francis; Jensen, Mark P.; Roddey, Toni S.; Callahan, Leigh F.; Revicki, Dennis; Bamer, Alyssa M.; Kim, Jiseon; Chung, Hyewon; Salem, Rana; Amtmann, Dagmar

2013-01-01

Pain behaviors that are maintained beyond the acute stage post-injury can contribute to subsequent psychosocial and physical disability. Critical to the study of pain behaviors is the availability of psychometrically sound pain behavior measures. In this study we developed a self-report measure of pain behaviors, the Pain Behaviors Self Report (PaB-SR). PaB-SR scores were developed using item response theory and evaluated using a rigorous, multiple-witness approach to validity testing. Participants included: a) 661 survey participants with chronic pain and with multiple sclerosis (MS), back pain, or arthritis; b) 618 survey participants who were significant others of a chronic pain participant; and c) 86 participants in a videotaped pain behavior observation protocol. Scores on the PaB-SR were found to be measurement invariant with respect to clinical condition. PaB-SR scores, observer-reports, and the video-taped protocol yielded distinct, but convergent views of pain behavior, supporting the validity of the new measure. The PaB-SR is expected to be of substantial utility to researchers wishing to explore the relationship between pain behaviors and constructs such as pain intensity, pain interference, and disability. PMID:23994451

Examining the Validity of Self-Reports on Scales Measuring Students' Strategic Processing

ERIC Educational Resources Information Center

Samuelstuen, Marit S.; Braten, Ivar

2007-01-01

Background: Self-report inventories trying to measure strategic processing at a global level have been much used in both basic and applied research. However, the validity of global strategy scores is open to question because such inventories assess strategy perceptions outside the context of specific task performance. Aims: The primary aim was to…

Do self-report instruments allow meaningful comparisons across diverse population groups? Testing measurement invariance using the confirmatory factor analysis framework.

PubMed

Gregorich, Steven E

2006-11-01

Comparative public health research makes wide use of self-report instruments. For example, research identifying and explaining health disparities across demographic strata may seek to understand the health effects of patient attitudes or private behaviors. Such personal attributes are difficult or impossible to observe directly and are often best measured by self-reports. Defensible use of self-reports in quantitative comparative research requires not only that the measured constructs have the same meaning across groups, but also that group comparisons of sample estimates (eg, means and variances) reflect true group differences and are not contaminated by group-specific attributes that are unrelated to the construct of interest. Evidence for these desirable properties of measurement instruments can be established within the confirmatory factor analysis (CFA) framework; a nested hierarchy of hypotheses is tested that addresses the cross-group invariance of the instrument's psychometric properties. By name, these hypotheses include configural, metric (or pattern), strong (or scalar), and strict factorial invariance. The CFA model and each of these hypotheses are described in nontechnical language. A worked example and technical appendices are included.

Test-retest reliability of the Mandarin versions of the Hypertension Self-Care Profile instrument.

PubMed

Ngoh, Soh Heng Agnes; Lim, Hazel Wai Ling; Koh, Yi Ling Eileen; Tan, Ngiap Chuan

2017-11-01

Self-efficacy in essential hypertension can be measured using scales, such as the "Hypertension Self-Care Profile" (HTN-SCP) questionnaire. It assesses "Behavior", "Motivation", and "Self-efficacy" in 3 domains, respectively. This study aimed to validate the Mandarin version of HTN-SCP instrument (HTN-SCP-Mn) targeted at patients of Chinese ethnicity with hypertension.Our study recruited Chinese patients, aged 40 years and older, with essential hypertension from a public primary healthcare clinic in Singapore. The 60-item HTN-SCP-Mn questionnaire was completed online using a tablet or smartphone on enrolment. A retest was conducted 2 weeks after the initial test. Reliability was assessed by internal consistency and test-retest reliability using Cronbach alpha and intraclass correlation coefficients (ICC). Differences between the overall HTN-SCP-Mn scores of the patients and their self-reported self-management activities were also determined using independent t test.Of the 153 patients who completed the HTN-SCP-Mn during the initial test, 79 responded to the test-retest evaluation. Reliability of the 3 domains "Behavior", "Motivation", and "Self-efficacy" obtained high internal consistency (Cronbach alpha = 0.838, 0.929, and 0.927, respectively). The item total correlation ranged from 0.058 to 0.677 for Behavior, 0.374 to 0.798 for Motivation, and 0.326 to 0.767 for self-efficacy. The ICC indicated fair to good test-retest reliability with scores of 0.643, 0.579, and 0.710 for the respective domains.The results showed face validity of the HTN-SCP-Mn instrument, indicating its potential application in mandarin-proficient patients. Further study is needed to correlate its scores with objective demonstration of self-efficacy.

Construct validity of adolescents' self-reported big five personality traits: importance of conceptual breadth and initial validation of a short measure.

PubMed

Morizot, Julien

2014-10-01

While there are a number of short personality trait measures that have been validated for use with adults, few are specifically validated for use with adolescents. To trust such measures, it must be demonstrated that they have adequate construct validity. According to the view of construct validity as a unifying form of validity requiring the integration of different complementary sources of information, this article reports the evaluation of content, factor, convergent, and criterion validities as well as reliability of adolescents' self-reported personality traits. Moreover, this study sought to address an inherent potential limitation of short personality trait measures, namely their limited conceptual breadth. In this study, starting with items from a known measure, after the language-level was adjusted for use with adolescents, items tapping fundamental primary traits were added to determine the impact of added conceptual breadth on the psychometric properties of the scales. The resulting new measure was named the Big Five Personality Trait Short Questionnaire (BFPTSQ). A group of expert judges considered the items to have adequate content validity. Using data from a community sample of early adolescents, the results confirmed the factor validity of the Big Five structure in adolescence as well as its measurement invariance across genders. More important, the added items did improve the convergent and criterion validities of the scales, but did not negatively affect their reliability. This study supports the construct validity of adolescents' self-reported personality traits and points to the importance of conceptual breadth in short personality measures. © The Author(s) 2014.

Comparing the Psychometric Properties of Two Physical Activity Self-Efficacy Instruments in Urban, Adolescent Girls: Validity, Measurement Invariance, and Reliability

PubMed Central

Voskuil, Vicki R.; Pierce, Steven J.; Robbins, Lorraine B.

2017-01-01

Aims: This study compared the psychometric properties of two self-efficacy instruments related to physical activity. Factorial validity, cross-group and longitudinal invariance, and composite reliability were examined. Methods: Secondary analysis was conducted on data from a group randomized controlled trial investigating the effect of a 17-week intervention on increasing moderate to vigorous physical activity among 5th–8th grade girls (N = 1,012). Participants completed a 6-item Physical Activity Self-Efficacy Scale (PASE) and a 7-item Self-Efficacy for Exercise Behaviors Scale (SEEB) at baseline and post-intervention. Confirmatory factor analyses for intervention and control groups were conducted with Mplus Version 7.4 using robust weighted least squares estimation. Model fit was evaluated with the chi-square index, comparative fit index, and root mean square error of approximation. Composite reliability for latent factors with ordinal indicators was computed from Mplus output using SAS 9.3. Results: Mean age of the girls was 12.2 years (SD = 0.96). One-third of the girls were obese. Girls represented a diverse sample with over 50% indicating black race and an additional 19% identifying as mixed or other race. Both instruments demonstrated configural invariance for simultaneous analysis of cross-group and longitudinal invariance based on alternative fit indices. However, simultaneous metric invariance was not met for the PASE or the SEEB instruments. Partial metric invariance for the simultaneous analysis was achieved for the PASE with one factor loading identified as non-invariant. Partial metric invariance was not met for the SEEB. Longitudinal scalar invariance was achieved for both instruments in the control group but not the intervention group. Composite reliability for the PASE ranged from 0.772 to 0.842. Reliability for the SEEB ranged from 0.719 to 0.800 indicating higher reliability for the PASE. Reliability was more stable over time in the control

Parent- and Self-Reported Dimensions of Oppositionality in Youth: Construct Validity, Concurrent Validity, and the Prediction of Criminal Outcomes in Adulthood

ERIC Educational Resources Information Center

Aebi, Marcel; Plattner, Belinda; Metzke, Christa Winkler; Bessler, Cornelia; Steinhausen, Hans-Christoph

2013-01-01

Background: Different dimensions of oppositional defiant disorder (ODD) have been found as valid predictors of further mental health problems and antisocial behaviors in youth. The present study aimed at testing the construct, concurrent, and predictive validity of ODD dimensions derived from parent- and self-report measures. Method: Confirmatory…

Self-Disclosure Between Friends: A Validity Study

ERIC Educational Resources Information Center

Panyard, Christine Marie

1973-01-01

Subjects reported that they had disclosed approximately the same amount of information as they had received. The consensual validation of the amount of personal information exchanged between friends suggested that the Self-Disclosure Questionnaire is a valid measure of self-disclosure to a specific target person. (Author)

Content Validity of Patient-Reported Outcome Instruments used with Pediatric Patients with Facial Differences: A Systematic Review.

PubMed

Wickert, Natasha M; Wong Riff, Karen W Y; Mansour, Mark; Forrest, Christopher R; Goodacre, Timothy E E; Pusic, Andrea L; Klassen, Anne F

2018-01-01

Objective The aim of this systematic review was to identify patient-reported outcome (PRO) instruments used in research with children/youth with conditions associated with facial differences to identify the health concepts measured. Design MEDLINE, EMBASE, CINAHL, and PsycINFO were searched from 2004 to 2016 to identify PRO instruments used in acne vulgaris, birthmarks, burns, ear anomalies, facial asymmetries, and facial paralysis patients. We performed a content analysis whereby the items were coded to identify concepts and categorized as positive or negative content or phrasing. Results A total of 7,835 articles were screened; 6 generic and 11 condition-specific PRO instruments were used in 96 publications. Condition-specific instruments were for acne (four), oral health (two), dermatology (one), facial asymmetries (two), microtia (one), and burns (one). The PRO instruments provided 554 items (295 generic; 259 condition specific) that were sorted into 4 domains, 11 subdomains, and 91 health concepts. The most common domain was psychological (n = 224 items). Of the identified items, 76% had negative content or phrasing (e.g., "Because of the way my face looks I wish I had never been born"). Given the small number of items measuring facial appearance (n = 19) and function (n = 22), the PRO instruments reviewed lacked content validity for patients whose condition impacted facial function and/or appearance. Conclusions Treatments can change facial appearance and function. This review draws attention to a problem with content validity in existing PRO instruments. Our team is now developing a new PRO instrument called FACE-Q Kids to address this problem.

The Premature Ejaculation Profile: validation of self-reported outcome measures for research and practice.

PubMed

Patrick, Donald L; Giuliano, François; Ho, Kai Fai; Gagnon, Dennis D; McNulty, Pauline; Rothman, Margaret

2009-02-01

To evaluate the reliability and validity of the Premature Ejaculation Profile (PEP), a self-reported outcome instrument for evaluating domains of PE and its treatment, comprised of four single-item measures, a profile, and an index score. Data were from men participating in observational studies in the USA (PE, 207 men; non-PE, 1380) and Europe (PE, 201; non-PE, 914) and from men with PE (1238) participating in a phase III randomized, placebo-controlled clinical trial of dapoxetine. The PEP contains four measures: perceived control over ejaculation, personal distress related to ejaculation, satisfaction with sexual intercourse, and interpersonal difficulty related to ejaculation, each assessed on five-point response scales. Test-retest reliability, known-groups validity, and ability to detect a patient-reported global impression of change (PGI) in condition were evaluated for the individual PEP measures and a PEP index score (the mean of all four measures). Profile analysis was conducted using multivariate analysis of variance. All PEP measures showed acceptable reliability (intraclass correlation coefficients ranged from 0.66 to 0.83) and mean scores for all measures differed significantly between PE and non-PE groups (P < 0.001). Men who reported a reduction in PE with treatment in the phase III trial had significantly greater scores on each of the four measures. The PEP profiles of men with and without PE differed significantly (P < 0.001) in both observational studies; higher levels of PGI were associated with higher PEP profiles (P < 0.001). The PEP index score also showed acceptable reliability and was significantly different between the PE and non-PE groups (P < 0.001). Men who reported an improvement in PE with treatment in the phase III trial had significantly greater PEP index scores. In the phase III trial, nausea was the most common adverse event with dapoxetine. The PEP provides a reliable, valid, and interpretable measure for use in monitoring

Measuring Educational Outcomes for At-Risk Children and Youth: Issues with the Validity of Self-Reported Data

ERIC Educational Resources Information Center

Teye, Amanda Cleveland; Peaslee, Liliokanaio

2015-01-01

Background: Youth programs often rely on self-reported data without clear evidence as to the accuracy of these reports. Although the validity of self-reporting has been confirmed among some high school and college age students, one area that is absent from extant literature is a serious investigation among younger children. Moreover, there is…

Design and validation of instruments to measure knowledge.

PubMed

Elliott, T E; Regal, R R; Elliott, B A; Renier, C M

2001-01-01

Measuring health care providers' learning after they have participated in educational interventions that use experimental designs requires valid, reliable, and practical instruments. A literature review was conducted. In addition, experience gained from designing and validating instruments for measuring the effect of an educational intervention informed this process. The eight main steps for designing, validating, and testing the reliability of instruments for measuring learning outcomes are presented. The key considerations and rationale for this process are discussed. Methods for critiquing and adapting existent instruments and creating new ones are offered. This study may help other investigators in developing valid, reliable, and practical instruments for measuring the outcomes of educational activities.

Validation of Yoon's Critical Thinking Disposition Instrument.

PubMed

Shin, Hyunsook; Park, Chang Gi; Kim, Hyojin

2015-12-01

The lack of reliable and valid evaluation tools targeting Korean nursing students' critical thinking (CT) abilities has been reported as one of the barriers to instructing and evaluating students in undergraduate programs. Yoon's Critical Thinking Disposition (YCTD) instrument was developed for Korean nursing students, but few studies have assessed its validity. This study aimed to validate the YCTD. Specifically, the YCTD was assessed to identify its cross-sectional and longitudinal measurement invariance. This was a validation study in which a cross-sectional and longitudinal (prenursing and postnursing practicum) survey was used to validate the YCTD using 345 nursing students at three universities in Seoul, Korea. The participants' CT abilities were assessed using the YCTD before and after completing an established pediatric nursing practicum. The validity of the YCTD was estimated and then group invariance test using multigroup confirmatory factor analysis was performed to confirm the measurement compatibility of multigroups. A test of the seven-factor model showed that the YCTD demonstrated good construct validity. Multigroup confirmatory factor analysis findings for the measurement invariance suggested that this model structure demonstrated strong invariance between groups (i.e., configural, factor loading, and intercept combined) but weak invariance within a group (i.e., configural and factor loading combined). In general, traditional methods for assessing instrument validity have been less than thorough. In this study, multigroup confirmatory factor analysis using cross-sectional and longitudinal measurement data allowed validation of the YCTD. This study concluded that the YCTD can be used for evaluating Korean nursing students' CT abilities. Copyright © 2015. Published by Elsevier B.V.

Validity of Self-reported Sexual Behavior Among Adolescents: Where Do We Go from Here?

PubMed

DiClemente, Ralph J

2016-01-01

Adolescents have high rates of sexually transmitted infections (STIs). Adolescents consuming alcohol and using drugs have markedly greater HIV/STI risk and are a priority population for intervention. Accurate measurement of sexual risk behavior is critical for understanding individual's risk for HIV/STI, transmission dynamics of HIV/STI, and evaluating the efficacy of interventions designed reduce HIV/STI risk. However, significant challenges to accurately measuring adolescents' self-reported sexual behavior are well-documented. Recent advances in microbiology, such as the use of less invasive specimen collection for DNA assays, can assist researchers in more accurately measuring adolescents' sexual risk behavior. However, the majority of studies of adolescents' sexual risk rely solely on self-reported behavior; therefore, methods to improve the validity of adolescents' self-reported sexual behavior are needed. In addition, integrating biologic measures to complement self-reported measures are recommended, when appropriate and feasible.

The Spanish version of the Self-Determination Inventory Student Report: application of item response theory to self-determination measurement.

PubMed

Mumbardó-Adam, C; Guàrdia-Olmos, J; Giné, C; Raley, S K; Shogren, K A

2018-04-01

A new measure of self-determination, the Self-Determination Inventory: Student Report (Spanish version), has recently been adapted and empirically validated in Spanish language. As it is the first instrument intended to measure self-determination in youth with and without disabilities, there is a need to further explore and strengthen its psychometric analysis based on item response patterns. Through item response theory approach, this study examined item observed distributions across the essential characteristics of self-determination. The results demonstrated satisfactory to excellent item functioning patterns across characteristics, particularly within agentic action domains. Increased variability across items was also found within action-control beliefs dimensions, specifically within the self-realisation subdomain. These findings further support the instrument's psychometric properties and outline future research directions. © 2017 MENCAP and International Association of the Scientific Study of Intellectual and Developmental Disabilities and John Wiley & Sons Ltd.

Validation of the "Quality of Life in School" instrument in Canadian elementary school students.

PubMed

Ghotra, Satvinder; McIsaac, Jessie-Lee D; Kirk, Sara F L; Kuhle, Stefan

2016-01-01

Background. School is an integral component of the life of a child, and thus quality of school life is an important part of the overall quality of life experienced by a child. There are a few instruments available to measure the quality of school life but they are often not available in English, or they are not appropriate for use alongside other instruments in a survey of young children. The Quality of Life in School (QoLS) instrument is a short, self-report measure to assess elementary school students' perception of their quality of school life in four domains. The instrument was developed in Israel and has been validated among Hebrew-speaking children. The aim of the current study was to evaluate the psychometric properties of the QoLS measure in Canadian elementary school children. Methods. A total of 629 children attending grades 4-6 were recruited in a population-based cross-sectional study. The QoLS measure was administered to participating children by trained research assistants. In addition, their socio-demographic details and academic data were also obtained. The psychometric testing included exploratory factor analysis and reliability estimation using internal consistency (Cronbach's Alpha). Construct validity was investigated using the known groups comparisons for discriminative validity and via convergent validity. Results. A four-factor structure was generated explaining 39% of the total variance in the model. The results showed good internal consistency and acceptable floor and ceiling effects. Cronbach's Alpha ranged from 0.75 to 0.93. Known groups comparisons showed that the QoLS measure discriminated well between subgroups on the basis of gender, grade, and academic achievement, thus providing evidence of construct validity. The convergent validity was also appropriate with all the four domains demonstrating moderate to strong correlations to each other and to the total QoLS score. Conclusions. QoLS appears to be a valid and reliable measure for

Reliability, validity, and clinical use of the Dominic Interactive: a DSM-based, self-report screen for school-aged children.

PubMed

Bergeron, Lise; Berthiaume, Claude; St-Georges, Marie; Piché, Geneviève; Smolla, Nicole

2013-08-01

As no single informant can be considered the gold standard of child psychopathology, interviewing of children regarding their own symptoms is necessary. Our study focused on the reliability, validity, and clinical use of the Dominic Interactive (DI), a multimedia self-report screen to assess symptoms for the most frequent Diagnostic and Statistical Manual of Mental Disorders, Fourth Edition, Text Revision, mental disorders in school-aged children. A sample of 585 children aged 6 to 11 years from the community and psychiatric clinics was used to analyze the internal consistency, the test-retest estimate of reliability, and the criterion-related validity of the DI against the referral status. In addition, cross-informant correlation coefficients between this instrument (child report) and the Child Symptom Inventory (parent report) were explored in a subsample of 292 participants. For the total sample, Cronbach alpha coefficients ranged from 0.63 to 0.91. Test-retest kappas varied from 0.42 to 0.62 for categories based on cut-off points, except for specific phobias. Intraclass correlation coefficients ranged from 0.70 to 0.81 for symptom scales. The DI discriminated between referred and non-referred children in psychiatric clinics for all symptom scales. Significant cross-informant correlation coefficients were higher for the externalizing symptoms (0.35 to 0.48) than the internalizing symptoms (0.14 to 0.27). Findings of our study reasonably support adequate psychometric properties of the DI. This instrument offers a developmentally sensitive screening method to obtain unique information from young children about their mental health problems in front-line services, psychiatric clinics, and research settings.

The Children's Sleep Comic: Psychometrics of a Self-rating Instrument for Childhood Insomnia.

PubMed

Schwerdtle, Barbara; Kanis, Julia; Kübler, Andrea; Schlarb, Angelika A

2016-02-01

The Children's Sleep Comic is a standardized self-report questionnaire for assessing insomnia in children ages 5-11 years. The goal of the present study is to introduce a revised version of this measure and to present psychometrics and a cut-off score. Therefore, the revised Children's Sleep Comic, the Sleep Self Report, the Children's Sleep Habits Questionnaire, and the Child Behavior Checklist were applied to a sample of 393 children and their parents. Of the parents who participated voluntarily, a subsample (n = 176) was interviewed on the phone to diagnose their children with sleep disorders according to the International Classification of Sleep Disorders, if applicable. The results indicated that the Children's Sleep Comic is a reliable self-rating instrument for diagnosing childhood insomnia. Internal consistency was α = 0.83; and convergent and divergent validity were adequate. The child-friendly format can foster a good therapeutic relationship, and thus establish the basis for successful intervention.

Sources of self-efficacy belief: development and validation of two scales.

PubMed

Liu, Ou Lydia; Wilson, Mark

2010-01-01

Self-efficacy belief has been an instrumental affective factor in predicting student behavior and achievement in academic settings. Although there is abundant literature on efficacy belief per se, the sources of efficacy belief have not been fully researched. Very few instruments exist to quantify the sources of efficacy-beliefs. To fill this void, we developed two scales for the two main sources of self-efficacy belief: past performance and social persuasion. Pilot test data were collected from 255 middle school students. A self-efficacy measure was also administered to the students as a criterion measure. The Rasch rating scale model was used to analyze the data. Information on item fit, item design, content validity, external validity, internal consistency, and person separation reliability was examined. The two scales displayed satisfactory psychometric properties. Applications and limitations of these two scales are also discussed.

The Nurses Self-Concept Instrument (NSCI): assessment of psychometric properties for Australian domestic and international student nurses.

PubMed

Angel, Elizabeth; Craven, Rhonda; Denson, Nida

2012-07-01

Professional self-concept is a critical driver of job satisfaction. In Australia, as international nursing enrolments rise, nursing is increasingly characterised by a professional body of international nurses who may differ from domestic Australian nurses in their nursing self-concept. At present, no psychometrically sound instrument for assessing nursing self-concept for Australian domestic and international nursing students is available. The purpose of this study was to: (1) develop an instrument (the Nurses' Self-Concept Instrument (NSCI)) to measure the professional self-concept of domestic and international nursing students in Australia, and (2) test the psychometric properties of this newly developed instrument. A literature review was conducted to generate the initial dimension and item pools to measure nurses' professional self-concept (NSCI). Two stakeholders examined the content and face validity of dimensions and items. Analysis was performed on data collected from 253 undergraduate nursing students in a large public university in Sydney, Australia, and consisted of domestic (n=218) and international (n=35) nursing students. Internal reliability was assessed using Cronbach's Alpha. Confirmatory factor analysis (CFA) was used to assess the construct validity of the NSCI. The resulting NSCI consisted of 14 items across four self-concept domains: care, leadership, staff relations, and knowledge. The CFA supported the hypothesised factor structure of the self-concept model. All reliabilities were acceptable for both domestic and international students (ranging from r=.78 to .93). The NSCI was shown to be a valid and reliable tool for assessing Australian domestic and international student nurses' professional self-concept. This instrument may also enable those responsible for recruitment of students into nursing courses to assess students' professional self-concept and implement appropriate strategies to foster the growth of lifelong career development

Validating self-reported food expenditures against food store and eating-out receipts.

PubMed

Tang, W; Aggarwal, A; Liu, Z; Acheson, M; Rehm, C D; Moudon, A V; Drewnowski, A

2016-03-01

To compare objective food store and eating-out receipts with self-reported household food expenditures. The Seattle Obesity Study II was based on a representative sample of King County adults, Washington, USA. Self-reported household food expenditures were modeled on the Flexible Consumer Behavior Survey (FCBS) Module from 2007 to 2009 National Health and Nutrition Examination Survey (NHANES). Objective food expenditure data were collected using receipts. Self-reported food expenditures for 447 participants were compared with receipts using paired t-tests, Bland-Altman plots and κ-statistics. Bias by sociodemographics was also examined. Self-reported expenditures closely matched with objective receipt data. Paired t-tests showed no significant differences between receipts and self-reported data on total food expenditures, expenditures at food stores or eating out. However, the highest-income strata showed weaker agreement. Bland-Altman plots confirmed no significant bias across both methods-mean difference: 6.4; agreement limits: -123.5 to 143.4 for total food expenditures, mean difference 5.7 for food stores and mean difference 1.7 for eating out. The κ-statistics showed good agreement for each (κ 0.51, 0.41 and 0.49 respectively. Households with higher education and income had significantly more number of receipts and higher food expenditures. Self-reported food expenditures using NHANES questions, both for food stores and eating out, serve as a decent proxy for objective household food expenditures from receipts. This method should be used with caution among high-income populations, or with high food expenditures. This is the first validation of the FCBS food expenditures question using food store and eating-out receipts.

Validating self-reported food expenditures against food store and eating-out receipts

PubMed Central

Tang, Wesley; Aggarwal, Anju; Liu, Zhongyuan; Acheson, Molly; Rehm, Colin D; Moudon, Anne Vernez; Drewnowski, Adam

2015-01-01

Objectives To compare objective food store and eating-out receipts with self-reported household food expenditures. Design and setting The Seattle Obesity Study (SOS II) was based on a representative sample of King County adults, Washington, USA. Self-reported household food expenditures were modeled on the Flexible Consumer Behavior Survey (FCBS) Module from 2007–2009 National Health and Nutrition Examination Survey (NHANES). Objective food expenditure data were collected using receipts. Self-reported food expenditures for 447 participants were compared to receipts using paired t-tests, Bland-Altman plots, and kappa statistics. Bias by socio-demographics was also examined. Results Self-reported expenditures closely matched with objective receipt data. Paired t-tests showed no significant differences between receipts and self-reported data on total food expenditures, expenditures at food stores, or eating out. However, the highest income strata showed weaker agreement. Bland Altman plots confirmed no significant bias across both methods - mean difference: 6.4; agreement limits: −123.5, 143.4 for total food expenditures, mean difference 5.7 for food stores, and mean difference 1.7 for eating-out. Kappa statistics showed good agreement for each (kappa 0.51, 0.41 and 0.49 respectively. Households with higher education and income had significantly more number of receipts and higher food expenditures. Conclusion Self-reported food expenditures using NHANES questions, both for food stores and eating-out, serve as a decent proxy for objective household food expenditures from receipts. This method should be used with caution among high income populations, or with high food expenditures. This is the first validation of the FCBS food expenditures question using food store and eating-out receipts. PMID:26486299

Validity of self-reported cancer history in the health examinees (HEXA) study: A comparison of self-report and cancer registry records.

PubMed

Cho, Sooyoung; Shin, Aesun; Song, Daesub; Park, Jae Kyung; Kim, Yeonjung; Choi, Ji-Yeob; Kang, Daehee; Lee, Jong-Koo

2017-10-01

To assess the validity of the cohort study participants' self-reported cancer history via data linkage to a cancer registry database. We included 143,965 participants from the Health Examinees (HEXA) study recruited between 2004 and 2013 who gave informed consent for record linkage to the Korean Central Cancer Registry (KCCR). The sensitivity and the positive predictive value of self-reported histories of cancer were calculated and 95% confidence intervals were estimated. A total of 4,860 participants who had at least one record in the KCCR were included in the calculation of sensitivity. In addition, 3,671 participants who reported a cancer history at enrollment were included in the calculation of positive predictive value. The overall sensitivity of self-reported cancer history was 72.0%. Breast cancer history among women showed the highest sensitivity (81.2%), whereas the lowest sensitivity was observed for liver cancer (53.7%) and cervical cancer (52.1%). The overall positive predictive value was 81.9%. The highest positive predictive value was observed for thyroid cancer (96.1%) and prostate cancer (96.1%), and the lowest was observed for cervical cancer (43.7%). The accuracy of self-reported cancer history varied by cancer site and may not be sufficient to ascertain cancer incidence, especially for cervical and bladder cancers. Copyright © 2017. Published by Elsevier Ltd.

Validation of self-reported information on dental caries in a birth cohort at 18 years of age.

PubMed

Silva, Alexandre Emidio Ribeiro; Menezes, Ana Maria Baptista; Assunção, Maria Cecília Formoso; Gonçalves, Helen; Demarco, Flávio Fernando; Vargas-Ferreira, Fabiana; Peres, Marco Aurélio

2014-01-01

Estimate the prevalence of dental caries based on clinical examinations and self-reports and compare differences in the prevalence and effect measures between the two methods among 18-year-olds belonging to a 1993 birth cohort in the city of Pelotas, Brazil. Data on self-reported caries, socio-demographic aspects and oral health behaviour were collected using a questionnaire administered to adolescents aged 18 years (n = 4041). Clinical caries was evaluated (n = 1014) by a dentist who had undergone training and calibration exercises. Prevalence rates of clinical and self-reported caries, sensitivity, specificity, positive and negative predictive values, absolute and relative bias, and inflation factors were calculated. Prevalence ratios of dental caries were estimated for each risk factor. The prevalence of clinical and self-reported caries (DMFT>1) was 66.5% (95%CI: 63.6%-69.3%) and 60.3% (95%CI: 58.8%-61.8%), respectively. Self-reports underestimated the prevalence of dental caries by 9.3% in comparison to clinical evaluations. The analysis of the validity of self-reports regarding the DMFT index indicated high sensitivity (81.8%; 95%CI: 78.7%-84.7%) and specificity (78.1%; 95%CI: 73.3%-82.4%) in relation to the gold standard (clinical evaluation). Both the clinical and self-reported evaluations were associated with gender, schooling and self-rated oral health. Clinical dental caries was associated with visits to the dentist in the previous year. Self-reported dental caries was associated with daily tooth brushing frequency. Based on the present findings, self-reported information on dental caries using the DMFT index requires further studies prior to its use in the analysis of risk factors, but is valid for population-based health surveys with the aim of planning and monitoring oral health actions directed at adolescents.

Validation of cross-cultural child mental health and psychosocial research instruments: adapting the Depression Self-Rating Scale and Child PTSD Symptom Scale in Nepal

PubMed Central

2011-01-01

Background The lack of culturally adapted and validated instruments for child mental health and psychosocial support in low and middle-income countries is a barrier to assessing prevalence of mental health problems, evaluating interventions, and determining program cost-effectiveness. Alternative procedures are needed to validate instruments in these settings. Methods Six criteria are proposed to evaluate cross-cultural validity of child mental health instruments: (i) purpose of instrument, (ii) construct measured, (iii) contents of construct, (iv) local idioms employed, (v) structure of response sets, and (vi) comparison with other measurable phenomena. These criteria are applied to transcultural translation and alternative validation for the Depression Self-Rating Scale (DSRS) and Child PTSD Symptom Scale (CPSS) in Nepal, which recently suffered a decade of war including conscription of child soldiers and widespread displacement of youth. Transcultural translation was conducted with Nepali mental health professionals and six focus groups with children (n = 64) aged 11-15 years old. Because of the lack of child mental health professionals in Nepal, a psychosocial counselor performed an alternative validation procedure using psychosocial functioning as a criterion for intervention. The validation sample was 162 children (11-14 years old). The Kiddie-Schedule for Affective Disorders and Schizophrenia (K-SADS) and Global Assessment of Psychosocial Disability (GAPD) were used to derive indication for treatment as the external criterion. Results The instruments displayed moderate to good psychometric properties: DSRS (area under the curve (AUC) = 0.82, sensitivity = 0.71, specificity = 0.81, cutoff score ≥ 14); CPSS (AUC = 0.77, sensitivity = 0.68, specificity = 0.73, cutoff score ≥ 20). The DSRS items with significant discriminant validity were "having energy to complete daily activities" (DSRS.7), "feeling that life is not worth living" (DSRS.10), and "feeling

Assessing Dependency using Self-report and Indirect Measures: Examining the Significance of Discrepancies

PubMed Central

Cogswell, Alex; Alloy, Lauren B.; Karpinski, Andrew; Grant, David

2011-01-01

The present study addressed convergence between self-report and indirect approaches to assessing dependency. The study was moderately successful in validating an implicit measure, which was found to be reliable, orthogonal to two self-report instruments, and predictive of external criteria. This study also examined discrepancies between scores on self-report and implicit measures, and has implications for their significance. The possibility that discrepancies themselves are pathological was not supported, although discrepancies were associated with particular personality profiles. Finally, this study offered additional evidence for the relation between dependency and depressive symptomatology, and identified implicit dependency as contributing unique variance in predicting past major depression. PMID:20552505

Assessing dependency using self-report and indirect measures: examining the significance of discrepancies.

PubMed

Cogswell, Alex; Alloy, Lauren B; Karpinski, Andrew; Grant, David A

2010-07-01

The present study addressed convergence between self-report and indirect approaches to assessing dependency. We were moderately successful in validating an implicit measure, which was found to be reliable, orthogonal to 2 self-report instruments, and predictive of external criteria. This study also examined discrepancies between scores on self-report and implicit measures, and has implications for their significance. The possibility that discrepancies themselves are pathological was not supported, although discrepancies were associated with particular personality profiles. Finally, this study offered additional evidence for the relation between dependency and depressive symptomatology and identified implicit dependency as contributing unique variance in predicting past major depression.

Development and validation of a new self-report measure of pain behaviors.

PubMed

Cook, Karon F; Keefe, Francis; Jensen, Mark P; Roddey, Toni S; Callahan, Leigh F; Revicki, Dennis; Bamer, Alyssa M; Kim, Jiseon; Chung, Hyewon; Salem, Rana; Amtmann, Dagmar

2013-12-01

Pain behaviors that are maintained beyond the acute stage after injury can contribute to subsequent psychosocial and physical disability. Critical to the study of pain behaviors is the availability of psychometrically sound pain behavior measures. In this study we developed a self-report measure of pain behaviors, the Pain Behaviors Self Report (PaB-SR). PaB-SR scores were developed using item response theory and evaluated using a rigorous, multiple-witness approach to validity testing. Participants included 661 survey participants with chronic pain and with multiple sclerosis, back pain, or arthritis; 618 survey participants who were significant others of a chronic pain participant; and 86 participants in a videotaped pain behavior observation protocol. Scores on the PaB-SR were found to be measurement invariant with respect to clinical condition. PaB-SR scores, observer reports, and the videotaped protocol yielded distinct, but convergent views of pain behavior, supporting the validity of the new measure. The PaB-SR is expected to be of substantial utility to researchers wishing to explore the relationship between pain behaviors and constructs such as pain intensity, pain interference, and disability. Copyright © 2013 International Association for the Study of Pain. Published by Elsevier B.V. All rights reserved.

Validity of covering-up sun-protection habits: Association of observations and self-report

PubMed Central

O'Riordan, David L.; Nehl, Eric; Gies, Peter; Bundy, Lucja; Burgess, Kristen; Davis, Erica; Glanz, Karen

2013-01-01

Background Few studies have reported the accuracy of measures used to assess sun-protection practices. Valid measures are critical to the internal validity and use of skin cancer control research. Objectives We sought to validate self-reported covering-up practices of pool-goers. Methods A total of 162 lifeguards and 201 parent/child pairs from 16 pools in 4 metropolitan regions in the United States completed a survey and a 4-day sun-habits diary. Observations of sun-protective behaviors were conducted on two occasions. Results Agreement between observations and diaries ranged from slight to substantial, with most values in the fair to moderate range. Highest agreement was observed for parent hat use (κ = 0.58–0.70). There was no systematic pattern of over- or under-reporting among the 3 study groups. Limitations Potential reactivity and a relatively affluent sample are limitations. Conclusion There was little over-reporting and no systematic bias, which increases confidence in reliance on verbal reports of these behaviors in surveys and intervention research. PMID:19278750

Approach and Instrument Placement Validation

NASA Technical Reports Server (NTRS)

Ator, Danielle

2005-01-01

The Mars Exploration Rovers (MER) from the 2003 flight mission represents the state of the art technology for target approach and instrument placement on Mars. It currently takes 3 sols (Martian days) for the rover to place an instrument on a designated rock target that is about 10 to 20 m away. The objective of this project is to provide an experimentally validated single-sol instrument placement capability to future Mars missions. After completing numerous test runs on the Rocky8 rover under various test conditions, it has been observed that lighting conditions, shadow effects, target features and the initial target distance have an effect on the performance and reliability of the tracking software. Additional software validation testing will be conducted in the months to come.

Measuring leprosy-related stigma - a pilot study to validate a toolkit of instruments.

PubMed

Rensen, Carin; Bandyopadhyay, Sudhakar; Gopal, Pala K; Van Brakel, Wim H

2011-01-01

Stigma negatively affects the quality of life of leprosy-affected people. Instruments are needed to assess levels of stigma and to monitor and evaluate stigma reduction interventions. We conducted a validation study of such instruments in Tamil Nadu and West Bengal, India. Four instruments were tested in a 'Community Based Rehabilitation' (CBR) setting, the Participation Scale, Internalised Scale of Mental Illness (ISMI) adapted for leprosy-affected persons, Explanatory Model Interview Catalogue (EMIC) for leprosy-affected and non-affected persons and the General Self-Efficacy (GSE) Scale. We evaluated the following components of validity, construct validity, internal consistency, test-retest reproducibility and reliability to distinguish between groups. Construct validity was tested by correlating instrument scores and by triangulating quantitative and qualitative findings. Reliability was evaluated by comparing levels of stigma among people affected by leprosy and community controls, and among affected people living in CBR project areas and those in non-CBR areas. For the Participation, ISMI and EMIC scores significant differences were observed between those affected by leprosy and those not affected (p = 0.0001), and between affected persons in the CBR and Control group (p < 0.05). The internal consistency of the instruments measured with Cronbach's α ranged from 0.83 to 0.96 and was very good for all instruments. Test-retest reproducibility coefficients were 0.80 for the Participation score, 0.70 for the EMIC score, 0.62 for the ISMI score and 0.50 for the GSE score. The construct validity of all instruments was confirmed. The Participation and EMIC Scales met all validity criteria, but test-retest reproducibility of the ISMI and GSE Scales needs further evaluation with a shorter test-retest interval and longer training and additional adaptations for the latter.

Instructional Interactions of Kindergarten Mathematics Classrooms: Validating a Direct Observation Instrument

ERIC Educational Resources Information Center

Doabler, Christian; Smolkowski, Keith; Fien, Hank; Kosty, Derek B.; Cary, Mari Strand

2010-01-01

In this paper, the authors report research focused directly on the validation of the Coding of Academic Teacher-Student interactions (CATS) direct observation instrument. They use classroom information gathered by the CATS instrument to better understand the potential mediating variables hypothesized to influence student achievement. Their study's…

The development of an instrument to measure the self-efficacy of students participating in VEX robotics competitions

NASA Astrophysics Data System (ADS)

Robinson, Trevor P.

The number of robotics competitions has steadily increased over the past 30 years. Schools are implementing robotics competitions to increase student content knowledge and interest in science, technology, engineering, and mathematics (STEM). Companies in STEM-related fields are financially supporting robotics competitions to help increase the number of students pursuing careers in STEM among other reasons. These financial supporters and school administrations are asking what the outcomes of students participating in competitive robotics are. Few studies have been conducted to investigate these outcomes. The studies that have been conducted usually compare students in robotics to students not in robotics. There have not been any studies that compare students to themselves before and after participating in robotics competitions. This may be due to the lack of available instruments to measure student outcomes. This study developed an instrument to measure the self-efficacy of students participating in VEX Robotics Competitions (VRC). The VRC is the world's largest and fastest growing robotics competition available for middle and high school students. Self-efficacy was measured because of its importance to the education community. Students with higher self-efficacy tend to persevere through difficult tasks more frequently than students with low self-efficacy. A person's self-efficacy has major influence over what interests, activities, classes, college majors, and careers he or she will pursue in life. The self-efficacy survey instrument created through this study was developed through an occupational and task analysis (OTA), and initial content and face validity was established through the OTA process. Exploratory and confirmatory factor analyses were also conducted to assist in instrument validation. The reliability was calculated using Cronbach's alpha. Face validity was established through the OTA process. Construct validity was established through the factor

Reliability and validity enhancement: a treatment package for increasing fidelity of self-report.

PubMed

Bornstein, P H; Hamilton, S B; Miller, R K; Quevillon, R P; Spitzform, M

1977-07-01

This study investigated the effects of reliability and validity "enhancers" on fidelity of self-report data in an analogue therapy situation. Under the guise of a Concentration Skills Training Program, 57 Ss were assigned randomly to one of the following conditions: (a) Reliability Enhancement; (b) Truth Talk; (c) No Comment Control. Results indicated significant differences among groups (p less than .05). In addition, tests of multiple comparisons revealed that Reliability Enhancement was significantly different from Truth Talk in occurrences of unreliability (p less than .05). These findings are discussed in light of the increased reliance on self-report data in behavioral intervention, and recommendations are made for future research.

External validity of children's self-reported sleep functioning: associations with academic, social, and behavioral adjustment.

PubMed

Becker, Stephen P

2014-09-01

Several child-report measures of sleep functioning have been developed but very few studies have examined the external validity of child self-reported sleep in relation to daytime functioning. This study examined child-reported sleep in relation to teacher-rated psychopathology symptoms and also tested the hypothesis that child-reported sleep would be associated with poorer child- and teacher-reported functioning after controlling for demographics and psychopathology symptoms that are known to be associated with adjustment. Participants were 175 children (81 boys, 94 girls) in 1st-6th grades (ages 6-13) and their teachers. Children completed the Sleep Self-Report. Teachers completed a measure of attention-deficit/hyperactivity disorder (ADHD), oppositional/conduct, and anxiety/depression symptoms. Children and teachers completed multiple measures of academic, behavioral, and social/peer functioning. Child-reported sleep was significantly associated with teacher-rated inattentive and internalizing symptoms, even after controlling for child demographics, hyperactivity-impulsivity, and conduct problems. Multilevel modeling analyses further indicated that, after controlling for child demographics and psychopathology symptoms, child-reported sleep problems were significantly associated with poorer child- and teacher-reported academic, behavioral, and social functioning (including increased reactive aggression, peer rejection, loneliness, and lower friendship satisfaction and self-worth). Findings provide initial support for the external validity of children's self-reported sleep functioning. Results of this study suggest that it may be clinically useful to screen for sleep problems by assessing for children's own perceptions of their sleep. Future studies should include both child- and parent-reported sleep functioning to further examine the utility of children's ratings of sleep functioning. Copyright © 2014 Elsevier B.V. All rights reserved.

[The Basel Screening Instrument for Psychosis (BSIP): development, structure, reliability and validity].

PubMed

Riecher-Rössler, A; Aston, J; Ventura, J; Merlo, M; Borgwardt, S; Gschwandtner, U; Stieglitz, R-D

2008-04-01

Early detection of psychosis is of growing clinical importance. So far there is, however, no screening instrument for detecting individuals with beginning psychosis in the atypical early stages of the disease with sufficient validity. We have therefore developed the Basel Screening Instrument for Psychosis (BSIP) and tested its feasibility, interrater-reliability and validity. Aim of this paper is to describe the development and structure of the instrument, as well as to report the results of the studies on reliability and validity. The instrument was developed based on a comprehensive search of literature on the most important risk factors and early signs of schizophrenic psychoses. The interraterreliability study was conducted on 24 psychiatric cases. Validity was tested based on 206 individuals referred to our early detection clinic from 3/1/2000 until 2/28/2003. We identified seven categories of relevance for early detection of psychosis and used them to construct a semistructured interview. Interrater-reliability for high risk individuals was high (Kappa .87). Predictive validity was comparable to other, more comprehensive instruments: 16 (32 %) of 50 individuals classified as being at risk for psychosis by the BSIP have in fact developed frank psychosis within an follow-up period of two to five years. The BSIP is the first screening instrument for the early detection of psychosis which has been validated based on transition to psychosis. The BSIP is easy to use by experienced psychiatrists and has a very good interrater-reliability and predictive validity.

Validation of a quality-of-life instrument for patients with nonmelanoma skin cancer.

PubMed

Rhee, John S; Matthews, B Alex; Neuburg, Marcy; Logan, Brent R; Burzynski, Mary; Nattinger, Ann B

2006-01-01

To validate a disease-specific quality-of-life instrument--the Skin Cancer Index--intended to measure quality-of-life issues relevant to patients with nonmelanoma skin cancer. Internal reliability, convergent and divergent validity with existing scales, and factor analyses were performed in a cross-sectional study of 211 patients presenting with cervicofacial nonmelanoma skin cancer to a dermatologic surgery clinic. Factor analyses of the Skin Cancer Index confirmed a multidimensional scale with 3 distinct subscales-emotional, social, and appearance. Excellent internal validity of the 3 subscales was demonstrated. Substantial evidence was observed for convergent validity with the Dermatology Life Quality Index, Rosenberg Self-Esteem Scale, Lerman's Cancer Worry Scale, and Medical Outcomes Survey Short-Form 12 domains for vitality, emotion, social function, and mental health. These findings validate a new disease-specific quality-of-life instrument for patients with cervicofacial nonmelanoma skin cancer. Studies on the responsiveness of the Skin Cancer Index to clinical intervention are currently under way.

The Faculty Self-Reported Assessment Survey (FRAS): differentiating faculty knowledge and experience in assessment.

PubMed

Hanauer, David I; Bauerle, Cynthia

2015-01-01

Science, technology, engineering, and mathematics education reform efforts have called for widespread adoption of evidence-based teaching in which faculty members attend to student outcomes through assessment practice. Awareness about the importance of assessment has illuminated the need to understand what faculty members know and how they engage with assessment knowledge and practice. The Faculty Self-Reported Assessment Survey (FRAS) is a new instrument for evaluating science faculty assessment knowledge and experience. Instrument validation was composed of two distinct studies: an empirical evaluation of the psychometric properties of the FRAS and a comparative known-groups validation to explore the ability of the FRAS to differentiate levels of faculty assessment experience. The FRAS was found to be highly reliable (α = 0.96). The dimensionality of the instrument enabled distinction of assessment knowledge into categories of program design, instrumentation, and validation. In the known-groups validation, the FRAS distinguished between faculty groups with differing levels of assessment experience. Faculty members with formal assessment experience self-reported higher levels of familiarity with assessment terms, higher frequencies of assessment activity, increased confidence in conducting assessment, and more positive attitudes toward assessment than faculty members who were novices in assessment. These results suggest that the FRAS can reliably and validly differentiate levels of expertise in faculty knowledge of assessment. © 2015 D. I. Hanauer and C. Bauerle. CBE—Life Sciences Education © 2015 The American Society for Cell Biology. This article is distributed by The American Society for Cell Biology under license from the author(s). It is available to the public under an Attribution–Noncommercial–Share Alike 3.0 Unported Creative Commons License (http://creativecommons.org/licenses/by-nc-sa/3.0).

Systematic review of systemic sclerosis-specific instruments for the EULAR Outcome Measures Library: An evolutional database model of validated patient-reported outcomes.

PubMed

Ingegnoli, Francesca; Carmona, Loreto; Castrejon, Isabel

2017-04-01

The EULAR Outcome Measures Library (OML) is a freely available database of validated patient-reported outcomes (PROs). The aim of this study was to provide a comprehensive review of validated PROs specifically developed for systemic sclerosis (SSc) to feed the EULAR OML. A sensitive search was developed in Medline and Embase to identify all validation studies, cohort studies, reviews, or meta-analyses in which the objective were the development or validation of specific PROs evaluating organ involvement, disease activity or damage in SSc. A reviewer screened title and abstracts, selected the studies, and collected data concerning validation using ad hoc forms based on the COSMIN checklist. From 13,140 articles captured, 74 met the predefined criteria. After excluding two instruments as they were unavailable in English the selected 23 studies provided information on seven SSc-specific PROs on different SSc domains: burden of illness (symptom burden index), functional status (Scleroderma Assessment Questionnaire), functional ability (scleroderma Functional Score), Raynaud's phenomenon (Raynaud's condition score), mouth involvement (Mouth Handicap in SSc), gastro-intestinal involvement (University of California Los Angeles-Scleroderma Clinical Trial Consortium Gastro-Intestinal tract 2.0), and skin involvement (skin self-assessment). Each of them is partially validated and has different psychometric requirements. Seven SSc-specific PROs have a minimum validation and were included in the EULAR OML. Further development in the area of disease-specific PROs in SSc is warranted. Copyright © 2017 Elsevier Inc. All rights reserved.

Self-reported dietary fructose intolerance in irritable bowel syndrome: Proposed diagnostic criteria.

PubMed

Berg, Leif Kyrre; Fagerli, Erik; Myhre, Arnt-Otto; Florholmen, Jon; Goll, Rasmus

2015-05-14

To study the criteria for self-reported dietary fructose intolerance (DFI) and to evaluate subjective global assessment (SGA) as outcome measure. Irritable bowel syndrome (IBS) patients were randomized in an open study design with a 2 wk run-in on a habitual IBS diet, followed by 12 wk with/without additional fructose-reduced diet (FRD). Daily registrations of stool frequency and consistency, and symptoms on a visual analog scale (VAS) were performed during the first 4 wk. SGA was used for weekly registrations during the whole study period. Provocation with high-fructose diet was done at the end of the registration period. Fructose breath tests (FBTs) were performed. A total of 182 subjects performed the study according to the protocol (88 FRD, 94 controls). We propose a new clinically feasible diagnostic standard for self-reported fructose intolerance. The instrument is based on VAS registrations of symptom relief on FRD combined with symptom aggravation upon provocation with fructose-rich diet. Using these criteria 43 of 77 patients (56%) in the present cohort of IBS patients had self-reported DFI. To improve the concept for clinical evaluation, we translated the SGA scale instrument to Norwegian and validated it in the context of the IBS diet regimen. The validation procedures showed a sensitivity, specificity and κ value for SGA detecting the self-reported DFI group by FRD response within the IBS patients of 0.79, 0.75 and 0.53, respectively. Addition of the provocation test yielded values of 0.84, 0.76 and 0.61, respectively. The corresponding validation results for FBT were 0.57, 0.34 and -0.13, respectively. FRD improves symptoms in a subgroup of IBS patients. A diet trial followed by a provocation test evaluated by SGA can identify most responders to FRD.

Self-reported dietary fructose intolerance in irritable bowel syndrome: Proposed diagnostic criteria

PubMed Central

Berg, Leif Kyrre; Fagerli, Erik; Myhre, Arnt-Otto; Florholmen, Jon; Goll, Rasmus

2015-01-01

AIM: To study the criteria for self-reported dietary fructose intolerance (DFI) and to evaluate subjective global assessment (SGA) as outcome measure. METHODS: Irritable bowel syndrome (IBS) patients were randomized in an open study design with a 2 wk run-in on a habitual IBS diet, followed by 12 wk with/without additional fructose-reduced diet (FRD). Daily registrations of stool frequency and consistency, and symptoms on a visual analog scale (VAS) were performed during the first 4 wk. SGA was used for weekly registrations during the whole study period. Provocation with high-fructose diet was done at the end of the registration period. Fructose breath tests (FBTs) were performed. A total of 182 subjects performed the study according to the protocol (88 FRD, 94 controls). RESULTS: We propose a new clinically feasible diagnostic standard for self-reported fructose intolerance. The instrument is based on VAS registrations of symptom relief on FRD combined with symptom aggravation upon provocation with fructose-rich diet. Using these criteria 43 of 77 patients (56%) in the present cohort of IBS patients had self-reported DFI. To improve the concept for clinical evaluation, we translated the SGA scale instrument to Norwegian and validated it in the context of the IBS diet regimen. The validation procedures showed a sensitivity, specificity and κ value for SGA detecting the self-reported DFI group by FRD response within the IBS patients of 0.79, 0.75 and 0.53, respectively. Addition of the provocation test yielded values of 0.84, 0.76 and 0.61, respectively. The corresponding validation results for FBT were 0.57, 0.34 and -0.13, respectively. CONCLUSION: FRD improves symptoms in a subgroup of IBS patients. A diet trial followed by a provocation test evaluated by SGA can identify most responders to FRD. PMID:25987795

Body Awareness: Construct and Self-Report Measures

PubMed Central

Mehling, Wolf E.; Gopisetty, Viranjini; Daubenmier, Jennifer; Price, Cynthia J.; Hecht, Frederick M.; Stewart, Anita

2009-01-01

Objectives Heightened body awareness can be adaptive and maladaptive. Improving body awareness has been suggested as an approach for treating patients with conditions such as chronic pain, obesity and post-traumatic stress disorder. We assessed the psychometric quality of selected self-report measures and examined their items for underlying definitions of the construct. Data sources PubMed, PsychINFO, HaPI, Embase, Digital Dissertations Database. Review methods Abstracts were screened; potentially relevant instruments were obtained and systematically reviewed. Instruments were excluded if they exclusively measured anxiety, covered emotions without related physical sensations, used observer ratings only, or were unobtainable. We restricted our study to the proprioceptive and interoceptive channels of body awareness. The psychometric properties of each scale were rated using a structured evaluation according to the method of McDowell. Following a working definition of the multi-dimensional construct, an inter-disciplinary team systematically examined the items of existing body awareness instruments, identified the dimensions queried and used an iterative qualitative process to refine the dimensions of the construct. Results From 1,825 abstracts, 39 instruments were screened. 12 were included for psychometric evaluation. Only two were rated as high standard for reliability, four for validity. Four domains of body awareness with 11 sub-domains emerged. Neither a single nor a compilation of several instruments covered all dimensions. Key domains that might potentially differentiate adaptive and maladaptive aspects of body awareness were missing in the reviewed instruments. Conclusion Existing self-report instruments do not address important domains of the construct of body awareness, are unable to discern between adaptive and maladaptive aspects of body awareness, or exhibit other psychometric limitations. Restricting the construct to its proprio- and interoceptive

Convergent and Discriminant Validity of Psychopathy Factors Assessed Via Self-Report

PubMed Central

Benning, Stephen D.; Patrick, Christopher J.; Salekin, Randall T.; Leistico, Anne-Marie R.

2008-01-01

Psychopathy has been conceptualized as a personality disorder with distinctive interpersonal-affective and behavioral deviance features. The authors examine correlates of the factors of the Psychopathic Personality Inventory (PPI), Self-Report Psychopathy–II (SRP-II) scale, and Antisocial Process Screening Device (APSD) to understand similarities and differences among the constructs embodied in these instruments. PPI Fearless Dominance and SRP-II Factor 1 were negatively related to most personality disorder symptoms and were both predicted by high Dominance and low Neuroticism. In addition, PPI Fearless Dominance correlated positively with antisocial personality features, although SRP-II Factor 1 did not. In contrast, PPI Impulsive Antisociality, SRP-II Factor 2, and both APSD factors correlated with antisocial personality features and symptoms of nearly all personality disorders, and were predicted by low Love. Results suggest ways in which the measurement of the constructs in each instrument may be improved. PMID:16123248

Online self-report questionnaire on computer work-related exposure (OSCWE): validity and internal consistency.

PubMed

Mekhora, Keerin; Jalayondeja, Wattana; Jalayondeja, Chutima; Bhuanantanondh, Petcharatana; Dusadiisariyavong, Asadang; Upiriyasakul, Rujiret; Anuraktam, Khajornyod

2014-07-01

To develop an online, self-report questionnaire on computer work-related exposure (OSCWE) and to determine the internal consistency, face and content validity of the questionnaire. The online, self-report questionnaire was developed to determine the risk factors related to musculoskeletal disorders in computer users. It comprised five domains: personal, work-related, work environment, physical health and psychosocial factors. The questionnaire's content was validated by an occupational medical doctor and three physical therapy lecturers involved in ergonomic teaching. Twenty-five lay people examined the feasibility of computer-administered and the user-friendly language. The item correlation in each domain was analyzed by the internal consistency (Cronbach's alpha; alpha). The content of the questionnaire was considered congruent with the testing purposes. Eight hundred and thirty-five computer users at the PTT Exploration and Production Public Company Limited registered to the online self-report questionnaire. The internal consistency of the five domains was: personal (alpha = 0.58), work-related (alpha = 0.348), work environment (alpha = 0.72), physical health (alpha = 0.68) and psychosocial factor (alpha = 0.93). The findings suggested that the OSCWE had acceptable internal consistency for work environment and psychosocial factors. The OSCWE is available to use in population-based survey research among computer office workers.

Toward Establishing the Validity of the Resource Interpreter's Self-Efficacy Instrument

NASA Astrophysics Data System (ADS)

Smith, Grant D.

Interpretive rangers serve as one of the major educational resources that visitors may encounter during their visit to a park or other natural area, yet our understanding of their professional growth remains limited. This study helps address this issue by developing an instrument that evaluates the beliefs of resource interpreters regarding their capabilities of communicating with the public. The resulting 11-item instrument was built around the construct of Albert Bandura's self-efficacy theory (Bandura, 1977, 1986, 1997), used guidelines and principles developed over the course of 30 years of teacher efficacy studies (Bandura, 2006; Gibson & Dembo, 1984; Riggs & Enochs, 1990; Tschannen-Moran & Hoy, 2001; Tschannen-Moran, Hoy, & Hoy, 1998), and probed areas of challenge that are unique to the demands of resource interpretation (Brochu & Merriman, 2002; Ham, 1992; Knudson, Cable, & Beck, 2003; Larsen, 2003; Tilden, 1977). A voluntary convenience sample of 364 National Park Service rangers was collected in order to conduct the statistical analyses needed to winnow the draft instrument down from 47 items in its original form to 11 items in its final state. Statistical analyses used in this process included item-total correlation, index of discrimination, exploratory factor analysis, and confirmatory factor analysis.

A Self-Report Measure of Physical Activity

ERIC Educational Resources Information Center

Siegel, Donald

2005-01-01

There are multiple approaches to measuring physical activity. Among these are direct observation, electronic monitoring, direct and indirect calorimetry, and self-report instruments. Self-report instruments are the most practical and cost effective option for use with a large group. In a study by Motl, Dishman, Dowda, and Pate (2004), two groups…

Reliability and validity of generalizable skills instruments for students who are deaf, blind, or visually impaired.

PubMed

Loeding, B L; Greenan, J P

1998-12-01

The study examined the validity and reliability of four assessments, with three instruments per domain. Domains included generalizable mathematics, communication, interpersonal relations, and reasoning skills. Participants were deaf, legally blind, or visually impaired students enrolled in vocational classes at residential secondary schools. The researchers estimated the internal consistency reliability, test-retest reliability, and construct validity correlations of three subinstruments: student self-ratings, teacher ratings, and performance assessments. The data suggest that these instruments are highly internally consistent measures of generalizable vocational skills. Four performance assessments have high-to-moderate test-retest reliability estimates, and were generally considered to possess acceptable validity and reliability.

The use of a personal digital assistant for dietary self-monitoring does not improve the validity of self-reports of energy intake.

PubMed

Yon, Bethany Ann; Johnson, Rachel K; Harvey-Berino, Jean; Gold, Beth Casey

2006-08-01

Underreporting of energy intake is a pervasive problem and resistant to improvement, especially among people with overweight and obesity. The goal of this study was to investigate whether the use of a personal digital assistant (PDA) for dietary self-monitoring would reduce underreporting prevalence and improve the validity of self-reported energy intake. Adults with overweight and obesity (n=61, 92% women, mean age 48.2 years, mean body mass index 32.3) were provided with a PalmZire 21 (Palm, Inc, Sunnyvale, CA) loaded with Calorie King's Diet Diary software (version 3.2.2, 2002, Family Health Network, Costa Mesa, CA). Subjects participated in a 24-week in-person behavioral weight control program and were asked to self-monitor their diet and exercise habits using the PDA. Basal metabolic rate and physical activity level were estimated at baseline. Energy intake from 7-day electronic food records were collected within the first month of the weight-control program. As subjects were actively losing weight, Bandini's adjustments were used to correct self-reported energy intake for weight loss. In this group, where 41% of the subjects were categorized as low-energy reporters, the use of a PDA did not improve validity of energy reporting when compared to what is reported in the literature.

A Measure for Pupils' Inconsistency of Response to a Self-Report Instrument of Attitudes toward School.

ERIC Educational Resources Information Center

Darom, Efraim; Rich, Yisrael

1983-01-01

To measure pupils' inconsistency in replying to a self-report questionnaire regarding attitudes toward school, 6,000 elementary and secondary school students participated in a nation-wide project to construct and validate the Israeli Quality of School Life Questionnaire (IQSL). (PN)

Content Validity for the VVSymQ® Instrument: A New Patient-Reported Outcome Measure for the Assessment of Varicose Veins Symptoms.

PubMed

Paty, Jean; Elash, Celeste A; Turner-Bowker, Diane M

2017-02-01

Varicose veins are common and can impact patients' quality of life, but consensus regarding the evaluation of varicose vein symptoms is lacking and existing measures have limitations. This research aimed to develop and establish the content validity of a new electronic patient-reported outcome (PRO) measure, the VVSymQ ® instrument, to assess symptoms of superficial venous insufficiency (varicose veins) in clinical trials. The development of the VVSymQ ® instrument began with qualitative interviews with patients based on the symptom domain of the VEINES-QOL/Sym, an existing PRO instrument for chronic venous disorders of the leg. Three phases of qualitative research were conducted to examine the relevance and importance of the symptoms to patients with varicose veins, and the patients' ability to understand and use the VVSymQ ® instrument. The development included evaluating questions that had 1-week and 24-h recall periods, and paper and electronic versions of the new instrument. Five symptoms (heaviness, achiness, swelling, throbbing, and itching [HASTI™]) were consistently reported by patients across all sources of qualitative data. The final version of the VVSymQ ® instrument queries patients on the HASTI™ symptoms using a 24-h recall period and a 6-point duration-based response scale ranging from "None of the time" to "All of the time," and is administered daily via an electronic diary. Cognitive interviews demonstrated varicose vein patients' understanding of and their ability to use the final version of the VVSymQ ® instrument. Content validity was established for the VVSymQ ® instrument, which assesses the five HASTI™ symptoms of varicose veins daily via an electronic diary and has promise for use in research and practice.

Convergent and Discriminant Validity of Psychopathy Factors Assessed via Self-Report: A Comparison of Three Instruments

ERIC Educational Resources Information Center

Benning, Stephen D.; Patrick, Christopher J.; Salekin, Randall T.; Leistico, Anne-Marie R.

2005-01-01

Psychopathy has been conceptualized as a personality disorder with distinctive interpersonal-affective and behavioral deviance features. The authors examine correlates of the factors of the Psychopathic Personality Inventory (PPI), Self-Report Psychopathy-II (SRP-II) scale, and Antisocial Process Screening Device (APSD) to understand similarities…

Short forms of the Schedule for Nonadaptive and Adaptive Personality (SNAP) for self- and collateral ratings: development, reliability, and validity.

PubMed

Harlan, E; Clark, L A

1999-06-01

Researchers and clinicians alike increasingly seek brief, reliable, and valid measures to obtain personality trait ratings from both selves and peers. We report the development of a paragraph-descriptor short form of a full-length personality assessment instrument, the Schedule for Nonadaptive and Adaptive Personality (SNAP) with both self- and other versions. Reliability and validity data were collected on a sample of 294 college students, from 90 of whom we also obtained parental ratings of their personality. Internal consistency reliability was good in both self- and parent data. The factorial structures of the self-report short and long forms were very similar. Convergence between parental ratings was moderately high. Self-parent convergence was variable, with lower agreement on scales assessing subjective distress than those assessing more observable behaviors; it also was stronger for higher order factors than for scales.

Continence following radical retropubic prostatectomy using self-reporting instruments.

PubMed

Lepor, Herbert; Kaci, Ledia; Xue, Xiaonan

2004-03-01

We performed a global self-assessment of continence following radical retropubic prostatectomy (RRP) and determined how this global self-assessment of continence correlates with commonly used definitions of continence. Between October 2000 and February 2002 all men who underwent RRP were encouraged to complete the University of California-Los Angeles Prostate Cancer Index 3, 6, 12 and 24 months postoperatively. Beginning October 2002 a single question capturing the patient global self-assessment of continence status was added to the postoperative continence assessment. The study design was cross-sectional since only continence surveys submitted between October 2002 through February 2003 were evaluated. Sensitivity, specificity and kappa coefficient was determined for the relationship between the patient global assessment of continence vs the definition of continence based on pad requirement, problem due to incontinence and frequency of incontinence. Continence progressively improved 3 to 24 months following RRP for all continence outcomes. At 24 months following RRP 97.1% of men considered themselves continent, while 97.1%, 94.1% and 97.1% were considered continent using continence definitions, including the requirement of no or 1 pad in a 24-hour interval, no or slight bother due to incontinence and total control or occasional dribbling, respectively. Our 3 definitions of continence derived from responses to the University of California-Los Angeles Prostate Cancer Index had excellent agreement with patient global self-assessment of continence (kappa coefficients between 0.76 and 0.83). The majority of men achieve continence without invasive intervention following RRP. Final continence status should be ascertained at 24 months. The patient global assessment of continence provides face validity for other definitions of continence based on responses to validated self-administered questionnaires.

Psychometric validation of the PROQOL-HIV questionnaire, a new health-related quality of life instrument-specific to HIV disease.

PubMed

Duracinsky, Martin; Lalanne, Christophe; Le Coeur, Sophie; Herrmann, Susan; Berzins, Baiba; Armstrong, Andrew Richard; Lau, Joseph Tak Fai; Fournier, Isabelle; Chassany, Olivier

2012-04-15

This study reports the psychometric validation of a new HIV/AIDS-specific health-related quality of life (HRQL) questionnaire, the Patient Reported Outcomes Quality of Life-HIV. The instrument was developed simultaneously across Europe, North and South America, Africa, Asia, and Australia to assess multidimensional quality of life impairments in the era of highly active antiretroviral therapy. A cross-sectional study was performed in 8 countries. The pilot 70-item questionnaire was co-administered with the HIV symptoms index, the EQ-5D and Medical Outcomes Study-HIV questionnaires. Demographic and biomedical data were collected. After item analysis and reduction, convergent discriminant concurrent validity and known-group validity were examined. Internal consistency and reliability scores were assessed using Cronbach alpha and intraclass correlation. The final sample of 791 patients was composed of 64% males (median age: 41 years, HIV diagnosis = 5 years), 13.8% were treatment naive. Item reduction yielded a 43-item form surveying 8 dimensions and 1 global health item that showed good convergent and discriminant validity and reliability (98% scaling success; Cronbach alphas 0.77-0.89). Correlations with EQ-5D and Medical Outcomes Study-HIV complied with concurrent validity expectations; likewise, correlations against the number of self-reported symptoms and depression showed good support for criterion validity. A test-retest study on French patients (n = 34) showed temporal stability (intraclass correlation coefficient = 0.86). Significant and meaningful differences of HRQL scores between countries were found. The Patient Reported Outcomes Quality of Life-HIV questionnaire is a valid and reliable instrument for assessing HRQL specific to HIV disease in different cultures and healthcare systems.

Rapid and Accurate Behavioral Health Diagnostic Screening: Initial Validation Study of a Web-Based, Self-Report Tool (the SAGE-SR)

PubMed Central

Purcell, Susan E; Rhea, Karen; Maier, Philip; First, Michael; Zweede, Lisa; Sinisterra, Manuela; Nunn, M Brad; Austin, Marie-Paule; Brodey, Inger S

2018-01-01

Background The Structured Clinical Interview for DSM (SCID) is considered the gold standard assessment for accurate, reliable psychiatric diagnoses; however, because of its length, complexity, and training required, the SCID is rarely used outside of research. Objective This paper aims to describe the development and initial validation of a Web-based, self-report screening instrument (the Screening Assessment for Guiding Evaluation-Self-Report, SAGE-SR) based on the Diagnostic and Statistical Manual of Mental Disorders, Fifth Edition (DSM-5) and the SCID-5-Clinician Version (CV) intended to make accurate, broad-based behavioral health diagnostic screening more accessible within clinical care. Methods First, study staff drafted approximately 1200 self-report items representing individual granular symptoms in the diagnostic criteria for the 8 primary SCID-CV modules. An expert panel iteratively reviewed, critiqued, and revised items. The resulting items were iteratively administered and revised through 3 rounds of cognitive interviewing with community mental health center participants. In the first 2 rounds, the SCID was also administered to participants to directly compare their Likert self-report and SCID responses. A second expert panel evaluated the final pool of items from cognitive interviewing and criteria in the DSM-5 to construct the SAGE-SR, a computerized adaptive instrument that uses branching logic from a screener section to administer appropriate follow-up questions to refine the differential diagnoses. The SAGE-SR was administered to healthy controls and outpatient mental health clinic clients to assess test duration and test-retest reliability. Cutoff scores for screening into follow-up diagnostic sections and criteria for inclusion of diagnoses in the differential diagnosis were evaluated. Results The expert panel reduced the initial 1200 test items to 664 items that panel members agreed collectively represented the SCID items from the 8 targeted

Biochemical Validation of Self-Reported Smokeless Tobacco Abstinence among Smokeless Tobacco Users: Results from a Clinical Trial of Varenicline in India.

PubMed

Jain, Raka; Jhanjee, Sonali; Jain, Veena; Gupta, Tina; Mittal, Swati; Chauhan, Prashant; Raghav, Rahul; Goelz, Patricia; Schnoll, Robert A

2015-01-01

The validity of self-reported tobacco use is often questioned given the potential for underestimation of use. This study used data from a double-blind, placebo-controlled clinical trial of varenicline for smokeless tobacco dependence in India to evaluate the accuracy of self-reported smokeless tobacco cessation using biochemical validation procedures and to evaluate correlates of reporting inaccuracy. Smokeless tobacco users attending a dental clinic at AIIMS were randomized to placebo or varenicline; all participants received counseling. Detailed smokeless tobacco use was recorded and abstinence was defined as cotinine-verified 7-day point prevalence cessation (cotinine < 50 ng/ml) and breath CO > 10 ppm at the end of 12 weeks of treatment. One-half of study completers (82/165) self-reported abstinence. Biochemical verification confirmed that (65.9%) subjects provided accurate self-reports while (34.1%) participants underreported tobacco use. These data indicate poor agreement between self-reported and biochemically confirmed abstinence (κ = -0.191). Underreporters of tobacco use had significantly higher baseline cotinine (p < 0.05), total craving (p < 0.012), and negative reinforcement craving (p < 0.001) vs. those whose self-reports were correctly verified. These findings provide evidence to support the need for biochemical validation of self-reported abstinence outcomes among smokeless tobacco users in cessation programs in India and identify high levels of pretreatment cotinine and craving levels as potential correlates of false reporting.

Validation of the ENVISAT atmospheric chemistry instruments

NASA Astrophysics Data System (ADS)

Snoeij, P.; Koopman, R.; Attema, E.; Zehner, C.; Wursteisen, P.; Dehn, A.; de Laurentius, M.; Frerick, J.; Mantovani, R.; Saavedra de Miguel, L.

Three atmospheric-chemistry sensors form part of the ENVISAT payload that has been placed into orbit in March 2002. This paper presents the ENVISAT mission status and data policy, and reviews the end-to-end performance of the GOMOS, MIPAS and SCIAMACHY observation systems and will discuss the validation aspects of these instruments. In particular, for each instrument, the review addresses mission planning, in-orbit performance, calibration, data processor algorithms and configuration, reprocessing strategy, and product quality control assessment. An important part of the quality assessment is the Geophysical Validation. At the ACVT Validation workshop held in Frascati, Italy, from 3-7 May 2004, scientists and engineers presented analyses of the exhaustive series of tests that have been run on each of ENVISAT atmospheric chemistry sensors since the spacecraft was launched in March 2002. On the basis of workshop results it was decided that most of the data products provided by the ENVISAT atmospheric chemistry instruments are ready for operational delivery. Although the main validation phase for the atmospheric instruments of ENVISAT will be completed soon, ongoing validation products will continue throughout the lifetime of the ENVISAT mission. The long-term validation phase will: Provide assurance of data quality and accuracy for applications such as climate change research Investigate the fully representative range of geophysical conditions Investigate the fully representative range of seasonal cycles Perform long term monitoring for instrumental drifts and other artefacts Validate new products. This paper will also discuss the general status of the validation activities for GOMOS, MIPAS and SCIAMACHY. The main and long-term geophysical validation programme will be presented. The flight and ground-segment planning, configuration and performance characterization will be discussed. The evolution of each of the observation systems has been distinct during the mission

The development and validation of an instrument to measure the quality of health research reports in the lay media.

PubMed

Zeraatkar, Dena; Obeda, Michael; Ginsberg, Jeffrey S; Hirsh, Jack

2017-04-20

The media serves as an important link between medical research, as reported in scholarly sources, and the public and has the potential to act as a powerful tool to improve public health. However, concerns about the reliability of health research reports have been raised. Tools to monitor the quality of health research reporting in the media are needed to identify areas of weakness in health research reporting and to subsequently work towards the efficient use of the lay media as a public health tool through which the public's health behaviors can be improved. We developed the Quality Index for health-related Media Reports (QIMR) as a tool to monitor the quality of health research reports in the lay media. The tool was developed according to themes generated from interviews with health journalists and researchers. Item and domain characteristics and scale reliability were assessed. The scale was correlated with a global quality assessment score and media report word count to provide evidence towards its construct validity. The items and domains of the QIMR demonstrated acceptable validity and reliability. Items from the 'validity' domain were negatively skewed, suggesting possible floor effect. These items were not eliminated due to acceptable content and face validity. QIMR total scores produced a strong correlation with raters' global assessment and a moderate correlation with media report word count, providing evidence towards the construct validity of the instrument. The results of this investigation indicate that QIMR can adequately measure the quality of health research reports, with acceptable reliability and validity.

Reliability and validity of the Daily Cognitive-Communication and Sleep Profile: a new instrument for monitoring sleep, wakefulness and daytime function.

PubMed

Fung, Christina Hoi Ling; Nguyen, Michelle; Moineddin, Rahim; Colantonio, Angela; Wiseman-Hakes, Catherine

2014-06-01

The Daily Cognitive Communicative and Sleep Profile (DCCASP) is a seven-item instrument that captures daily subjective sleep quality, perceived mood, cognitive, and communication functions. The objective of this study was to evaluate the reliability and validity of the DCCASP. The DCCASP was self-administered daily to a convenience sample of young adults (n = 54) for two two-week blocks, interspersed with a two-week rest period. Afterwards, participants completed the Pittsburgh Sleep Quality Index (PSQI). Internal consistency and criterion validity were calculated by Cronbach's α coefficient, Concordance Correlation Coefficient (CCC), and Spearman rank (rs) correlation coefficient, respectively. Results indicated high internal consistency (Cronbach-s α = 0.864-0.938) among mean ratings of sleep quality on the DCCASP. There were significant correlations between mean ratings of sleep quality and all domains (rs=0.38-0.55, p<0.0001). Criterion validity was established between mean sleep quality ratings on the DCCASP and PSQI (rs=0.40, p<0.001). The DCCASP is a reliable and valid self-report instrument to monitor daily sleep quality and perceived mood, cognitive, and communication functions over time, amongst a normative sample of young adults. Further studies on its psychometric properties are necessary to clarify its utility in a clinical population. Copyright © 2014 John Wiley & Sons, Ltd.

EOS-Aura's Ozone Monitoring Instrument (OMI): Validation Requirements

NASA Technical Reports Server (NTRS)

Brinksma, E. J.; McPeters, R.; deHaan, J. F.; Levelt, P. F.; Hilsenrath, E.; Bhartia, P. K.

2003-01-01

OMI is an advanced hyperspectral instrument that measures backscattered radiation in the UV and visible. It will be flown as part of the EOS Aura mission and provide data on atmospheric chemistry that is highly synergistic with other Aura instruments HIRDLS, MLS, and TES. OMI is designed to measure total ozone, aerosols, cloud information, and UV irradiances, continuing the TOMS series of global mapped products but with higher spatial resolution. In addition its hyperspectral capability enables measurements of trace gases such as SO2, NO2, HCHO, BrO, and OClO. A plan for validation of the various OM1 products is now being formulated. Validation of the total column and UVB products will rely heavily on existing networks of instruments, like NDSC. NASA and its European partners are planning aircraft missions for the validation of Aura instruments. New instruments and techniques (DOAS systems for example) will need to be developed, both ground and aircraft based. Lidar systems are needed for validation of the vertical distributions of ozone, aerosols, NO2 and possibly SO2. The validation emphasis will be on the retrieval of these products under polluted conditions. This is challenging because they often depend on the tropospheric profiles of the product in question, and because of large spatial variations in the troposphere. Most existing ground stations are located in, and equipped for, pristine environments. This is also true for almost all NDSC stations. OMI validation will need ground based sites in polluted environments and specially developed instruments, complementing the existing instrumentation.

Reliability and validity of a nutrition and physical activity environmental self-assessment for child care

PubMed Central

Benjamin, Sara E; Neelon, Brian; Ball, Sarah C; Bangdiwala, Shrikant I; Ammerman, Alice S; Ward, Dianne S

2007-01-01

Background Few assessment instruments have examined the nutrition and physical activity environments in child care, and none are self-administered. Given the emerging focus on child care settings as a target for intervention, a valid and reliable measure of the nutrition and physical activity environment is needed. Methods To measure inter-rater reliability, 59 child care center directors and 109 staff completed the self-assessment concurrently, but independently. Three weeks later, a repeat self-assessment was completed by a sub-sample of 38 directors to assess test-retest reliability. To assess criterion validity, a researcher-administered environmental assessment was conducted at 69 centers and was compared to a self-assessment completed by the director. A weighted kappa test statistic and percent agreement were calculated to assess agreement for each question on the self-assessment. Results For inter-rater reliability, kappa statistics ranged from 0.20 to 1.00 across all questions. Test-retest reliability of the self-assessment yielded kappa statistics that ranged from 0.07 to 1.00. The inter-quartile kappa statistic ranges for inter-rater and test-retest reliability were 0.45 to 0.63 and 0.27 to 0.45, respectively. When percent agreement was calculated, questions ranged from 52.6% to 100% for inter-rater reliability and 34.3% to 100% for test-retest reliability. Kappa statistics for validity ranged from -0.01 to 0.79, with an inter-quartile range of 0.08 to 0.34. Percent agreement for validity ranged from 12.9% to 93.7%. Conclusion This study provides estimates of criterion validity, inter-rater reliability and test-retest reliability for an environmental nutrition and physical activity self-assessment instrument for child care. Results indicate that the self-assessment is a stable and reasonably accurate instrument for use with child care interventions. We therefore recommend the Nutrition and Physical Activity Self-Assessment for Child Care (NAP SACC

Residents' self-reported quality of life in long-term care facilities in Canada.

PubMed

Kehyayan, Vahe; Hirdes, John P; Tyas, Suzanne L; Stolee, Paul

2015-06-01

Quality of life (QoL) of long-term care (LTC) facility residents is an important outcome of care. This cross-sectional, descriptive study examined the self-reported QoL of LTC facility residents in Canada using the interRAI Self-Report Nursing Home Quality of Life Survey instrument. A secondary purpose was to test the instrument's psychometric properties. Psychometric testing of the instrument supported its reliability and its convergent and content validity for assessing the residents' QoL. Findings showed that residents rated positively several aspects of their life, such as having privacy during visits (76.9%) and staff's being honest with them (73.6%). Residents gave lower ratings to other aspects such as autonomy, staff-resident bonding, and personal relationships. The findings point to gaps between facility philosophies of care and their translation into a care environment where care is truly resident-directed. Moreover, the findings have potential implications for resident care planning, facility programming, social policy development, and future research.

Survey Instrument Validity Part I: Principles of Survey Instrument Development and Validation in Athletic Training Education Research

ERIC Educational Resources Information Center

Burton, Laura J.; Mazerolle, Stephanie M.

2011-01-01

Context: Instrument validation is an important facet of survey research methods and athletic trainers must be aware of the important underlying principles. Objective: To discuss the process of survey development and validation, specifically the process of construct validation. Background: Athletic training researchers frequently employ the use of…

A new self-report inventory of dyslexia for students: criterion and construct validity.

PubMed

Tamboer, Peter; Vorst, Harrie C M

2015-02-01

The validity of a Dutch self-report inventory of dyslexia was ascertained in two samples of students. Six biographical questions, 20 general language statements and 56 specific language statements were based on dyslexia as a multi-dimensional deficit. Dyslexia and non-dyslexia were assessed with two criteria: identification with test results (Sample 1) and classification using biographical information (both samples). Using discriminant analyses, these criteria were predicted with various groups of statements. All together, 11 discriminant functions were used to estimate classification accuracy of the inventory. In Sample 1, 15 statements predicted the test criterion with classification accuracy of 98%, and 18 statements predicted the biographical criterion with classification accuracy of 97%. In Sample 2, 16 statements predicted the biographical criterion with classification accuracy of 94%. Estimations of positive and negative predictive value were 89% and 99%. Items of various discriminant functions were factor analysed to find characteristic difficulties of students with dyslexia, resulting in a five-factor structure in Sample 1 and a four-factor structure in Sample 2. Answer bias was investigated with measures of internal consistency reliability. Less than 20 self-report items are sufficient to accurately classify students with and without dyslexia. This supports the usefulness of self-assessment of dyslexia as a valid alternative to diagnostic test batteries. Copyright © 2015 John Wiley & Sons, Ltd.

Psychometric Validation Study of the Liebowitz Social Anxiety Scale - Self-Reported Version for Brazilian Portuguese

PubMed Central

Forni dos Santos, Larissa; Loureiro, Sonia Regina; Crippa, José Alexandre de Souza; Osório, Flávia de Lima

2013-01-01

Social Anxiety Disorder (SAD) is prevalent and rarely diagnosed due to the difficulty in recognizing its symptoms as belonging to a disorder. Therefore, the evaluation/screening scales are of great importance for its detection, with the most used being the Liebowitz Social Anxiety Scale (LSAS). Thus, this study proposed to evaluate the psychometric properties of internal consistency and convergent validity, as well as the confirmatory factorial analysis and reliability of the self-reported version of the LSAS (LSAS-SR), translated into Brazilian Portuguese, in a sample of the general population (N = 413) and in a SAD clinical sample (N = 252). The convergent validity with specific scales for the evaluation of SAD and a general anxiety scale presented correlations ranging from 0.21 to 0.84. The confirmatory factorial analysis did not replicate the previously indicated findings of the literature, with the difficulty being in obtaining a consensus factorial structure common to the diverse cultures in which the instrument was studied. The LSAS-SR presented excellent internal consistency (α = 0.90–0.96) and test-retest reliability (Intraclass Correlation Coefficient = 0.81; Pearson’s = 0.82). The present findings support those of international studies that attest to the excellent psychometric properties of the LSAS-SR, endorsing its status as the gold standard. PMID:23922961

Psychometric Properties of the Arabic Version of the Summary of Diabetes Self-Care Activities Instrument.

PubMed

Sukkarieh-Haraty, Ola; Howard, Elizabeth

2016-01-01

Translation of instruments needs to ensure equivalence between the source and the target language to establish the psychometric properties of the translated version. The purpose of this study was to examine the psychometric properties of the Arabic version of the Summary of Diabetes Self-Care Activities (SDSCA) instrument. The 12-item English version of the SDSCA was translated into Arabic using back translation on a sample of 140 Lebanese participants with Type 2 diabetes. Construct validity was measured using exploratory factor analysis with varimax rotation. Multitrait scaling analysis was used to test for item convergent and discriminant validity based on item-scale correlations. Conceptual and content validity were examined by an expert panel in diabetes. Internal consistency reliability R was assessed using interitem correlations. The average interitem correlation for the four subscales ranged between--.05 for Diet and .66 for Glucose Testing. Factor analysis identified four factors which accounted for 60% of the variance. The preliminary results of Summary of Diabetes Self-Care Activities-Arabic Version (SDSCA-Ar) are comparable to the psychometric properties the original SDSCA. SDSCA-Ar is a valid measure of diabetes self-care in Lebanese patients with diabetes.

The Development of a Physical Education Teachers' Physical Activity Self-Efficacy Instrument.

ERIC Educational Resources Information Center

Martin, Jeffrey J.; Kulinna, Pamela Hodges

2003-01-01

Developed a valid, reliable physical education teachers' physical activity self-efficacy scale for teaching classes in which students were engaged in high levels of physical activity. Results offer preliminary support for the psychometric properties of this instrument, which can help understand physical education teachers' efficacy in overcoming…

Biomarker validation of self-reported sex among middle-aged female sex workers in China.

PubMed

Guida, Jennifer; Fukunaga, Ami; Liu, Hongjie

2017-03-01

The objective of this study was to examine information bias arising from self-reported sexual activity and its association with syphilitic infections among female sex workers (FSWs) aged 35 years and older in China. A questionnaire was administered to 1245 middle-aged FSWs. Respondents self-reported sexual intercourse in the past 48 hours. The prostate-specific antigen test was used to verify self-reported sexual activity. FSWs were considered discordant if they indicated no sexual intercourse in the past 48 hours on the questionnaire and had a positive prostate-specific antigen test. Logistic regression was used to assess the associations between discordance and syphilis. Three hundred twenty FSWs self-reported no engagement in sexual intercourse in the past 48 hours. One-fourth of respondents (25%) were discordant. Twenty-two percent and 35.8% of discordant FSWs tested positive for active and prevalent syphilis, respectively. After adjusting for confounders, discordant FSWs had 3.8 times the odds of active syphilis (95% confidence interval: 1.52-9.30) and 2.6 times the odds of prevalent syphilis (95% confidence interval: 1.37-5.02), compared with concordant FSWs. FSWs who had active or prevalent syphilis were more likely to be discordant. Data collected via self-reported questionnaire may not be a valid tool to assess sexual behavior. Copyright © 2017 Elsevier Inc. All rights reserved.

An international prospective cohort study of mobile phone users and health (COSMOS): Factors affecting validity of self-reported mobile phone use.

PubMed

Toledano, Mireille B; Auvinen, Anssi; Tettamanti, Giorgio; Cao, Yang; Feychting, Maria; Ahlbom, Anders; Fremling, Karin; Heinävaara, Sirpa; Kojo, Katja; Knowles, Gemma; Smith, Rachel B; Schüz, Joachim; Johansen, Christoffer; Poulsen, Aslak Harbo; Deltour, Isabelle; Vermeulen, Roel; Kromhout, Hans; Elliott, Paul; Hillert, Lena

2018-01-01

This study investigates validity of self-reported mobile phone use in a subset of 75 993 adults from the COSMOS cohort study. Agreement between self-reported and operator-derived mobile call frequency and duration for a 3-month period was assessed using Cohen's weighted Kappa (κ). Sensitivity and specificity of both self-reported high (≥10 calls/day or ≥4h/week) and low (≤6 calls/week or <30min/week) mobile phone use were calculated, as compared to operator data. For users of one mobile phone, agreement was fair for call frequency (κ=0.35, 95% CI: 0.35, 0.36) and moderate for call duration (κ=0.50, 95% CI: 0.49, 0.50). Self-reported low call frequency and duration demonstrated high sensitivity (87% and 76% respectively), but for high call frequency and duration sensitivity was lower (38% and 56% respectively), reflecting a tendency for greater underestimation than overestimation. Validity of self-reported mobile phone use was lower in women, younger age groups and those reporting symptoms during/shortly after using a mobile phone. This study highlights the ongoing value of using self-report data to measure mobile phone use. Furthermore, compared to continuous scale estimates used by previous studies, categorical response options used in COSMOS appear to improve validity considerably, most likely by preventing unrealistically high estimates from being reported. Copyright © 2017 Elsevier GmbH. All rights reserved.

Construct validity of the Chinese version of the Self-care of Heart Failure Index determined using structural equation modeling.

PubMed

Kang, Xiaofeng; Dennison Himmelfarb, Cheryl R; Li, Zheng; Zhang, Jian; Lv, Rong; Guo, Jinyu

2015-01-01

The Self-care of Heart Failure Index (SCHFI) is an empirically tested instrument for measuring the self-care of patients with heart failure. The aim of this study was to develop a simplified Chinese version of the SCHFI and provide evidence for its construct validity. A total of 182 Chinese with heart failure were surveyed. A 2-step structural equation modeling procedure was applied to test construct validity. Factor analysis showed 3 factors explaining 43% of the variance. Structural equation model confirmed that self-care maintenance, self-care management, and self-care confidence are indeed indicators of self-care, and self-care confidence was a positive and equally strong predictor of self-care maintenance and self-care management. Moreover, self-care scores were correlated with the Partners in Health Scale, indicating satisfactory concurrent validity. The Chinese version of the SCHFI is a theory-based instrument for assessing self-care of Chinese patients with heart failure.

Social Desirability Bias in Self-Reporting of Hearing Protector Use among Farm Operators

PubMed Central

McCullagh, Marjorie C.; Rosemberg, Marie-Anne

2015-01-01

Objective: The purposes of this study were (i) to examine the relationship between reported hearing protector use and social desirability bias, and (ii) to compare results of the Marlowe-Crowne social desirability instrument when administered using two different methods (i.e. online and by telephone). Methods: A shortened version of the Marlowe-Crowne social desirability instrument, as well as a self-administered instrument measuring use of hearing protectors, was administered to 497 participants in a study of hearing protector use. The relationship between hearing protector use and social desirability bias was examined using regression analysis. The results of two methods of administration of the Marlowe-Crowne social desirability instrument were compared using t-tests and regression analysis. Results: Reliability (using Cronbach’s alpha) for the shortened seven-item scale for this sample was 0.58. There was no evidence of a relationship between reported hearing protector use and social desirability reporting bias, as measured by the shortened Marlowe-Crowne. The difference in results by method of administration (i.e. online, telephone) was very small. Conclusions: This is the first published study to measure social desirability bias in reporting of hearing protector use among farmers. Findings of this study do not support the presence of social desirability bias in farmers’ reporting of hearing protector use, lending support for the validity of self-report in hearing protector use in this population. PMID:26209595

The validity of self-reported leisure time physical activity, and its relationship to serum cholesterol, blood pressure and body mass index. A population based study of 332,182 men and women aged 40-42 years.

PubMed

Aires, Nibia; Selmer, Randi; Thelle, Dag

2003-01-01

The importance of leisure time physical activity as a health indicator became more obvious after the results of large prospective studies were published. The validity of these results depends upon both the selection of the active individuals and to what extent self-reported physical activity reflects the individual's true activity. The purpose of this paper is to describe the changes in self-reported physical activity, and to assess the relation between this variable and other biological risk factors such as blood lipids, blood pressure and body mass index (BMI). This report also aims at corroborating the validity of self-reported physical activity by assessing the consistency of the associations between these biological risk factors and physical activity during a 25-years period. The basis for this analysis is a long lasting observational study with a questionnaire as the most important research instrument, in addition to physiological and biological factors such as BMI, blood pressure and blood lipids. The study population consists of 332,182 individuals, aged 40-42 from different counties in Norway who were invited to participate in health survey during 1974-1999. The objectives of this study are (1) to describe changes in self-reported physical activity from 1974 to 1999; (2) to assess the relation between physical activity and the biological variables; and (3) to corroborate the validity of the variable physical activity by assessing the consistency of the above analysis. The results of the analyses of association between decade of birth and self-reported physical activity show that physical activity among 40-aged individuals decreased during 1974-1999. This trend is stronger among the men. Multivariate analyses revealed differences in BMI and serum cholesterol between levels of self-reported physical activity, gender, smoking habits and decade of birth. The explained percentage of the total variance ranged from 6% for BMI to 7% for serum cholesterol. The

Register of Validated Short Dietary Assessment Instruments

Cancer.gov

The register contains descriptive information about the instruments identified (over 135) along with any associated validation studies and publications, and copies of the instruments themselves when available.

Corporate Entrepreneurship Assessment Instrument (CEAI): Systematic Validation of a Measure

DTIC Science & Technology

2006-03-01

CORPORATE ENTREPRENEURSHIP ASSESSMENT INSTRUMENT (CEAI): SYSTEMATIC VALIDATION OF A MEASURE THESIS...the United States Government. AFIT/GIR/ENV/06M-05 CORPORATE ENTREPRENEURSHIP ASSESSMENT INSTRUMENT (CEAI): SYSTEMATIC VALIDATION...DISTRIBUTION UNLIMITED. AFIT/GIR/ENV/06M-05 CORPORATE ENTREPRENEURSHIP ASSESSMENT INSTRUMENT (CEAI): SYSTEMATIC VALIDATION OF A MEASURE

How young can children reliably and validly self-report their health-related quality of life?: an analysis of 8,591 children across age subgroups with the PedsQL 4.0 Generic Core Scales.

PubMed

Varni, James W; Limbers, Christine A; Burwinkle, Tasha M

2007-01-03

size range. The results demonstrate that children as young as the 5 year old age subgroup can reliably and validly self-report their HRQOL when given the opportunity to do so with an age-appropriate instrument. These analyses are consistent with recent FDA guidelines which require instrument development and validation testing for children and adolescents within fairly narrow age groupings and which determine the lower age limit at which children can provide reliable and valid responses across age categories.

Developing an interactive mobile phone self-report system for self-management of hypertension. Part 2: content validity and usability.

PubMed

Bengtsson, Ulrika; Kjellgren, Karin; Höfer, Stefan; Taft, Charles; Ring, Lena

2014-10-01

Self-management support tools using technology may improve adherence to hypertension treatment. There is a need for user-friendly tools facilitating patients' understanding of the interconnections between blood pressure, wellbeing and lifestyle. This study aimed to examine comprehension, comprehensiveness and relevance of items, and further to evaluate the usability and reliability of an interactive hypertension-specific mobile phone self-report system. Areas important in supporting self-management and candidate items were derived from five focus group interviews with patients and healthcare professionals (n = 27), supplemented by a literature review. Items and response formats were drafted to meet specifications for mobile phone administration and were integrated into a mobile phone data-capture system. Content validity and usability were assessed iteratively in four rounds of cognitive interviews with patients (n = 21) and healthcare professionals (n = 4). Reliability was examined using a test-retest. Focus group analyses yielded six areas covered by 16 items. The cognitive interviews showed satisfactory item comprehension, relevance and coverage; however, one item was added. The mobile phone self-report system was reliable and perceived easy to use. The mobile phone self-report system appears efficiently to capture information relevant in patients' self-management of hypertension. Future studies need to evaluate the effectiveness of this tool in improving self-management of hypertension in clinical practice.

The validity of self-reported vs. measured body weight and height and the effect of self-perception.

PubMed

Gokler, Mehmet Enes; Bugrul, Necati; Sarı, Ahu Ozturk; Metintas, Selma

2018-01-01

The objective was to assess the validity of self-reported body weight and height and the possible influence of self-perception of body mass index (BMI) status on the actual BMI during the adolescent period. This cross sectional study was conducted on 3918 high school students. Accurate BMI perception occurred when the student's self-perception of their BMI status did not differ from their actual BMI based on measured height and weight. Agreement between the measured and self-reported body height and weight and BMI values was determined using the Bland-Altman metod. To determine the effects of "a good level of agreement", hierarchical logistic regression models were used. Among male students who reported their BMI in the normal region, 2.8% were measured as overweight while 0.6% of them were measured as obese. For females in the same group, these percentages were 1.3% and 0.4% respectively. Among male students who perceived their BMI in the normal region, 8.5% were measured as overweight while 0.4% of them were measured as obese. For females these percentages were 25.6% and 1.8% respectively. According to logistic regression analysis, residence and accurate BMI perception were significantly associated with "good agreement" ( p ≤ 0.001). The results of this study demonstrated that in determining obesity and overweight statuses, non-accurate weight perception is a potential risk for students.

Design and validation of a three-instrument toolkit for the assessment of competence in electrocardiogram rhythm recognition.

PubMed

Hernández-Padilla, José M; Granero-Molina, José; Márquez-Hernández, Verónica V; Suthers, Fiona; López-Entrambasaguas, Olga M; Fernández-Sola, Cayetano

2017-06-01

Rapid and accurate interpretation of cardiac arrhythmias by nurses has been linked with safe practice and positive patient outcomes. Although training in electrocardiogram rhythm recognition is part of most undergraduate nursing programmes, research continues to suggest that nurses and nursing students lack competence in recognising cardiac rhythms. In order to promote patient safety, nursing educators must develop valid and reliable assessment tools that allow the rigorous assessment of this competence before nursing students are allowed to practise without supervision. The aim of this study was to develop and psychometrically evaluate a toolkit to holistically assess competence in electrocardiogram rhythm recognition. Following a convenience sampling technique, 293 nursing students from a nursing faculty in a Spanish university were recruited for the study. The following three instruments were developed and psychometrically tested: an electrocardiogram knowledge assessment tool (ECG-KAT), an electrocardiogram skills assessment tool (ECG-SAT) and an electrocardiogram self-efficacy assessment tool (ECG-SES). Reliability and validity (content, criterion and construct) of these tools were meticulously examined. A high Cronbach's alpha coefficient demonstrated the excellent reliability of the instruments (ECG-KAT=0.89; ECG-SAT=0.93; ECG-SES=0.98). An excellent context validity index (scales' average content validity index>0.94) and very good criterion validity were evidenced for all the tools. Regarding construct validity, principal component analysis revealed that all items comprising the instruments contributed to measure knowledge, skills or self-efficacy in electrocardiogram rhythm recognition. Moreover, known-groups analysis showed the tools' ability to detect expected differences in competence between groups with different training experiences. The three-instrument toolkit developed showed excellent psychometric properties for measuring competence in

Development and psychometric validation of the Nausea/Vomiting Symptom Assessment patient-reported outcome (PRO) instrument for adults with secondary hyperparathyroidism.

PubMed

McHorney, Colleen A; Bensink, Mark E; Burke, Laurie B; Belozeroff, Vasily; Gwaltney, Chad

2017-01-01

We developed the Nausea/Vomiting Symptom Assessment (NVSA © ) patient-reported outcome (PRO) instrument to capture patients' experience with nausea and vomiting while on calcimimetic therapy to treat secondary hyperparathyroidism (SHPT) related to end-stage kidney disease. This report summarizes the content validity and psychometric validation of the NVSA © . The two NVSA © items were drafted by two health outcomes researchers, one medical development lead, and one regulatory lead: it yields three scores: the number of days of vomiting or nausea per week, the number of vomiting episodes per week, and the mean severity of nausea. An eight-week prospective observational study was conducted at ten dialysis centers in the U.S. with 91 subjects. Criterion measures included in the study were the Functional Living Index-Emesis, Kidney Disease Quality of Life Instrument, EQ-5D-5 L, Static Patient Global Assessment, and Patient Global Rating of Change. Analyses included assessment of score distributions, convergent and known-groups validity, test-retest reliability, ability to detect change, and thresholds for meaningful change. Qualitative interviews verified that the NVSA © captures relevant aspects of nausea and vomiting. Patients understood the NVSA © instructions, items, and response scales. Correlations between the NVSA © and related and unrelated measures indicated strong convergent and discriminant validity, respectively. Mean differences between externally-defined vomiting/nausea groups supported known-groups validity. The scores were stable in subjects who reported no change on the Patient Global Rating of Change indicating sufficient test-retest reliability. The no-change group had mean differences and effect sizes close to zero; mean differences were mostly positive for a worsening group and mostly negative for the improvement group with predominantly medium or large effect sizes. Preliminary thresholds for meaningful worsening were 0.90 days for number

Psychometric instrumentation: reliability and validity of instruments used for clinical practice, evidence-based practice projects and research studies.

PubMed

Mayo, Ann M

2015-01-01

It is important for CNSs and other APNs to consider the reliability and validity of instruments chosen for clinical practice, evidence-based practice projects, or research studies. Psychometric testing uses specific research methods to evaluate the amount of error associated with any particular instrument. Reliability estimates explain more about how well the instrument is designed, whereas validity estimates explain more about scores that are produced by the instrument. An instrument may be architecturally sound overall (reliable), but the same instrument may not be valid. For example, if a specific group does not understand certain well-constructed items, then the instrument does not produce valid scores when used with that group. Many instrument developers may conduct reliability testing only once, yet continue validity testing in different populations over many years. All CNSs should be advocating for the use of reliable instruments that produce valid results. Clinical nurse specialists may find themselves in situations where reliability and validity estimates for some instruments that are being utilized are unknown. In such cases, CNSs should engage key stakeholders to sponsor nursing researchers to pursue this most important work.

Rapid and Accurate Behavioral Health Diagnostic Screening: Initial Validation Study of a Web-Based, Self-Report Tool (the SAGE-SR).

PubMed

Brodey, Benjamin; Purcell, Susan E; Rhea, Karen; Maier, Philip; First, Michael; Zweede, Lisa; Sinisterra, Manuela; Nunn, M Brad; Austin, Marie-Paule; Brodey, Inger S

2018-03-23

The Structured Clinical Interview for DSM (SCID) is considered the gold standard assessment for accurate, reliable psychiatric diagnoses; however, because of its length, complexity, and training required, the SCID is rarely used outside of research. This paper aims to describe the development and initial validation of a Web-based, self-report screening instrument (the Screening Assessment for Guiding Evaluation-Self-Report, SAGE-SR) based on the Diagnostic and Statistical Manual of Mental Disorders, Fifth Edition (DSM-5) and the SCID-5-Clinician Version (CV) intended to make accurate, broad-based behavioral health diagnostic screening more accessible within clinical care. First, study staff drafted approximately 1200 self-report items representing individual granular symptoms in the diagnostic criteria for the 8 primary SCID-CV modules. An expert panel iteratively reviewed, critiqued, and revised items. The resulting items were iteratively administered and revised through 3 rounds of cognitive interviewing with community mental health center participants. In the first 2 rounds, the SCID was also administered to participants to directly compare their Likert self-report and SCID responses. A second expert panel evaluated the final pool of items from cognitive interviewing and criteria in the DSM-5 to construct the SAGE-SR, a computerized adaptive instrument that uses branching logic from a screener section to administer appropriate follow-up questions to refine the differential diagnoses. The SAGE-SR was administered to healthy controls and outpatient mental health clinic clients to assess test duration and test-retest reliability. Cutoff scores for screening into follow-up diagnostic sections and criteria for inclusion of diagnoses in the differential diagnosis were evaluated. The expert panel reduced the initial 1200 test items to 664 items that panel members agreed collectively represented the SCID items from the 8 targeted modules and DSM criteria for the covered

Validation of self-reported breast and cervical cancer screening tests among low-income minority women.

PubMed

Paskett, E D; Tatum, C M; Mack, D W; Hoen, H; Case, L D; Velez, R

1996-09-01

The objective of the Forsyth County Cancer Screening Project is to assess barriers to breast and cervical cancer screening among low-income women and to develop an educational program to address these barriers. To properly assess the barriers, it was first necessary to determine if self-reported rates of breast and cervical cancer screening were accurate. All women who participated in the baseline survey (n = 555) were asked to provide information regarding if, where, and when they had obtained mammograms and Pap smears. Identified health care facilities were then contacted to verify this information. Approximately 80% of responses were verified for at least one of the exams with the information provided. For mammography, 77% of self-reports were correct, whereas 67% of self-reports of Pap smear screening were correct (kappa = 0.54 and 0.15, respectively). For both tests, women thought they had received them more recently than they actually had, by an average of 3 months for mammography and 23 months for Pap smears. Using validated reports of screening did not substantially change identified predictors of screening for mammography. For Pap smear screening, however, most of the identified predictors of screening became nonsignificant when medical chart reports were used instead of self-reports, suggesting that caution should be used in relying on self-reports to design programs to improve cervical cancer screening practices.

Validity and reliability of a brief self-reported questionnaire assessing fruit and vegetable consumption among pregnant women.

PubMed

Vézina-Im, Lydi-Anne; Godin, Gaston; Couillard, Charles; Perron, Julie; Lemieux, Simone; Robitaille, Julie

2016-09-15

Short instruments measuring frequency of specific foods, such as fruit and vegetable (FV), are increasingly used in interventions. The objective of the study was to verify the validity and test-retest reliability of such an instrument among pregnant women. Pregnant women from the region of Quebec City, Quebec, Canada, were recruited through e-mails sent to female students and employees of the local university from October 2014 to April 2015. To assess the validity of the fruit and vegetable questionnaire (FVQ) developed by Godin et al. (Can J Public Health 99: 494-498, 2008), pregnant women were asked in a first mailing to complete the FVQ assessing FV intake over the past 7 days and a 3-day estimated food record. A subsample (n = 33) also gave a fasting blood sample and completed a validated semi-quantitative FFQ administered by a trained registered dietitian during a visit at the research center. FV intakes for all instruments were calculated in terms of servings of FV based on Canada's Food Guide definition of a serving of fruit or vegetable. In order to assess its test-retest reliability, respondents were asked to complete the FVQ 14 days later in a second mailing. Forty-eight pregnant women from all three trimesters completed the questionnaires in the first mailing. FV intake assessed using the FVQ was correlated to FV consumption measured using the food record (r = 0.34, p = 0.0180) and the FFQ (r = 0.61, p = 0.0002). Results were similar when controlling for energy intake and the experience of nausea in the past month. Only β-cryptoxanthin was significantly correlated to FV intake assessed by the FFQ when adjusted for the presence of nausea (r = 0.35, p = 0.0471). Data on the test-retest reliability was available for 44 women and the intra-class coefficient for the FVQ was 0.72 at a mean 28-day interval. The FVQ has acceptable validity and test-retest reliability values, but seems to underestimate FV servings in pregnant women

The validity of self-reported cancer screening history and the role of social disadvantage in Ontario, Canada.

PubMed

Lofters, Aisha; Vahabi, Mandana; Glazier, Richard H

2015-01-29

Self-report may not be an accurate method of determining cervical, breast and colorectal cancer screening rates due to recall, acquiescence and social desirability biases, particularly for certain sociodemographic groups. Therefore, the aims of this study were to determine the validity of self-report of cancer screening in Ontario, Canada, both for people in the general population and for socially disadvantaged groups based on immigrant status, ethnicity, education, income, language ability, self-rated health, employment status, age category (for cervical cancer screening), and gender (for fecal occult blood testing). We linked multiple data sources for this study, including the Canadian Community Health Survey and provincial-level health databases. Using administrative data as our gold standard, we calculated validity measures for self-report (i.e. sensitivity, specificity, positive and negative likelihood ratios, positive and negative predictive values), calculated report-to-record ratios, and conducted a multivariable regression analysis to determine which characteristics were independently associated with over-reporting of screening. Specificity was less than 70% overall and for all subgroups for cervical and breast cancer screening, and sensitivity was lower than 80% overall and for all subgroups for fecal occult blood testing FOBT. Report-to-record ratios were persistently significantly greater than 1 across all cancer screening types, highest for the FOBT group: 1.246 [1.189-1.306]. Regression analyses showed no consistent patterns, but sociodemographic characteristics were associated with over-reporting for each screening type. We have found that in Ontario, as in other jurisdictions, there is a pervasive tendency for people to over-report their cancer screening histories. Sociodemographic status also appears to influence over-reporting. Public health practitioners and policymakers need to be aware of the limitations of self-report and adjust their methods

The Validation of a Software Evaluation Instrument.

ERIC Educational Resources Information Center

Schmitt, Dorren Rafael

This study, conducted at six southern universities, analyzed the validity and reliability of a researcher developed instrument designed to evaluate educational software in secondary mathematics. The instrument called the Instrument for Software Evaluation for Educators uses measurement scales, presents a summary section of the evaluation, and…

Measuring stigma in children receiving mental health treatment: Validation of the Paediatric Self-Stigmatization Scale (PaedS).

PubMed

Kaushik, A; Papachristou, E; Dima, D; Fewings, S; Kostaki, E; Ploubidis, G B; Kyriakopoulos, M

2017-06-01

Research on the impact of stigma associated with mental illness in children is scarce. Considering the known negative effects of stigma associated with mental illness in adults, it is crucial to explore the stigma experienced by children who access mental health treatment. However, no scale measuring self-stigmatization in younger children is available to date. This study aimed to develop and validate such a scale, the Paediatric Self-Stigmatization Scale (PaedS). A total of 156 children (119 receiving outpatient and 37 receiving inpatient treatment), aged 8-12 years, completed the PaedS, the Self-Perception Profile for Children and the Pediatric Quality of Life Inventory (PedsQL - Child Report, ages 8-12). In addition, parents completed the PedsQL (Parent Report for Children, ages 8-12), the Strengths and Difficulties Questionnaire (SDQ) and a modified subscale of the PaedS measuring the children's rejection by others due to their mental health difficulties. A confirmatory factor analysis showed that a four-factor structure, comprising Societal Devaluation, Personal Rejection, Self-Stigma and Secrecy scales, had excellent fit to the data (CFI=0.95; TLI=0.95; RMSEA=0.05). Child-reported PaedS scores were positively correlated with parental-reported PaedS scores and negatively with PedsQL, the SDQ, and 5 out of 6 subscales of the Self-Perception Profile for Children, suggesting adequate convergent validity (all P-values<0.05). The PaedS is a valid instrument, which is hoped to advance the understanding of self-stigmatization in children with mental health difficulties and contribute to its prevention. Copyright © 2017 Elsevier Masson SAS. All rights reserved.

Assessing local instrument reliability and validity: a field-based example from northern Uganda.

PubMed

Betancourt, Theresa S; Bass, Judith; Borisova, Ivelina; Neugebauer, Richard; Speelman, Liesbeth; Onyango, Grace; Bolton, Paul

2009-08-01

This paper presents an approach for evaluating the reliability and validity of mental health measures in non-Western field settings. We describe this approach using the example of our development of the Acholi psychosocial assessment instrument (APAI), which is designed to assess depression-like (two tam, par and kumu), anxiety-like (ma lwor) and conduct problems (kwo maraco) among war-affected adolescents in northern Uganda. To examine the criterion validity of this measure in the absence of a traditional gold standard, we derived local syndrome terms from qualitative data and used self reports of these syndromes by indigenous people as a reference point for determining caseness. Reliability was examined using standard test-retest and inter-rater methods. Each of the subscale scores for the depression-like syndromes exhibited strong internal reliability ranging from alpha = 0.84-0.87. Internal reliability was good for anxiety (0.70), conduct problems (0.83), and the pro-social attitudes and behaviors (0.70) subscales. Combined inter-rater reliability and test-retest reliability were good for most subscales except for the conduct problem scale and prosocial scales. The pattern of significant mean differences in the corresponding APAI problem scale score between self-reported cases vs. noncases on local syndrome terms was confirmed in the data for all of the three depression-like syndromes, but not for the anxiety-like syndrome ma lwor or the conduct problem kwo maraco.

Validation of an Instrument to Measure Community College Student Satisfaction

ERIC Educational Resources Information Center

Zhai, Lijuan

2012-01-01

This article reports the development and validation of a survey instrument to measure community college students' satisfaction with their educational experiences. The initial survey included 95 questions addressing community college student experiences. Data were collected from 558 community college students during spring of 2001. An exploratory…

Racial differences in the validity of self-reported drug use among men who have sex with men in Atlanta, GA.

PubMed

White, Darcy; Rosenberg, Eli S; Cooper, Hannah L F; del Rio, Carlos; Sanchez, Travis H; Salazar, Laura F; Sullivan, Patrick S

2014-05-01

Men who have sex with men (MSM), particularly young black MSM, are disproportionately affected in the United States' HIV epidemic. Drug use may contribute to these disparities, yet previous studies have failed to provide evidence of elevated use among black MSM, relying exclusively on self-reported usage. This study uses biological assays to validate self-reports of drug use and explore the potential for misclassification to distort findings on racial patterns of use in this population. From an Atlanta-based cohort study of 454 black and 349 white MSM from 2010 to 2012, participants' self-reported drug use was compared to urine drug screening findings. The sensitivity of self-report was calculated as the proportion reporting recent usage among those who screened positive. Multivariable regression models were constructed to examine racial patterns in self-report, urine-detection, and self-report sensitivity of marijuana and cocaine usage, adjusted for socio-demographic factors. In analyses that adjusted for age, education, income, sexual orientation, and history of arrest, black MSM were less likely to report recent use of marijuana (P<0.001) and cocaine (P=0.02), but equally likely to screen positive for either drug. This discrepancy between self-reported and urine-detected drug use was explained by significantly lower sensitivity of self-report for black participants (P<0.001 for marijuana, P<0.05 for cocaine). The contribution of individual drug-related risk behaviors to the HIV disparities between black and white MSM should be revisited with methods that validate self-reports of illegal drug use. Copyright © 2014 Elsevier Ireland Ltd. All rights reserved.

Integrating Validity Theory with Use of Measurement Instruments in Clinical Settings

PubMed Central

Kelly, P Adam; O'Malley, Kimberly J; Kallen, Michael A; Ford, Marvella E

2005-01-01

Objective To present validity concepts in a conceptual framework useful for research in clinical settings. Principal Findings We present a three-level decision rubric for validating measurement instruments, to guide health services researchers step-by-step in gathering and evaluating validity evidence within their specific situation. We address construct precision, the capacity of an instrument to measure constructs it purports to measure and differentiate from other, unrelated constructs; quantification precision, the reliability of the instrument; and translation precision, the ability to generalize scores from an instrument across subjects from the same or similar populations. We illustrate with specific examples, such as an approach to validating a measurement instrument for veterans when prior evidence of instrument validity for this population does not exist. Conclusions Validity should be viewed as a property of the interpretations and uses of scores from an instrument, not of the instrument itself: how scores are used and the consequences of this use are integral to validity. Our advice is to liken validation to building a court case, including discovering evidence, weighing the evidence, and recognizing when the evidence is weak and more evidence is needed. PMID:16178998

Validation of internet-based self-reported anthropometric, demographic data and participant identity in the Food4Me study

USDA-ARS?s Scientific Manuscript database

BACKGROUND In e-health intervention studies, there are concerns about the reliability of internet-based, self-reported (SR) data and about the potential for identity fraud. This study introduced and tested a novel procedure for assessing the validity of internet-based, SR identity and validated anth...

Self Validation of Radiance Measurements from the CERES (TRMM)Instrument

NASA Technical Reports Server (NTRS)

Paden, Jack; Pandey, Dhirendra K.; Lee, Robert B., III; Priestley, Kory J.

1999-01-01

Eight continuous months of earth-nadir-viewing radiance measurements from the 3-channel Tropical Rainfall Measuring Mission (TRMM,) Clouds and the Earth's Radiant Energy System (CERES) scanning radiometric measurement instrument, have been analyzed. While previous remote sensing satellites, such as the Earth Radiation Budget Experiment (ERBE) covered all subsets of the broadband radiance spectrum (total, longwave and shortwave.) CERES has two subset channels (window and shortwave) which do not give continuous frequency coverage over the total band. Previous experience with ERBE indicated the need for us to model the equivalent daytime longwave radiance using a window channel regression, which will allow us to validate the performance of the instrument using a three-channel inter-comparison. Limiting our consideration to the fixed azimuth plane, cross-track, scanning mode (FAPS), each nadir-viewing measurement was averaged into three subjective categories called daytime, nighttime, and twilight. Daytime was defined as any measurement taken when the solar zenith angle (SZA) was less than 90 ; nighttime was taken to be any measurement where the SZA was greater than 117 ; and twilight was everything else. Our analysis indicates that there are only two distinct categories of nadir-view data; daytime, and non-daytime (i.e., the union of the nighttime and twilight sets); and that the CERES longwave radiance is predictable to an accuracy of 1%, based on the SZA, and window channel measurements.

Validity of a Self-Administered 3-Day Physical Activity Recall in Young Adults

ERIC Educational Resources Information Center

Han, Jennifer L.; Dinger, Mary K.

2009-01-01

Background: Most physical activity recall questionnaires assess activity over a 7-day period. However, questionnaires have been validated in adolescents and adults using shorter recall timeframes. Purpose: The purpose of this study was to assess the validity of a self-administered 3-day physical activity recall instrument (3DR) in young adults.…

Comparative validation of self-report measures of negative attitudes towards Aboriginal Australians and Torres Strait Islanders.

PubMed

Skinner, Timothy C; Blick, Julie; Coffin, Juli; Dudgeon, Pat; Forrest, Simon; Morrison, David

2013-01-01

This study sought to determine the construct validity of two self-report measures of attitudes towards Aboriginal Australians and Torres Strait Islanders against an implicit measure of attitude. Total of 102 volunteer participants completed the three measures in a randomized order. The explicit measures of prejudice towards Aboriginal Australians were the Modern Racism Scale (MRS) and the Attitudes Towards Indigenous Australians Scale (ATIAS). The implicit attitudes measure was an adaptation of the Implicit Association Test (IAT) and utilised simple drawn head-and-shoulder images of Aboriginal Australians and White Australians as the stimuli. Both explicit measures and implicit measure varied in the extent to which negative prejudicial attitudes were held by participants, and the corresponding construct validities were unimpressive. The MRS was significantly correlated with the IAT, (r =.314;p<.05) where the ATIAS was not significantly correlated with IAT scores (r =.12). Of the two self-report measures of attitudes towards Aboriginal Australians, only the MRS evidenced validity when compared with the use of an implicit attitude measure.

Development of a valid measurement instrument to understand self-regulatory driving practices among older drivers in Malaysia.

PubMed

Yeoh, Sok Foon; Ibrahim, Rahimah; Oxley, Jennifer; Hamid, Tengku Aizan; Rashid, Sharifah Norazizan Syed Abd

2016-07-01

Self-regulatory driving is a term used to describe a strategy used by older drivers to preserve mobility and safety, through the adjustment of driving behaviors to match declining physical functions. It can be regarded as a way to prolong driving, or as a process leading to the cessation of driving. Previous studies have striven to explore and understand how older drivers self-regulate their driving. This paper aims to provide an overview of the relevant theories, to explicate the factors that contribute to the adoption of self-regulated driving and the scales used to measure self-regulatory behaviors. This paper also reports on the development and psychometric testing of a Self-Regulatory Driving Practices (SRDP) scale in the Malaysian context. Based on the reviewed theories, adoption of self-regulatory driving practices is a process and involves cognitive thinking that reflects a set of actions. Existing instruments to measure self-regulatory driving practices have been developed and used to identify the behavioral components of self-regulation. Based on literature reviews and a thematic analysis from focus group discussions, a SRDP scale was developed, accommodating the Malaysian context. There were 498 surveys completed by older drivers for further psychometric testing purposes. Results revealed that the final 12-item SRDP scale (α=0.81) consists of four subscales that are planning, avoidance, reduction and alternatives. Suggestions for future research are also recommended. Copyright © 2016 Elsevier Ltd. All rights reserved.

Measuring Graduate Students' Teaching and Research Skills through Self-Report: Descriptive Findings and Validity Evidence

ERIC Educational Resources Information Center

Gilmore, Joanna; Feldon, David

2010-01-01

This study extends research on graduate student development by examining descriptive findings and validity of a self-report survey designed to capture graduate students' assessments of their teaching and research skills. Descriptive findings provide some information about areas of growth among graduate students' in the first years of their…

Validity and reproducibility of self-reported total physical activity--differences by relative weight.

PubMed

Norman, A; Bellocco, R; Bergström, A; Wolk, A

2001-05-01

Physical activity is hypothesized to reduce the risk of obesity and several other chronic diseases and enhance longevity. However, most of the questionnaires used measure only part of total physical activity, occupational and/or leisure-time activity, which might lead to misclassification of total physical activity level and to dilution of risk estimates. We evaluated the validity and reproducibility of a short self-administered physical activity questionnaire, intended to measure long-term total daily 24 h physical activity. The questionnaire included questions on level of physical activity at work, hours per day of walking/bicycling, home/household work, leisure-time activity/inactivity and sleeping and was sent twice during one year (winter/spring and late summer). Two 7-day activity records, performed 6 months apart, were used as the reference method. One-hundred and eleven men, aged 44-78, completed the questionnaire and one or two activity records. The physical activity levels were measured as metabolic equivalents (MET)xh/day. Spearman correlation coefficient between total daily activity score estimated from the first questionnaire and the records (validity) was 0.56 (deattenuated) and between the first and the second questionnaire (reproducibility) 0.65. Significantly higher validity correlations were observed in men with self-reported body mass index below 26 kg/m(2) than in heavier men (r=0.73 vs r=0.39). This study indicates that the average total daily physical activity scores can be estimated satisfactorily in men using this simple self-administered questionnaire.

Validity of self-reported periodontal measures, demographic characteristics and systemic medical conditions.

PubMed

Chatzopoulos, Georgios S; Cisneros, Alejandro; Sanchez, Miguel; Lunos, Scott; Wolff, Larry F

2018-04-06

The objective of the present study was to assess self-reported periodontal screening questions, demographic characteristics, systemic medical conditions and tobacco use for predicting periodontal disease among individuals seeking dental therapy in a university dental clinic. In this retrospective study, a total of 4,890 randomly selected dental charts were evaluated from among patients who had attended the University of Minnesota School of Dentistry clinics for treatment. Radiographic bone loss measurements were utilized to assess the severity of periodontal disease. Demographic characteristics as well as medical history of the patients were also recorded. Five self-reported periodontal screening questions were included with the range of answers limited to Yes/No. Generalized logit models were used to assess the association between bone loss and the predictors. The sample mean age was 54.1 years and included 52.6% males and 14.9% smokers with a mean number of missing teeth of 3.5. Self-reported tooth mobility, history of "gum treatment" and the importance to keep the teeth as well as age, tobacco use and cancer were statistically significant (p < 0.05) predictors of a radiographic diagnosis of moderate and severe periodontal disease. With respect to severe periodontal disease, significant (p < 0.05) associations were also found with "bleeding while brushing", gender, diabetes, anxiety and arthritis. Self-reported periodontal screening questions as well as demographic characteristics, smoking and systemic medical conditions were significant predictors of periodontal disease and they could be used as valid, economical and practical measures. This article is protected by copyright. All rights reserved. © 2018 American Academy of Periodontology.

Solid motor diagnostic instrumentation. [design of self-contained instrumentation

NASA Technical Reports Server (NTRS)

Nakamura, Y.; Arens, W. E.; Wuest, W. S.

1973-01-01

A review of typical surveillance and monitoring practices followed during the flight phases of representative solid-propellant upper stages and apogee motors was conducted to evaluate the need for improved flight diagnostic instrumentation on future spacecraft. The capabilities of the flight instrumentation package were limited to the detection of whether or not the solid motor was the cause of failure and to the identification of probable primary failure modes. Conceptual designs of self-contained flight instrumentation packages capable of meeting these reqirements were generated and their performance, typical cost, and unit characteristics determined. Comparisons of a continuous real time and a thresholded hybrid design were made on the basis of performance, mass, power, cost, and expected life. The results of this analysis substantiated the feasibility of a self-contained independent flight instrumentation module as well as the existence of performance margins by which to exploit growth option applications.

Cultural Adaptation and Validation of the Cultural Self-Efficacy Scale for Colombian Nursing Professionals.

PubMed

Herrero-Hahn, Raquel; Rojas, Juan Guillermo; Ospina-Díaz, Juan Manuel; Montoya-Juárez, Rafael; Restrepo-Medrano, Juan Carlos; Hueso-Montoro, César

2017-03-01

The level of cultural self-efficacy indicates the degree of confidence nursing professionals possess for their ability to provide culturally competent care. Cultural adaptation and validation of the Cultural Self-Efficacy Scale was performed for nursing professionals in Colombia. A scale validation study was conducted. Cultural adaptation and validation of the Cultural Self-Efficacy Scale was performed using a sample of 190 nurses in Colombia, between September 2013 and April 2014. This sample was chosen via systematic random sampling from a finite population. The scale was culturally adapted. Cronbach's alpha for the revised scale was .978. Factor analysis revealed the existence of six factors grouped in three dimensions that explained 68% of the variance. The results demonstrated that the version of the Cultural Self-Efficacy Scale adapted to the Colombian context is a valid and reliable instrument for determining the level of cultural self-efficacy of nursing professionals.

Student mathematical imagination instruments: construction, cultural adaptation and validity

NASA Astrophysics Data System (ADS)

Dwijayanti, I.; Budayasa, I. K.; Siswono, T. Y. E.

2018-03-01

Imagination has an important role as the center of sensorimotor activity of the students. The purpose of this research is to construct the instrument of students’ mathematical imagination in understanding concept of algebraic expression. The researcher performs validity using questionnaire and test technique and data analysis using descriptive method. Stages performed include: 1) the construction of the embodiment of the imagination; 2) determine the learning style questionnaire; 3) construct instruments; 4) translate to Indonesian as well as adaptation of learning style questionnaire content to student culture; 5) perform content validation. The results stated that the constructed instrument is valid by content validation and empirical validation so that it can be used with revisions. Content validation involves Indonesian linguists, english linguists and mathematics material experts. Empirical validation is done through a legibility test (10 students) and shows that in general the language used can be understood. In addition, a questionnaire test (86 students) was analyzed using a biserial point correlation technique resulting in 16 valid items with a reliability test using KR 20 with medium reability criteria. While the test instrument test (32 students) to find all items are valid and reliability test using KR 21 with reability is 0,62.

Validity and reliability of the EQ-5D self-report questionnaire in Chinese-speaking patients with rheumatic diseases in Singapore.

PubMed

Luo, N; Chew, L H; Fong, K Y; Koh, D R; Ng, S C; Yoon, K H; Vasoo, S; Li, S C; Thumboo, J

2003-09-01

We assessed the psychometric properties of a Singaporean Chinese version of the EQ-5D, a health-related quality of life (HRQoL) instrument. Consecutive outpatients with rheumatic diseases seen for routine follow-up consultations at the National University Hospital, Singapore were interviewed twice within 2 weeks using a standardised questionnaire containing the EQ-5D, the Short-Form 36 Health Survey (SF-36), the Learned Helplessness Subscale, a pain Visual Analogue Scale (VAS) and assessing demographic and psychosocial characteristics. To assess the validity of the EQ-5D, 13 hypotheses relating the EQ-5D self-classifier (5 dimensions) or visual analogue scale (EQ-VAS) to SF-36 scores or other variables were examined using the Mann-Whitney U test, Kruskal-Wallis or Spearman's correlation coefficient. Test-retest reliability was assessed using Cohen's kappa. Forty-eight subjects were studied (osteoarthritis: 16; rheumatoid arthritis: 22; systemic lupus erythematosus: 8; spondyloarthropathy: 2; female: 93.8%; mean age: 56.4 years). Seven of 13 a-priori hypotheses relating EQ-5D to external variables were fulfilled, supporting the validity of the EQ-5D. For example, subjects reporting moderate or extreme problems for EQ-5D dimensions generally had lower median SF-36 scores than those without such problems. Cohen's kappa for test-retest reliability of the self-classifier ranged from 0.41 to 1.00 (n = 42; median interval: 7 days, interquartile range: 7 to 11 days). The Singaporean Chinese EQ-5D self-classifier appears to be a valid measure of HRQoL in Singaporeans with rheumatic diseases; however, the reliability of the EQ-VAS requires further investigation. These data provide a basis for further studies of the Singaporean Chinese EQ-5D.

The reporting of functional outcome instruments in the Journal of Orthopaedic Trauma over a 5-year period.

PubMed

Horwitz, Daniel S; Richard, Raveesh D; Suk, Michael

2014-01-01

Orthopaedic journals, such as the Journal of Orthopaedic Trauma, frequently publish studies reporting functional outcome instruments, but little information has been provided regarding the validity and overall strength of these instruments. This study analyzes the trends in reported functional outcome instruments in articles published in the Journal of Orthopaedic Trauma over a 5-year period and examines the utilization rate, "overall" strength, and validity of these functional outcome instruments for the populations being studied. Articles that were published in the Journal of Orthopaedic Trauma from January 2006 to December 2010 were reviewed, and each article was assigned to 1 of 4 different categories, based on the subspecialty focus and body region. The total number of articles reporting the use of functional outcome instruments, articles with at least 1 functional outcome instrument found in the AO Handbook, and the total number of functional outcome instruments reported were recorded. Each functional outcome instrument was assigned to 1 of 3 categories (generic, nonvalidated, validated), and each validated instrument was also examined to determine whether the category of interest for which it was used was one in which it was previously validated in. A total of 171 articles (34%) of the articles initially reviewed met the inclusion criteria. The average number of articles per year that reported functional outcome instruments was 56% (range, 47%-65%), and the average number of articles that reported at least 1 validated outcome instrument was 51% (range, 44%-61%). The average percentage of validated scores that were appropriately used within the category of interest was 23% (range, 13%-41%). Even though the 56% utilization rate of functional outcome instruments in The Journal of Orthopaedic Trauma is much higher than other journals, it is still low given the importance of measuring and attaining excellent functional outcomes. It is clear that future effort

Instruments assessing attitudes toward or capability regarding self-management of osteoarthritis: a systematic review of measurement properties.

PubMed

Eyles, J P; Hunter, D J; Meneses, S R F; Collins, N J; Dobson, F; Lucas, B R; Mills, K

2017-08-01

To make a recommendation on the "best" instrument to assess attitudes toward and/or capabilities regarding self-management of osteoarthritis (OA) based on available measurement property evidence. Electronic searches were performed in MEDLINE, EMBASE, CINAHL and PsychINFO (inception to 27 December 2016). Two reviewers independently rated measurement properties using the Consensus-based Standards for the selection of Health Measurement Instruments (COSMIN) 4-point scale. Best evidence synthesis was determined by considering COSMIN ratings for measurement property results and the level of evidence available for each measurement property of each instrument. Eight studies out of 5653 publications met the inclusion criteria, with eight instruments identified for evaluation: Multidimensional Health Locus of Control (MHLC), Perceived Behavioural Control (PBC), Patient Activation Measure (PAM), Educational Needs Assessment (ENAT), Stages of Change Questionnaire in Osteoarthritis (SCQOA), Effective Consumer Scale (EC-17) and Perceived Efficacy in Patient-Physician Interactions five item (PEPPI-5) and ten item scales. Measurement properties assessed for these instruments included internal consistency (k = 8), structural validity (k = 8), test-retest reliability (k = 2), measurement error (k = 1), hypothesis testing (k = 3) and cross-cultural validity (k = 3). No information was available for content validity, responsiveness or minimal important change (MIC)/minimal important difference (MID). The Dutch PEPPI-5 demonstrated the best measurement property evidence; strong evidence for internal consistency and structural validity but limited evidence for reliability and construct validity. Although PEPPI-5 was identified as having the best measurement properties, overall there is a poor level of evidence currently available concerning measurement properties of instruments to assess attitudes toward and/or capabilities regarding osteoarthritis self-management. Further

Dental Management Survey Brazil (DMS-BR): creation and validation of a management instrument

PubMed

Gonzales, Paola Sampaio; Martins, Ismar Eduardo; Biazevic, Maria Gabriela Haye; Silva, Paulo Roberto da; Michel-Crosato, Edgard

2017-04-10

Questionnaires for the assessment of knowledge and self-perception can be useful to diagnose what a dentist knows about management and administration. The aim of the present study was to create and validate the Dental Management Survey Brazil (DMS-BR) scale, based on meetings with experts in the field. After having elaborated the first version, 10 audits were performed in dental offices in order to produce the final version, which included nine dimensions: location, patient, finance, marketing, competition, quality, staff, career, and productivity. The accuracy of the instrument was measured by intrarater and interrater reliability. In the validation phase, 247 Brazilian dentists answered a web-based questionnaire. The data were processed using Stata 13.0 and the significance level was set at 95%. The instrument had intrarater and interrater reliability (ICC-0.93 and 0.94). The overall average of respondents for the DMS-BR scale was 3.77 (SD = 0.45). Skewness and kurtosis were below absolute values 3 and 7, respectively. Internal validity measured by Cronbach's alpha was 0.925 and the correlation of each dimension with the final result of the DMS-BR ranged between 0.606 and 0.810. Correlation with the job satisfaction scale was 0.661. The SEM data ranged between 0.80 and 0.56. The questionnaire presented satisfactory indicators of dentists' self-perception about management and administration activities.

EASY-An Instrument for Surveillance of Physical Activity in Youth.

PubMed

Pate, Russell R; McIver, Kerry; Dowda, Marsha; Schenkelberg, Michaela A; Beets, Michael; DiStefano, Christine

2018-01-23

Physical activity (PA) promotion among youth is a public health priority and there is a need for robust surveillance systems to help support such initiatives. Existing youth PA self-report instruments that are used for surveillance lack information regarding the types and contexts of activity. Further, these instruments have limited validity with accelerometry. The purpose of the present study was to develop a self-report instrument, with sound psychometric properties, for monitoring compliance with PA guidelines in youth. In focus groups, 162 middle school students identified 30 forms of PA that are highly prevalent in that age group. We incorporated these activities into three preliminary forms of a self-report instrument. An independent sample of middle school students (n = 537) was randomly assigned to complete one of the three preliminary versions of the instrument. Rasch analysis was applied to the responses to the three formats, and a yes/no plus frequency format emerged as the preferred method. A third sample of 342 middle school students then completed the yes/no plus frequency instrument twice following a seven-day period during which they wore an accelerometer. Using both Rasch analysis and traditional correlational methods, validity and reliability of a 14-item instrument were established. Data were collected during 2012 - 2015. Spearman correlation coefficient for the association between the cumulative score for the 14 items and minutes per day of accelerometry-derived moderate-to-vigorous physical activity (MVPA) was 0.33 (95% CI 0.22, 0.43; p<.001). Sensitivity and specificity of the 14-item instrument was 0.90 and 0.44, respectively. The study produced a PA self-report instrument for youth that was found to be reliable (r=0.91), valid versus accelerometry (r=0.33), and acceptably specific and sensitive in detecting compliance with PA guidelines.This is an open-access article distributed under the terms of the Creative Commons Attribution

Systematic literature review and assessment of patient-reported outcome instruments in sickle cell disease.

PubMed

Sarri, Grammati; Bhor, Menaka; Abogunrin, Seye; Farmer, Caroline; Nandal, Savita; Halloway, Rashid; Revicki, Dennis A

2018-05-21

Sickle cell disease (SCD) is a chronic condition associated with high mortality and morbidity. It is characterized by acute clinical symptoms such as painful vaso-occlusive crises, which can impair health-related quality of life (HRQL). This study was conducted to identify validated patient-reported outcome (PRO) instruments for use in future trials of potential treatments for SCD. A systematic literature review (SLR) was performed using MEDLINE and EMBASE to identify United States (US)-based studies published in English between 1997 and 2017 that reported on validated PRO instruments used in randomized controlled trials and real-world settings. The COnsensus-based Standards for the selection of health Measurement INstruments (COSMIN) checklist was used to assess the quality of PRO instruments. The SLR included 21 studies assessing the psychometric properties of 24 PRO instruments. Fifteen of those instruments were developed and validated for adults and 10 for children (one instrument was used in both children and young adults aged up to 21 years). Only five of the 15 adult instruments and three of the 10 pediatric instruments were developed specifically for SCD. For most instruments, there were few or no data on validation conducted in SCD development cohorts. Of the 24 PRO instruments identified, 16 had strong internal reliability (Cronbach's α ≥0.80). There was often insufficient information to assess the content validity, construct validity, responsiveness, or test-retest reliability of the instruments identified for both child and adult populations. No validated PRO instruments measuring caregiver burden in SCD were identified. The evidence on the psychometric properties of PRO instruments was limited. However, the results of this SLR provide key information on such tools to help inform the design of future clinical trials for patients with SCD in the US.

A validity study of self-reported daily texting frequency, cell phone characteristics, and texting styles among young adults.

PubMed

Gold, Judith E; Rauscher, Kimberly J; Zhu, Motao

2015-04-02

Texting is associated with adverse health effects including musculoskeletal disorders, sleep disturbances, and traffic crashes. Many studies have relied on self-reported texting frequency, yet the validity of self-reports is unknown. Our objective was to provide some of the first data on the validity of self-reported texting frequency, cell phone characteristics including input device (e.g. touchscreen), key configuration (e.g., QWERTY), and texting styles including phone orientation (e.g., horizontal) and hands holding the phone while texting. Data were collected using a self-administered questionnaire and observation of a texting task among college students ages 18 to 24. To gauge agreement between self-reported and phone bill-derived categorical number of daily text messages sent, we calculated percent of agreement, Spearman correlation coefficient, and a linear weighted kappa statistic. For agreement between self-reported and observed cell phone characteristics and texting styles we calculated percentages of agreement. We used chi-square tests to detect significant differences (α = 0.05) by gender and study protocol. There were 106 participants; 87 of which had complete data for texting frequency analyses. Among these 87, there was 26% (95% CI: 21-31) agreement between self-reported and phone bill-derived number of daily text messages sent with a Spearman's rho of 0.48 and a weighted kappa of 0.17 (95% CI: 0.06-0.27). Among those who did not accurately report the number of daily texts sent, 81% overestimated this number. Among the full sample (n = 106), there was high agreement between self-reported and observed texting input device (96%, 95% CI: 91-99), key configuration (89%, 95% CI: 81-94), and phone orientation while texting (93%, 95% CI: 86-97). No differences were found by gender or study protocol among any items. While young adults correctly reported their cell phone's characteristics and phone orientation while texting, most incorrectly

The creation and validation of an instrument to measure school STEM Culture

NASA Astrophysics Data System (ADS)

White, Christopher

Although current research exists on school culture, there is a gap in the literature on specialized aspects of culture such as STEM Culture defined as the beliefs, values, practices, resources, and challenges in STEM fields (Science, Technology, Engineering and Mathematics) within a school. The objective of this study was to create a valid and reliable instrument, the STEM Culture Assessment Tool (STEM-CAT), that measures this cultural aspect based on a survey of stakeholder groups within the school community and use empirical data to support the use of this instrument to measure STEM Culture. Items were created and face validity was determined through a focus group and expert review before a pilot study was conducted to determine reliability of the items. Once items were determined reliable, the survey was given to eight high schools and results were correlated to the percentage of seniors who self-reported whether they intend to pursue STEM fields upon graduation. The results of this study indicate further need for research to determine how the STEM-CAT correlates to STEM culture due to some inconsistencies with the dependent variable in this study. Future research could be done correlating the results of the STEM-CAT with participation in Advanced Placement science and mathematics, SAT/ACT scores in science and mathematics or the number of students who actually pursue STEM fields rather than a prediction halfway through the 12th grade.

Cross-cultural validation of instruments measuring health beliefs about colorectal cancer screening among Korean Americans.

PubMed

Lee, Shin-Young; Lee, Eunice E

2015-02-01

The purpose of this study was to report the instrument modification and validation processes to make existing health belief model scales culturally appropriate for Korean Americans (KAs) regarding colorectal cancer (CRC) screening utilization. Instrument translation, individual interviews using cognitive interviewing, and expert reviews were conducted during the instrument modification phase, and a pilot test and a cross-sectional survey were conducted during the instrument validation phase. Data analyses of the cross-sectional survey included internal consistency and construct validity using exploratory and confirmatory factor analysis. The main issues identified during the instrument modification phase were (a) cultural and linguistic translation issues and (b) newly developed items reflecting Korean cultural barriers. Cross-sectional survey analyses during the instrument validation phase revealed that all scales demonstrate good internal consistency reliability (Cronbach's alpha=.72~.88). Exploratory factor analysis showed that susceptibility and severity loaded on the same factor, which may indicate a threat variable. Items with low factor loadings in the confirmatory factor analysis may relate to (a) lack of knowledge about fecal occult blood testing and (b) multiple dimensions of the subscales. Methodological, sequential processes of instrument modification and validation, including translation, individual interviews, expert reviews, pilot testing and a cross-sectional survey, were provided in this study. The findings indicate that existing instruments need to be examined for CRC screening research involving KAs.

Adaptation and validation of the Diabetes Management Self-Efficacy Scale to Brazilian Portuguese 1

PubMed Central

Pace, Ana Emilia; Gomes, Lilian Cristiane; Bertolin, Daniela Comelis; Loureiro, Helena Maria Almeira Macedo; Bijl, Jaap Van Der; Shortridge-Baggett, Lillie M.

2017-01-01

Objective: to perform the cultural adaptation and validation of the Diabetes Management Self-efficacy Scale for Patients with Type 2 Diabetes Mellitus with a Brazilian population sample. Method: cross-sectional methodological study in which the adaptation and validation process included the stages recommended in the literature. Construct validity and reliability were assessed with 200 adults with type 2 diabetes mellitus. Results: the items indicated by the panel of judges and by the target population were adjusted in the cultural adaptation to improve clarity and understanding. The instrument's four factors remained in the confirmatory factor analysis with factor loadings of items greater than 0.30, except for factor 4; convergent validity, verified by the multitrait-multimethod analysis, presented inter-item correlations from 0.37 to 0.92, while for discriminant validity, 100% of the items presented greater correlation in their own factors. Cronbach's coefficient alpha for the total scale was 0.78, ranging from 0.57 to 0.86 among factors. Conclusion: semantic, cultural, conceptual and idiomatic equivalences were achieved and the instrument's Brazilian version also presented psychometric properties that showed evidence of reliability and validity. Thus, it can be applied both in clinical practice and research. Self-efficacy is useful for planning and assessing educational interventions, as well as predicting behavior modification in self-care. PMID:28562700

Development and validation of a self-report measure of emotional intelligence as a multidimensional trait domain.

PubMed

Tett, Robert P; Fox, Kevin E; Wang, Alvin

2005-07-01

Psychometric review of 33 peer-reviewed studies of six self-report emotional intelligence (EI) measures supports a multidimensional conceptualization of EI. The nature and number of EI facets, however, and their distinctiveness from more established trait domains is unclear. Building on earlier efforts, three studies were undertaken (Ns = 138, 163, 152) to develop self-report measures of 10 facets of EI proposed by Salovey and Mayer (1990). Results support the reliability (internal consistency, test-retest) and validity (content, criterion, construct, structural) of the proposed scales and their distinctiveness among themselves and with respect to more established trait domains (e.g., personality). Specifically, three satisfaction and four cross-cultural adaptability facets were predicted uniquely by 9 of the 10 proposed subscales, controlling for social desirability, the Big Five, positive and negative affect, and self-monitoring. All told, results confirm that trait-EI can be measured using self-report and conceptualized as a distinct multidimensional domain.

Technical Analysis of Scores on the "Self-Efficacy Self-Report Scale"

ERIC Educational Resources Information Center

Erford, Bradley T.; Schein, Hallie; Duncan, Kelly

2011-01-01

The purpose of this study was to provide preliminary analysis of reliability and validity of scores on the "Self-Efficacy Self-Report Scale", which was designed to assess general self-efficacy in students aged 10 to 17 years. Confirmatory factor analysis on cross-validated samples was conducted revealing a marginal fit of the data to the…

Self-Reported Physical Activity in Medically Underserved Adults With Type 2 Diabetes in Clinical and Community Settings.

PubMed

Cooper, John; Stetson, Barbara; Bonner, Jason; Spille, Sean; Krishnasamy, Sathya; Mokshagundam, Sri Prakash

2015-07-01

This study assessed physical activity (PA) in community dwelling adults with Type 2 diabetes, using multiple instruments reflecting internationally normed PA and diabetes-specific self-care behaviors. Two hundred and fifty-three Black (44.8%) and White (55.2%) Americans [mean age = 57.93; 39.5% male] recruited at low-income clinic and community health settings. Participants completed validated PA self-report measures developed for international comparisons (International Physical Activity Questionnaire Short Form), characterization of diabetes self-care (Summary of Diabetes Self-Care Activities Measure; SDSCA) and exercise-related domains including provider recommendations and PA behaviors and barriers (Personal Diabetes Questionnaire; PDQ). Self-reported PA and PA correlates differed by instrument. BMI was negatively correlated with PA level assessed by the PDQ in both genders, and assessed with SDSCA activity items in females. PA levels were low, comparable to previous research with community and diabetes samples. Pain was the most frequently reported barrier; females reported more frequent PA barriers overall. When using self-report PA measures for PA evaluation of adults with diabetes in clinical settings, it is critical to consider population and setting in selecting appropriate tools. PA barriers may be an important consideration when interpreting PA levels and developing interventions. Recommendations for incorporating these measures in clinical and research settings are discussed.

The N2N instrument to evaluate healthy work environments: an Italian validation.

PubMed

Palese, Alvisa; Dante, Angelo; Tonzar, Laura; Balboni, Bernardo

2014-02-01

The aims of the study were to (a) validate N2N Healthy Work Environment tool, (b) assess the healthiness of work environments as perceived by nurses themselves and (c) identify the factors associated with Italian nurses' perception of work environment healthiness. The linguistic and cultural adaptation of USA-N2N Healthy Work Environments was achieved through a process of forward/backward translation. Content validity was assessed by three expert nurses. The stability of the instrument was checked with a test/retest evaluation. The instrument psychometric properties, the confirmatory factor analysis as well the healthiness of the work environment and its determinant factors were evaluated with a sample of 294 nurses. The content and face validity of the N2N Healthy Work Environment instrument was confirmed. The instrument demonstrated good internal consistency (α of 0.82), excellent stability values (ρ > 0.70) and high levels of acceptability (response rate: 96.4 %). The confirmatory factor analysis has corroborated the existence of two factors as documented in the original instrument (Mays et al. in J Nurs Manag 19:18-26, 2011). Eighty-seven (29.6 %) nurses perceived the work environment where they work as "healthy". Working under a functional model of care delivery (χ(2) 24.856, p 0.000) and being responsible for one project or more (χ(2) 5.256, p 0.021) were associated with healthy environments. The instrument--valid and reliable, short in the number of items, easy to understand and based on international standards--allows a systematic assessment of the healthiness of the environment and might provide not only the opportunity to evaluate the effects of new organizational models and interventions, but also the possibility to activate a process of self-analysis and a process of ongoing review. The instrument can be used to systematically check the healthiness of Italian working environments, allowing for organizational diagnosis, targeted interventions and

Validation of self-reported health literacy questions among diverse English and Spanish-speaking populations.

PubMed

Sarkar, Urmimala; Schillinger, Dean; López, Andrea; Sudore, Rebecca

2011-03-01

Limited health literacy (HL) contributes to poor health outcomes and disparities, and direct measurement is often time-intensive. Self-reported HL questions have not been validated among Spanish-speaking and diverse English-speaking populations. To evaluate three self-reported questions: 1 "How confident are you filling out medical forms?"; 2 "How often do you have problems learning about your medical condition because of difficulty understanding written information?"; and 3 "How often do you have someone help you read hospital materials?" Answers were based on a 5-point Likert scale. This was a validation study nested within a trial of diabetes self-management support in the San Francisco Department of Public Health. English and Spanish-speaking adults with type 2 diabetes receiving primary care. Using the Test of Functional Health Literacy in Adults (s-TOFHLA) in English and Spanish as the reference, we classified HL as inadequate, marginal, or adequate. We calculated the C-index and test characteristics of the three questions and summative scale compared to the s-TOFHLA and assessed variations in performance by language, race/ethnicity, age, and education. Of 296 participants, 48% were Spanish-speaking; 9% were White, non-Hispanic; 47% had inadequate HL and 12% had marginal HL. Overall, 57% reported being confident with forms "somewhat" or less. The "confident with forms" question performed best for detecting inadequate (C-index = 0.82, (0.77-0.87)) and inadequate plus marginal HL (C index = 0.81, (0.76-0.86); p<0.01 for differences from other questions), and performed comparably to the summative scale. The "confident with forms" question and scale also performed best across language, race/ethnicity, educational attainment, and age. A single self-reported HL question about confidence with forms and a summative scale of three questions discriminated between Spanish and English speakers with adequate HL and those with inadequate and/or inadequate plus marginal HL

A population based validation study of self-reported pensions and benefits: the Nord-Trøndelag health study (HUNT).

PubMed

Myrtveit, Solbjørg Makalani; Ariansen, Anja M S; Wilhelmsen, Ingvard; Krokstad, Steinar; Mykletun, Arnstein

2013-01-23

Measures of disability pensions, sickness certification and long-term health related benefits are often self-reported in epidemiological studies. Few studies have examined these measures, and the validity is yet to be established.We aimed to estimate the validity of self-reported disability pension, rehabilitation benefit and retirement pension and to explore the benefit status and basic characteristics of those not responding to these items.A large health survey (HUNT2) containing self-reported questionnaire data on sickness benefits and pensions was linked to a national registry of pensions and benefits, used as "gold standard" for the analysis. We investigated two main sources of bias in self-reported data; misclassification - due to participants answering questions incorrectly, and systematic missing/selection bias - when participants do not respond to the questions.Sensitivity, specificity, positive (PPV) and negative (NPV) predicative value, agreement and Cohen's Kappa were calculated for each benefit. Co-variables were compared between non-responders and responders. In the study-population of 40,633, 9.2% reported receiving disability pension, 1.4% rehabilitation benefits and 6.1% retirement pension. According to the registry, the corresponding numbers were 9.0%, 1.7% and 5.4%. Excluding non-responders, specificity, NPV and agreement were above 98% for all benefits. Sensitivity and PPV were lower. When including non-responders as non-receivers, specificity got higher, sensitivity dropped while the other measures changed less.Between 17.7% and 24.1% did not answer the questions on benefits. Non-responders were older and more likely to be female. They reported more anxiety, more depression, a higher number of somatic diagnoses, less physical activity and lower consumption of alcohol (p < 0.001 for all variables). For disability pension and retirement pension, non-responders were less likely to receive benefits than responders (p < 0.001). For each

Validation of the organizational culture assessment instrument.

PubMed

Heritage, Brody; Pollock, Clare; Roberts, Lynne

2014-01-01

Organizational culture is a commonly studied area in industrial/organizational psychology due to its important role in workplace behaviour, cognitions, and outcomes. Jung et al.'s [1] review of the psychometric properties of organizational culture measurement instruments noted many instruments have limited validation data despite frequent use in both theoretical and applied situations. The Organizational Culture Assessment Instrument (OCAI) has had conflicting data regarding its psychometric properties, particularly regarding its factor structure. Our study examined the factor structure and criterion validity of the OCAI using robust analysis methods on data gathered from 328 (females = 226, males = 102) Australian employees. Confirmatory factor analysis supported a four factor structure of the OCAI for both ideal and current organizational culture perspectives. Current organizational culture data demonstrated expected reciprocally-opposed relationships between three of the four OCAI factors and the outcome variable of job satisfaction but ideal culture data did not, thus indicating possible weak criterion validity when the OCAI is used to assess ideal culture. Based on the mixed evidence regarding the measure's properties, further examination of the factor structure and broad validity of the measure is encouraged.

Validation of the Organizational Culture Assessment Instrument

PubMed Central

Heritage, Brody; Pollock, Clare; Roberts, Lynne

2014-01-01

Organizational culture is a commonly studied area in industrial/organizational psychology due to its important role in workplace behaviour, cognitions, and outcomes. Jung et al.'s [1] review of the psychometric properties of organizational culture measurement instruments noted many instruments have limited validation data despite frequent use in both theoretical and applied situations. The Organizational Culture Assessment Instrument (OCAI) has had conflicting data regarding its psychometric properties, particularly regarding its factor structure. Our study examined the factor structure and criterion validity of the OCAI using robust analysis methods on data gathered from 328 (females = 226, males = 102) Australian employees. Confirmatory factor analysis supported a four factor structure of the OCAI for both ideal and current organizational culture perspectives. Current organizational culture data demonstrated expected reciprocally-opposed relationships between three of the four OCAI factors and the outcome variable of job satisfaction but ideal culture data did not, thus indicating possible weak criterion validity when the OCAI is used to assess ideal culture. Based on the mixed evidence regarding the measure's properties, further examination of the factor structure and broad validity of the measure is encouraged. PMID:24667839

The development and validation of the Dormitory Observation Report: a behavioral rating instrument for juvenile delinquents in residential care.

PubMed

Veneziano, Louis; Veneziano, Carol

2002-09-01

In order to provide an objective measure of problematic behavioral patterns among juvenile delinquents in residential facilities, the Dormitory Observation Report (DOR) was developed. The DOR assesses 11 dimensions of problematic behavioral patterns (e.g., physical assaultiveness, manipulativeness), as well as three dimensions of desirable behavioral patterns expected in an institutional setting (e.g., independent functioning, personal hygiene, care of surroundings). Empirical study regarding the reliability and validity of the DOR are reported, and the results are discussed in terms of the theoretical and practical implications of this instrument. Copyright 2002 Wiley Periodicals, Inc.

Validating self-reported mobile phone use in adults using a newly developed smartphone application.

PubMed

Goedhart, Geertje; Kromhout, Hans; Wiart, Joe; Vermeulen, Roel

2015-11-01

Interpretation of epidemiological studies on health effects from mobile phone use is hindered by uncertainties in the exposure assessment. We used a newly developed smartphone application (app) to validate self-reported mobile phone use and behaviour among adults. 107 participants (mean age 41.4 years) in the Netherlands either downloaded the software app on their smartphone or were provided with a study smartphone for 4 weeks. The app recorded the number and duration of calls, text messages, data transfer, laterality and hands-free use. Self-reported mobile phone use was collected before using the app and after 6 months through an interviewer-administered questionnaire. The geometric mean ratios (GMR, 95% CI) and Spearman correlations (r) of self-reported (after 6 months) versus recorded number and duration of calls were: GMR=0.65 (0.53 to 0.80), r=0.53; and GMR=1.11 (0.86 to 1.42), r=0.57 respectively. Participants held the phone on average for 86% of the total call time near the head. Self-reported right side users held the phone for 70.7% of the total call time on the right side of the head, and left side users for 66.2% on the left side of the head. The percentage of total call time that the use of hands-free devices (headset, speaker mode, Bluetooth) was recorded increased with increasing frequency of reported hands-free device usage. The observed recall errors and precision of reported laterality and hands-free use can be used to quantify and improve radiofrequency exposure models based on self-reported mobile phone use. Published by the BMJ Publishing Group Limited. For permission to use (where not already granted under a licence) please go to http://group.bmj.com/group/rights-licensing/permissions.

Reliability and validity of the McDonald Play Inventory.

PubMed

McDonald, Ann E; Vigen, Cheryl

2012-01-01

This study examined the ability of a two-part self-report instrument, the McDonald Play Inventory, to reliably and validly measure the play activities and play styles of 7- to 11-yr-old children and to discriminate between the play of neurotypical children and children with known learning and developmental disabilities. A total of 124 children ages 7-11 recruited from a sample of convenience and a subsample of 17 parents participated in this study. Reliability estimates yielded moderate correlations for internal consistency, total test intercorrelations, and test-retest reliability. Validity estimates were established for content and construct validity. The results suggest that a self-report instrument yields reliable and valid measures of a child's perceived play performance and discriminates between the play of children with and without disabilities. Copyright © 2012 by the American Occupational Therapy Association, Inc.

Validity and test-retest reliability of an at-work production loss instrument.

PubMed

Aboagye, E; Jensen, I; Bergström, G; Hagberg, J; Axén, I; Lohela-Karlsson, M

2016-07-01

Besides causing ill health, a poor work environment may contribute to production loss. Production loss assessment instruments emphasize health-related consequences but there is no instrument to measure reduced work performance related to the work environment. To examine convergent validity and test-retest reliability of health-related production loss (HRPL) and work environment-related production loss (WRPL) against a valid comparable instrument, the Health and Work Performance Questionnaire (HPQ). Cross-sectional study of employees, not on sick leave, who were asked to self-rate their work performance and production losses. Using the Pearson correlation and Bland and Altman's Test of Agreement, convergent validity was examined. Subgroup analyses were performed for employees recording problem-specific reduced work performance. Consistency of pairs of HRPL and WRPL for samples responding to both assessments was expressed using Intraclass Correlation Coefficient (ICC) and tests of repeatability. A total of 88 employees participated and 44 responded to both assessments. Test of agreement between measurements estimates a mean difference of 0.34 for HRPL and -0.03 for WRPL compared with work performance. This indicates that the production loss questions are valid and moderately associated with work performance for the total sample and subgroups. ICC for paired HRPL assessments was 0.90 and 0.91 for WRPL, i.e. the test-retest reliability was good and suggests stability in the instrument. HRPL and WRPL can be used to measure production loss due to health-related and work environment-related problems. These results may have implications for advancing methods of assessing production loss, which represents an important cost to employers. © The Author 2016. Published by Oxford University Press on behalf of the Society of Occupational Medicine. All rights reserved. For Permissions, please email: journals.permissions@oup.com.

The Construct Validity of the German Academic Self-regulation Questionnaire (SRQ-A) within Primary and Secondary School Children

PubMed Central

Kröner, Julia; Goussios, Christina; Schaitz, Caroline; Streb, Judith; Sosic-Vasic, Zrinka

2017-01-01

The assessment of students' motivation can be a powerful tool in enhancing and understanding students' learning. One valid and often applied self-report measure is the Academic Self-Regulation Questionnaire (SRQ-A) which is grounded in the self-determination theory. However, to date, there is still no German equivalent to the English version of this questionnaire. Therefore, the aim of the present study was to adapt and validate the SRQ-A on a representative German student sample, consisting of 672 children (327 girls), ages 8–14 from one primary and two secondary German schools. First, the translation-back-translation method was used to ensure the linguistic equivalence of the German questionnaire. Second, item analysis of the generated scores of the German SRQ-A were conducted. Third, the multidimensional factorial structure of the original measure was tested with confirmatory factor analysis (CFA) using maximum likelihood estimation. Last, additional construct validity of the German SRQ-A was tested using correlational analyses with convergent and divergent measures. After conducting CFA, four items were excluded from the original questionnaire, due to loadings lower than 0.40, resulting in 28 items. The German SRQ-A showed good internal consistency for all subscales, with Chronbach's α ranging between 0.75 and 0.88. The simplex-structure of the original measurement could also be confirmed, however, the four-factorial model could not be replicated. The measurement showed good convergent and discriminant validity with other related questionnaires. In summary, the German SRQ-A is a reliable and valid self-report instrument for the assessment of self-determined motivational styles within the school context. PMID:28690567

The Construct Validity of the German Academic Self-regulation Questionnaire (SRQ-A) within Primary and Secondary School Children.

PubMed

Kröner, Julia; Goussios, Christina; Schaitz, Caroline; Streb, Judith; Sosic-Vasic, Zrinka

2017-01-01

The assessment of students' motivation can be a powerful tool in enhancing and understanding students' learning. One valid and often applied self-report measure is the Academic Self-Regulation Questionnaire (SRQ-A) which is grounded in the self-determination theory. However, to date, there is still no German equivalent to the English version of this questionnaire. Therefore, the aim of the present study was to adapt and validate the SRQ-A on a representative German student sample, consisting of 672 children (327 girls), ages 8-14 from one primary and two secondary German schools. First, the translation-back-translation method was used to ensure the linguistic equivalence of the German questionnaire. Second, item analysis of the generated scores of the German SRQ-A were conducted. Third, the multidimensional factorial structure of the original measure was tested with confirmatory factor analysis (CFA) using maximum likelihood estimation. Last, additional construct validity of the German SRQ-A was tested using correlational analyses with convergent and divergent measures. After conducting CFA, four items were excluded from the original questionnaire, due to loadings lower than 0.40, resulting in 28 items. The German SRQ-A showed good internal consistency for all subscales, with Chronbach's α ranging between 0.75 and 0.88. The simplex-structure of the original measurement could also be confirmed, however, the four-factorial model could not be replicated. The measurement showed good convergent and discriminant validity with other related questionnaires. In summary, the German SRQ-A is a reliable and valid self-report instrument for the assessment of self-determined motivational styles within the school context.

Comparing the Validity of Informant- and Self-reports of Personality Using Laboratory Indices of Emotional Responding as Criterion Variables

PubMed Central

Lieberman, Lynne; Liu, Huiting; Huggins, Ashley A.; Katz, Andrea C.; Zvolensky, Michael J.; Shankman, Stewart A.

2016-01-01

Personality traits relate to risk for psychopathology and can inform predictions about treatment outcome. In an effort to obtain a comprehensive index of personality, informant-reports of personality are sometimes obtained in addition to self-reports of personality. However, there is limited research comparing the validity of self- and informant-reports of personality, particularly among those with internalizing psychopathology. This is important given that informants may provide an additional (and perhaps different) perspective on individuals’ personality. The present study therefore compared how both reports of positive affectivity (PA) and negative affectivity (NA) relate to psychophysiological and subjective measures of emotional responding to positive and negative stimuli. Given that our sample (n = 117) included individuals with no history of psychopathology, as well as individuals with major depressive disorder (MDD) and/or panic disorder (PD), we were also able to explore whether these internalizing diagnoses moderated the association between personality reports and measures of emotional responding. Informant-reported PA predicted physiological responses to positive stimuli (but not negative). Informant reported NA predicted physiological responses to negative stimuli (but not positive). Self-reported personality did not predict physiological responding, but did predict subjectively measured emotional responding (NA for negative responding; PA for positive responding). Diagnoses of internalizing psychopathology (PD or MDD) did not moderate these associations. Results suggest self- and informant-reports of personality may each provide valid indices of an individual’s emotional response tendencies, but predict different aspects of those tendencies. PMID:27273802

Comparing the validity of informant and self-reports of personality using laboratory indices of emotional responding as criterion variables.

PubMed

Lieberman, Lynne; Liu, Huiting; Huggins, Ashley A; Katz, Andrea C; Zvolensky, Michael J; Shankman, Stewart A

2016-09-01

Personality traits relate to risk for psychopathology and can inform predictions about treatment outcome. In an effort to obtain a comprehensive index of personality, informant reports of personality are sometimes obtained in addition to self-reports of personality. However, there is limited research comparing the validity of self- and informant reports of personality, particularly among those with internalizing psychopathology. This is important given that informants may provide an additional (and perhaps different) perspective on individuals' personality. The present study therefore compared how both reports of positive affectivity (PA) and negative affectivity (NA) relate to psychophysiological and subjective measures of emotional responding to positive and negative stimuli. Given that our sample (n = 117) included individuals with no history of psychopathology, as well as individuals with major depressive disorder (MDD) and/or panic disorder (PD), we were also able to explore whether these internalizing diagnoses moderated the association between personality reports and measures of emotional responding. Informant-reported PA predicted physiological responses to positive stimuli (but not negative). Informant-reported NA predicted physiological responses to negative stimuli (but not positive). Self-reported personality did not predict physiological responding, but did predict subjectively measured emotional responding (NA for negative responding, PA for positive responding). Diagnoses of internalizing psychopathology (PD or MDD) did not moderate these associations. Results suggest self- and informant reports of personality may each provide valid indices of an individual's emotional response tendencies, but predict different aspects of those tendencies. © 2016 Society for Psychophysiological Research.

Development of an instrument to measure self-efficacy in caregivers of people with advanced cancer.

PubMed

Ugalde, Anna; Krishnasamy, Meinir; Schofield, Penelope

2013-06-01

Informal caregivers of people with advanced cancer experience many negative impacts as a result of their role. There is a lack of suitable measures specifically designed to assess their experience. This study aimed to develop a new measure to assess self-efficacy in caregivers of people with advanced cancer. The development and testing of the new measure consisted of four separate, sequential phases: generation of issues, development of issues into items, pilot testing and field testing. In the generation of issues, 17 caregivers were interviewed to generate data. These data were analysed to generate codes, which were then systematically developed into items to construct the instrument. The instrument was pilot tested with 14 health professionals and five caregivers. It was then administered to a large sample for field testing to establish the psychometric properties, with established measures including the Brief Cope and the Family Appraisals for Caregiving Questionnaire for Palliative Care. Ninety-four caregivers completed the questionnaire booklet to establish the factor structure, reliability and validity. The factor analysis resulted in a 21-item, four-factor instrument, with the subscales being termed Resilience, Self-Maintenance, Emotional Connectivity and Instrumental Caregiving. The test-retest reliability and internal consistency were both excellent, ranging from 0.73 to 0.85 and 0.81 to 0.94, respectively. Six convergent and divergent hypotheses were made, and five were supported. This study has developed a new instrument to assess self-efficacy in caregivers of people with advanced cancer. The result is a four-factor, 21-item instrument with demonstrated reliability and validity. Copyright © 2012 John Wiley & Sons, Ltd.

The TUPA Scale: A Self-Report Measure for the Type A Subcomponent of Time Urgency and Perpetual Activation.

ERIC Educational Resources Information Center

Wright, Logan; And Others

1992-01-01

A self-report measure for the Type A subcomponent of time urgency and perpetual activation (TUPA) was developed using 10 coronary heart disease (CHD) patients and validated with another 48 CHD patients. The internal consistency and test-retest reliabilities indicate that the instrument has clinical and research applications. (SLD)

Development and validation of an instrument to evaluate science teachers' assessment beliefs and practices

NASA Astrophysics Data System (ADS)

Genc, Evrim

The primary purpose of this study was to develop a valid and reliable instrument to examine science teachers' assessment beliefs and practices in science classrooms. The present study also investigated the relationship between teachers' beliefs and practices in terms of assessment issues in science, their perceptions of the factors that influenced their assessment practices and their feelings towards high-stakes testing. The participants of the study were 408 science teachers teaching at middle and high school levels in the State of Florida. Data were collected through two modes of administration of the instrument as a paper-and-pencil and a web-based form. The response rate for paper-and-pencil administration was estimated as 68% whereas the response for the web administration was found to be 27%. Results from the various dimensions of validity and reliability analyses revealed that the 24 item-four-factor belief and practice measures were psychometrically sound and conceptually anchored measures of science teachers' assessment beliefs and self-reported practices. Reliability estimates for the belief measure ranged from .83 to .91 whereas alpha values for the practice measure ranged from .56 to .90. Results from the multigroup analysis supported that the instrument has the same theoretical structure across both administration groups. Therefore, future researchers may use either a paper-and-pencil or web-based format of the instrument. This study underscored a discrepancy between what teachers believe and how they act in classroom settings. It was emphasized that certain factors were mediating the dynamics between the belief and the practice. The majority of teachers reported that instruction time, class size, professional development activities, availability of school funding, and state testing mandates impact their assessment routines. Teachers reported that both the preparation process and the results of the test created unbelievable tension both on students and

The Strengths and Difficulties Self-Report Questionnaire as a screening instrument in Norwegian community samples.

PubMed

Rønning, John A; Handegaard, Bjørn Helge; Sourander, Andre; Mørch, Willy-Tore

2004-04-01

This study reports on the application of the Norwegian self-report version of the Strengths and Difficulties Questionnaire (SDQ-S). The application of the SDQ-S was not motivated by a wish to reveal the prevalence of psychiatric disorders, but rather to set the stage for routine screening as part of schools' efforts to inform themselves about the life of adolescents at school. The survey included 4167 young people aged 11 to 16 years, attending 66 primary and secondary schools in Northern Norway. The respondents comprised 80.2% of the total population in these grades in the target area. Structural analysis of the instrument, including confirmatory factor analysis, internal consistency and intra- and cross-scale correlations revealed somewhat variable psychometric properties. Model modification suggested several ways of improving the structural psychometric properties of the SDQ-S. Norwegian cut-off points were similar to those found in other Scandinavian studies. About one third of the subjects reported at least minor perceived difficulties, while about 5% reported definite or severe difficulties. These difficulties were strongly associated with all symptom scales. Girls reported a significantly higher level of emotional problems and better prosocial functioning. Boys reported significantly higher scores on the externalising scales and on peer problems. The SDQ-S may be judged as an efficient and economical screening instrument for preventive research on large community samples. However, efforts should be made to improve its psychometric structure.

Reliability and validity of two self-rating scales in the assessment of childhood depression.

PubMed

Fundudis, T; Berney, T P; Kolvin, I; Famuyiwa, O O; Barrett, L; Bhate, S; Tyrer, S P

1991-07-01

A comparison was made of the reliability and validity of two self-rating scales, the Children's Depression Inventory (CDI) and Depression Self-Rating Scale (DSRS), in the diagnosis of depression in 93 children (aged 8-16 years) attending a university child psychiatry department. The two scales were of comparable merit but had only moderate discrimination between depressed and non-depressed children, with each scale having a misclassification rate of 25%. Better agreement was obtained in more verbally intelligent children, irrespective of age. Girls scored higher on the instruments than boys. No significant relationship was found between teacher assessment of classroom behaviour and the two self-rating depression instruments.

An Instrument to Assess Self-Statements During Public Speaking: Scale Development and Preliminary Psychometric Properties

PubMed Central

Hofmann, Stefan G.; DiBartolo, Patricia Marten

2006-01-01

Public speaking is the most commonly reported fearful social situation. Although a number of contemporary theories emphasize the importance of cognitive processes in social anxiety, there is no instrument available to assess fearful thoughts experienced during public speaking. The Self-Statements During Public Speaking (SSPS) scale is a 10-item questionnaire consisting of two 5-item subscales, the “Positive Self-Statements” (SSPS-P) and the “Negative Self-Statements” subscale (SSPS-N). Four studies report on the development and the preliminary psychometric properties of this instrument. PMID:16763666

[Interpersonal attention management inventory: a new instrument to capture different self- and external perception skills].

PubMed

Blaser, Klaus; Zlabinger, Milena; Hinterberger, Thilo

2014-01-01

The Interpersonal Attention Management Inventory (IAMI) represents a new instrument to capture self- and external perception skills. The underlying theoretical model assumes 3 mental locations of attention (the intrapersonal space, the extrapersonal space, and the external intrapersonal space) of the other. The IAMI was studied regarding its factor structure; it was shortened and statistical values as well as first reference values were calculated based on a larger sample (n = 1089). By factor analysis, the superordinate scales could be widely validated. The shortened version with 31 items and 3 superordinate scales shows a high reliability of the global value (Cronbach's α = 0.81) and, regarding the convergent validity, a modest correlation (r = 0.41) of the global value and mindfulness, measured with the Freiburg Mindfulness Inventory (FMI). Further validation studies are invited so that the IAMI can be used as an instrument for (course) diagnosis in the therapy of psychiatric disorders as well as for research in social neuroscience, e.g., in investigations on mindfulness, compassion, empathy, theory of mind, and self-boundaries.

An Attitude Scale on Individual Instrument and Individual Instrument Course: Validity-Reliability Research

ERIC Educational Resources Information Center

Kuçukosmanoglu, Hayrettin Onur

2015-01-01

The main purpose of this study is to develop a scale to determine students' attitude levels on individual instruments and individual instrument courses in instrument training, which is an important dimension of music education, and to conduct a validity-reliability research of the scale that has been developed. The scale consists of 16 items. The…

Acquaintance ratings of the Big Five personality traits: incremental validity beyond and interactive effects with self-reports in the prediction of workplace deviance.

PubMed

Kluemper, Donald H; McLarty, Benjamin D; Bing, Mark N

2015-01-01

It is widely established that the Big Five personality traits of conscientiousness, agreeableness, and emotional stability are antecedents to workplace deviance (Berry, Ones, & Sackett, 2007). However, these meta-analytic findings are based on self-reported personality traits. A recent meta-analysis by Oh, Wang, and Mount (2011) identified the value of acquaintance-reported personality in the prediction of job performance. The current investigation extends prior work by comparing the validities of self- and acquaintance-reported personality in the prediction of workplace deviance across 2 studies. We also hypothesized and tested an interactive, value-added integration of self- with acquaintance-reported personality using socioanalytic personality theory (R. T. Hogan, 1991). Both studies assessed self- and acquaintance-rated Big Five traits, along with supervisor-rated workplace deviance. However, the studies varied the measures of workplace deviance, and the 2nd study also included a self-rated workplace deviance criterion for additional comparison. Across both studies, the traits of conscientiousness and agreeableness were strong predictors of workplace deviance, and acquaintance-reported personality provided incremental validity beyond self-reports. Additionally, acquaintance-reported conscientiousness and agreeableness moderated the prediction of workplace deviance by interacting with the corresponding self-reported traits. Implications for personality theory and measurement are discussed along with applications for practice. (c) 2015 APA, all rights reserved.

Cultural adaptation: translatability assessment and linguistic validation of the patient-reported outcome instrument for irritable bowel syndrome with diarrhea

PubMed Central

Delgado-Herrera, Leticia; Lasch, Kathryn; Popielnicki, Ana; Nishida, Akito; Arbuckle, Rob; Banderas, Benjamin; Zentner, Susan; Gagainis, Ingrid; Zeiher, Bernhardt

2016-01-01

Background and objective Following a 2009 US Food and Drug Administration guidance, a new patient-reported outcome (PRO) instrument was developed to support end points in multinational clinical trials assessing irritable bowel syndrome with diarrhea (IBS-D) symptom severity. Our objective was to assess the translatability of the IBS-D PRO instrument into ten languages, and subsequently perform a cultural adaptation/linguistic validation of the questionnaire into Japanese and US Spanish. Materials and methods Translatability assessments of the US English version of the IBS-D PRO were performed by experienced PRO translators who were native speakers of each target language and currently residing in target-language countries. Languages were Chinese (People’s Republic of China), Dutch (the Netherlands), French (Belgium), German (Germany), Japanese (Japan), Polish (Poland), Portuguese (Brazil), Russian (Russia), Spanish (Mexico), and Spanish (US). The project team assessed the instrument to identify potential linguistic and/or cultural adaptation issues. After the issues identified were resolved, the instrument was translated into Spanish (US) and Japanese through a process of two forward translations, one reconciled translation, and one backward translation. The project team reviewed the translated versions before the instruments were evaluated by cognitive debriefing interviews with samples of five Spanish (US) and five Japanese IBS-D patients. Results Linguistic and cultural adaptation concerns identified during the translatability assessment required minor revisions, mainly the presentation of dates/times and word structure. During the cognitive debriefing interviews, two of five Spanish respondents misunderstood the term “bowel movement” to mean only diarrhea in the Spanish version. Consequently, the term was changed from “movimiento intestinal” to “evacuaciones”. None of the Japanese respondents identified issues with the Japanese version. Conclusion

Cultural adaptation: translatability assessment and linguistic validation of the patient-reported outcome instrument for irritable bowel syndrome with diarrhea.

PubMed

Delgado-Herrera, Leticia; Lasch, Kathryn; Popielnicki, Ana; Nishida, Akito; Arbuckle, Rob; Banderas, Benjamin; Zentner, Susan; Gagainis, Ingrid; Zeiher, Bernhardt

2016-01-01

Following a 2009 US Food and Drug Administration guidance, a new patient-reported outcome (PRO) instrument was developed to support end points in multinational clinical trials assessing irritable bowel syndrome with diarrhea (IBS-D) symptom severity. Our objective was to assess the translatability of the IBS-D PRO instrument into ten languages, and subsequently perform a cultural adaptation/linguistic validation of the questionnaire into Japanese and US Spanish. Translatability assessments of the US English version of the IBS-D PRO were performed by experienced PRO translators who were native speakers of each target language and currently residing in target-language countries. Languages were Chinese (People's Republic of China), Dutch (the Netherlands), French (Belgium), German (Germany), Japanese (Japan), Polish (Poland), Portuguese (Brazil), Russian (Russia), Spanish (Mexico), and Spanish (US). The project team assessed the instrument to identify potential linguistic and/or cultural adaptation issues. After the issues identified were resolved, the instrument was translated into Spanish (US) and Japanese through a process of two forward translations, one reconciled translation, and one backward translation. The project team reviewed the translated versions before the instruments were evaluated by cognitive debriefing interviews with samples of five Spanish (US) and five Japanese IBS-D patients. Linguistic and cultural adaptation concerns identified during the translatability assessment required minor revisions, mainly the presentation of dates/times and word structure. During the cognitive debriefing interviews, two of five Spanish respondents misunderstood the term "bowel movement" to mean only diarrhea in the Spanish version. Consequently, the term was changed from "movimiento intestinal" to "evacuaciones". None of the Japanese respondents identified issues with the Japanese version. The translatability of the IBS-D PRO instrument into ten target languages was

Teacher Evaluation Project. The Beginning Teacher Program, Intellectual Skills Development, Validity Studies of the Evaluation System, Special Instrument Development. Report for 1984-1985.

ERIC Educational Resources Information Center

Florida Coalition for the Development of a Performance Measurement System, Tallahassee.

Reports, summaries, and recommendations are presented on the following research studies: (1) Beginning Teacher Studies; (2) Instructional Skills for Teaching Higher Order Thinking; (3) Development of the Conferential Observation Instrument; (4) Predictive Validity Studies Conducted to Test the Relationship Between Teacher Performance as Measured…

Development and validation of a new condition-specific instrument for evaluation of smile esthetics-related quality of life.

PubMed

Saltovic, Ema; Lajnert, Vlatka; Saltovic, Sabina; Kovacevic Pavicic, Daniela; Pavlic, Andrej; Spalj, Stjepan

2018-03-01

Orofacial esthetics raises psychosocial issues. The purpose was to create and validate new short instrument for psychosocial impacts of altered smile esthetics. A team of an orthodontist, two prosthodontists, psychologist, and a dental student generated items that could draw up specific hypothetical psychosocial dimensions (69 items initially, 39 in final analysis). The sample consisted of 261 Caucasian subjects attending local high schools and university (26% male) aged 14 to 28 years that have self-administrated the designed questionnaire. Factorial analysis, Cronbach's alpha, Pearson correlation, paired samples t-test and analysis of variance were used for analyses of internal consistency, construct validity, responsiveness, and test-retest. Three dimensions of psychosocial impacts of altered smile esthetics were identified: dental self-consciousness, dental self-confidence and social contacts that can be best fitted by 12 items, 4 items in each dimension. Internal consistency was good (α in range 0.85-0.89). Good stability in test-retest was confirmed. In responsiveness testing, tooth whitening induced increase in dental self-confidence (P = 0.002), but no significant changes in other dimensions. The new instrument, Smile Esthetics-Related Quality of Life (SERQoL), is short and has proven to be a good indicator of psychosocial dimensions related to perception of smile esthetics. Smile Esthetics-Related Quality of Life questionnaire might have practical validity when applied in esthetic dental clinical procedures. © 2017 Wiley Periodicals, Inc.

Student information literacy: psychometric validation of a self-efficacy report.

PubMed

Brown, Gavin T L

2005-06-01

Psychometric characteristics of the Student Information Literacy Self-efficacy Report based on responses from 498 students ages 9 to 12 years are reported. Students report their self-efficacy (confidence and difficulty) in 11 different phases of being information literate, i.e., developing a topic, planning, self-management, locating sources, selecting sources, retrieving information, analysing information, evaluating information, synthesising knowledge, presenting knowledge, and self-evaluation using a positively packed rating scale. The data were strongly internally consistent (Cronbach alpha=.95) with a test-retest reliability of .78. The 11 phases, factors measured by a matching pair of self-efficacy questions, were confirmed (chi2=529.68; df= 198; RMSEA =.058; TLI=.940). Ratings were correlated low with teachers' ratings and test scores of information literacy skills and moderately correlated with academic self-concept. The test provides unique information about students' self-efficacy for information literacy. Its use in classrooms is warranted.

Self-report: psychology's four-letter word.

PubMed

Haeffel, Gerald J; Howard, George S

2010-01-01

Self-report continues to be one of the most widely used measurement strategies in psychology despite longstanding concerns about its validity and scientific rigor. In this article, the merits of self-report are examined from a philosophy of science perspective. A framework is also provided for evaluating self-report measures. Specifically, four issues are presented that can be used as a decision aid when making choices about measurement.

A population based validation study of self-reported pensions and benefits: the Nord-Trøndelag health study (HUNT)

PubMed Central

2013-01-01

Background Measures of disability pensions, sickness certification and long-term health related benefits are often self-reported in epidemiological studies. Few studies have examined these measures, and the validity is yet to be established. We aimed to estimate the validity of self-reported disability pension, rehabilitation benefit and retirement pension and to explore the benefit status and basic characteristics of those not responding to these items. A large health survey (HUNT2) containing self-reported questionnaire data on sickness benefits and pensions was linked to a national registry of pensions and benefits, used as “gold standard” for the analysis. We investigated two main sources of bias in self-reported data; misclassification - due to participants answering questions incorrectly, and systematic missing/selection bias - when participants do not respond to the questions. Sensitivity, specificity, positive (PPV) and negative (NPV) predicative value, agreement and Cohen’s Kappa were calculated for each benefit. Co-variables were compared between non-responders and responders. Results In the study-population of 40,633, 9.2% reported receiving disability pension, 1.4% rehabilitation benefits and 6.1% retirement pension. According to the registry, the corresponding numbers were 9.0%, 1.7% and 5.4%. Excluding non-responders, specificity, NPV and agreement were above 98% for all benefits. Sensitivity and PPV were lower. When including non-responders as non-receivers, specificity got higher, sensitivity dropped while the other measures changed less. Between 17.7% and 24.1% did not answer the questions on benefits. Non-responders were older and more likely to be female. They reported more anxiety, more depression, a higher number of somatic diagnoses, less physical activity and lower consumption of alcohol (p < 0.001 for all variables). For disability pension and retirement pension, non-responders were less likely to receive benefits than responders

Sexual Orientation Self-Concept Ambiguity: Scale Adaptation and Validation.

PubMed

Talley, Amelia E; Stevens, Jordan E

2017-07-01

The current article describes the adaptation of a measure of sexual orientation self-concept ambiguity (SSA) from an existing measure of general self-concept clarity. Latent "trait" scores of SSA reflect the extent to which a person's beliefs about their own sexual orientation are perceived as inconsistent, unreliable, or incongruent. Sexual minority and heterosexual women ( n = 348), ages 18 to 30, completed a cross-sectional survey. Categorical confirmatory factor analysis guided the selection of items to form a 10-item, self-report measure of SSA. In the current report, we also examine (a) reliability of the 10-item scale score, (b) measurement invariance based on respondents' sexual identity status and age group, and (c) correlations with preexisting surveys that purport to measure similar constructs and theoretical correlates. Evidence for internal reliability, measurement invariance (based on respondent sex), and convergent validity was also investigated in an independent, validation sample. The lowest SSA scores were reported by women who self-ascribed an exclusively heterosexual or exclusively lesbian/gay sexual identity, whereas those who reported a bisexual, mostly lesbian/gay, or mostly heterosexual identity, reported relatively higher SSA scores.

A Scoping Review of Self-Report Measures of Aggression and Bullying for Use With Preadolescent Children.

PubMed

Nelson, Helen J; Kendall, Garth E; Burns, Sharyn K; Schonert-Reichl, Kimberly A

2017-02-01

Bullying in schools is a major health concern throughout the world, contributing to poor educational and mental health outcomes. School nurses are well placed to facilitate the implementation and evaluation of bullying prevention strategies. To evaluate the effect of such strategies, it is necessary to measure children's behavior over time. This scoping review of instruments that measure the self-report of aggressive behavior and bullying by children will inform the evaluation of bullying interventions. This review aimed to identify validated instruments that measure aggression and bullying among preadolescent children (age 8-12). The review was part of a larger study that sought to differentiate bullying from aggressive behavior by measuring the self-report of power imbalance between the aggressor and the child being bullied. The measurement of power imbalance was therefore a key aspect of the scoping review.

The Relation of the Response Distribution to Self-Report Questionnaire Items and Cognitive Ability among School-Aged Children

ERIC Educational Resources Information Center

Stapleton, Laura M.; Reiner, Laura S.; Aluvathingal, Anu J.

2010-01-01

This proposed research is part of an on-going line of research of developing questionnaire instruments for use at the elementary school level. Because field trials often use child self-report as outcome measures and sometimes determine implementation fidelity using such measures, evaluation of the validity of the use of such measures with…

Using the Rasch measurement model to design a report writing assessment instrument.

PubMed

Carlson, Wayne R

2013-01-01

This paper describes how the Rasch measurement model was used to develop an assessment instrument designed to measure student ability to write law enforcement incident and investigative reports. The ability to write reports is a requirement of all law enforcement recruits in the state of Michigan and is a part of the state's mandatory basic training curriculum, which is promulgated by the Michigan Commission on Law Enforcement Standards (MCOLES). Recently, MCOLES conducted research to modernize its training and testing in the area of report writing. A structured validation process was used, which included: a) an examination of the job tasks of a patrol officer, b) input from content experts, c) a review of the professional research, and d) the creation of an instrument to measure student competency. The Rasch model addressed several measurement principles that were central to construct validity, which were particularly useful for assessing student performances. Based on the results of the report writing validation project, the state established a legitimate connectivity between the report writing standard and the essential job functions of a patrol officer in Michigan. The project also produced an authentic instrument for measuring minimum levels of report writing competency, which generated results that are valid for inferences of student ability. Ultimately, the state of Michigan must ensure the safety of its citizens by licensing only those patrol officers who possess a minimum level of core competency. Maintaining the validity and reliability of both the training and testing processes can ensure that the system for producing such candidates functions as intended.

Comparing the validity of the self reporting questionnaire and the Afghan symptom checklist: dysphoria, aggression, and gender in transcultural assessment of mental health

PubMed Central

2014-01-01

Background The relative performance of local and international assessment instruments is subject to ongoing discussion in transcultural research on mental health and psychosocial support. We examined the construct and external validity of two instruments, one developed for use in Afghanistan, the other developed by the World Health Organization for use in resource-poor settings. Methods We used data collected on 1003 Afghan adults (500 men, 503 women) randomly sampled at three sites in Afghanistan. We compared the 22-item Afghan Symptom Checklist (ASCL), a culturally-grounded assessment of psychosocial wellbeing, with Pashto and Dari versions of the 20-item Self-Reporting Questionnaire (SRQ-20). We derived subscales using exploratory and confirmatory factor analyses (EFA and CFA) and tested total and subscale scores for external validity with respect to lifetime trauma and household wealth using block model regressions. Results EFA suggested a three-factor structure for SRQ-20 - somatic complaints, negative affect, and emotional numbing - and a two-factor structure for ASCL - jigar khun (dysphoria) and aggression. Both factor models were supported by CFA in separate subsamples. Women had higher scores for each of the five subscales than men (p < 0.001), and larger bivariate associations with trauma (rs .24 to .29, and .10 to .19, women and men respectively) and household wealth (rs -.27 to -.39, and .05 to -.22, respectively). The three SRQ-20 subscales and the ASCL jigar khun subscale were equally associated with variance in trauma exposures. However, interactions between gender and jigar khun suggested that, relative to SRQ-20, the jigar khun subscale was more strongly associated with household wealth for women; similarly, gender interactions with aggression indicated that the aggression subscale was more strongly associated with trauma and wealth. Conclusions Two central elements of Afghan conceptualizations of mental distress - aggression and the syndrome

Comparing the validity of the self reporting questionnaire and the Afghan symptom checklist: dysphoria, aggression, and gender in transcultural assessment of mental health.

PubMed

Rasmussen, Andrew; Ventevogel, Peter; Sancilio, Amelia; Eggerman, Mark; Panter-Brick, Catherine

2014-07-18

The relative performance of local and international assessment instruments is subject to ongoing discussion in transcultural research on mental health and psychosocial support. We examined the construct and external validity of two instruments, one developed for use in Afghanistan, the other developed by the World Health Organization for use in resource-poor settings. We used data collected on 1003 Afghan adults (500 men, 503 women) randomly sampled at three sites in Afghanistan. We compared the 22-item Afghan Symptom Checklist (ASCL), a culturally-grounded assessment of psychosocial wellbeing, with Pashto and Dari versions of the 20-item Self-Reporting Questionnaire (SRQ-20). We derived subscales using exploratory and confirmatory factor analyses (EFA and CFA) and tested total and subscale scores for external validity with respect to lifetime trauma and household wealth using block model regressions. EFA suggested a three-factor structure for SRQ-20--somatic complaints, negative affect, and emotional numbing--and a two-factor structure for ASCL--jigar khun (dysphoria) and aggression. Both factor models were supported by CFA in separate subsamples. Women had higher scores for each of the five subscales than men (p < 0.001), and larger bivariate associations with trauma (rs .24 to .29, and .10 to .19, women and men respectively) and household wealth (rs -.27 to -.39, and .05 to -.22, respectively). The three SRQ-20 subscales and the ASCL jigar khun subscale were equally associated with variance in trauma exposures. However, interactions between gender and jigar khun suggested that, relative to SRQ-20, the jigar khun subscale was more strongly associated with household wealth for women; similarly, gender interactions with aggression indicated that the aggression subscale was more strongly associated with trauma and wealth. Two central elements of Afghan conceptualizations of mental distress--aggression and the syndrome jigar khun--were captured by the ASCL and not by

Validation of the Spanish Version of the Mammography-Specific Self-Efficacy Scale.

PubMed

Jerome-D'Emilia, Bonnie; Suplee, Patricia; Akincigil, Ayse

2015-05-01

To consider psychometric estimates of the validity and reliability of the Spanish translation of a mammography-specific self-efficacy scale. A cross-sectional study. Three primarily Hispanic churches and a Hispanic community center in a low-income urban area of New Jersey. 153 low-income Hispanic women aged 40-85 years. The translated scale was administered to participants during a six-month period. Internal consistency, reliability, and construct and predictive validity were assessed. Demographic variables included income and insurance status. Outcome variables included total mammography-specific self-efficacy and having had a mammogram within the past two years. Preliminary evidence of reliability and validity were found, and predictive validity was demonstrated. The health needs of specific populations can be addressed only when research instruments have been appropriately validated and all relevant factors are considered. Diverse groups of low-income women face similar challenges and barriers in their efforts to get screened. Nurses are in an ideal position to help women with preventive care decision making (e.g., screening for breast cancer). Understanding how a woman's level of self-efficacy affects her decision making should be considered when counseling a client.

Development and Score Validation of a Chemistry Laboratory Anxiety Instrument (CLAI) for College Chemistry Students.

ERIC Educational Resources Information Center

Bowen, Craig W.

1999-01-01

Reports the development and score validation of an instrument for measuring anxieties students experience in college chemistry laboratories. Factor analysis of scores from 361 college students shows that the developed Chemistry Laboratory Anxiety Instrument measures five constructs. Results from a second sample of 598 students show that scores on…

The development of an instrument to measure factors that influence self-perceived dignity.

PubMed

Vlug, Mariska G; de Vet, Henrica C W; Pasman, H Roeline W; Rurup, Mette L; Onwuteaka-Philipsen, Bregje D

2011-05-01

Preserving dignity can be considered as a goal of palliative care. To provide dignity-conserving care, it is relevant to identify the factors that influence a patient's self-perceived dignity. This study aims to develop an instrument to measure factors affecting self-perceived dignity that has good content validity and is appropriate for use in practice. Data were collected in the Advance Directives Cohort Study. In 2008, the cohort received a questionnaire with 31 items that might influence one's self-perceived dignity. For a subsample of people with poor health (n = 292), we analyzed which items could be removed because of the mean scores for presence of the item and its influence on dignity. The 31 items fell into four domains: evaluation of self in relation to others, functional status, mental state, and care and situational aspects. Mean scores for presence and influence on dignity showed large differences and were not correlated. Six items were scarcely present and did not substantially affect self-perceived dignity. Because three of these were expected to influence dignity in other settings, only three items could be removed and two items could be combined into one. After calculating correlations between conceptually similar items, one extra item could be removed. Reducing the instrument to 26 items and dichotomizing the answer option for presence increases its feasibility for use in practice. The instrument offers an important step to better understanding the phenomenon of self-perceived dignity by gaining information directly from patients.

The exchangeability of self-reports and administrative health care resource use measurements: assessement of the methodological reporting quality.

PubMed

Noben, Cindy Yvonne; de Rijk, Angelique; Nijhuis, Frans; Kottner, Jan; Evers, Silvia

2016-06-01

To assess the exchangeability of self-reported and administrative health care resource use measurements for cost estimation. In a systematic review (NHS EED and MEDLINE), reviewers evaluate, in duplicate, the methodological reporting quality of studies comparing the validation evidence of instruments measuring health care resource use. The appraisal tool Methodological Reporting Quality (MeRQ) is developed by merging aspects form the Guidelines for Reporting Reliability and Agreement Studies and the Standards for Reporting Diagnostic Accuracy. Out of 173 studies, 35 full-text articles are assessed for eligibility. Sixteen articles are included in this study. In seven articles, more than 75% of the reporting criteria assessed by MERQ are considered "good." Most studies score at least "fair" on most of the reporting quality criteria. In the end, six studies score "good" on the minimal criteria for reporting. Varying levels of agreement among the different data sources are found, with correlations ranging from 0.14 up to 0.93 and with occurrences of both random and systematic errors. The validation evidence of the small number of studies with adequate MeRQ cautiously supports the exchangeability of both the self-reported and administrative resource use measurement methods. Copyright © 2016 Elsevier Inc. All rights reserved.

Self-Report Measures of Family Competence.

ERIC Educational Resources Information Center

Green, Robert G.

1987-01-01

Describes and compares two self-report measures of family competence: the Family Awareness Scales (FAS) (Green and Kolevzon, late 1970s) and the Self-Report Family Inventory (SFI) (Beavers, 1983). Discusses reliability and validity. Their focus on the "insider" (family member) is different from the traditional examination of family…

Vocational Education Students' Generic Working Life Competencies: Developing a Self-Assessment Instrument

ERIC Educational Resources Information Center

Kyndt, Eva; Janssens, Ine; Coertjens, Liesje; Gijbels, David; Donche, Vincent; Van Petegem, Peter

2014-01-01

The current study reports on the process of developing a self-assessment instrument for vocational education students' generic working life competencies. The instrument was developed based on a competence framework and in close collaboration with several vocational education teachers and intermediary organisations offering various human…

Concurrent Validity of a Self-Reported Physical Activity “Vital Sign” Questionnaire With Adult Primary Care Patients

PubMed Central

Joy, Elizabeth A.; Gren, Lisa H.; Shaw, Janet M.

2016-01-01

Introduction No tool currently used by primary health care providers to assess physical activity has been evaluated for its ability to determine whether or not patients achieve recommended levels of activity. The purpose of this study was to assess concurrent validity of physical activity self-reported to the brief (<30 sec) Physical Activity “Vital Sign” questionnaire (PAVS) compared with responses to the lengthier (3–5 min), validated Modifiable Activity Questionnaire (MAQ). Methods Agreement between activity reported to the PAVS and MAQ by primary care patients at 2 clinics in 2014 was assessed by using percentages and κ coefficients. Agreement consisted of meeting or not meeting the 2008 Aerobic Physical Activity Guidelines for Americans (PA Guidelines) of the US Department of Health and Human Services. We compared self-reported usual minutes per week of moderate-to-vigorous physical activity among patients at a primary care clinic in 2014 who reported to PAVS and to MAQ by using Pearson correlation and Bland–Altman plots of agreement. Results Among 269 consenting patients who reported physical activity, PAVS results agreed with those of MAQ 89.6% of the time and demonstrated good agreement in identifying patients who did not meet PA Guidelines recommendations (κ = 0.55, ρ = 0.57; P < .001). Usual minutes per week of moderate-to-vigorous physical activity reported to PAVS had a high positive correlation with the same reported to MAQ (r = 0.71; P < .001). Conclusion PAVS may be a valid tool for identifying primary care patients who need counseling about physical activity. PAVS should be assessed further for agreement with repeated objective measures of physical activity in the patient population. PMID:26851335

A Questionnaire-Based Validation of Multidimensional Models of Self-Regulated Learning Strategies

ERIC Educational Resources Information Center

Teng, Lin Sophie; Zhang, Lawrence Jun

2016-01-01

This study aimed to validate a newly-developed instrument, The Writing Strategies for Self-Regulated Learning (SRL) Questionnaire, with respect to its multifaceted structure of SRL strategies in English as a foreign language (EFL) writing. A total of 790 undergraduate students from 6 universities in Northeast China volunteered to be participants.…

Corporate Entrepreneurship Assessment Instrument (CEAI): Refinement and Validation of a Survey Measure

DTIC Science & Technology

2007-03-01

CORPORATE ENTREPRENEURSHIP ASSESSMENT INSTRUMENT (CEAI): REFINEMENT AND VALIDATION OF A SURVEY MEASURE...States Government. AFIT/GIR/ENV/07-M7 CORPORATE ENTREPRENEURSHIP ASSESSMENT INSTRUMENT (CEAI): REFINEMENT AND VALIDATION OF A SURVEY MEASURE...UNLIMITED AFIT/GIR/ENV/07-M7 CORPORATE ENTREPRENEURSHIP ASSESSMENT INSTRUMENT (CEAI): REFINEMENT AND VALIDATION OF A SURVEY MEASURE Michael

Validation of an instrument to evaluate health promotion at schools

PubMed Central

Pinto, Raquel Oliveira; Pattussi, Marcos Pascoal; Fontoura, Larissa do Prado; Poletto, Simone; Grapiglia, Valenca Lemes; Balbinot, Alexandre Didó; Teixeira, Vanessa Andina; Horta, Rogério Lessa

2016-01-01

ABSTRACT OBJECTIVE To validate an instrument designed to assess health promotion in the school environment. METHODS A questionnaire, based on guidelines from the World Health Organization and in line with the Brazilian school health context, was developed to validate the research instrument. There were 60 items in the instrument that included 40 questions for the school manager and 20 items with direct observations made by the interviewer. The items’ content validation was performed using the Delphi technique, with the instrument being applied in 53 schools from two medium-sized cities in the South region of Brazil. Reliability (Cronbach’s alpha and split-half) and validity (principal component analysis) analyses were performed. RESULTS The final instrument remained composed of 28 items, distributed into three dimensions: pedagogical, structural and relational. The resulting components showed good factorial loads (> 0.4) and acceptable reliability (> 0.6) for most items. The pedagogical dimension identifies educational activities regarding drugs and sexuality, violence and prejudice, auto care and peace and quality of life. The structural dimension is comprised of access, sanitary structure, and conservation and equipment. The relational dimension includes relationships within the school and with the community. CONCLUSIONS The proposed instrument presents satisfactory validity and reliability values, which include aspects relevant to promote health in schools. Its use allows the description of the health promotion conditions to which students from each educational institution are exposed. Because this instrument includes items directly observed by the investigator, it should only be used during periods when there are full and regular activities at the school in question. PMID:26982958

Development of an Instrument to Assess Prospective Elementary Teacher Self-Efficacy Beliefs about Equitable Science Teaching and Learning (SEBEST)

NASA Astrophysics Data System (ADS)

Ritter, Jennifer M.; Boone, William J.; Rubba, Peter A.

2001-06-01

This paper presents an overview of the procedures used to develop and validate an instrument to measure the self-efficacy beliefs of prospective elementary teachers about equitable science teaching and learning. The instrument, titled the SEBEST, was based on the work of Ashton and Webb (1986a, 1986b) and Bandura (1977, 1986). It was modeled after the Science Teaching Efficacy Belief Instrument (STEBI) (Riggs, 1988) and the Science Teaching Efficacy Belief Instrument for Prospective Teachers (STEBI-B) (Enochs & Riggs, 1990). Based on the standardized development procedures used and associated evidence, the SEBEST appears to be a content and construct valid instrument, with high internal reliability qualities. "Most probable response" plots are introduced and used to bring meaning to SEBEST raw scores.

Validation of the Short Self-Regulation Questionnaire for Taiwanese College Students (TSSRQ).

PubMed

Chen, Yang-Hsueh; Lin, Yu-Ju

2018-01-01

While self-regulation has long been recognized as an important characteristic of an individual, instruments assessing the general aptitude of self-regulation remain limited especially in Asian countries. This study re-validated Carey et al.'s (2004) Short Self-Regulation Questionnaire based on a national sample of Taiwanese college students ( N = 1,988). Item analysis, exploratory factor analysis, and confirmatory factor analysis (CFA) yielded 22 items in five internally consistent factors. Descriptive findings showed that, a lack of proactiveness and volitional control, and a decrease of self-regulation throughout the college span appeared to be an overarching problem among Taiwanese college students. Furthermore, male students achieved lower self-regulation scores than female ones, and students in Services and STEM-related majors are in the need of self-regulation enhancement. Due to the generic measurement of individual's self-regulation traits, the Taiwanese Short Self-regulation Questionnaire (TSSRQ) can be flexibly applied to various contexts and used to deal with different issues beyond learning such as college students' Internet or smartphone addiction. Through this study, we hope the validated TSSRQ can promote studies on self-regulation and associated antecedents and outcomes, in turn leveraging college students' life adjustment and well-being.

Self-Reported Versus Accelerometer-Assessed Daily Physical Activity in Childhood Obesity Treatment.

PubMed

Schnurr, Theresia M; Bech, Bianca; Nielsen, Tenna R H; Andersen, Ida G; Hjorth, Mads F; Aadahl, Mette; Fonvig, Cilius E; Hansen, Torben; Holm, Jens-Christian

2017-08-01

We investigated the relationship between interview-based subjective ratings of physical activity (PA) engagement and accelerometer-assessed objectively measured PA in children and adolescents with overweight or obesity. A total of 92 children and adolescents (40 males, 52 females) with BMI ≥ 90th percentile for sex and age, aged 5-17 years had valid GT3X + accelerometer-assessed PA and interview-assessed self-reported information on PA engagement at the time of enrollment in a multidisciplinary outpatient tertiary treatment for childhood obesity. Accelerometer-derived mean overall PA and time spent in moderate to vigorous physical intensity were generated, applying cut-offs based on Vector Magnitude settings as defined by Romanzini et al. (2014), and a physical activity score (PAS) based on self-reported data. Overall, a higher self-reported PAS was correlated with higher accelerometer-assessed daily total PA levels ( r = 0.34, p < .01) and children who reported a high PAS were more physically active compared with children who reported a low PAS. There was a fair level of agreement between self-reported PAS and accelerometer-assessed PA (Kappa agreement = 0.23; 95% CI = [0.03, 0.43]; p = .01). PAS, derived from self-report, may be a useful instrument for evaluating PA at a group level among children and adolescents enrolled in multidisciplinary obesity treatment.

Chronic fatigue in patients with unexplained self-reported food hypersensitivity and irritable bowel syndrome: validation of a Norwegian translation of the Fatigue Impact Scale.

PubMed

Lind, Ragna; Berstad, Arnold; Hatlebakk, Jan; Valeur, Jørgen

2013-01-01

Patients with unexplained self-reported food hypersensitivity and irritable bowel syndrome (IBS) suffer from several health complaints, including fatigue. The aim of the present study was to validate a Norwegian translation of the Fatigue Impact Scale (FIS), and to assess the impact of fatigue in patients with self-reported food hypersensitivity and IBS, as compared with healthy controls. Thirty-eight patients with unexplained self-reported food hypersensitivity and IBS, who participated in the validation of the FIS completed the following additional questionnaires: the Short Form of Nepean Dyspepsia Index for assessment of quality of life, the Subjective Health Complaint Inventory, and questionnaires for diagnosis and severity of IBS. Impact of fatigue was studied in 43 patients with unexplained self-reported food hypersensitivity, 70% diagnosed with IBS, and 42 healthy controls. Cronbach's α for the FIS was 0.98, indicating excellent agreement between individual items. Scores on the FIS correlated with scores on the Short Form of Nepean Dyspepsia Index (r = 0.50, P = 0.001), indicating good convergent validity, and were higher in patients (median 85.0, interquartile range 36.8-105.3) than in controls (median 14.0, interquartile range 3.0-29.0, P ≤ 0.0001). The Norwegian translation of the FIS performed excellently in patients with unexplained self-reported food hypersensitivity and IBS, with patients reporting significantly more impact of chronic fatigue than healthy controls.

Ecological validity and clinical utility of Patient-Reported Outcomes Measurement Information System (PROMIS®) instruments for detecting premenstrual symptoms of depression, anger, and fatigue.

PubMed

Junghaenel, Doerte U; Schneider, Stefan; Stone, Arthur A; Christodoulou, Christopher; Broderick, Joan E

2014-04-01

This study examined the ecological validity and clinical utility of NIH Patient Reported-Outcomes Measurement Information System (PROMIS®) instruments for anger, depression, and fatigue in women with premenstrual symptoms. One-hundred women completed daily diaries and weekly PROMIS assessments over 4weeks. Weekly assessments were administered through Computerized Adaptive Testing (CAT). Weekly CATs and corresponding daily scores were compared to evaluate ecological validity. To test clinical utility, we examined if CATs could detect changes in symptom levels, if these changes mirrored those obtained from daily scores, and if CATs could identify clinically meaningful premenstrual symptom change. PROMIS CAT scores were higher in the pre-menstrual than the baseline (ps<.0001) and post-menstrual (ps<.0001) weeks. The correlations between CATs and aggregated daily scores ranged from .73 to .88 supporting ecological validity. Mean CAT scores showed systematic changes in accordance with the menstrual cycle and the magnitudes of the changes were similar to those obtained from the daily scores. Finally, Receiver Operating Characteristic (ROC) analyses demonstrated the ability of the CATs to discriminate between women with and without clinically meaningful premenstrual symptom change. PROMIS CAT instruments for anger, depression, and fatigue demonstrated validity and utility in premenstrual symptom assessment. The results provide encouraging initial evidence of the utility of PROMIS instruments for the measurement of affective premenstrual symptoms. Copyright © 2014 Elsevier Inc. All rights reserved.

Ecological Validity and Clinical Utility of Patient-Reported Outcomes Measurement Information System (PROMIS®) instruments for detecting premenstrual symptoms of depression, anger, and fatigue

PubMed Central

Junghaenel, Doerte U.; Schneider, Stefan; Stone, Arthur A.; Christodoulou, Christopher; Broderick, Joan E.

2014-01-01

Objective This study examined the ecological validity and clinical utility of NIH Patient Reported-Outcomes Measurement Information System (PROMIS®) instruments for anger, depression, and fatigue in women with premenstrual symptoms. Methods One-hundred women completed daily diaries and weekly PROMIS assessments over 4 weeks. Weekly assessments were administered through Computerized Adaptive Testing (CAT). Weekly CATs and corresponding daily scores were compared to evaluate ecological validity. To test clinical utility, we examined if CATs could detect changes in symptom levels, if these changes mirrored those obtained from daily scores, and if CATs could identify clinically meaningful premenstrual symptom change. Results PROMIS CAT scores were higher in the pre-menstrual than the baseline (ps < .0001) and post-menstrual (ps < .0001) weeks. The correlations between CATs and aggregated daily scores ranged from .73 to .88 supporting ecological validity. Mean CAT scores showed systematic changes in accordance with the menstrual cycle and the magnitudes of the changes were similar to those obtained from the daily scores. Finally, Receiver Operating Characteristic (ROC) analyses demonstrated the ability of the CATs to discriminate between women with and without clinically meaningful premenstrual symptom change. Conclusions PROMIS CAT instruments for anger, depression, and fatigue demonstrated validity and utility in premenstrual symptom assessment. The results provide encouraging initial evidence of the utility of PROMIS instruments for the measurement of affective premenstrual symptoms. PMID:24630180

Early Validity and Reliability Data for Two Instruments Assessing the Predispositions People Have toward Technology Use: Continued Integration of Quantitative and Qualitative Methods.

ERIC Educational Resources Information Center

Scherer, Marcia J.; McKee, Barbara G.

Validity and reliability data are presented for two instruments for assessing the predispositions that people have toward the use of assistive and educational technologies. The two instruments, the Assistive Technology Device Predisposition Assessment (ATDPA) and the Educational Technology Predisposition Assessment (ETPA), are self-report…

Voice-Related Patient-Reported Outcome Measures: A Systematic Review of Instrument Development and Validation

PubMed Central

Daniero, James J.; Hovis, Kristen L.; Sathe, Nila; Jacobson, Barbara; Penson, David F.; Feurer, Irene D.; McPheeters, Melissa L.

2017-01-01

Purpose The purpose of this study was to perform a comprehensive systematic review of the literature on voice-related patient-reported outcome (PRO) measures in adults and to evaluate each instrument for the presence of important measurement properties. Method MEDLINE, the Cumulative Index of Nursing and Allied Health Literature, and the Health and Psychosocial Instrument databases were searched using relevant vocabulary terms and key terms related to PRO measures and voice. Inclusion and exclusion criteria were developed in consultation with an expert panel. Three independent investigators assessed study methodology using criteria developed a priori. Measurement properties were examined and entered into evidence tables. Results A total of 3,744 studies assessing voice-related constructs were identified. This list was narrowed to 32 PRO measures on the basis of predetermined inclusion and exclusion criteria. Questionnaire measurement properties varied widely. Important thematic deficiencies were apparent: (a) lack of patient involvement in the item development process, (b) lack of robust construct validity, and (c) lack of clear interpretability and scaling. Conclusions PRO measures are a principal means of evaluating treatment effectiveness in voice-related conditions. Despite their prominence, available PRO measures have disparate methodological rigor. Care must be taken to understand the psychometric and measurement properties and the applicability of PRO measures before advocating for their use in clinical or research applications. PMID:28030869

Development and validation of Dutch version of Lasater Clinical Judgment Rubric in hospital practice: An instrument design study.

PubMed

Vreugdenhil, Jettie; Spek, Bea

2018-03-01

Clinical reasoning in patient care is a skill that cannot be observed directly. So far, no reliable, valid instrument exists for the assessment of nursing students' clinical reasoning skills in hospital practice. Lasater's clinical judgment rubric (LCJR), based on Tanner's model "Thinking like a nurse" has been tested, mainly in academic simulation settings. The aim is to develop a Dutch version of the LCJR (D-LCJR) and to test its psychometric properties when used in a hospital traineeship context. A mixed-model approach was used to develop and to validate the instrument. Ten dedicated educational units in a university hospital. A well-mixed group of 52 nursing students, nurse coaches and nurse educators. A Delphi panel developed the D-LCJR. Students' clinical reasoning skills were assessed "live" by nurse coaches, nurse educators and students who rated themselves. The psychometric properties tested during the assessment process are reliability, reproducibility, content validity and construct validity by testing two hypothesis: 1) a positive correlation between assessed and self-reported sum scores (convergent validity) and 2) a linear relation between experience and sum score (clinical validity). The obtained D-LCJR was found to be internally consistent, Cronbach's alpha 0.93. The rubric is also reproducible with intraclass correlations between 0.69 and 0.78. Experts judged it to be content valid. The two hypothesis were both tested significant, supporting evidence for construct validity. The translated and modified LCJR, is a promising tool for the evaluation of nursing students' development in clinical reasoning in hospital traineeships, by students, nurse coaches and nurse educators. More evidence on construct validity is necessary, in particular for students at the end of their hospital traineeship. Based on our research, the D-LCJR applied in hospital traineeships is a usable and reliable tool. Copyright © 2017 Elsevier Ltd. All rights reserved.

Measurement of assertive behavior: construct and predictive validity of self-report, role-playing, and in-vivo measures.

PubMed

Burkhart, B R; Green, S B; Harrison, W H

1979-04-01

Examined the predictive validity and construct equivalence of the three major procedures used to measure assertive behavior: Self-report, behavioral role-playing, and in-vivo assessment. Seventy-five Ss, who spanned the range of assertiveness, completed two self-report measures of assertiveness, the Rathus Assertiveness Scale (RAS) and the College Self-Expression Scale (CSES); two scales from the Endler S-R Inventory of General Trait Anxiousness, the interpersonal and general anxiety scales; eight role-playing situations that involved the expression of positive and negative assertiveness; and a telephone in-vivo task. In general, the study revealed the following: (1) assertiveness measures are task-dependent in that there was more overlap within task than between tasks; (2) there is a moderate degree of correspondence between self-report and role-playing measures, although this was true only for negative assertion; (3) positive and negative assertion do not appear to have the same topography of responding; and (4) there appears to be no consistent relationship between the in-vivo measure and any other type of assertiveness measure.

Clinical validity of the Me and My School questionnaire: a self-report mental health measure for children and adolescents.

PubMed

Patalay, Praveetha; Deighton, Jessica; Fonagy, Peter; Vostanis, Panos; Wolpert, Miranda

2014-01-01

The Me and My School Questionnaire (M&MS) is a self-report measure for children aged eight years and above that measures emotional difficulties and behavioural difficulties, and has been previously validated in a community sample. The present study aimed to assess its clinical sensitivity to justify its utility as a screening tool in schools. Data were collected from service-users (n = 91, 8-15 years) and accompanying parent/carer in outpatient mental health services in England. A matched community sample (N = 91) were used to assess the measure's ability to discriminate between low- and high-risk samples. Receiver operating curves (area under the curve, emotional difficulties = .79; behavioural difficulties = .78), mean comparisons (effect size, emotional difficulties d = 1.17, behavioural difficulties = 1.12) and proportions above clinical thresholds indicate that the measure satisfactorily discriminates between the samples. The scales have good internal reliability (emotional difficulties α = .84; behavioural difficulties α = .82) and cross-informant agreement with parent-reported symptoms is comparable to existing measures (r = .30). The findings of this study indicate that the M&MS sufficiently discriminates between high-risk (clinic) and low-risk (community) samples, has good internal reliability, compares favourably with existing self-report measures of mental health and has comparable levels of agreement between parent-report and self-report to other measures. Alongside existing validation of the M&MS, these findings justify the measures use as a self-report screening tool for mental health problems in community settings for children aged as young as 8 years.

Actual curriculum development practices instrument: Testing for factorial validity

NASA Astrophysics Data System (ADS)

Foi, Liew Yon; Bakar, Kamariah Abu; Hamzah, Mohd Sahandri Gani; Alwi, Nor Hayati

2014-09-01

The Actual Curriculum Development Practices Instrument (ACDP-I) was developed and the factorial validity of the ACDP-I was tested (n = 107) using exploratory factor analysis procedures in the earlier work of [1]. Despite the ACDP-I appears to be content and construct valid instrument with very high internal reliability qualities for using in Malaysia, the accumulated evidences are still needed to provide a sound scientific basis for the proposed score interpretations. Therefore, the present study addresses this concern by utilising the confirmatory factor analysis to further confirm the theoretical structure of the variable Actual Curriculum Development Practices (ACDP) and enrich the psychometrical properties of ACDP-I. Results of this study have practical implication to both researchers and educators whose concerns focus on teachers' classroom practices and the instrument development and validation process.

The positive mental health instrument: development and validation of a culturally relevant scale in a multi-ethnic Asian population.

PubMed

Vaingankar, Janhavi Ajit; Subramaniam, Mythily; Chong, Siow Ann; Abdin, Edimansyah; Orlando Edelen, Maria; Picco, Louisa; Lim, Yee Wei; Phua, Mei Yen; Chua, Boon Yiang; Tee, Joseph Y S; Sherbourne, Cathy

2011-10-31

Instruments to measure mental health and well-being are largely developed and often used within Western populations and this compromises their validity in other cultures. A previous qualitative study in Singapore demonstrated the relevance of spiritual and religious practices to mental health, a dimension currently not included in exiting multi-dimensional measures. The objective of this study was to develop a self-administered measure that covers all key and culturally appropriate domains of mental health, which can be applied to compare levels of mental health across different age, gender and ethnic groups. We present the item reduction and validation of the Positive Mental Health (PMH) instrument in a community-based adult sample in Singapore. Surveys were conducted among adult (21-65 years) residents belonging to Chinese, Malay and Indian ethnicities. Exploratory and confirmatory factor analysis (EFA, CFA) were conducted and items were reduced using item response theory tests (IRT). The final version of the PMH instrument was tested for internal consistency and criterion validity. Items were tested for differential item functioning (DIF) to check if items functioned in the same way across all subgroups. EFA and CFA identified six first-order factor structure (General coping, Personal growth and autonomy, Spirituality, Interpersonal skills, Emotional support, and Global affect) under one higher-order dimension of Positive Mental Health (RMSEA=0.05, CFI=0.96, TLI=0.96). A 47-item self-administered multi-dimensional instrument with a six-point Likert response scale was constructed. The slope estimates and strength of the relation to the theta for all items in each six PMH subscales were high (range:1.39 to 5.69), suggesting good discrimination properties. The threshold estimates for the instrument ranged from -3.45 to 1.61 indicating that the instrument covers entire spectrums for the six dimensions. The instrument demonstrated high internal consistency and had

Measurement properties of quality-of-life measurement instruments for infants, children and adolescents with eczema: a systematic review.

PubMed

Heinl, D; Prinsen, C A C; Sach, T; Drucker, A M; Ofenloch, R; Flohr, C; Apfelbacher, C

2017-04-01

Quality of life (QoL) is one of the core outcome domains identified by the Harmonising Outcome Measures for Eczema (HOME) initiative to be assessed in every eczema trial. There is uncertainty about the most appropriate QoL instrument to measure this domain in infants, children and adolescents. To systematically evaluate the measurement properties of existing measurement instruments developed and/or validated for the measurement of QoL in infants, children and adolescents with eczema. A systematic literature search in PubMed and Embase, complemented by a thorough hand search of reference lists, retrieved studies on measurement properties of eczema QoL instruments for infants, children and adolescents. For all eligible studies, we judged the adequacy of the measurement properties and the methodological study quality with the COnsensus-based Standards for the selection of health Measurement INstruments (COSMIN) checklist. Results from different studies were summarized in a best-evidence synthesis and formed the basis to assign four degrees of recommendation. Seventeen articles, three of which were found by hand search, were included. These 17 articles reported on 24 instruments. No instrument can be recommended for use in all eczema trials because none fulfilled all required adequacy criteria. With adequate internal consistency, reliability and hypothesis testing, the U.S. version of the Childhood Atopic Dermatitis Impact Scale (CADIS), a proxy-reported instrument, has the potential to be recommended depending on the results of further validation studies. All other instruments, including all self-reported ones, lacked significant validation data. Currently, no QoL instrument for infants, children and adolescents with eczema can be highly recommended. Future validation research should primarily focus on the CADIS, but also attempt to broaden the evidence base for the validity of self-reported instruments. © 2016 British Association of Dermatologists.

Self-report measure of financial exploitation of older adults.

PubMed

Conrad, Kendon J; Iris, Madelyn; Ridings, John W; Langley, Kate; Wilber, Kathleen H

2010-12-01