42 CFR 412.140 - Participation, data submission, and validation requirements under the Hospital Inpatient Quality...

Code of Federal Regulations, 2013 CFR

2013-10-01

... 42 Public Health 2 2013-10-01 2013-10-01 false Participation, data submission, and validation... Payment Systems § 412.140 Participation, data submission, and validation requirements under the Hospital... which a Hospital IQR payment determination will be made. (c) Submission and validation of Hospital IQR...

Measuring Stakeholder Participation in Evaluation: An Empirical Validation of the Participatory Evaluation Measurement Instrument (PEMI)

ERIC Educational Resources Information Center

Daigneault, Pierre-Marc; Jacob, Steve; Tremblay, Joel

2012-01-01

Background: Stakeholder participation is an important trend in the field of program evaluation. Although a few measurement instruments have been proposed, they either have not been empirically validated or do not cover the full content of the concept. Objectives: This study consists of a first empirical validation of a measurement instrument that…

Addressing Participant Validity in a Small Internet Health Survey (The Restore Study): Protocol and Recommendations for Survey Response Validation

PubMed Central

Dewitt, James; Capistrant, Benjamin; Kohli, Nidhi; Mitteldorf, Darryl; Merengwa, Enyinnaya; West, William

2018-01-01

Background While deduplication and cross-validation protocols have been recommended for large Web-based studies, protocols for survey response validation of smaller studies have not been published. Objective This paper reports the challenges of survey validation inherent in a small Web-based health survey research. Methods The subject population was North American, gay and bisexual, prostate cancer survivors, who represent an under-researched, hidden, difficult-to-recruit, minority-within-a-minority population. In 2015-2016, advertising on a large Web-based cancer survivor support network, using email and social media, yielded 478 completed surveys. Results Our manual deduplication and cross-validation protocol identified 289 survey submissions (289/478, 60.4%) as likely spam, most stemming from advertising on social media. The basic components of this deduplication and validation protocol are detailed. An unexpected challenge encountered was invalid survey responses evolving across the study period. This necessitated the static detection protocol be augmented with a dynamic one. Conclusions Five recommendations for validation of Web-based samples, especially with smaller difficult-to-recruit populations, are detailed. PMID:29691203

Addressing Participant Validity in a Small Internet Health Survey (The Restore Study): Protocol and Recommendations for Survey Response Validation.

PubMed

Dewitt, James; Capistrant, Benjamin; Kohli, Nidhi; Rosser, B R Simon; Mitteldorf, Darryl; Merengwa, Enyinnaya; West, William

2018-04-24

While deduplication and cross-validation protocols have been recommended for large Web-based studies, protocols for survey response validation of smaller studies have not been published. This paper reports the challenges of survey validation inherent in a small Web-based health survey research. The subject population was North American, gay and bisexual, prostate cancer survivors, who represent an under-researched, hidden, difficult-to-recruit, minority-within-a-minority population. In 2015-2016, advertising on a large Web-based cancer survivor support network, using email and social media, yielded 478 completed surveys. Our manual deduplication and cross-validation protocol identified 289 survey submissions (289/478, 60.4%) as likely spam, most stemming from advertising on social media. The basic components of this deduplication and validation protocol are detailed. An unexpected challenge encountered was invalid survey responses evolving across the study period. This necessitated the static detection protocol be augmented with a dynamic one. Five recommendations for validation of Web-based samples, especially with smaller difficult-to-recruit populations, are detailed. ©James Dewitt, Benjamin Capistrant, Nidhi Kohli, B R Simon Rosser, Darryl Mitteldorf, Enyinnaya Merengwa, William West. Originally published in JMIR Research Protocols (http://www.researchprotocols.org), 24.04.2018.

Impact on Participation and Autonomy: Test of Validity and Reliability for Older Persons.

PubMed

Hammar, Isabelle Ottenvall; Ekelund, Christina; Wilhelmson, Katarina; Eklund, Kajsa

2014-11-06

In research and healthcare it is important to measure older persons' self-determination in order to improve their possibilities to decide for themselves in daily life. The questionnaire Impact on Participation and Autonomy (IPA) assesses self-determination, but is not constructed for older persons. The aim of this study was to examine the validity and reliability of the IPA-S questionnaire for persons aged 70 years and older. The study was performed in two steps; first a validity test of the Swedish version of the questionnaire, IPA-S, followed by a reliability test-retest of an adjusted version. The validity was tested with focus groups and individual interviews on persons aged 77-88 years, and the reliability on persons aged 70-99 years. The validity test result showed that IPA-S is valid for older persons but it was too extensive and the phrasing of the items needed adjustments. The reliability test-retest on the adjusted questionnaire, IPA- Older persons (IPA-O), showed that 15 of 22 items had high agreement. IPA-O can be used to measure older persons' self-determination in their care and rehabilitation.

42 CFR 419.46 - Participation, data submission, and validation requirements under the Hospital Outpatient Quality...

Code of Federal Regulations, 2014 CFR

2014-10-01

... deadlines by measure and by data type are posted on the QualityNet Web site. (3) Initial submission... 42 Public Health 3 2014-10-01 2014-10-01 false Participation, data submission, and validation... Hospitals § 419.46 Participation, data submission, and validation requirements under the Hospital Outpatient...

42 CFR 412.140 - Participation, data submission, and validation requirements under the Hospital Inpatient Quality...

Code of Federal Regulations, 2014 CFR

2014-10-01

... 42 Public Health 2 2014-10-01 2014-10-01 false Participation, data submission, and validation... Payment Systems § 412.140 Participation, data submission, and validation requirements under the Hospital....org, before it begins to report data; (2) Identify and register a QualityNet Administrator as part of...

42 CFR 412.140 - Participation, data submission, and validation requirements under the Hospital Inpatient Quality...

Code of Federal Regulations, 2011 CFR

2011-10-01

... 42 Public Health 2 2011-10-01 2011-10-01 false Participation, data submission, and validation... Payment Systems § 412.140 Participation, data submission, and validation requirements under the Hospital....org, before it begins to report data; (2) Identify and register a QualityNet Administrator as part of...

42 CFR 412.140 - Participation, data submission, and validation requirements under the Hospital Inpatient Quality...

Code of Federal Regulations, 2012 CFR

2012-10-01

... 42 Public Health 2 2012-10-01 2012-10-01 false Participation, data submission, and validation... Payment Systems § 412.140 Participation, data submission, and validation requirements under the Hospital....org, before it begins to report data; (2) Identify and register a QualityNet Administrator as part of...

Development and Validation of an Instrument to Assess Youth Motivation to Participate in Career Development Events

ERIC Educational Resources Information Center

Knobloch, Neil A.; Brady, Colleen M.; Orvis, Kathryn S.; Carroll, Natalie J.

2016-01-01

Career development events develop career and life skills in youth, but limited work has been done to assess the motivation of students who participate in these events. The purpose of this study was to validate an instrument developed to measure youth motivation to participate in career development events. An instrument grounded in expectancy-value…

Validation of environmental content in the Young Children's Participation and Environment Measure.

PubMed

Khetani, Mary A

2015-02-01

To evaluate the concurrent validity of the environment content in the newly developed Young Children's Participation and Environment Measure (YC-PEM). Cross-sectional study. Data were collected online. Convenience and snowball sampling methods were used to survey caregivers of children (N=381; 85 children with developmental disabilities and delays and 296 children without developmental disabilities and delays) aged 0 and 5 years (mean age, 36.49±20.18 mo). Not applicable. The YC-PEM includes an assessment of the effect of environment on children's participation for 3 settings: home, daycare/preschool, and community. Pearson and Spearman correlational analyses were used to examine the concurrent validity of the YC-PEM environmental content according to a criterion measure, the Craig Hospital Inventory of Environmental Factors-Child and Parent Version (CHIEF-CP). The YC-PEM and the CHIEF-CP items were first mapped to the International Classification of Functioning, Disability, and Health-Children and Youth Version to identify items for pairwise comparison. We found small to moderate negative associations for 51 of 66 pairwise comparisons involving CHIEF-CP and YC-PEM environment items (r=-.13 to -.39; P<.01). Significant associations were found for items in all 5 International Classification of Functioning, Disability and Health-Children and Youth Version environmental domains. Results lend further support for the use of the YC-PEM for valid caregiver assessment of the physical, social, attitudinal, and institutional features of environments in terms of their effect on young children's participation within the home, daycare/preschool, and community settings. Copyright © 2015 American Congress of Rehabilitation Medicine. Published by Elsevier Inc. All rights reserved.

Measuring Participants' Attitudes Toward Mobile Device Conference Applications in Continuing Medical Education: Validation of an Instrument.

PubMed

Wittich, Christopher M; Wang, Amy T; Fiala, Justin A; Mauck, Karen F; Mandrekar, Jayawant N; Ratelle, John T; Beckman, Thomas J

2016-01-01

Mobile device applications (apps) may enhance live CME courses. We aimed to (1) validate a measure of participant attitudes toward using a conference app and (2) determine associations between participant characteristics and attitudes toward CME apps with conference app usage. We conducted a cross-sectional validation study of participants at the Mayo Clinic Selected Topics in Internal Medicine Course. A conference app was developed that included presentation slides, note-taking features, search functions, social networking with other attendees, and access to presenter information. The CME app attitudes survey instrument (CMEAPP-10) was designed to determine participant attitudes toward conference apps. Of the 602 participants, 498 (82.7%) returned surveys. Factor analysis revealed a two-dimensional model for CMEAPP-10 scores (Cronbach α, 0.97). Mean (SD) CMEAPP-10 scores (maximum possible score of five) were higher for women than for men (4.06 [0.91] versus 3.85 [0.92]; P = .04). CMEAPP-10 scores (mean [SD]) were significantly associated (P = .02) with previous app usage as follows: less than once per month, 3.73 (1.05); monthly, 3.41 (1.16); weekly, 4.03 (0.69); and daily or more, 4.06 (0.89). Scores were unrelated to participant age, specialty, practice characteristics, or previous app use. This is the first validated measure of attitudes toward CME apps among course participants. App usage was higher among younger participants who had previously used educational or professional apps. Additionally, attitudes were more favorable among women and those who had previously used apps. These findings have important implications regarding efforts to engage participants with portable and accessible technology.

Using wound care algorithms: a content validation study.

PubMed

Beitz, J M; van Rijswijk, L

1999-09-01

Valid and reliable heuristic devices facilitating optimal wound care are lacking. The objectives of this study were to establish content validation data for a set of wound care algorithms, to identify their associated strengths and weaknesses, and to gain insight into the wound care decision-making process. Forty-four registered nurse wound care experts were surveyed and interviewed at national and regional educational meetings. Using a cross-sectional study design and an 83-item, 4-point Likert-type scale, this purposive sample was asked to quantify the degree of validity of the algorithms' decisions and components. Participants' comments were tape-recorded, transcribed, and themes were derived. On a scale of 1 to 4, the mean score of the entire instrument was 3.47 (SD +/- 0.87), the instrument's Content Validity Index was 0.86, and the individual Content Validity Index of 34 of 44 participants was > 0.8. Item scores were lower for those related to packing deep wounds (P < .001). No other significant differences were observed. Qualitative data analysis revealed themes of difficulty associated with wound assessment and care issues, that is, the absence of valid and reliable definitions. The wound care algorithms studied proved valid. However, the lack of valid and reliable wound assessment and care definitions hinders optimal use of these instruments. Further research documenting their clinical use is warranted. Research-based practice recommendations should direct the development of future valid and reliable algorithms designed to help nurses provide optimal wound care.

Developing and validating risk prediction models in an individual participant data meta-analysis

PubMed Central

2014-01-01

Background Risk prediction models estimate the risk of developing future outcomes for individuals based on one or more underlying characteristics (predictors). We review how researchers develop and validate risk prediction models within an individual participant data (IPD) meta-analysis, in order to assess the feasibility and conduct of the approach. Methods A qualitative review of the aims, methodology, and reporting in 15 articles that developed a risk prediction model using IPD from multiple studies. Results The IPD approach offers many opportunities but methodological challenges exist, including: unavailability of requested IPD, missing patient data and predictors, and between-study heterogeneity in methods of measurement, outcome definitions and predictor effects. Most articles develop their model using IPD from all available studies and perform only an internal validation (on the same set of data). Ten of the 15 articles did not allow for any study differences in baseline risk (intercepts), potentially limiting their model’s applicability and performance in some populations. Only two articles used external validation (on different data), including a novel method which develops the model on all but one of the IPD studies, tests performance in the excluded study, and repeats by rotating the omitted study. Conclusions An IPD meta-analysis offers unique opportunities for risk prediction research. Researchers can make more of this by allowing separate model intercept terms for each study (population) to improve generalisability, and by using ‘internal-external cross-validation’ to simultaneously develop and validate their model. Methodological challenges can be reduced by prospectively planned collaborations that share IPD for risk prediction. PMID:24397587

Validation of Brief Multidimensional Spirituality/Religiousness Inventory (BMMRS) in Italian Adult Participants and in Participants with Medical Diseases.

PubMed

Vespa, Anna; Giulietti, Maria Velia; Spatuzzi, Roberta; Fabbietti, Paolo; Meloni, Cristina; Gattafoni, Pisana; Ottaviani, Marica

2017-06-01

This study aimed at assessing the reliability and construct validity of Brief Multidimensional Measure of Religiousness/Spirituality (BMMRS) on Italian sample. 353 Italian participants: 58.9% affected by different diseases and 41.1% healthy subjects. The results of descriptive statistics of internal consistency reliabilities (Chronbach's coefficient) of the BMMRS revealed a remarkable consistency and reliability of different scales DSE, SpC, SC, CSC, VB, SPY-WELL and a good Inter-Class Correlations ≥70 maintaining a good stability of the measures over the time. BMMRS is a useful inventory for the evaluation of the principal spiritual dimensions.

Tinnitus Screener: Results From the First 100 Participants in an Epidemiology Study.

PubMed

Henry, James A; Griest, Susan; Austin, Don; Helt, Wendy; Gordon, Jane; Thielman, Emily; Theodoroff, Sarah M; Lewis, M Samantha; Blankenship, Cody; Zaugg, Tara L; Carlson, Kathleen

2016-06-01

In the Noise Outcomes in Servicemembers Epidemiology Study, Veterans recently separated from the military undergo comprehensive assessments to initiate long-term monitoring of their auditory function. We developed the Tinnitus Screener, a four-item algorithmic instrument that determines whether tinnitus is present and, if so, whether it is constant or intermittent, or whether only temporary tinnitus has been experienced. Predictive validity data are presented for the first 100 Noise Outcomes in Servicemembers Epidemiology Study participants. The Tinnitus Screener was administered to participants by telephone. In lieu of a gold standard for determining tinnitus presence, the predictive validity of the tinnitus category assigned to participants on the basis of the Screener results was assessed when the participants attended audiologic testing. Of the 100 participants, 67 screened positive for intermittent or constant tinnitus. Three were categorized as "temporary" tinnitus only, and 30 were categorized as "no tinnitus." Tinnitus categorization was predictively valid with 96 of the 100 participants. These results provide preliminary evidence that the Screener may be suitable for quickly determining essential parameters of reported tinnitus. We have since revised the instrument to differentiate acute from chronic tinnitus and to identify occasional tinnitus. We are also obtaining measures that will enable assessment of its test-retest reliability.

Critical validation studies of neurofeedback.

PubMed

Gruzelier, John; Egner, Tobias

2005-01-01

The field of neurofeedback training has proceeded largely without validation. In this article the authors review studies directed at validating sensory motor rhythm, beta and alpha-theta protocols for improving attention, memory, and music performance in healthy participants. Importantly, benefits were demonstrable with cognitive and neurophysiologic measures that were predicted on the basis of regression models of learning to enhance sensory motor rhythm and beta activity. The first evidence of operant control over the alpha-theta ratio is provided, together with remarkable improvements in artistic aspects of music performance equivalent to two class grades in conservatory students. These are initial steps in providing a much needed scientific basis to neurofeedback.

PRA (Probabilistic Risk Assessments) Participation versus Validation

NASA Technical Reports Server (NTRS)

DeMott, Diana; Banke, Richard

2013-01-01

Probabilistic Risk Assessments (PRAs) are performed for projects or programs where the consequences of failure are highly undesirable. PRAs primarily address the level of risk those projects or programs posed during operations. PRAs are often developed after the design has been completed. Design and operational details used to develop models include approved and accepted design information regarding equipment, components, systems and failure data. This methodology basically validates the risk parameters of the project or system design. For high risk or high dollar projects, using PRA methodologies during the design process provides new opportunities to influence the design early in the project life cycle to identify, eliminate or mitigate potential risks. Identifying risk drivers before the design has been set allows the design engineers to understand the inherent risk of their current design and consider potential risk mitigation changes. This can become an iterative process where the PRA model can be used to determine if the mitigation technique is effective in reducing risk. This can result in more efficient and cost effective design changes. PRA methodology can be used to assess the risk of design alternatives and can demonstrate how major design changes or program modifications impact the overall program or project risk. PRA has been used for the last two decades to validate risk predictions and acceptability. Providing risk information which can positively influence final system and equipment design the PRA tool can also participate in design development, providing a safe and cost effective product.

Relative Validity and Reliability of a 1-Week, Semiquantitative Food Frequency Questionnaire for Women Participating in the Supplemental Nutrition Assistance Program.

PubMed

Sanjeevi, Namrata; Freeland-Graves, Jeanne; George, Goldy Chacko

2017-12-01

The Supplemental Nutrition Assistance Program (SNAP) plays a critical role in reducing food insecurity by distribution of benefits at a monthly interval to participants. Households that receive assistance from SNAP spend at least three-quarters of benefits within the first 2 weeks of receipt. Because this expenditure pattern may be associated with lower food intake toward the end of the month, it is important to develop a tool that can assess the weekly diets of SNAP participants. The goal of this study was to develop and assess the relative validity and reliability of a semiquantitative 1-week food frequency questionnaire (FFQ) tailored to a population of women participating in SNAP. The FFQ was derived from an existing 195-item FFQ that was based on a reference period of 1 month. This 195-item FFQ has been validated in a population of low-income postpartum women who were recruited from central Texas during 2004. Mean daily servings of each food item in the 195-item FFQ completed by women who took part in the 2004 validation study were calculated to determine the most frequently consumed food items. Emphasis on these items led to the creation of a shorter, 1-week FFQ of only 95 items. This new 1-week instrument was compared with 3-day diet records to evaluate relative validity in a sample of women participating in SNAP. For reliability, the FFQ was administered a second time, separated by a 1-month time interval. The validity study included 70 female SNAP participants who were recruited from the partner agencies of the Central Texas Food Bank from March to June 2015. A subsample of 40 women participated in the reliability study. Outcome measures were mean nutrient intake values obtained from the two tests of the 95-item FFQ and 3-day diet records. Deattenuated Pearson correlation coefficients examined relationships in nutrient intake between the 95-item FFQ and 3-day diet records, and a paired samples t test determined differences in mean nutrient intake. Weighted

General Health Questionnaire-12 validity in Colombia and factorial equivalence between clinical and nonclinical participants.

PubMed

Ruiz, Francisco J; García-Beltrán, Diana M; Suárez-Falcón, Juan C

2017-10-01

The General Health Questionnaire - 12 (GHQ-12) is a widely used screening self-report for emotional disorders among adults. However, there is little evidence concerning the validity of the GHQ-12 in Colombia and its factorial invariance between nonclinical and clinical samples. Accordingly, the current study aims to explore the GHQ-12 validity in Colombian nonclinical and clinical samples. The GHQ-12 was administered to a total of 1641 participants, including a sample of undergraduates, one of general population, and a clinical sample. The internal consistency of the GHQ-12 across samples was good (overall alpha of .90). The one-factor model showed a good fit to the data and was considered theoretically more coherent than the two-factor model with positive and negative items loading in separate factors. Metric and scalar invariance were observed across nonclinical and clinical samples. The GHQ-12 scores were strongly and positively related to emotional symptoms and experiential avoidance, and negatively related to life satisfaction. According to the receiver operating characteristic (ROC) curves, a threshold score of 11/12 was optimal to identify emotional disorders. In conclusion, the GHQ-12 is a valid screening self-report in Colombia that provides scores that can be compared across clinical and nonclinical participants. Copyright © 2017 Elsevier B.V. All rights reserved.

Measuring children's self-reported sport participation, risk perception and injury history: development and validation of a survey instrument.

PubMed

Siesmaa, Emma J; Blitvich, Jennifer D; White, Peta E; Finch, Caroline F

2011-01-01

Despite the health benefits associated with children's sport participation, the occurrence of injury in this context is common. The extent to which sport injuries impact children's ongoing involvement in sport is largely unknown. Surveys have been shown to be useful for collecting children's injury and sport participation data; however, there are currently no published instruments which investigate the impact of injury on children's sport participation. This study describes the processes undertaken to assess the validity of two survey instruments for collecting self-reported information about child cricket and netball related participation, injury history and injury risk perceptions, as well as the reliability of the cricket-specific version. Face and content validity were assessed through expert feedback from primary and secondary level teachers and from representatives of peak sporting bodies for cricket and netball. Test-retest reliability was measured using a sample of 59 child cricketers who completed the survey on two occasions, 3-4 weeks apart. Based on expert feedback relating to face and content validity, modification and/or deletion of some survey items was undertaken. Survey items with low test-retest reliability (κ≤0.40) were modified or deleted, items with moderate reliability (κ=0.41-0.60) were modified slightly and items with higher reliability (κ≥0.61) were retained, with some undergoing minor modifications. This is the first survey of its kind which has been successfully administered to cricketers aged 10-16 years to collect information about injury risk perceptions and intentions for continued sport participation. Implications for its generalisation to other child sport participants are discussed. Copyright © 2010 Sports Medicine Australia. Published by Elsevier Ltd. All rights reserved.

Reliability and criterion validity of two applications of the iPhone™ to measure cervical range of motion in healthy participants

PubMed Central

2013-01-01

Summary of background data Recent smartphones, such as the iPhone, are often equipped with an accelerometer and magnetometer, which, through software applications, can perform various inclinometric functions. Although these applications are intended for recreational use, they have the potential to measure and quantify range of motion. The purpose of this study was to estimate the intra and inter-rater reliability as well as the criterion validity of the clinometer and compass applications of the iPhone in the assessment cervical range of motion in healthy participants. Methods The sample consisted of 28 healthy participants. Two examiners measured cervical range of motion of each participant twice using the iPhone (for the estimation of intra and inter-reliability) and once with the CROM (for the estimation of criterion validity). Estimates of reliability and validity were then established using the intraclass correlation coefficient (ICC). Results We observed a moderate intra-rater reliability for each movement (ICC = 0.65-0.85) but a poor inter-rater reliability (ICC < 0.60). For the criterion validity, the ICCs are moderate (>0.50) to good (>0.65) for movements of flexion, extension, lateral flexions and right rotation, but poor (<0.50) for the movement left rotation. Conclusion We found good intra-rater reliability and lower inter-rater reliability. When compared to the gold standard, these applications showed moderate to good validity. However, before using the iPhone as an outcome measure in clinical settings, studies should be done on patients presenting with cervical problems. PMID:23829201

Validation of an Alzheimer’s disease assessment battery in Asian participants with mild to moderate Alzheimer’s disease

PubMed Central

Shen, Joan HQ; Shen, Qi; Yu, Holly; Lai, Jin-Shei; Beaumont, Jennifer L; Zhang, Zhenxin; Wang, Huali; Kim, Seong Yoon; Chen, Christopher; Kwok, Timothy; Wang, Shuu-Jiun; Lee, Dong Young; Harrison, John; Cummings, Jeffrey

2014-01-01

There is a lack of validated tools for assessing Alzheimer’s disease (AD) across Asia. This study evaluates the psychometric properties of the Alzheimer’s Disease Assessment Scale-Cognitive Subscale (ADAS-Cog), Disability Assessment for Dementia (DAD), and Neuropsychological Test Battery (NTB) in Asian participants. Participants with mild to moderate AD (n=251) and healthy controls (n=51) from Mainland China, Taiwan, Singapore, Hong Kong, and South Korea completed selected instruments at several time points. Test-retest reliability was better than 0.70 for all tests. AD participants performed significantly more poorly than controls on every score. Within the AD group, greater disease severity corresponded to significantly poorer performance. The AD group test performance worsened over time and there was a trend for worse performance in AD compared to healthy controls over time. The ADAS-Cog, DAD, and NTB are reliable, valid, and responsive measures in this population and could be used for clinical trials across Asian countries/regions. PMID:25628967

Effects of validating communication on recall during a pain-task in healthy participants.

PubMed

Carstens, Johan K P; Boersma, Katja; Schrooten, Martien G S; Linton, Steven J

2017-10-01

Increasing recall of instructions and advice in a pain consultation is important, since it is a prerequisite for adherence to treatment recommendations. However, interference due to pain-related distress may result in poor recall. Whereas there are some indications that recall can be increased by empathic communication that reduces interference, this interesting possibility remains largely untested experimentally. The current experiment aimed at studying effects of empathic communication, and more specifically validation, on recall during a pain test and possible mediators and moderators of this effect. Participants received either validating (N=25) or invalidating responses (N=25) from the experimenter during a pain provoking task, followed by self-report measures of interference (affect, situational pain catastrophizing) and recall (accurate and false memories of words). As expected, the validated group exhibited higher accurate recall and less false memories following the pain test as compared to the invalidated group. This was partly due to the effect of interference being counteracted by moderating the relationship between pain catastrophizing and recall. These novel results suggest that validating communication can counteract interference due to pain catastrophizing on recall, at least in a controlled experimental setting. Good communication by health professionals is of utmost importance for adherence to pain management. The current results expand our knowledge on the effects of pain communication by establishing and explaining a clear link between empathic communication and recall, highlighting the role of pain catastrophizing. Copyright © 2017 Scandinavian Association for the Study of Pain. Published by Elsevier B.V. All rights reserved.

Test of Creative Imagination: Validity and Reliability Study

ERIC Educational Resources Information Center

Gundogan, Aysun; Ari, Meziyet; Gonen, Mubeccel

2013-01-01

The purpose of this study was to investigate validity and reliability of the test of creative imagination. This study was conducted with the participation of 1000 children, aged between 9-14 and were studying in six primary schools in the city center of Denizli Province, chosen by cluster ratio sampling. In the study, it was revealed that the…

Social Media Addiction Scale-Student Form: The Reliability and Validity Study

ERIC Educational Resources Information Center

Sahin, Cengiz

2018-01-01

The purpose of this study is to develop a valid and reliable measurement tool to determine the social media addictions of secondary school, high school and university students. 998 students participated in the study. 476 students from secondary schools, high schools and universities participated in the first application during which the…

Development and Validation of a Short Form of the Social Role Participation Questionnaire in Patients with Ankylosing Spondylitis.

PubMed

Oude Voshaar, Martijn; van Onna, Marloes; van Genderen, Simon; van de Laar, Mart; van der Heijde, Désirée; Heuft, Liesbeth; Spoorenberg, Anneke; Luime, Jolanda; Gignac, Monique; Boonen, Annlies

2016-07-01

The Social Role Participation Questionnaire (SRPQ) assesses the influence of health on 11 specific roles and 1 general role along 4 dimensions. In this study, a shortened version of the SRPQ (s-SRPQ) was developed in patients with ankylosing spondylitis (AS) to facilitate data collection in clinical studies and practice. Using data from 246 patients with AS and population controls, the fit of each role to the different participation dimensions, the contribution of each role to the measurement precision, and the correlation between dimensions were evaluated using item response theory. Representation of the 3 participation chapters of the International Classification of Functioning, Disability, and Health was ensured. Reliability of each dimension of both versions of the SRPQ was compared by correlating scores to the Medical Outcomes Study Short Form-36 (SF-36) and the Satisfaction With Life Scale (SWLS), and by comparing ability to discriminate between patients and controls and between patients with low and high disease activity (Bath Ankylosing Spondylitis Disease Activity Index ≥ 4). The s-SRPQ, which assesses participation across 6 social roles along 2 dimensions (physical difficulty and satisfaction with performance), was proposed. Both dimensions of the s-SRPQ were highly reliable (r ≥ 0.86) and were shown to have construct validity as indicated by a similar pattern of correlations with the SF-36 and SWLS as the original SRPQ dimensions. Both versions discriminated well between patients and controls and between patients with high versus low disease activity (relative validity ≥ 0.72). The s-SRPQ retains the measurement properties of the original SRPQ and seems useful for measuring the effect of AS on participation.

Absorption in Sport: A Cross-Validation Study

PubMed Central

Koehn, Stefan; Stavrou, Nektarios A. M.; Cogley, Jeremy; Morris, Tony; Mosek, Erez; Watt, Anthony P.

2017-01-01

Absorption has been identified as readiness for experiences of deep involvement in the task. Conceptually, absorption is a key psychological construct, incorporating experiential, cognitive, and motivational components. Although, no operationalization of the construct has been provided to facilitate research in this area, the purpose of this research was the development and examination of the psychometric properties of a sport-specific measure of absorption that evolved from the use of the modified Tellegen Absorption Scale (MODTAS; Jamieson, 2005) in mainstream psychology. The study aimed to provide evidence of the psychometric properties, reliability, and validity of the Measure of Absorption in Sport Contexts (MASCs). The psychometric examination included a calibration sample from Scotland and a cross-validation sample from Australia using a cross-sectional design. The item pool was developed based on existing items from the modified Tellegen Absorption Scale (Jamieson, 2005). The MODTAS items were reworded and translated into a sport context. The Scottish sample consisted of 292 participants and the Australian sample of 314 participants. Congeneric model testing and confirmatory factor analysis for both samples and multi-group invariance testing across samples was used. In the cross-validation sample the MASC subscales showed acceptable internal consistency and construct reliability (≥0.70). Excellent fit indices were found for the final 18-item, six-factor measure in the cross-validation sample, χ(120)2 = 197.486, p < 0.001; CFI = 0.957; TLI = 0.945; RMSEA = 0.045; SRMR = 0.044. Multi-group invariance testing revealed no differences in item meaning, except for two items. The MASC and the Dispositional Flow Scale-2 showed moderate-to-strong positive correlations in both samples, r = 0.38, p < 0.001 and r = 0.42, p < 0.001, supporting the external validity of the MASC. This article provides initial evidence in support of the psychometric properties

Validation of internet-based self-reported anthropometric, demographic data and participant identity in the Food4Me study

USDA-ARS?s Scientific Manuscript database

BACKGROUND In e-health intervention studies, there are concerns about the reliability of internet-based, self-reported (SR) data and about the potential for identity fraud. This study introduced and tested a novel procedure for assessing the validity of internet-based, SR identity and validated anth...

[Adapting and validating the generic instrument CollaboRATE™ to measure women's participation in health related decision-making during the reproductive process].

PubMed

Bravo, Paulina; Contreras, Aixa; Dois, Angelina; Villarroel, Luis

2018-05-01

There is a worldwide interest in involving patients in health related decisions, so patients can actively search for therapeutic options and choose course of action that allows them to have better quality of life and wellbeing. The majority of the instruments available to capture the degree of participation in medical decision-making are in English and have been developed in high income countries. To adapt and validate for the Chilean context the instrument CollaboRATE™, to measure women's participation in medical decisions during the reproductive process. Cross-sectional study to adapt and validate the instrument CollaboRATE™. Maternity units in Santiago, Chile. Puerperal women in maternity units of three public hospitals. Translation and back-translation, cultural and linguistic relevance with service users and final revision by experts. Study for validation with 90 puerperal women. The Chilean version of CollaboRATE™ demonstrated to be a reliable instrument to capture the degree of patients' participation in medical decision-making. Cronbach alpha was above 0.89. This study provides the first instrument to capture the prevalence of SDM in a Latin American country. This instrument will be critical in future research efforts that seek to explore to what extent people are being involved in the decisions related to their healthcare. Copyright © 2017. Publicado por Elsevier España, S.L.U.

Impact of sample collection participation on the validity of estimated measures of association in the National Birth Defects Prevention Study when assessing gene-environment interactions.

PubMed

Jenkins, Mary M; Reefhuis, Jennita; Herring, Amy H; Honein, Margaret A

2017-12-01

To better understand the impact that nonresponse for specimen collection has on the validity of estimates of association, we examined associations between self-reported maternal periconceptional smoking, folic acid use, or pregestational diabetes mellitus and six birth defects among families who did and did not submit buccal cell samples for DNA following a telephone interview as part of the National Birth Defects Prevention Study (NBDPS). Analyses included control families with live born infants who had no birth defects (N = 9,465), families of infants with anorectal atresia or stenosis (N = 873), limb reduction defects (N = 1,037), gastroschisis (N = 1,090), neural tube defects (N = 1,764), orofacial clefts (N = 3,836), or septal heart defects (N = 4,157). Estimated dates of delivery were between 1997 and 2009. For each exposure and birth defect, odds ratios and 95% confidence intervals were calculated using logistic regression stratified by race-ethnicity and sample collection status. Tests for interaction were applied to identify potential differences between estimated measures of association based on sample collection status. Significant differences in estimated measures of association were observed in only four of 48 analyses with sufficient sample sizes. Despite lower than desired participation rates in buccal cell sample collection, this validation provides some reassurance that the estimates obtained for sample collectors and noncollectors are comparable. These findings support the validity of observed associations in gene-environment interaction studies for the selected exposures and birth defects among NBDPS participants who submitted DNA samples. Published 2017. This article is a U.S. Government work and is in the public domain in the USA.

Shedding light on research participation effects in behaviour change trials: a qualitative study examining research participant experiences.

PubMed

MacNeill, Virginia; Foley, Marian; Quirk, Alan; McCambridge, Jim

2016-01-29

this study. This study demonstrates the likely value of well conducted qualitative studies of subtle research participation effects, which may be particularly important to explore for alcohol. Separating unintended influences in trial participation from the effects of behaviour change interventions being evaluated therein is necessary for valid estimates of intervention effects.

Preliminary development and validation of an Australian community participation questionnaire: types of participation and associations with distress in a coastal community.

PubMed

Berry, Helen Louise; Rodgers, Bryan; Dear, Keith B G

2007-04-01

Participating in the social and civic life of communities is protectively associated with the onset and course of physical and mental disorders, and is considered important in achieving health promotion goals. Despite its importance in health research, there is no systematically developed measure of community participation. Our aim was to undertake the preliminary development of a community participation questionnaire, including validating it against an external reference, general psychological distress. Participants were 963 randomly selected community members, aged 19-97, from coastal New South Wales, Australia, who completed an anonymous postal survey. There were 14 types of community participation, most of which were characterised by personal involvement, initiative and effort. Frequency of participation varied across types and between women and men. Based on multiple linear regression analyses, controlling for socio-demographic factors, nine types of participation were independently and significantly associated with general psychological distress. Unexpectedly, for two of these, "expressing opinions publicly" and "political protest", higher levels of participation were associated with higher levels of distress. The other seven were: contact with immediate household, extended family, friends, and neighbours; participating in organised community activities; taking an active interest in current affairs; and religious observance. We called these the "Big 7". Higher levels of participation in the Big 7 were associated with lower levels of distress. Participating in an increasing number of the Big 7 types of participation was strongly associated in linear fashion with decreasing distress.

Can We Study Autonomous Driving Comfort in Moving-Base Driving Simulators? A Validation Study.

PubMed

Bellem, Hanna; Klüver, Malte; Schrauf, Michael; Schöner, Hans-Peter; Hecht, Heiko; Krems, Josef F

2017-05-01

To lay the basis of studying autonomous driving comfort using driving simulators, we assessed the behavioral validity of two moving-base simulator configurations by contrasting them with a test-track setting. With increasing level of automation, driving comfort becomes increasingly important. Simulators provide a safe environment to study perceived comfort in autonomous driving. To date, however, no studies were conducted in relation to comfort in autonomous driving to determine the extent to which results from simulator studies can be transferred to on-road driving conditions. Participants ( N = 72) experienced six differently parameterized lane-change and deceleration maneuvers and subsequently rated the comfort of each scenario. One group of participants experienced the maneuvers on a test-track setting, whereas two other groups experienced them in one of two moving-base simulator configurations. We could demonstrate relative and absolute validity for one of the two simulator configurations. Subsequent analyses revealed that the validity of the simulator highly depends on the parameterization of the motion system. Moving-base simulation can be a useful research tool to study driving comfort in autonomous vehicles. However, our results point at a preference for subunity scaling factors for both lateral and longitudinal motion cues, which might be explained by an underestimation of speed in virtual environments. In line with previous studies, we recommend lateral- and longitudinal-motion scaling factors of approximately 50% to 60% in order to obtain valid results for both active and passive driving tasks.

Treatment Readiness as a Determinant of Treatment Participation in a Prison-Based Rehabilitation Program: An Exploratory Study.

PubMed

Bosma, Anouk Q; Kunst, Maarten J J; Dirkzwager, Anja J E; Nieuwbeerta, Paul

2017-06-01

The current study had three aims. First, it measured treatment readiness among offenders who entered the Prevention of Recidivism program. This is a prison-based rehabilitation program in the Netherlands that aims to lower re-offending rates among offenders with a prison sentence of at least for months and that is carried out during the final months of incarceration. Second, the study evaluated whether treatment readiness was associated with treatment participation. Third, the study examined whether treatment readiness measured with a validated instrument predicted treatment participation above and beyond a clinical assessment of treatment readiness, currently used as a criterion to include offenders in rehabilitation programs. To address these aims, data were used from the fourth wave of a research project studying the effects of imprisonment on the life of detainees in the Netherlands. Results indicated that treatment readiness as measured with a validated instrument was a significant predictor of treatment participation. Also, the current study showed that treatment readiness measured with a validated instrument improved the prediction of treatment participation above and beyond a clinical assessment of treatment readiness. Outcomes were discussed in light of study limitations and implications.

Cross-cultural validation and psychometric evaluation of the Participation and Environment Measure for Children and Youth in Korea.

PubMed

Jeong, Yunwha; Law, Mary; Stratford, Paul; DeMatteo, Carol; Kim, Hwan

2016-11-01

To develop the Korean version of the Participation and Environment Measure for Children and Youth (KPEM-CY) and examine its psychometric properties. The PEM-CY was cross-culturally translated into Korean using a specific guideline: pre-review of participation items, forward/backward translation, expert committee review, pre-test of the KPEM-CY and final review. To establish internal consistency, test-retest reliability and construct validity of the KPEM-CY, 80 parents of children with disabilities aged 5-13 years were recruited in South Korea. Across the home, school and community settings, 76% of participation items and 29% of environment items were revised to improve their fit with Korean culture. Internal consistency was moderate to excellent (0.67-0.92) for different summary scores. Test-retest reliability was excellent (>0.75) in the summary scores of participation frequency and extent of involvement across the three settings and moderate to excellent (0.53-0.95) in all summary scores at home. Child's age, type of school and annual income were the factors that significantly influenced specific dimensions of participation and environment across all settings. Results indicated that the KPEM-CY is equivalent to the original PEM-CY and has initial evidence of reliability and validity for use with Korean children with disabilities. Implications for rehabilitation Because 'participation' is a key outcome of the rehabilitation, measuring comprehensive participation of children with disabilities is necessary. The PEM-CY is a parent-report survey measure to assess comprehensive participation of children and youth and environment, which affect their participation, at home, school and in the community. A cross-cultural adaptation process is mandatory to adapt the measurement tool to a new culture or country. The Korean PEM-CY has both reliability and validity and can therefore generate useful clinical data for Korean children with disabilities.

Measuring Nutrition Literacy in Spanish-Speaking Latinos: An Exploratory Validation Study.

PubMed

Gibbs, Heather D; Camargo, Juliana M T B; Owens, Sarah; Gajewski, Byron; Cupertino, Ana Paula

2017-11-21

Nutrition is important for preventing and treating chronic diseases highly prevalent among Latinos, yet no tool exists for measuring nutrition literacy among Spanish speakers. This study aimed to adapt the validated Nutrition Literacy Assessment Instrument for Spanish-speaking Latinos. This study was developed in two phases: adaptation and validity testing. Adaptation included translation, expert item content review, and interviews with Spanish speakers. For validity testing, 51 participants completed the Short Assessment of Health Literacy-Spanish (SAHL-S), the Nutrition Literacy Assessment Instrument in Spanish (NLit-S), and socio-demographic questionnaire. Validity and reliability statistics were analyzed. Content validity was confirmed with a Scale Content Validity Index of 0.96. Validity testing demonstrated NLit-S scores were strongly correlated with SAHL-S scores (r = 0.52, p < 0.001). Entire reliability was substantial at 0.994 (CI 0.992-0.996) and internal consistency was excellent (Cronbach's α = 0.92). The NLit-S demonstrates validity and reliability for measuring nutrition literacy among Spanish-speakers.

Pressure ulcer prevention algorithm content validation: a mixed-methods, quantitative study.

PubMed

van Rijswijk, Lia; Beitz, Janice M

2015-04-01

Translating pressure ulcer prevention (PUP) evidence-based recommendations into practice remains challenging for a variety of reasons, including the perceived quality, validity, and usability of the research or the guideline itself. Following the development and face validation testing of an evidence-based PUP algorithm, additional stakeholder input and testing were needed. Using convenience sampling methods, wound care experts attending a national wound care conference and a regional wound ostomy continence nursing (WOCN) conference and/or graduates of a WOCN program were invited to participate in an Internal Review Board-approved, mixed-methods quantitative survey with qualitative components to examine algorithm content validity. After participants provided written informed consent, demographic variables were collected and participants were asked to comment on and rate the relevance and appropriateness of each of the 26 algorithm decision points/steps using standard content validation study procedures. All responses were anonymous. Descriptive summary statistics, mean relevance/appropriateness scores, and the content validity index (CVI) were calculated. Qualitative comments were transcribed and thematically analyzed. Of the 553 wound care experts invited, 79 (average age 52.9 years, SD 10.1; range 23-73) consented to participate and completed the study (a response rate of 14%). Most (67, 85%) were female, registered (49, 62%) or advanced practice (12, 15%) nurses, and had > 10 years of health care experience (88, 92%). Other health disciplines included medical doctors, physical therapists, nurse practitioners, and certified nurse specialists. Almost all had received formal wound care education (75, 95%). On a Likert-type scale of 1 (not relevant/appropriate) to 4 (very relevant and appropriate), the average score for the entire algorithm/all decision points (N = 1,912) was 3.72 with an overall CVI of 0.94 (out of 1). The only decision point/step recommendation

A reliability and validity study of the Palliative Performance Scale

PubMed Central

Ho, Francis; Lau, Francis; Downing, Michael G; Lesperance, Mary

2008-01-01

Background The Palliative Performance Scale (PPS) was first introduced in1996 as a new tool for measurement of performance status in palliative care. PPS has been used in many countries and has been translated into other languages. Methods This study evaluated the reliability and validity of PPS. A web-based, case scenarios study with a test-retest format was used to determine reliability. Fifty-three participants were recruited and randomly divided into two groups, each evaluating 11 cases at two time points. The validity study was based on the content validation of 15 palliative care experts conducted over telephone interviews, with discussion on five themes: PPS as clinical assessment tool, the usefulness of PPS, PPS scores affecting decision making, the problems in using PPS, and the adequacy of PPS instruction. Results The intraclass correlation coefficients for absolute agreement were 0.959 and 0.964 for Group 1, at Time-1 and Time-2; 0.951 and 0.931 for Group 2, at Time-1 and Time-2 respectively. Results showed that the participants were consistent in their scoring over the two times, with a mean Cohen's kappa of 0.67 for Group 1 and 0.71 for Group 2. In the validity study, all experts agreed that PPS is a valuable clinical assessment tool in palliative care. Many of them have already incorporated PPS as part of their practice standard. Conclusion The results of the reliability study demonstrated that PPS is a reliable tool. The validity study found that most experts did not feel a need to further modify PPS and, only two experts requested that some performance status measures be defined more clearly. Areas of PPS use include prognostication, disease monitoring, care planning, hospital resource allocation, clinical teaching and research. PPS is also a good communication tool between palliative care workers. PMID:18680590

The HealthNuts population-based study of paediatric food allergy: validity, safety and acceptability.

PubMed

Osborne, N J; Koplin, J J; Martin, P E; Gurrin, L C; Thiele, L; Tang, M L; Ponsonby, A-L; Dharmage, S C; Allen, K J

2010-10-01

The incidence of hospital admissions for food allergy-related anaphylaxis in Australia has increased, in line with world-wide trends. However, a valid measure of food allergy prevalence and risk factor data from a population-based study is still lacking. To describe the study design and methods used to recruit infants from a population for skin prick testing and oral food challenges, and the use of preliminary data to investigate the extent to which the study sample is representative of the target population. The study sampling frame design comprises 12-month-old infants presenting for routine scheduled vaccination at immunization clinics in Melbourne, Australia. We compared demographic features of participating families to population summary statistics from the Victorian Perinatal census database, and administered a survey to those non-responders who chose not to participate in the study. Study design proved acceptable to the community with good uptake (response rate 73.4%), with 2171 participants recruited. Demographic information on the study population mirrored the Victorian population with most the population parameters measured falling within our confidence intervals (CI). Use of a non-responder questionnaire revealed that a higher proportion of infants who declined to participate (non-responders) were already eating and tolerating peanuts, than those agreeing to participate (54.4%; 95% CI 50.8, 58.0 vs. 27.4%; 95% CI 25.5, 29.3 among participants). A high proportion of individuals approached in a community setting participated in a food allergy study. The study population differed from the eligible sample in relation to family history of allergy and prior consumption and peanut tolerance, providing some insights into the internal validity of the sample. The study exhibited external validity on general demographics to all births in Victoria. © 2010 Blackwell Publishing Ltd.

Nurse managers' work life quality and their participation in knowledge management: a correlational study.

PubMed

Hashemi Dehaghi, Zahra; Sheikhtaheri, Abbas; Dehnavi, Fariba

2015-01-01

The association between quality of work life and participation in knowledge management is unknown. This study aimed to discover the association between quality of work life of nurse managers and their participation in implementing knowledge management. This was a correlational study. All nurse managers (71 people) from 11 hospitals affiliated with the Social Security Organization in Tehran, Iran, were included. They were asked to rate their participation in knowledge management and their quality of work life. Data was gathered by a researcher-made questionnaire (May-June 2012). The questionnaire was validated by content and construct validity approaches. Cronbach's alpha was used to evaluate reliability. Finally, 50 questionnaires were analyzed. The answers were scored and analyzed using mean of scores, T-test, ANOVA (or nonparametric test, if appropriate), Pearson's correlation coefficient and linear regression. Nurse managers' performance to implement knowledge management strategies was moderate. A significant correlation was found between quality of work life of nurse managers and their participation in implementing knowledge management strategies (r = 0.82; P < 0.001). The strongest correlations were found between implementation of knowledge management and participation of nurse managers in decision making (r = 0.82; P < 0.001). Improvement of nurse managers' work life quality, especially in decision-making, may increase their participation in implementing knowledge management.

Modification of the Assessment of Life Habits (LIFE-Hm) to consider personalized satisfaction with participation in activities and roles: results from a construct validity study with older adults.

PubMed

Roy-Bouthot, Kathleen; Filiatrault, Patrick; Caron, Cyndi; Gagnon, Maxime; Prémont, Stéphanie; Levasseur, Mélanie

2014-01-01

Participation, defined as a person's involvement in activities and roles, is a primary intervention goal in rehabilitation. To achieve client-centered practice, rehabilitation professionals need to go beyond objective accomplishment criteria and consider satisfaction with and the importance of participation in activities and roles. To our knowledge, no instrument considers accomplishment, satisfaction and importance of activities and roles, and allows numerical scoring and comparison. The objectives of this study were to modify the Assessment of Life Habits questionnaire (LIFE-Hm) to consider personalized satisfaction (satisfaction weighted by importance) with participation in activities and roles, and to: (1) examine its convergent validity with quality of life (QOL) and (2) compare the associations between QOL on the one hand and, satisfaction (LIFE-H) and personalized satisfaction (LIFE-Hm) with participation on the other. A descriptive cross-sectional study was conducted with 84 older adults, average age 76 years, with different functional autonomy levels. Quality of life was associated with personalized satisfaction for all categories of activities and roles (r = 0.45 to 0.75; p < 0.001). These associations differed significantly from the associations with satisfaction for the "housing", "mobility" and "responsibilities" categories (p = 0.04 to 0.0047). This study found good construct validity of the LIFE-Hm with QOL. Personalization can add value in achieving client-centered practice. Implications for Rehabilitation The LIFE-Hm becomes the first instrument available in English and French that allows comparison between individuals and informs rehabilitation professionals about the level of accomplishment, satisfaction and personalized satisfaction with participation in activities and roles. Personalized satisfaction can add value in achieving client-centered practice as it considers not only how satisfying activities and roles are for the person

Validity of a modified Parkinson's disease screening questionnaire in India: effects of literacy of participants and medical training of screeners and implications for screening efforts in developing countries.

PubMed

Sarangmath, Nagaraja; Rattihalli, Rohini; Ragothaman, Mona; Gopalkrishna, Gururaj; Doddaballapur, Subbakrishna; Louis, Elan D; Muthane, Uday B

2005-12-01

The prevalence of Parkinson's disease (PD) is low among Indians, except in the Parsis. Data for Indians come from studies using different screening tools and criteria to detect PD. An epidemiological study in India, which has nearly a billion people, more than 18 spoken languages, and varying levels of literacy, requires development and validation of a screening tool for PD. The objectives of this study are to (1) validate a modified version of a widely used screening questionnaire for PD to suit the needs of the Indian population; (2) compare the use of a nonmedical assistant (NMA) with the use of a medical person during screening; and (3) compare the effect of literacy of participants on the validity of the screening tool. The validity of the questionnaire was tested on 125 participants from a home for the elderly. NMAs of similar background and medical personnel administered the modified screening questionnaire. A movement disorder neurologist blind to the responses on the questionnaire, examined participants independently and diagnosed if participants had PD. The questionnaire was validated in the movement disorders clinic, on known PD patients and their family members without PD. In the movement disorders clinic, sensitivity and specificity of the questionnaire were 100% and 89%, respectively. Fifty-seven participants were included for analysis. The questionnaire had a higher sensitivity when NMAs (75%) rather than the medical personnel (61%) administered it, and its specificity was higher with the medical personnel (61%) than with NMAs (55% and 25%). The questionnaire had a higher specificity in literates than illiterates, whereas sensitivity varied considerably. The modified questionnaire translated in a local Indian language had reasonable sensitivity and can be used to screen individuals for PD in epidemiological studies in India. This questionnaire can be administered by NMAs to screen PD and this strategy would reduce manpower costs. Literacy may

The Oxford Participation and Activities Questionnaire: study protocol.

PubMed

Morley, David; Dummett, Sarah; Kelly, Laura; Dawson, Jill; Fitzpatrick, Ray; Jenkinson, Crispin

2013-01-01

With an ageing population and increasing demands on health and social care services, there is growing importance attached to the management of long-term conditions, including maximizing the cost-effectiveness of treatments. In line with this, there is increasing emphasis on the need to keep people both active and participating in daily life. Consequently, it is essential that well developed and validated instruments that can meaningfully assess levels of participation and activity are widely available. Current measures, however, are largely focused on disability and rehabilitation, and there is no measure of activity or participation for generic use that fully meets the standards set by regulatory bodies such as the US Food and Drug Administration. Here we detail a protocol for the development and validation of a new patient-reported outcome measure (PROM) for assessment of participation and activity in people experiencing a variety of health conditions, ie, the Oxford Participation and Activities Questionnaire (Ox-PAQ). The stages incorporated in its development are entirely in line with current regulations and represent best practice in the development of PROMs. Development of the Ox-PAQ is theoretically grounded in the World Health Organization International Classification of Functioning, Disability, and Health. The project incorporates a new strategy of engaging with stakeholders from the outset in an attempt to identify those characteristics of PROMs considered most important to a range of potential users. Items will be generated through interviews with patients from a range of conditions. Pretesting of the instrument will be via cognitive interviews and focus groups. A postal survey will be conducted, with data subject to factor and Rasch analysis in order to identify appropriate dimensions and redundant items. Reliability will be assessed by Cronbach's alpha and item-total correlations. A second, large-scale postal survey will follow, with the Ox-PAQ being

The Oxford Participation and Activities Questionnaire: study protocol

PubMed Central

Morley, David; Dummett, Sarah; Kelly, Laura; Dawson, Jill; Fitzpatrick, Ray; Jenkinson, Crispin

2014-01-01

Background With an ageing population and increasing demands on health and social care services, there is growing importance attached to the management of long-term conditions, including maximizing the cost-effectiveness of treatments. In line with this, there is increasing emphasis on the need to keep people both active and participating in daily life. Consequently, it is essential that well developed and validated instruments that can meaningfully assess levels of participation and activity are widely available. Current measures, however, are largely focused on disability and rehabilitation, and there is no measure of activity or participation for generic use that fully meets the standards set by regulatory bodies such as the US Food and Drug Administration. Here we detail a protocol for the development and validation of a new patient-reported outcome measure (PROM) for assessment of participation and activity in people experiencing a variety of health conditions, ie, the Oxford Participation and Activities Questionnaire (Ox-PAQ). The stages incorporated in its development are entirely in line with current regulations and represent best practice in the development of PROMs. Methods Development of the Ox-PAQ is theoretically grounded in the World Health Organization International Classification of Functioning, Disability, and Health. The project incorporates a new strategy of engaging with stakeholders from the outset in an attempt to identify those characteristics of PROMs considered most important to a range of potential users. Items will be generated through interviews with patients from a range of conditions. Pretesting of the instrument will be via cognitive interviews and focus groups. A postal survey will be conducted, with data subject to factor and Rasch analysis in order to identify appropriate dimensions and redundant items. Reliability will be assessed by Cronbach’s alpha and item-total correlations. A second, large-scale postal survey will follow

Validation of self-reported anthropometrics in the Adventist Health Study 2

PubMed Central

2011-01-01

Background Relying on self-reported anthropometric data is often the only feasible way of studying large populations. In this context, there are no studies assessing the validity of anthropometrics in a mostly vegetarian population. The objective of this study was to evaluate the validity of self-reported anthropometrics in the Adventist Health Study 2 (AHS-2). Methods We selected a representative sample of 911 participants of AHS-2, a cohort of over 96,000 adult Adventists in the USA and Canada. Then we compared their measured weight and height with those self-reported at baseline. We calculated the validity of the anthropometrics as continuous variables, and as categorical variables for the definition of obesity. Results On average, participants underestimated their weight by 0.20 kg, and overestimated their height by 1.57 cm resulting in underestimation of body mass index (BMI) by 0.61 kg/m2. The agreement between self-reported and measured BMI (as a continuous variable), as estimated by intraclass correlation coefficient, was 0.97. The sensitivity of self-reported BMI to detect obesity was 0.81, the specificity 0.97, the predictive positive value 0.93, the predictive negative value 0.92, and the Kappa index 0.81. The percentage of absolute agreement for each category of BMI (normoweight, overweight, and obese) was 83.4%. After multivariate analyses, predictors of differences between self-reported and measured BMI were obesity, soy consumption and the type of dietary pattern. Conclusions Self-reported anthropometric data showed high validity in a representative subsample of the AHS-2 being valid enough to be used in epidemiological studies, although it can lead to some underestimation of obesity. PMID:21466678

Validation of self-reported anthropometrics in the Adventist Health Study 2.

PubMed

Bes-Rastrollo, Maira; Sabaté, Joan; Jaceldo-Siegl, Karen; Fraser, Gary E

2011-04-05

Relying on self-reported anthropometric data is often the only feasible way of studying large populations. In this context, there are no studies assessing the validity of anthropometrics in a mostly vegetarian population. The objective of this study was to evaluate the validity of self-reported anthropometrics in the Adventist Health Study 2 (AHS-2). We selected a representative sample of 911 participants of AHS-2, a cohort of over 96,000 adult Adventists in the USA and Canada. Then we compared their measured weight and height with those self-reported at baseline. We calculated the validity of the anthropometrics as continuous variables, and as categorical variables for the definition of obesity. On average, participants underestimated their weight by 0.20 kg, and overestimated their height by 1.57 cm resulting in underestimation of body mass index (BMI) by 0.61 kg/m(2). The agreement between self-reported and measured BMI (as a continuous variable), as estimated by intraclass correlation coefficient, was 0.97. The sensitivity of self-reported BMI to detect obesity was 0.81, the specificity 0.97, the predictive positive value 0.93, the predictive negative value 0.92, and the Kappa index 0.81. The percentage of absolute agreement for each category of BMI (normoweight, overweight, and obese) was 83.4%. After multivariate analyses, predictors of differences between self-reported and measured BMI were obesity, soy consumption and the type of dietary pattern. Self-reported anthropometric data showed high validity in a representative subsample of the AHS-2 being valid enough to be used in epidemiological studies, although it can lead to some underestimation of obesity.

The validity of the 4-Skills Scan: A double validation study.

PubMed

van Kernebeek, W G; de Kroon, M L A; Savelsbergh, G J P; Toussaint, H M

2018-06-01

Adequate gross motor skills are an essential aspect of a child's healthy development. Where physical education (PE) is part of the primary school curriculum, a strong curriculum-based emphasis on evaluation and support of motor skill development in PE is apparent. Monitoring motor development is then a task for the PE teacher. In order to fulfil this task, teachers need adequate tools. The 4-Skills Scan is a quick and easily manageable gross motor skill instrument; however, its validity has never been assessed. Therefore, the purpose of this study is to assess the construct and concurrent validity of both 4-Skills Scans (version 2007 and version 2015). A total of 212 primary school children (6 - 12 years old), was requested to participate in both versions of the 4-Skills Scan. For assessing construct validity, children covered an obstacle course with video recordings for observation by an expert panel. For concurrent validity, a comparison was made with the MABC-2, by calculating Pearson correlations. Multivariable linear regression analyses were performed to determine the contribution of each subscale to the construct of gross motor skills, according to the MABC-2 and the expert panel. Correlations between the 4-Skills Scans and expert valuations were moderate, with coefficients of .47 (version 2007) and .46 (version 2015). Correlations between the 4-Skills Scans and the MABC-2 (gross) were moderate (.56) for version 2007 and high (.64) for version 2015. It is concluded that both versions of the 4-Skills Scans are satisfactory valid instruments for assessing gross motor skills during PE lessons. This article is protected by copyright. All rights reserved. This article is protected by copyright. All rights reserved.

Nurse Managers’ Work Life Quality and Their Participation in Knowledge Management: A Correlational Study

PubMed Central

Hashemi Dehaghi, Zahra; Sheikhtaheri, Abbas; Dehnavi, Fariba

2014-01-01

Background: The association between quality of work life and participation in knowledge management is unknown. Objectives: This study aimed to discover the association between quality of work life of nurse managers and their participation in implementing knowledge management. Materials and Methods: This was a correlational study. All nurse managers (71 people) from 11 hospitals affiliated with the Social Security Organization in Tehran, Iran, were included. They were asked to rate their participation in knowledge management and their quality of work life. Data was gathered by a researcher-made questionnaire (May-June 2012). The questionnaire was validated by content and construct validity approaches. Cronbach’s alpha was used to evaluate reliability. Finally, 50 questionnaires were analyzed. The answers were scored and analyzed using mean of scores, T-test, ANOVA (or nonparametric test, if appropriate), Pearson’s correlation coefficient and linear regression. Results: Nurse managers’ performance to implement knowledge management strategies was moderate. A significant correlation was found between quality of work life of nurse managers and their participation in implementing knowledge management strategies (r = 0.82; P < 0.001). The strongest correlations were found between implementation of knowledge management and participation of nurse managers in decision making (r = 0.82; P < 0.001). Conclusions: Improvement of nurse managers’ work life quality, especially in decision-making, may increase their participation in implementing knowledge management. PMID:25763267

CANFOR Portuguese version: validation study.

PubMed

Talina, Miguel; Thomas, Stuart; Cardoso, Ana; Aguiar, Pedro; Caldas de Almeida, Jose M; Xavier, Miguel

2013-05-30

The increase in prisoner population is a troublesome reality in several regions of the world. Along with this growth there is increasing evidence that prisoners have a higher proportion of mental illnesses and suicide than the general population. In order to implement strategies that address criminal recidivism and the health and social status of prisoners, particularly in mental disordered offenders, it is necessary to assess their care needs in a comprehensive, but individual perspective. This assessment must include potential harmful areas like comorbid personality disorder, substance misuse and offending behaviours. The Camberwell Assessment of Need - Forensic Version (CANFOR) has proved to be a reliable tool designed to accomplish such aims. The present study aimed to validate the CANFOR Portuguese version. The translation, adaptation to the Portuguese context, back-translation and revision followed the usual procedures. The sample comprised all detainees receiving psychiatric care in four forensic facilities, over a one year period. A total of 143 subjects, and respective case manager, were selected. The forensic facilities were chosen by convenience: one prison hospital psychiatric ward (n=68; 47.6%), one male (n=24; 16.8%) and one female (n=22; 15.4%) psychiatric clinic and one civil security ward (n=29; 20.3%), all located nearby Lisbon. Basic descriptive statistics and Kappa weighted coefficients were calculated for the inter-rater and the test-retest reliability studies. The convergent validity was evaluated using the Global Assessment of Functioning and the Brief Psychiatric Rating Scale scores. The majority of the participants were male and single, with short school attendance, and accused of a crime involving violence against persons. The most frequent diagnosis was major depression (56.1%) and almost half presented positive suicide risk. The reliability study showed average Kappa weighted coefficients of 0.884 and 0.445 for inter-rater and test

Validity and Feasibility of a Digital Diet Estimation Method for Use with Preschool Children: A Pilot Study

ERIC Educational Resources Information Center

Nicklas, Theresa A.; O'Neil, Carol E.; Stuff, Janice; Goodell, Lora Suzanne; Liu, Yan; Martin, Corby K.

2012-01-01

Objective: The goal of the study was to assess the validity and feasibility of a digital diet estimation method for use with preschool children in "Head Start." Methods: Preschool children and their caregivers participated in validation (n = 22) and feasibility (n = 24) pilot studies. Validity was determined in the metabolic research unit using…

Measuring leprosy-related stigma - a pilot study to validate a toolkit of instruments.

PubMed

Rensen, Carin; Bandyopadhyay, Sudhakar; Gopal, Pala K; Van Brakel, Wim H

2011-01-01

Stigma negatively affects the quality of life of leprosy-affected people. Instruments are needed to assess levels of stigma and to monitor and evaluate stigma reduction interventions. We conducted a validation study of such instruments in Tamil Nadu and West Bengal, India. Four instruments were tested in a 'Community Based Rehabilitation' (CBR) setting, the Participation Scale, Internalised Scale of Mental Illness (ISMI) adapted for leprosy-affected persons, Explanatory Model Interview Catalogue (EMIC) for leprosy-affected and non-affected persons and the General Self-Efficacy (GSE) Scale. We evaluated the following components of validity, construct validity, internal consistency, test-retest reproducibility and reliability to distinguish between groups. Construct validity was tested by correlating instrument scores and by triangulating quantitative and qualitative findings. Reliability was evaluated by comparing levels of stigma among people affected by leprosy and community controls, and among affected people living in CBR project areas and those in non-CBR areas. For the Participation, ISMI and EMIC scores significant differences were observed between those affected by leprosy and those not affected (p = 0.0001), and between affected persons in the CBR and Control group (p < 0.05). The internal consistency of the instruments measured with Cronbach's α ranged from 0.83 to 0.96 and was very good for all instruments. Test-retest reproducibility coefficients were 0.80 for the Participation score, 0.70 for the EMIC score, 0.62 for the ISMI score and 0.50 for the GSE score. The construct validity of all instruments was confirmed. The Participation and EMIC Scales met all validity criteria, but test-retest reproducibility of the ISMI and GSE Scales needs further evaluation with a shorter test-retest interval and longer training and additional adaptations for the latter.

Assessment of the face validity of two pain scales in Kenya: a validation study using cognitive interviewing

PubMed Central

2012-01-01

Background Patients in sub-Saharan Africa commonly experience pain, which often is un-assessed and undertreated. One hindrance to routine pain assessment in these settings is the lack of a single-item pain rating scale validated for the particular context. The goal of this study was to examine the face validity and cultural acceptability of two single-item pain scales, the Numerical Rating Scale (NRS) and the Faces Pain Scale-Revised (FPS-R), in a population of patients on the medical, surgical, and pediatric wards of Moi Teaching and Referral Hospital in Kenya. Methods Swahili versions of the NRS and FPS-R were developed by standard translation and back-translation. Cognitive interviews were performed with 15 patients at Moi Teaching and Referral Hospital in Eldoret, Kenya. Interview transcripts were analyzed on a question-by-question basis to identify major themes revealed through the cognitive interviewing process and to uncover any significant problems participants encountered with understanding and using the pain scales. Results Cognitive interview analysis demonstrated that participants had good comprehension of both the NRS and the FPS-R and showed rational decision-making processes in choosing their responses. Participants felt that both scales were easy to use. The FPS-R was preferred almost unanimously to the NRS. Conclusions The face validity and acceptability of the Swahili versions of the NRS and FPS-R has been demonstrated for use in Kenyan patients. The broader application of these scales should be evaluated and may benefit patients who currently suffer from pain. PMID:22512923

Assessing Patient Organization Participation in Health Policy: A Comparative Study in France and Italy

PubMed Central

Souliotis, Kyriakos; Agapidaki, Eirini; Evangelia Peppou, Lily; Tzavara, Chara; Varvaras, Dimitrios; Buonomo, Oreste Claudio; Debiais, Dominique; Hasurdjiev, Stanimir; Sarkozy, Francois

2018-01-01

Background: Even though there are many patient organizations across Europe, their role in impacting health policy decisions and reforms has not been well documented. In line with this, the present study endeavours to fill this gap in the international literature. To this end, it aims to validate further a previously developed instrument (the Health Democracy Index - HDI) measuring patient organization participation in health policy decision-making. In addition, by utilizing this tool, it aims to provide a snapshot of the degree and impact of cancer patient organization (CPO) participation in Italy and France. Methods: A convenient sample of 188 members of CPOs participated in the study (95 respondents from 10 CPOs in Italy and 93 from 12 CPOs in France). Participants completed online a self-reported questionnaire, encompassing the 9-item index and questions enquiring about the type and impact of participation in various facets of health policy decisionmaking. The psychometric properties of the scale were explored by performing factor analysis (construct validity) and by computing Cronbach α (internal consistency). Results: Findings indicate that the index has good internal consistency and the construct it taps is unidimensional. The degree and impact of CPO participation in health policy decision-making were found to be low in both countries; however in Italy they were comparatively lower than in France. Conclusion: In conclusion, the HDI can be effectively used in international policy and research contexts. CPOs participation is low in Italy and France and concerted efforts should be made on upgrading their role in health policy decision-making. PMID:29325402

Community participation in the development and validation of a school violence observation instrument

PubMed Central

Medina, N.; Fernández, G.; Cruz, T.; Jordán, N.; Trenche, M.

2015-01-01

Background School violence is a worldwide public health issue with negative effects on education. Official statistics and reports do not include daily occurrences of violent behavior that may precede severe incidents. Objectives This project aimed to engage school community members in the development, validation and implementation of an observation instrument to identify characteristics of school violence. Methods The role of members of each participating school community in all phases of the research is described. Results (or Lessons Learned) The input of community members contributed to enrich the process by providing insight into the problem studied and a more informed framework for interpreting results. Conclusions Taking into account distinctive features of each particular school made results meaningful to the school community and fostered a sense of empowerment of community members as they recognized their knowledge is essential to the solution of their problems. PMID:27346771

Validity of self-reported height and weight in 4808 EPIC-Oxford participants.

PubMed

Spencer, Elizabeth A; Appleby, Paul N; Davey, Gwyneth K; Key, Timothy J

2002-08-01

To assess the validity of self-reported height and weight by comparison with measured height and weight in a sample of middle-aged men and women, and to determine the extent of misclassification of body mass index (BMI) arising from differences between self-reported and measured values. Analysis of self-reported and measured height and weight data from participants in the Oxford cohort of the European Prospective Investigation into Cancer and Nutrition (EPIC-Oxford). Four thousand eight hundred and eight British men and women aged 35-76 years. Spearman rank correlations between self-reported and measured height, weight and BMI were high (r > 0.9, P < 0.0001). Height was overestimated by a mean of 1.23 (95% confidence interval (CI) 1.11-1.34) cm in men and 0.60 (0.51-0.70) cm in women; the extent of overestimation was greater in older men and women, shorter men and heavier women. Weight was underestimated by a mean of 1.85 (1.72-1.99) kg in men and 1.40 (1.31-1.49) kg in women; the extent of underestimation was greater in heavier men and women, but did not vary with age or height. Using standard categories of BMI, 22.4% of men and 18.0% of women were classified incorrectly based on self-reported height and weight. After correcting the self-reported values using predictive equations derived from a 10% sample of subjects, misclassification decreased to 15.2% in men and 13.8% in women. Self-reported height and weight data are valid for identifying relationships in epidemiological studies. In analyses where anthropometric factors are the primary variables of interest, measurements in a representative sample of the study population can be used to improve the accuracy of estimates of height, weight and BMI.

Evaluating the Social Validity of the Early Start Denver Model: A Convergent Mixed Methods Study.

PubMed

Ogilvie, Emily; McCrudden, Matthew T

2017-09-01

An intervention has social validity to the extent that it is socially acceptable to participants and stakeholders. This pilot convergent mixed methods study evaluated parents' perceptions of the social validity of the Early Start Denver Model (ESDM), a naturalistic behavioral intervention for children with autism. It focused on whether the parents viewed (a) the ESDM goals as appropriate for their children, (b) the intervention procedures as acceptable and appropriate, and (c) whether changes in their children's behavior was practically significant. Parents of four children who participated in the ESDM completed the TARF-R questionnaire and participated in a semi-structured interview. Both data sets indicated that parents rated their experiences with the ESDM positively and rated it as socially-valid. The findings indicated that what was implemented in the intervention is complemented by how it was implemented and by whom.

Design validation and labeling comprehension study for a new epinephrine autoinjector.

PubMed

Edwards, Eric S; Edwards, Evan T; Gunn, Ronald; Patterson, Patricia; North, Robert

2013-03-01

To facilitate the correct use of epinephrine autoinjectors (EAIs) by patients and caregivers, a novel EAI (Auvi-Q) was designed to help minimize use-related hazards. To support validation of Auvi-Q final design and assess whether the instructions for use in the patient information leaflet (PIL) are effective in training participants on proper use of Auvi-Q. Healthy participants, 20 adult and 20 pediatric, were assessed for their ability to complete a simulated injection by following the Auvi-Q instructions for use. Participants relied only on the contents of the PIL and other labeling features (device labeling and its instructions for use, electronic voice instructions and visual prompts). The mean ± SD age of the adult and pediatric participants was 39.4 ± 11.6 and 10.9 ± 2.3 years, respectively. In total, 80% of adult and 35% of pediatric participants had prior experience with EAIs. All adults and 95% of pediatric participants completed a simulated injection on the first attempt; 1 pediatric participant required parental training and a second attempt. Three adult and 4 pediatric participants exhibited a noncritical issue while successfully completing the simulated injection. Most participants agreed that the injection steps were easy to follow and the PIL facilitated understanding on using Auvi-Q safely and effectively. The PIL and other labeling features were effective in communicating instructions for successful use of Auvi-Q. This study provided validation support for the final design and anticipated instructions for use of Auvi-Q. Copyright © 2013 American College of Allergy, Asthma & Immunology. Published by Elsevier Inc. All rights reserved.

A Study of Validity and Reliability on the Instructional Capacity Scale

ERIC Educational Resources Information Center

Yalçin, Mehmet Tufan; Eres, Figen

2018-01-01

The aim of this study is to develop a valid and reliable measurement tool that can determine the instructional capacity, according to teacher opinions. In the academic year of 2016-2017, 1011 teachers working in the public high schools and vocational technical schools in Ankara participated in the study. The total number of items on the scale was…

Estimating GFR Among Participants in the Chronic Renal Insufficiency Cohort (CRIC) Study

PubMed Central

Anderson, Amanda Hyre; Yang, Wei; Hsu, Chi-yuan; Joffe, Marshall M.; Leonard, Mary B.; Xie, Dawei; Chen, Jing; Greene, Tom; Jaar, Bernard G.; Kao, Patricia; Kusek, John W.; Landis, J. Richard; Lash, James P.; Townsend, Raymond R.; Weir, Matthew R.; Feldman, Harold I.

2012-01-01

Background Glomerular filtration rate (GFR) is considered the best measure of kidney function, but repeated assessment is not feasible in most research studies. Study Design Cross-sectional study of 1,433 participants from the Chronic Renal Insufficiency Cohort (CRIC) Study (i.e., the GFR subcohort) to derive an internal GFR estimating equation using a split sample approach. Setting & Participants Adults from 7 US metropolitan areas with mild to moderate chronic kidney disease; 48% had diabetes and 37% were black. Index Test CRIC GFR estimating equation Reference Test or Outcome Urinary 125I-iothalamate clearance testing (measured GFR) Other Measurements Laboratory measures including serum creatinine and cystatin C, and anthropometrics Results In the validation dataset, the model that included serum creatinine, serum cystatin C, age, gender, and race was the most parsimonious and similarly predictive of mGFR compared to a model additionally including bioelectrical impedance analysis phase angle, CRIC clinical center, and 24-hour urinary creatinine excretion. Specifically, the root mean square errors for the separate model were 0.207 vs. 0.202, respectively. The performance of the CRIC GFR estimating equation was most accurate among the subgroups of younger participants, men, non-blacks, non-Hispanics, those without diabetes, those with body mass index <30 kg/m2, those with higher 24-hour urine creatinine excretion, those with lower levels of high-sensitivity C-reactive protein, and those with higher mGFR. Limitations Urinary clearance of 125I-iothalamate is an imperfect measure of true GFR; cystatin C is not standardized to certified reference material; lack of external validation; small sample sizes limit analyses of subgroup-specific predictors. Conclusions The CRIC GFR estimating equation predicts measured GFR accurately in the CRIC cohort using serum creatinine and cystatin C, age, gender, and race. Its performance was best among younger and healthier

Validity of the Participation and Environment Measure for Children and Youth (PEM-CY) for Health Impact Assessment (HIA) in sustainable development projects.

PubMed

Khetani, Mary; Marley, Jenifer; Baker, Megan; Albrecht, Erin; Bedell, Gary; Coster, Wendy; Anaby, Dana; Law, Mary

2014-04-01

Participation in home, school, and community activities is an important indicator of child health and well-being. Evaluating environmental influences on children's participation can inform efforts to develop sustainable built environments, but few validated measures exist. To examine the concurrent validity and utility of the Participation and Environment Measure for Children and Youth (PEM-CY) for Health Impact Assessment in non-urban sustainable development projects affecting children with disabilities. Eighty-nine parents of children and youth with disabilities who identified as residing in a small town or rural community were sampled. Sixty-six caregivers completed the PEM-CY online, and 23 caregivers completed the PEM-CY and CHIEF-CP paper forms. Spearman correlational analyses were conducted to establish the concurrent validity of the PEM-CY environment sections against the CHIEF-CP. Group comparisons by child's age, number of functional limitations, and annual household income were used to examine differences in summary and item-level responses on the PEM-CY community section. Moderate to strong associations were found between CHIEF-CP Total Product and Magnitude Scores and all PEM-CY Environment Summary Scores. CHIEF-CP Physical/Structural and Policies Subscale Scores were most consistently associated with PEM-CY Environment Summary Scores. Group differences by household income were found for participation frequency and number of supports, including perceived availability and adequacy of money and information about programs and services, even when controlling child's age and number of functional limitations. Study results lend support to the use of the PEM-CY in HIA to reliably assess for environmental impact on children's participation. Implications for using the PEM-CY to inform decision-making in non-urban sustainable development projects affecting families of children and youth with disabilities are discussed. Published by Elsevier Inc.

Hyperventilation in asthma: a validation study of the Nijmegen Questionnaire--NQ.

PubMed

Grammatopoulou, Eirini P; Skordilis, Emmanouil K; Georgoudis, Georgios; Haniotou, Aikaterini; Evangelodimou, Afroditi; Fildissis, George; Katsoulas, Theodoros; Kalagiakos, Panagiotis

2014-10-01

The Nijmegen questionnaire (NQ) has previously been used for screening the hyperventilation syndrome (HVS) in asthmatics. However, no validity study has been reported so far. To examine the validity and reliability of the NQ in asthma patients and identify the prevalence of HVS. The NQ (n = 162) was examined for translation, construct, cross-sectional and discriminant validity as well as for internal consistency and test-retest reliability. Principal component analysis and exploratory factor analysis revealed a single factor solution with 11 items and 58.6% of explained variability. These 11 NQ items showed high internal consistency (Cronbach's alpha = 0.92) and test-retest reliability (IR = 0.98). Higher NQ scores were found in the following subgroups: women versus men (p < 0.01); participants with moderate versus mild asthma (p < 0.001) or uncontrolled versus controlled asthma (p < 0.001), and participants with breath-hold time (BHT) < 30 versus ≥ 30 s (p < 0.01) or end-tidal CO2 (ETCO2) ≤ 35 versus >35 mmHg (p < 0.001). A cut-off score of >17 discriminated the participants with regard to the presence of HVS. The NQ showed 92.73% sensitivity and 91.59% specificity. The total NQ score was found significantly correlated with ETCO2 (r = -0.68), RR (r = 0.66) and BHT (r = -0.65). The prevalence of HVS was found 34%. The NQ is a valid and reliable questionnaire for screening HVS in patients with stable mild-to-moderate asthma.

Evaluating the Social Validity of the Early Start Denver Model: A Convergent Mixed Methods Study

ERIC Educational Resources Information Center

Ogilvie, Emily; McCrudden, Matthew T.

2017-01-01

An intervention has social validity to the extent that it is socially acceptable to participants and stakeholders. This pilot convergent mixed methods study evaluated parents' perceptions of the social validity of the Early Start Denver Model (ESDM), a naturalistic behavioral intervention for children with autism. It focused on whether the parents…

External validity of post-stroke interventional gait rehabilitation studies.

PubMed

Kafri, Michal; Dickstein, Ruth

2017-01-01

Gait rehabilitation is a major component of stroke rehabilitation, and is supported by extensive research. The objective of this review was to examine the external validity of intervention studies aimed at improving gait in individuals post-stroke. To that end, two aspects of these studies were assessed: subjects' exclusion criteria and the ecological validity of the intervention, as manifested by the intervention's technological complexity and delivery setting. Additionally, we examined whether the target population as inferred from the titles/abstracts is broader than the population actually represented by the reported samples. We systematically researched PubMed for intervention studies to improve gait post-stroke, working backwards from the beginning of 2014. Exclusion criteria, the technological complexity of the intervention (defined as either elaborate or simple), setting, and description of the target population in the titles/abstracts were recorded. Fifty-two studies were reviewed. The samples were exclusive, with recurrent stroke, co-morbidities, cognitive status, walking level, and residency being major reasons for exclusion. In one half of the studies, the intervention was elaborate. Descriptions of participants in the title/abstract in almost one half of the studies included only the diagnosis (stroke or comparable terms) and its stage (acute, subacute, and chronic). The external validity of a substantial number of intervention studies about rehabilitation of gait post-stroke appears to be limited by exclusivity of the samples as well as by deficiencies in ecological validity of the interventions. These limitations are not accurately reflected in the titles or abstracts of the studies.

Use of Daily Phone Diary to study religiosity and mood: Convergent validity

PubMed Central

Szczesniak, Rhonda D.; Zou, Yuanshu; Dimitriou, Sophia M.; Quittner, Alexandra L.; Grossoehme, Daniel H.

2017-01-01

Studies of religious/spiritual behavior frequently rely on self-reported questionnaire data, which is susceptible to bias. The Daily Phone Diary (DPD) was developed to minimize bias in reporting activities and behavior across a 24-hour period. A cross-sectional study of 126 parents of children with cystic fibrosis was used to establish the validity of the DPD to study religious/spiritual behaviors. Longitudinal models were used to determine the odds of improved mood during religious/spiritual activities. Convergent validity was found. Participants had increased odds of improved mood during religious/spiritual activities compared to non-religious/spiritual activities. Associations with gender and religious affiliations were found. The DPD is a valid tool for studying religious/spiritual activities and opens novel avenues for chaplaincy research and the development of chaplaincy interventions incorporating these findings. PMID:27869567

Design, methodological issues and participation in a multiple sclerosis case-control study.

PubMed

Williamson, D M; Marrie, R A; Ashley-Koch, A; Schiffer, R; Trottier, J; Wagner, L

2012-09-01

This study was conducted to determine whether the risk of developing multiple sclerosis (MS) was associated with certain environmental exposures or genetic factors previously reported to influence MS risk. This paper describes the methodological issues, study design and characteristics of the study population. Individuals with definite MS were identified from a prevalence study conducted in three geographic areas. The target number of cases was not reached, so an additional study area was added. Identifying clinic controls was inefficient, so controls were recruited using random digit dialing. All study participants completed a detailed questionnaire regarding environmental exposures using computer-assisted telephone interviewing, and blood was collected for genetic analysis. In total, 276 cases and 590 controls participated, but participation rates were low, ranging from 28.4% to 38.9%. Only one-third (33.6%) of individuals identified in the prevalence study agreed to participate in the case-control study. Cases were more likely to be non-Hispanic white and older than their source populations as identified in the preceding prevalence study (P < 0.05). Most participants provided a blood sample for genotyping (91%; n = 789). Epidemiological studies play a key role in identifying genetic and environmental factors that are associated with complex diseases like MS. Methodological issues arise in every study, and investigators need to be able to detect, respond to and correct problems in a timely and scientifically valid manner. © 2011 John Wiley & Sons A/S.

The Volunteer Satisfaction Index: A Validation Study in the Chinese Cultural Context

ERIC Educational Resources Information Center

Wong, Lok Ping; Chui, Wing Hong; Kwok, Yan Yuen

2011-01-01

Using a Hong Kong-sourced sample of 261 participants, this study set out to validate the Volunteer Satisfaction Index (VSI) in the Chinese cultural context and to evaluate its psychometric properties. The VSI was originally developed by Galindo-Kuhn and Guzley (2001) to measure the outcomes of volunteer experiences. In this study, exploratory…

Construct validity of the canadian occupational performance measure in participants with tendon injury and Dupuytren disease.

PubMed

van de Ven-Stevens, Lucelle A W; Graff, Maud J L; Peters, Marlijn A M; van der Linde, Harmen; Geurts, Alexander C H

2015-05-01

In patient-centered practice, instruments need to assess outcomes that are meaningful to patients with hand conditions. It is unclear which assessment tools address these subjective perspectives best. The aim of this study was to establish the construct validity of the Canadian Occupational Performance Measure (COPM) in relation to the Disabilities of Arm, Shoulder, and Hand (DASH) questionnaire and the Michigan Hand Outcomes Questionnaire (MHQ) in people with hand conditions. It was hypothesized that COPM scores would correlate with DASH and MHQ total scores only to a moderate degree and that the COPM, DASH questionnaire, and MHQ would all correlate weakly with measures of hand impairments. This was a validation study. The COPM, DASH questionnaire, and MHQ were scored, and then hand impairments were measured (pain [numerical rating scale], active range of motion [goniometer], grip strength [dynamometer], and pinch grip strength [pinch meter]). People who had received postsurgery rehabilitation for flexor tendon injuries, extensor tendon injuries, or Dupuytren disease were eligible. Seventy-two participants were included. For all diagnosis groups, the Pearson coefficient of correlation between the DASH questionnaire and the MHQ was higher than .60, whereas the correlation between the performance scale of the COPM and either the DASH questionnaire or the MHQ was lower than .51. Correlations of these assessment tools with measures of hand impairments were lower than .46. The small sample sizes may limit the generalization of the results. The results supported the hypotheses and, thus, the construct validity of the COPM after surgery in people with hand conditions. © 2015 American Physical Therapy Association.

Construct Validity Evidence for Single-Response Items to Estimate Physical Activity Levels in Large Sample Studies

ERIC Educational Resources Information Center

Jackson, Allen W.; Morrow, James R., Jr.; Bowles, Heather R.; FitzGerald, Shannon J.; Blair, Steven N.

2007-01-01

Valid measurement of physical activity is important for studying the risks for morbidity and mortality. The purpose of this study was to examine evidence of construct validity of two similar single-response items assessing physical activity via self-report. Both items are based on the stages of change model. The sample was 687 participants (men =…

Satisfaction of Middle School Lunch Program Participants and Non-Participants with the School Lunch Experience

ERIC Educational Resources Information Center

Smith, Stephanie; Cunningham-Sabo, Leslie; Auld, Garry

2015-01-01

Purpose/Objectives: The purpose of this study was to determine middle school students' satisfaction with the school lunch experience, using two validated surveys; the Middle/Junior High School Student Participation Survey and the Middle/Junior High School Student Non-Participation Survey, both developed by the National Food Service Management…

Reproducibility and validity of the Shanghai Men's Health Study physical activity questionnaire.

PubMed

Jurj, Adriana L; Wen, Wanqing; Xiang, Yong-Bing; Matthews, Charles E; Liu, Dake; Zheng, Wei; Shu, Xiao-Ou

2007-05-15

Reproducibility and validity of the physical activity questionnaire (PAQ) used in the Shanghai Men's Health Study (2003-2006, People's Republic of China) was evaluated in a random sample of 196 participants aged 40-74 years. Participants completed a PAQ at baseline and again 1 year later, 12 monthly 7-day physical activity recalls, and four quarterly 1-week physical activity logs. Reproducibility was evaluated by using the two PAQs and validity by comparing the PAQs with 1-year averages of the two criterion measures: 7-day physical activity recall and physical activity log. The PAQ had moderate to high reproducibility for measuring adult exercise participation (kappa = 0.60) and energy expenditure (r(s) = 0.68), nonexercise activities (correlation coefficients = 0.42-0.68), and total daily energy expenditure (r(s) = 0.68, kappa(quartiles) = 0.47). Correlations between the PAQ and criterion measures of adult exercise were 0.45 (7-day physical activity recall) and 0.51 (physical activity log) for the first PAQ and 0.62 (7-day physical activity recall) and 0.71 (physical activity log) for the second PAQ. Correlations between PAQ nonexercise activities and the physical activity log and 7-day physical activity recall were 0.31-0.86. Correlations for total energy expenditure were high (0.62-0.77). Results indicate that the Shanghai Men's Health Study PAQ has reasonable reproducibility and validity for classifying men by their level of exercise and nonexercise activities in this cohort.

Measuring participation as defined by the World Health Organization in the International Classification of Functioning, Disability and Health. Psychometric properties of the Ghent Participation Scale.

PubMed

Van de Velde, Dominique; Coorevits, Pascal; Sabbe, Lode; De Baets, Stijn; Bracke, Piet; Van Hove, Geert; Josephsson, Staffan; Ilsbroukx, Stephan; Vanderstraeten, Guy

2017-03-01

To examine the internal consistency, test-retest reliability, construct validity, discriminant validity and responsiveness of the Ghent Participation Scale. Cross-sectional study with a test-retest sample. Six outpatient rehabilitation centres in Belgium. A total of 365 outpatients from eight diagnostic groups. The Ghent Participation Scale, the Impact on Participation and Autonomy, the Utrecht Scale for Evaluation of Rehabilitation-Participation and the Medical outcome study Short Form SF-36. The Ghent Participation Scale was found to have good internal consistency (Cronbach's α between 0.75 and 0.83). At item level, the test-retest reliability was good; weighted kappas ranged between 0.57 and 0.88. On the dimension level intraclass correlation coefficients ranged between 0.80 and 0.90. Evidence for construct validity came from high correlations between the subscales of the Ghent Participation Scale and four subscales of the Impact on Participation and Autonomy (range, r = -0.71 to -0.87) and two subscales of the Utrecht Scale for Evaluation of Rehabilitation-Participation (range, r = 0.54 to 0.72). Standardized response mean ranged between 0.23 and 0.68 and the area under the curve ranged between 68% and 88%. The Ghent Participation Scale appears to be a valid and reliable method of assessing participation irrespective of the respondent's health condition. The Ghent Participation Scale is responsive and is able to detect changes over time.

A Validity and Reliability Study of the Motivated Strategies for Learning Questionnaire

ERIC Educational Resources Information Center

Erturan Ilker, Gökçe; Arslan, Yunus; Demirhan, Giyasettin

2014-01-01

The aim of this study is to determine the validity and reliability of the Motivated Strategies for Learning Questionnaire (MSLQ) for high school students. In total, 1605 students (829 girls, 776 boys, average age = 15.67 ± 1.19) from three different high schools in the central district of Ankara voluntarily participated in the study. The MSLQ was…

Recommendations of the VAC2VAC workshop on the design of multi-centre validation studies.

PubMed

Halder, Marlies; Depraetere, Hilde; Delannois, Frédérique; Akkermans, Arnoud; Behr-Gross, Marie-Emmanuelle; Bruysters, Martijn; Dierick, Jean-François; Jungbäck, Carmen; Kross, Imke; Metz, Bernard; Pennings, Jeroen; Rigsby, Peter; Riou, Patrice; Balks, Elisabeth; Dobly, Alexandre; Leroy, Odile; Stirling, Catrina

2018-03-01

Within the Innovative Medicines Initiative 2 (IMI 2) project VAC2VAC (Vaccine batch to vaccine batch comparison by consistency testing), a workshop has been organised to discuss ways of improving the design of multi-centre validation studies and use the data generated for product-specific validation purposes. Moreover, aspects of validation within the consistency approach context were addressed. This report summarises the discussions and outlines the conclusions and recommendations agreed on by the workshop participants. Copyright © 2018.

A Construct Validity Study of Clinical Competence: A Multitrait Multimethod Matrix Approach

ERIC Educational Resources Information Center

Baig, Lubna; Violato, Claudio; Crutcher, Rodney

2010-01-01

Introduction: The purpose of the study was to adduce evidence for estimating the construct validity of clinical competence measured through assessment instruments used for high-stakes examinations. Methods: Thirty-nine international physicians (mean age = 41 + 6.5 y) participated in high-stakes examination and 3-month supervised clinical practice…

Assessing Cognitive Performance in Badminton Players: A Reproducibility and Validity Study

PubMed Central

van de Water, Tanja; Faber, Irene; Elferink-Gemser, Marije

2017-01-01

Abstract Fast reaction and good inhibitory control are associated with elite sports performance. To evaluate the reproducibility and validity of a newly developed Badminton Reaction Inhibition Test (BRIT), fifteen elite (25 ± 4 years) and nine non-elite (24 ± 4 years) Dutch male badminton players participated in the study. The BRIT measured four components: domain-general reaction time, badminton-specific reaction time, domain-general inhibitory control and badminton-specific inhibitory control. Five participants were retested within three weeks on the badminton-specific components. Reproducibility was acceptable for badminton-specific reaction time (ICC = 0.626, CV = 6%) and for badminton-specific inhibitory control (ICC = 0.317, CV = 13%). Good construct validity was shown for badminton-specific reaction time discriminating between elite and non-elite players (F = 6.650, p < 0.05). Elite players did not outscore non-elite players on domain-general reaction time nor on both components of inhibitory control (p > 0.05). Concurrent validity for domain-general reaction time was good, as it was associated with a national ranking for elite (p = 0.70, p < 0.01) and non-elite (p = 0.70, p < 0.05) players. No relationship was found between the national ranking and badminton-specific reaction time, nor both components of inhibitory control (p > 0.05). In conclusion, reproducibility and validity of inhibitory control assessment was not confirmed, however, the BRIT appears a reproducible and valid measure of reaction time in badminton players. Reaction time measured with the BRIT may provide input for training programs aiming to improve badminton players’ performance. PMID:28210347

Assessing Cognitive Performance in Badminton Players: A Reproducibility and Validity Study.

PubMed

van de Water, Tanja; Huijgen, Barbara; Faber, Irene; Elferink-Gemser, Marije

2017-01-01

Fast reaction and good inhibitory control are associated with elite sports performance. To evaluate the reproducibility and validity of a newly developed Badminton Reaction Inhibition Test (BRIT), fifteen elite (25 ± 4 years) and nine non-elite (24 ± 4 years) Dutch male badminton players participated in the study. The BRIT measured four components: domain-general reaction time, badminton-specific reaction time, domain-general inhibitory control and badminton-specific inhibitory control. Five participants were retested within three weeks on the badminton-specific components. Reproducibility was acceptable for badminton-specific reaction time (ICC = 0.626, CV = 6%) and for badminton-specific inhibitory control (ICC = 0.317, CV = 13%). Good construct validity was shown for badminton-specific reaction time discriminating between elite and non-elite players (F = 6.650, p < 0.05). Elite players did not outscore non-elite players on domain-general reaction time nor on both components of inhibitory control (p > 0.05). Concurrent validity for domain-general reaction time was good, as it was associated with a national ranking for elite (p = 0.70, p < 0.01) and non-elite (p = 0.70, p < 0.05) players. No relationship was found between the national ranking and badminton-specific reaction time, nor both components of inhibitory control (p > 0.05). In conclusion, reproducibility and validity of inhibitory control assessment was not confirmed, however, the BRIT appears a reproducible and valid measure of reaction time in badminton players. Reaction time measured with the BRIT may provide input for training programs aiming to improve badminton players' performance.

Convergent validity of the Arab Teens Lifestyle Study (ATLS) physical activity questionnaire.

PubMed

Al-Hazzaa, Hazzaa M; Al-Sobayel, Hana I; Musaiger, Abdulrahman O

2011-09-01

The Arab Teens Lifestyle Study (ATLS) is a multicenter project for assessing the lifestyle habits of Arab adolescents. This study reports on the convergent validity of the physical activity questionnaire used in ATLS against an electronic pedometer. Participants were 39 males and 36 females randomly selected from secondary schools, with a mean age of 16.1 ± 1.1 years. ATLS self-reported questionnaire was validated against the electronic pedometer for three consecutive weekdays. Mean steps counts were 6,866 ± 3,854 steps/day with no significant gender difference observed. Questionnaire results showed no significant gender differences in time spent on total or moderate-intensity activities. However, males spent significantly more time than females on vigorous-intensity activity. The correlation of steps counts with total time spent on all activities by the questionnaire was 0.369. Relationship of steps counts was higher with vigorous-intensity (r = 0.338) than with moderate-intensity activity (r = 0.265). Pedometer steps counts showed higher correlations with time spent on walking (r = 0.350) and jogging (r = 0.383) than with the time spent on other activities. Active participants, based on pedometer assessment, were also most active by the questionnaire. It appears that ATLS questionnaire is a valid instrument for assessing habitual physical activity among Arab adolescents.

Community Willingness to Participate in a Dengue Study in Aceh Province, Indonesia

PubMed Central

Anwar, Samsul; Bustaman, Aslam; Radiansyah, Arsil; Angraini, Pradiba; Fasli, Riny; Salwiyadi, Salwiyadi; Bastian, Reza Akbar; Oktiviyari, Ade; Akmal, Imaduddin; Iqbalamin, Muhammad; Adil, Jamalul; Henrizal, Fenni; Darmayanti, Darmayanti; Pratama, Rovy; Fajar, Jonny Karunia; Setiawan, Abdul Malik; Imrie, Allison; Kuch, Ulrich; Groneberg, David Alexander; Sasmono, R. Tedjo; Dhimal, Meghnath; Müller, Ruth

2016-01-01

Background Dengue virus infection is the most rapidly spreading vector-borne disease in the world. Essential research on dengue virus transmission and its prevention requires community participation. Therefore, it is crucial to understand the factors that are associated with the willingness of communities in high prevalence areas to participate in dengue research. The aim of this study was to explore factors associated with the willingness of healthy community members in Aceh province, Indonesia, to participate in dengue research that would require phlebotomy. Methodology/Principal Findings A community-based cross-sectional study was carried out in nine regencies and municipalities of Aceh from November 2014 to March 2015. Interviews using a set of validated questionnaires were conducted to collect data on demography, history of dengue infection, socioeconomic status, and knowledge, attitude and practice regarding dengue fever. Two-step logistic regression and Spearman’s rank correlation (rs) analysis were used to assess the influence of independent variables on dependent variables. Among 535 participants, less than 20% had a good willingness to participate in the dengue study. The factors associated with good willingness to participate were being female, working as a civil servant, private employee or entrepreneur, having a high socioeconomic status and good knowledge, attitude and practice regarding dengue. Good knowledge and attitude regarding dengue were positive independent predictors of willingness to participate (OR: 2.30 [95% CI: 1.36–3.90] and 3.73 [95% CI: 2.24–6.21], respectively). Conclusion/Significance The willingness to participate in dengue research is very low among community members in Aceh, and the two most important associated factors are knowledge and attitude regarding dengue. To increase participation rate, efforts to improve the knowledge and attitude of community members regarding dengue fever and dengue-related research is required

Validation of the da Vinci Surgical Skill Simulator across three surgical disciplines: A pilot study

PubMed Central

Alzahrani, Tarek; Haddad, Richard; Alkhayal, Abdullah; Delisle, Josée; Drudi, Laura; Gotlieb, Walter; Fraser, Shannon; Bergman, Simon; Bladou, Frank; Andonian, Sero; Anidjar, Maurice

2013-01-01

Objective: In this paper, we evaluate face, content and construct validity of the da Vinci Surgical Skills Simulator (dVSSS) across 3 surgical disciplines. Methods: In total, 48 participants from urology, gynecology and general surgery participated in the study as novices (0 robotic cases performed), intermediates (1–74) or experts (≥75). Each participant completed 9 tasks (Peg board level 2, match board level 2, needle targeting, ring and rail level 2, dots and needles level 1, suture sponge level 2, energy dissection level 1, ring walk level 3 and tubes). The Mimic Technologies software scored each task from 0 (worst) to 100 (best) using several predetermined metrics. Face and content validity were evaluated by a questionnaire administered after task completion. Wilcoxon test was used to perform pair wise comparisons. Results: The expert group comprised of 6 attending surgeons. The intermediate group included 4 attending surgeons, 3 fellows and 5 residents. The novices included 1 attending surgeon, 1 fellow, 13 residents, 13 medical students and 2 research assistants. The median number of robotic cases performed by experts and intermediates were 250 and 9, respectively. The median overall realistic score (face validity) was 8/10. Experts rated the usefulness of the simulator as a training tool for residents (content validity) as 8.5/10. For construct validity, experts outperformed novices in all 9 tasks (p < 0.05). Intermediates outperformed novices in 7 of 9 tasks (p < 0.05); there were no significant differences in the energy dissection and ring walk tasks. Finally, experts scored significantly better than intermediates in only 3 of 9 tasks (matchboard, dots and needles and energy dissection) (p < 0.05). Conclusions: This study confirms the face, content and construct validities of the dVSSS across urology, gynecology and general surgery. Larger sample size and more complex tasks are needed to further differentiate intermediates from experts. PMID:23914275

Development and validation study of the Smartphone Overuse Screening Questionnaire.

PubMed

Lee, Han-Kyeong; Kim, Ji-Hae; Fava, Maurizio; Mischoulon, David; Park, Jae-Hyun; Shim, Eun-Jung; Lee, Eun-Ho; Lee, Ji Hyeon; Jeon, Hong Jin

2017-11-01

The aim of this study was to develop a screening questionnaire that could distinguish individuals at high risk of smartphone overuse from casual users. The reliability, validity, and diagnostic ability of the Smartphone Overuse Screening Questionnaire (SOS-Q) were evaluated. Preliminary items were assessed by 50 addiction experts on-line, and 28 questions were selected. A total of 158 subjects recruited from six community centers for internet addiction participated in this study. The SOS-Q, Young's internet addiction scale, Korean scale for internet addiction, and Smartphone Scale for Smartphone Addiction (S-Scale) were used to assess the concurrent validity. Construct validity was supported by a six-factor model using an exploratory factor analysis. The internal consistency and the item-total correlations were favorable (α = 0.95, r = 0.35-0.81). The test-retest reliability was moderate (r = 0.70). The SOS-Q showed superior concurrent validity with the highest correlation between the S-Scale (r = 0.76). Receiver operating characteristic curve analysis revealed an area under the curve of 0.877. A cut-off point of 49 effectively categorized addiction high-risk group with a sensitivity of 0.81 and specificity of 0.86. Overall, the current study supports the use of SOS-Q as both a primary and supplementary measurement tool in a variety of settings. Copyright © 2017 Elsevier B.V. All rights reserved.

How well do adolescents recall use of mobile telephones? Results of a validation study

PubMed Central

2009-01-01

Background In the last decade mobile telephone use has become more widespread among children. Concerns expressed about possible health risks have led to epidemiological studies investigating adverse health outcomes associated with mobile telephone use. Most epidemiological studies have relied on self reported questionnaire responses to determine individual exposure. We sought to validate the accuracy of self reported adolescent mobile telephone use. Methods Participants were recruited from year 7 secondary school students in Melbourne, Australia. Adolescent recall of mobile telephone use was assessed using a self administered questionnaire which asked about number and average duration of calls per week. Validation of self reports was undertaken using Software Modified Phones (SMPs) which logged exposure details such as number and duration of calls. Results A total of 59 adolescents participated (39% boys, 61% girls). Overall a modest but significant rank correlation was found between self and validated number of voice calls (ρ = 0.3, P = 0.04) with a sensitivity of 57% and specificity of 66%. Agreement between SMP measured and self reported duration of calls was poorer (ρ = 0.1, P = 0.37). Participants whose parents belonged to the 4th socioeconomic stratum recalled mobile phone use better than others (ρ = 0.6, P = 0.01). Conclusion Adolescent recall of mobile telephone use was only modestly accurate. Caution is warranted in interpreting results of epidemiological studies investigating health effects of mobile phone use in this age group. PMID:19523193

Validation of physical activity instruments: Black Women's Health Study.

PubMed

Carter-Nolan, Pamela L; Adams-Campbell, Lucile L; Makambi, Kepher; Lewis, Shantell; Palmer, Julie R; Rosenberg, Lynn

2006-01-01

Few studies have reported on the validity of physical activity measures in African Americans. The present study was designed to determine the validity of a self-administered physical activity questionnaire (PAQ) that was used in a large prospective study of African American women in the United States against an accelerometer (actigraph), an objective assessment of movement, and a seven-day activity diary. The study was conducted among 101 women enrolled in the Black Women's Health Study (BWHS) cohort who resided in the Washington, DC, metropolitan area, representing 11.2% (101/900) of this sample. Physical activity levels were obtained from the parent BWHS PAQ (eg, 1997 and 1999) and repeated in the present study. This information entailed hours per week of participation in walking for exercise, hours per week of moderate activity (eg, housework, gardening, and bowling), and hours per week of strenuous activity (eg, basketball, swimming, running, and aerobics) during the previous year. The participants were required to wear actigraphs for seven days and then record their physical activities in their diaries (seven-day physical activity diary) during this time. The diaries were used to record the amount and pattern of daily energy expenditure. Significant positive correlations were seen between the BWHS PAQ and the actigraph for total activity, r=.28; walking, r=.26; and vigorous activity, r=.40, P<.001. For the seven-day physical activity diary, the BWHS PAQ also demonstrated significant correlations for total (r=0.42, P<.01); moderate (r=.26, P<.05); and vigorous activities (r=.41, P<.01). The BWHS PAQ is a useful measure of physical activity in the BWHS cohort and thus has utility in prospective epidemiologic research.

Objectifying Content Validity: Conducting a Content Validity Study in Social Work Research.

ERIC Educational Resources Information Center

Rubio, Doris McGartland; Berg-Weger, Marla; Tebb, Susan S.; Lee, E. Suzanne; Rauch, Shannon

2003-01-01

The purpose of this article is to demonstrate how to conduct a content validity study. Instructions on how to calculate a content validity index, factorial validity index, and an interrater reliability index and guide for interpreting these indices are included. Implications regarding the value of conducting a content validity study for…

Variability of total step activity in children with cerebral palsy: influence of definition of a day on participant retention within the study.

PubMed

Wilson, Nichola C; Mudge, Suzie; Stott, N Susan

2016-08-20

Activity monitoring is important to establish accurate daily physical activity levels in children with cerebral palsy (CP). However, few studies address issues around inclusion or exclusion of step count data; in particular, how a valid day should be defined and what impact different lengths of monitoring have on retention of participant data within a study. This study assessed how different 'valid day' definitions influenced inclusion of participant data in final analyses and the subsequent variability of the data. Sixty-nine children with CP were fitted with a StepWatch™ Activity Monitor and instructed to wear it for a week. Data analysis used two broad definitions of a day, based on either number of steps in a 24 h monitoring period or the number of hours of recorded activity in a 24 h monitoring period. Eight children either did not use the monitor, or used it for only 1 day. The remaining 61 children provided 2 valid days of monitoring defined as >100 recorded steps per 24 h period and 55 (90 %) completed 2 valid days of monitoring with ≥10 h recorded activity per 24 h period. Performance variability in daily step count was lower across 2 days of monitoring when a valid day was defined as ≥10 h recorded activity per 24 h period (ICC = 0.765) and, higher when the definition >100 recorded steps per 24 h period (ICC = 0.62). Only 46 participants (75 %) completed 5 days of monitoring with >100 recorded steps per 24 h period and only 23 (38 %) achieved 5 days of monitoring with ≥10 h recorded activity per 24 h period. Datasets of participants who functioned at GMFCS level II were differentially excluded when the criteria for inclusion in final analysis was 5 valid days of ≥10 h recorded activity per 24 h period, leaving datasets available for only 8 of 32 participant datasets retained in the study. We conclude that changes in definition of a valid day have significant impacts on both inclusion of participant data in final

The Feasibility and Validity of a Remote Pulse Oximetry System for Pulmonary Rehabilitation: A Pilot Study

PubMed Central

Tang, Jonathan; Mandrusiak, Allison; Russell, Trevor

2012-01-01

Pulmonary rehabilitation is an effective treatment for people with chronic obstructive pulmonary disease. However, access to these services is limited especially in rural and remote areas. Telerehabilitation has the potential to deliver pulmonary rehabilitation programs to these communities. The aim of this study was threefold: to establish the technical feasibility of transmitting real-time pulse oximetry data, determine the validity of remote measurements compared to conventional face-to-face measures, and evaluate the participants' perception of the usability of the technology. Thirty-seven healthy individuals participated in a single remote pulmonary rehabilitation exercise session, conducted using the eHAB telerehabilitation system. Validity was assessed by comparing the participant's oxygen saturation and heart rate with the data set received at the therapist's remote location. There was an 80% exact agreement between participant and therapist data sets. The mean absolute difference and Bland and Altman's limits of agreement fell within the minimum clinically important difference for both oxygen saturation and heart rate values. Participants found the system easy to use and felt confident that they would be able to use it at home. Remote measurement of pulse oximetry data for a pulmonary rehabilitation exercise session was feasible and valid when compared to conventional face-to-face methods. PMID:23049549

Evaluation of the internal construct validity of the Personal Care Participation Assessment and Resource Tool (PC-PART) using Rasch analysis.

PubMed

Darzins, Susan; Imms, Christine; Di Stefano, Marilyn; Taylor, Nicholas F; Pallant, Julie F

2014-11-05

The Personal Care Participation Assessment and Resource Tool (PC-PART) is a 43-item, clinician-administered assessment, designed to identify patients' unmet needs (participation restrictions) in activities of daily living (ADL) required for community life. This information is important for identifying problems that need addressing to enable, for example, discharge from inpatient settings to community living. The objective of this study was to evaluate internal construct validity of the PC-PART using Rasch methods. Fit to the Rasch model was evaluated for 41 PC-PART items, assessing threshold ordering, overall model fit, individual item fit, person fit, internal consistency, Differential Item Functioning (DIF), targeting of items and dimensionality. Data used in this research were taken from admission data from a randomised controlled trial conducted at two publically funded inpatient rehabilitation units in Melbourne, Australia, with 996 participants (63% women; mean age 74 years) and with various impairment types. PC-PART items assessed as one scale, and original PC-PART domains evaluated as separate scales, demonstrated poor fit to the Rasch model. Adequate fit to the Rasch model was achieved in two newly formed PC-PART scales: Self-Care (16 items) and Domestic Life (14 items). Both scales were unidimensional, had acceptable internal consistency (PSI =0.85, 0.76, respectively) and well-targeted items. Rasch analysis did not support conventional summation of all PC-PART item scores to create a total score. However, internal construct validity of the newly formed PC-PART scales, Self-Care and Domestic Life, was supported. Their Rasch-derived scores provided interval-level measurement enabling summation of scores to form a total score on each scale. These scales may assist clinicians, managers and researchers in rehabilitation settings to assess and measure changes in ADL participation restrictions relevant to community living. Data used in this research were

Validation study of the Japanese version of the Obsessive-Compulsive Drinking Scale.

PubMed

Tatsuzawa, Yasutaka; Yoshimasu, Haruo; Moriyama, Yasushi; Furusawa, Teruyuki; Yoshino, Aihide

2002-02-01

The Obsessive-Compulsive Drinking Scale (OCDS) is a self-rating questionnaire that measures cognitive and behavioral aspects of craving for alcohol. The OCDS consists of two subscales: the obsessive thoughts of drinking subscale (OS) and the compulsive drinking subscale (CS). This study aims to validate the Japanese version of the OCDS. First, internal consistency and discriminant validity were evaluated. Second, a prospective longitudinal 3-month outcome study of 67 patients with alcohol dependence who participated in a relapse prevention program was designed to assess the concurrent and predictive validity of the OCDS. The OCDS demonstrated high internal consistency. The OS had high discriminant validity, while the CS did not. Twenty-three patients (34.3%) dropped out of treatment. These patients had significantly higher OS scores than those who completed the program. At 3 months, the relapse group had significantly higher OCDS scores than the no relapse group. Also, the OCDS score was higher in subjects who had early-onset alcohol dependence than late-onset dependence. The OCDS is useful for evaluating cognitive aspect of craving and predicts dropout and relapse.

Convergent Validity of the Arab Teens Lifestyle Study (ATLS) Physical Activity Questionnaire

PubMed Central

Al-Hazzaa, Hazzaa M.; Al-Sobayel, Hana I.; Musaiger, Abdulrahman O.

2011-01-01

The Arab Teens Lifestyle Study (ATLS) is a multicenter project for assessing the lifestyle habits of Arab adolescents. This study reports on the convergent validity of the physical activity questionnaire used in ATLS against an electronic pedometer. Participants were 39 males and 36 females randomly selected from secondary schools, with a mean age of 16.1 ± 1.1 years. ATLS self-reported questionnaire was validated against the electronic pedometer for three consecutive weekdays. Mean steps counts were 6,866 ± 3,854 steps/day with no significant gender difference observed. Questionnaire results showed no significant gender differences in time spent on total or moderate-intensity activities. However, males spent significantly more time than females on vigorous-intensity activity. The correlation of steps counts with total time spent on all activities by the questionnaire was 0.369. Relationship of steps counts was higher with vigorous-intensity (r = 0.338) than with moderate-intensity activity (r = 0.265). Pedometer steps counts showed higher correlations with time spent on walking (r = 0.350) and jogging (r = 0.383) than with the time spent on other activities. Active participants, based on pedometer assessment, were also most active by the questionnaire. It appears that ATLS questionnaire is a valid instrument for assessing habitual physical activity among Arab adolescents. PMID:22016718

Adaptation of Organizational Justice in Sport Scale into Turkish Language: Validity and Reliability Study

ERIC Educational Resources Information Center

Sayin, Ayfer; Sahin, Mustafa Yasar

2017-01-01

The present study aimed to provide a Turkish adaptation of the Organizational Justice in Sport Scale and perform reliability and validity studies. Answers provided by 260 participants who work as football, male basketball and female basketball coaches in National Collegiate Athletic Association (NCAA) were analysed using the original scale that…

Preliminary validation study of the Russian Birmingham Cognitive Screen.

PubMed

Kuzmina, E; Humphreys, G W; Riddoch, M J; Skvortsov, A A; Weekes, B S

2018-02-01

The Birmingham Cognitive Screen (BCoS) is designed for use with individuals who have acquired language impairment following stroke. Our goal was to develop a Russian version of the BCoS (Rus-BCoS) by translating the battery following cultural and linguistic adaptations and establishing preliminary data on its psychometric properties. Fifty patients with left-hemisphere stroke were recruited, of whom 98% were diagnosed with mild to moderate aphasia. To check whether the Rus-BCoS provides stable and consistent scores, internal consistency, test-retest, and interrater types of reliability were determined. Eight participants with stroke and 20 neurologically intact participants were assessed twice. To inspect the discriminative power of the battery, 63 participants without brain impairment were tested with the Rus-BCoS. Additionally, the Russian version of the Montreal Cognitive Assessment (MoCA), Quantitative Assessment of Speech in Aphasia, and Luria's Neuropsychological Assessment Battery were used to examine convergent validity, sensitivity, and specificity of the Rus-BCoS. The internal consistency as well as test-retest and interrater reliability of the Rus-BCoS satisfied criteria for the research use. Performance on a majority of tasks in the battery correlated significantly with independently validated tests that putatively measure similar cognitive processes. Critically, all patients with aphasia returned nonzero scores in at least one task in all the Rus-BCoS sections, with the exception of the Controlled Attention section where two patients with severe executive control deficits could not perform. The Rus-BCoS shows promise as a comprehensive cognitive screening tool that can be used by clinicians working with Russian-speaking persons experiencing poststroke aphasia after much further validation and development of reliable normative standards. Given a lack of quantitative neuropsychological assessment tools in Russia, however, we contend the Rus-BCoS offers

Validation studies in forensic odontology - Part 1: Accuracy of radiographic matching.

PubMed

Page, Mark; Lain, Russell; Kemp, Richard; Taylor, Jane

2018-05-01

As part of a series of studies aimed at validating techniques in forensic odontology, this study aimed to validate the accuracy of ante-mortem (AM)/postmortem (PM) radiographic matching by dentists and forensic odontologists. This study used a web-based interface with 50 pairs of AM and PM radiographs from real casework, at varying degrees of difficulty. Participants were shown both radiographs as a pair and initially asked to decide if they represented the same individual using a yes/no binary choice forced-decision. Participants were asked to assess their level of confidence in their decision, and to make a conclusion using one of the ABFO (American Board of Forensic Odontology), INTERPOL (International Criminal Police Organisation) and DVISys™ (DVI System International, Plass Data Software) identification scale degrees. The mean false-positive rate using the binary choice scale was 12%. Overall accuracy was 89% using this model, however, 13% of participants scored below 80%. Only 25% of participants accurately answered yes or no >90% of the time, with no individual making the correct yes/no decision for all 50 pairs of radiographs. Non-odontologists (lay participants) scored poorly, with a mean accuracy of only 60%. Use of the graded ABFO, DVISYS and INTERPOL scales resulted in general improvements in performance, with the false-positive and false-negative rates falling to approximately 2% overall. Inter-examiner agreement in assigning scale degrees was good (ICC=0.64), however there was little correlation between confidence and both accuracy or agreement among practitioners. These results suggest that use of a non-binary scale is supported over a match/non-match call as it reduces the frequency of false positives and negatives. The use of the terms "possible" and "insufficient information" in the same scale appears to create confusion, reducing inter-examiner agreement. The lack of agreement between higher-performing and lower-performing groups suggests that

The cross-cultural equivalence of participation instruments: a systematic review.

PubMed

Stevelink, S A M; van Brakel, W H

2013-07-01

Concepts such as health-related quality of life, disability and participation may differ across cultures. Consequently, when assessing such a concept using a measure developed elsewhere, it is important to test its cultural equivalence. Previous research suggested a lack of cultural equivalence testing in several areas of measurement. This paper reviews the process of cross-cultural equivalence testing of instruments to measure participation in society. An existing cultural equivalence framework was adapted and used to assess participation instruments on five categories of equivalence: conceptual, item, semantic, measurement and operational equivalence. For each category, several aspects were rated, resulting in an overall category rating of 'minimal/none', 'partial' or 'extensive'. The best possible overall study rating was five 'extensive' ratings. Articles were included if the instruments focussed explicitly on measuring 'participation' and were theoretically grounded in the ICIDH(-2) or ICF. Cross-validation articles were only included if it concerned an adaptation of an instrument developed in a high or middle-income country to a low-income country or vice versa. Eight cross-cultural validation studies were included in which five participation instruments were tested (Impact on Participation and Autonomy, London Handicap Scale, Perceived Impact and Problem Profile, Craig Handicap Assessment Reporting Technique, Participation Scale). Of these eight studies, only three received at least two 'extensive' ratings for the different categories of equivalence. The majority of the cultural equivalence ratings given were 'partial' and 'minimal/none'. The majority of the 'none/minimal' ratings were given for item and measurement equivalence. The cross-cultural equivalence testing of the participation instruments included leaves much to be desired. A detailed checklist is proposed for designing a cross-validation study. Once a study has been conducted, the checklist can

Lifelong Learning Competence Scale (LLLCS): The Study of Validity and Reliability

ERIC Educational Resources Information Center

Uzunboylu, Huseyin; Hursen, Cigdem

2011-01-01

In this research our aim is to develop a scale for lifelong learning competences and investigate the validity and the reliability of the structure of the scale. The participants of this research are 300 secondary school teachers who are randomly selected. The findings on the scale's validity of the structure are computed by the method of factor…

Comprehension of Written Grammar Test: Reliability and Known-Groups Validity Study With Hearing and Deaf and Hard-of-Hearing Students.

PubMed

Cannon, Joanna E; Hubley, Anita M; Millhoff, Courtney; Mazlouman, Shahla

2016-01-01

The aim of the current study was to gather validation evidence for the Comprehension of Written Grammar (CWG; Easterbrooks, 2010) receptive test of 26 grammatical structures of English print for use with children who are deaf and hard of hearing (DHH). Reliability and validity data were collected for 98 participants (49 DHH and 49 hearing) in Grades 2-6. The objectives were to: (a) examine 4-week test-retest reliability data; and (b) provide evidence of known-groups validity by examining expected differences between the groups on the CWG vocabulary pretest and main test, as well as selected structures. Results indicated excellent test-retest reliability estimates for CWG test scores. DHH participants performed statistically significantly lower on the CWG vocabulary pretest and main test than the hearing participants. Significantly lower performance by DHH participants on most expected grammatical structures (e.g., basic sentence patterns, auxiliary "be" singular/plural forms, tense, comparatives, and complementation) also provided known groups evidence. Overall, the findings of this study showed strong evidence of the reliability of scores and known group-based validity of inferences made from the CWG. © The Author 2015. Published by Oxford University Press. All rights reserved. For Permissions, please email: journals.permissions@oup.com.

Pilot Validation Study of the European Association of Urology Robotic Training Curriculum.

PubMed

Volpe, Alessandro; Ahmed, Kamran; Dasgupta, Prokar; Ficarra, Vincenzo; Novara, Giacomo; van der Poel, Henk; Mottrie, Alexandre

2015-08-01

The development of structured and validated training curricula is one of the current priorities in robot-assisted urological surgery. To establish the feasibility, acceptability, face validity, and educational impact of a structured training curriculum for robot-assisted radical prostatectomy (RARP), and to assess improvements in performance and ability to perform RARP after completion of the curriculum. A 12-wk training curriculum was developed based on an expert panel discussion and used to train ten fellows from major European teaching institutions. The curriculum included: (1) e-learning, (2) 1 wk of structured simulation-based training (virtual reality synthetic, animal, and cadaveric platforms), and (3) supervised modular training for RARP. The feasibility, acceptability, face validity, and educational impact were assessed using quantitative surveys. Improvement in the technical skills of participants over the training period was evaluated using the inbuilt validated assessment metrics on the da Vinci surgical simulator (dVSS). A final RARP performed by fellows on completion of their training was assessed using the Global Evaluative Assessment of Robotic Skills (GEARS) score and generic and procedure-specific scoring criteria. The median baseline experience of participants as console surgeon was 4 mo (interquartile range [IQR] 0-6.5 mo). All participants completed the curriculum and were involved in a median of 18 RARPs (IQR 14-36) during modular training. The overall score for dVSS tasks significantly increased over the training period (p<0.001-0.005). At the end of the curriculum, eight fellows (80%) were deemed able by their mentors to perform a RARP independently, safely, and effectively. At assessment of the final RARP, the participants achieved an average score ≥4 (scale 1-5) for all domains using the GEARS scale and an average score >10 (scale 4-16) for all procedural steps using a generic dedicated scoring tool. In performance comparison using this

Exploring validation of a graphic symbol questionnaire to measure participation experiences of youth in activity settings.

PubMed

Batorowicz, Beata; King, Gillian; Vane, Freda; Pinto, Madhu; Raghavendra, Parimala

2017-06-01

Participation has a subjective and private dimension, and so it is important to hear directly from youth about their experiences in various activity settings, the places where they "do things" and interact with others. To meet this need, our team developed the Self-Reported Experiences of Activity Settings (SEAS) measure, which demonstrated good-to-excellent measurement properties. To address the needs of youth who could benefit from graphic symbol support, the SEAS-PCS TM , 1 was created. The purpose of this paper is to describe the development of SEAS-PCS and the preliminary study that explores the equivalency of the SEAS and SEAS-PCS. The SEAS and SEAS-PCS were compared in terms of the equivalency of meaning of stimulus items by 11 professionals and five adults who used augmentative and alternative communication, were familiar with PCS, and were fluent readers. Out of 22 items, 68% were rated as highly similar on a 5-point scale (M = 4.14; SD = .70; mdn = 4; range: 2.81-5.00). Subsequently, the 32% of the SEAS-PCS items that were rated below 4 were modified based on the participants' specific comments. Further work is required to validate the SEAS-PCS. The next step could involve exploring the views of youth who use AAC.

PSI-Center Validation Studies

NASA Astrophysics Data System (ADS)

Nelson, B. A.; Akcay, C.; Glasser, A. H.; Hansen, C. J.; Jarboe, T. R.; Marklin, G. J.; Milroy, R. D.; Morgan, K. D.; Norgaard, P. C.; Shumlak, U.; Sutherland, D. A.; Victor, B. S.; Sovinec, C. R.; O'Bryan, J. B.; Held, E. D.; Ji, J.-Y.; Lukin, V. S.

2014-10-01

The Plasma Science and Innovation Center (PSI-Center - http://www.psicenter.org) supports collaborating validation platform experiments with 3D extended MHD simulations using the NIMROD, HiFi, and PSI-TET codes. Collaborators include the Bellan Plasma Group (Caltech), CTH (Auburn U), HBT-EP (Columbia), HIT-SI (U Wash-UW), LTX (PPPL), MAST (Culham), Pegasus (U Wisc-Madison), SSX (Swarthmore College), TCSU (UW), and ZaP/ZaP-HD (UW). The PSI-Center is exploring application of validation metrics between experimental data and simulations results. Biorthogonal decomposition (BOD) is used to compare experiments with simulations. BOD separates data sets into spatial and temporal structures, giving greater weight to dominant structures. Several BOD metrics are being formulated with the goal of quantitive validation. Results from these simulation and validation studies, as well as an overview of the PSI-Center status will be presented.

Development and Validation of Videotaped Scenarios

PubMed Central

Noel, Nora E.; Maisto, Stephen A.; Johnson, James D.; Jackson, Lee A.; Goings, Christopher D.; Hagman, Brett T.

2013-01-01

Researchers using scenarios often neglect to validate perceived content and salience of embedded stimuli specifically with intended participants, even when such meaning is integral to the study. For example, sex and aggression stimuli are heavily influenced by culture, so participants may not perceive what researchers intended in sexual aggression scenarios. Using four studies, the authors describe the method of scenario validation to produce two videos assessing alcohol-related sexual aggression. Both videos are identical except for the presence in one video of antiforce cues that are extremely salient to the young heterosexual men. Focus groups and questionnaires validate these men's perceptions that (a) the woman was sexually interested, (b) the sexual cues were salient, (c) the antiforce cues were salient (antiaggression video only), and (e) these antiforce cues inhibited acceptance of forced sex. Results show the value of carefully selecting and validating content when assessing socially volatile variables and provide a useful template for developing culturally valid scenarios. PMID:18252938

Genetic variation and willingness to participate in epidemiologic research: data from three studies.

PubMed

Bhatti, Parveen; Sigurdson, Alice J; Wang, Sophia S; Chen, Jinbo; Rothman, Nathaniel; Hartge, Patricia; Bergen, Andrew W; Landi, Maria Teresa

2005-10-01

The differences in common genetic polymorphism frequencies by willingness to participate in epidemiologic studies are unexplored, but the same threats to internal validity operate as for studies with nongenetic information. We analyzed single nucleotide polymorphism genotypes, haplotypes, and short tandem repeats among control groups from three studies with different recruitment designs that included early, late, and never questionnaire responders, one or more participation incentives, and blood or buccal DNA collection. Among 2,955 individuals, we compared 108 genotypes, 8 haplotypes, and 9 to 15 short tandem repeats by respondent type. Among our main comparisons, single nucleotide polymorphism genotype frequencies differed significantly (P < 0.05) between respondent groups in six instances, with 13 expected by chance alone. When comparing the odds of carrying a variant among the various response groups, 19 odds ratios were /=1.40, levels that might be notably different. Among the various respondent group comparisons, haplotype and short tandem repeat frequencies were not significantly different by willingness to participate. We observed little evidence to suggest that genotype differences underlie response characteristics in molecular epidemiologic studies, but a greater variety of genes should be examined, including those related to behavioral traits potentially associated with willingness to participate. To the extent possible, investigators should evaluate their own genetic data for bias in response categories.

[Construct validity of the Medical Outcomes Study's social support scale adapted to Portuguese in the Pró-Saúde Study].

PubMed

Griep, Rosane Harter; Chor, Dóra; Faerstein, Eduardo; Werneck, Guilherme L; Lopes, Cláudia S

2005-01-01

This paper evaluates the construct validity of the Medical Outcomes Study's social support scale adapted to Portuguese, when utilized in a cohort study among non-faculty civil servants at a university in Rio de Janeiro, Brazil (Pró-Saúde Study). Baseline data were obtained in 1999, when 4,030 participants (92.0% of those eligible) completed a multidimensional self-administered questionnaire at the workplace. From the original scale's five social support dimensions, factor analysis of the data extracted only three dimensions: positive social interaction/affective support; emotional/information support; and material support. We estimated associations between social support dimensions and socio-demographic, health, and well being-related characteristics. We confirmed the hypotheses that less isolated individuals, those with better self-rated health, those who reported more participation in group activities, and those with no evidence of common mental disorders reported better perception of social support. In conclusion, we found good evidence for a high construct validity of this scale, supporting its use in future analyses in the Pró-Saúde Study and in similar population groups.

Adaptation of General Belongingness Scale into Turkish for Adolescents: Validity and Reliability Studies

ERIC Educational Resources Information Center

Yildiz, Mehmet Ali

2017-01-01

The current research aims to adapt the General Belongingness Scale (GBS), developed by Malone, Pillow, and Osman (2012), into Turkish for adolescents and to conduct the validity and reliability studies for it. Ages of the participants, a total of 567 adolescents including 274 males (48.3%) and 293 females (51.7%) ranged between 14 and 18 (average…

The birth satisfaction scale: Turkish adaptation, validation and reliability study

PubMed Central

Cetin, Fatma Cosar; Sezer, Ayse; Merih, Yeliz Dogan

2015-01-01

OBJECTIVE: The objective of this study is to investigate the validity and the reliability of Birth Satisfaction Scale (BSS) and to adapt it into the Turkish language. This scale is used for measuring maternal satisfaction with birth in order to evaluate women’s birth perceptions. METHODS: In this study there were 150 women who attended to inpatient postpartum clinic. The participants filled in an information form and the BSS questionnaire forms. The properties of the scale were tested by conducting reliability and validation analyses. RESULTS: BSS entails 30 Likert-type questions. It was developed by Hollins Martin and Fleming. Total scale scores ranged between 30–150 points. Higher scores from the scale mean increases in birth satisfaction. Three overarching themes were identified in Scale: service provision (home assessment, birth environment, support, relationships with health care professionals); personal attributes (ability to cope during labour, feeling in control, childbirth preparation, relationship with baby); and stress experienced during labour (distress, obstetric injuries, receiving sufficient medical care, obstetric intervention, pain, prolonged labour and baby’s health). Cronbach’s alfa coefficient was 0.62. CONCLUSION: According to the present study, BSS entails 30 Likert-type questions and evaluates women’s birth perceptions. The Turkish version of BSS has been proven to be a valid and a reliable scale. PMID:28058355

Inhibitors and facilitators of willingness to participate (WTP) in an HIV vaccine trial: construction and initial validation of the Inhibitors and Facilitators of Willingness to Participate Scale (WPS) among women at risk for HIV infection.

PubMed

Fincham, Dylan; Kagee, Ashraf; Swartz, Leslie

2010-04-01

A psychometric scale assessing inhibitors and facilitators of willingness to participate (WTP) in an HIV vaccine trial has not yet been developed. This study aimed to construct and derive the exploratory factor structure of such a scale. The 35-item Inhibitors and Facilitators of Willingness to Participate Scale (WPS) was developed and administered to a convenience sample of 264 Black females between the ages of 16 and 49 years living in an urban-informal settlement near Cape Town. The subscales of the WPS demonstrated good internal consistency with Cronbach's alpha coefficients ranging between 0.69 and 0.82. A principal components exploratory factor analysis revealed the presence of five latent factors. The factors, which accounted for 45.93% of the variance in WTP, were (1) personal costs, (2) safety and convenience, (3) stigmatisation, (4) personal gains and (5) social approval and trust. Against the backdrop of the study limitations, these results provide initial support for the reliability and construct validity of the WPS among the most eligible trial participants in the Western Cape of South Africa.

Japanese study on stratification, health, income, and neighborhood: study protocol and profiles of participants.

PubMed

Takada, Misato; Kondo, Naoki; Hashimoto, Hideki

2014-01-01

The Japanese Study on Stratification, Health, Income, and Neighborhood (J-SHINE) aims to clarify the complex associations between social factors and health from an interdisciplinary perspective and to provide a database for use in various health policy evaluations. J-SHINE is an ongoing longitudinal panel study of households of adults aged 25-50 years. The wave 1 survey was carried out in 2010 among adults randomly selected from the resident registry of four urban and suburban municipalities in the greater Tokyo metropolitan area, Japan. In 2011, surveys for the participants' spouse/partner and child were additionally conducted. The wave 2 survey was conducted in 2012 for the wave 1 participants and will be followed by the wave 2 survey for spouse/partner and child in 2013. Wave 1 sample sizes were 4357 for wave 1 participants (valid response rate: 31.3%; cooperation rate: 51.8%), 1873 for spouse/partner (response rate: 61.9%), and 1520 for child (response rate: 67.7%). Wave 2 captured 69.0% of wave 1 participants. Information gathered covered socio-demographics, household economy, self-reported health conditions and healthcare utilization, stress and psychological values, and developmental history. A subpopulation underwent physiological (n = 2468) and biomarker (n = 1205) measurements. Longitudinal survey data, including repeated measures of social factors evaluated based on theories and techniques of various disciplines, like J-SHINE, should contribute toward opening a web of causality for society and health, which may have important policy implications for recent global health promotion strategies such as the World Health Organization's Social Determinants of Health approach and the second round of Japan's Healthy Japan 21.

Validation studies and proficiency testing.

PubMed

Ankilam, Elke; Heinze, Petra; Kay, Simon; Van den Eede, Guy; Popping, Bert

2002-01-01

Genetically modified organisms (GMOs) entered the European food market in 1996. Current legislation demands the labeling of food products if they contain <1% GMO, as assessed for each ingredient of the product. To create confidence in the testing methods and to complement enforcement requirements, there is an urgent need for internationally validated methods, which could serve as reference methods. To date, several methods have been submitted to validation trials at an international level; approaches now exist that can be used in different circumstances and for different food matrixes. Moreover, the requirement for the formal validation of methods is clearly accepted; several national and international bodies are active in organizing studies. Further validation studies, especially on the quantitative polymerase chain reaction methods, need to be performed to cover the rising demand for new extraction methods and other background matrixes, as well as for novel GMO constructs.

40 CFR 761.395 - A validation study.

Code of Federal Regulations, 2011 CFR

2011-07-01

... 40 Protection of Environment 31 2011-07-01 2011-07-01 false A validation study. 761.395 Section... PROHIBITIONS Comparison Study for Validating a New Performance-Based Decontamination Solvent Under § 761.79(d)(4) § 761.395 A validation study. (a) Decontaminate the following prepared sample surfaces using the...

40 CFR 761.395 - A validation study.

Code of Federal Regulations, 2010 CFR

2010-07-01

... 40 Protection of Environment 30 2010-07-01 2010-07-01 false A validation study. 761.395 Section... PROHIBITIONS Comparison Study for Validating a New Performance-Based Decontamination Solvent Under § 761.79(d)(4) § 761.395 A validation study. (a) Decontaminate the following prepared sample surfaces using the...

New Validated Thresholds for Various Intensities of Physical Activity in Adolescents Using the Actigraph Accelerometer

ERIC Educational Resources Information Center

Vanhelst, Jeremy; Beghin, Laurent; Turck, Dominique; Gottrand, Frederic

2011-01-01

The aim of this study was to determine and validate the new thresholds for various intensities of physical activity in adolescents using the Actigraph accelerometer. Sixty healthy participants aged 10-16 years were recruited. Forty participants participated in the calibration study whereas the others participated in the validation study.…

A pilot study to validate measures of the theory of reasoned action for organ donation behavior.

PubMed

Wong, Shui Hung; Chow, Amy Yin Man

2018-04-01

The present study aimed at taking the first attempt in validating the measures generated based on the theory of reasoned action (TRA). A total of 211 university students participated in the study, 95 were included in the exploratory factor analysis and 116 were included in the confirmatory factor analysis. The TRA measurements were established with adequate psychometric properties, internal consistency, and construct validity. Findings also suggested that attitude toward organ donation has both a cognitive and affective nature, while the subjective norm of the family seems to be important to students' views on organ donation.

Identifying Barriers to Study Abroad Program Participation

ERIC Educational Resources Information Center

McKinley, Karen E.

2014-01-01

University administrators, industry professionals, and government leaders encourage college students to participate in study abroad programs. Despite an increase in the number of students going abroad, the percentage of students participating in global programs remain low. This study identified barriers to study abroad program participation at a…

An exploratory study into the effect of time-restricted internet access on face-validity, construct validity and reliability of postgraduate knowledge progress testing

PubMed Central

2013-01-01

Background Yearly formative knowledge testing (also known as progress testing) was shown to have a limited construct-validity and reliability in postgraduate medical education. One way to improve construct-validity and reliability is to improve the authenticity of a test. As easily accessible internet has become inseparably linked to daily clinical practice, we hypothesized that allowing internet access for a limited amount of time during the progress test would improve the perception of authenticity (face-validity) of the test, which would in turn improve the construct-validity and reliability of postgraduate progress testing. Methods Postgraduate trainees taking the yearly knowledge progress test were asked to participate in a study where they could access the internet for 30 minutes at the end of a traditional pen and paper test. Before and after the test they were asked to complete a short questionnaire regarding the face-validity of the test. Results Mean test scores increased significantly for all training years. Trainees indicated that the face-validity of the test improved with internet access and that they would like to continue to have internet access during future testing. Internet access did not improve the construct-validity or reliability of the test. Conclusion Improving the face-validity of postgraduate progress testing, by adding the possibility to search the internet for a limited amount of time, positively influences test performance and face-validity. However, it did not change the reliability or the construct-validity of the test. PMID:24195696

40 CFR 761.395 - A validation study.

Code of Federal Regulations, 2013 CFR

2013-07-01

... 40 Protection of Environment 32 2013-07-01 2013-07-01 false A validation study. 761.395 Section...)(4) § 761.395 A validation study. (a) Decontaminate the following prepared sample surfaces using the... must be 10 µg/100 cm2, then the validation study failed and the solvent may not be used for...

40 CFR 761.395 - A validation study.

Code of Federal Regulations, 2014 CFR

2014-07-01

... 40 Protection of Environment 31 2014-07-01 2014-07-01 false A validation study. 761.395 Section...)(4) § 761.395 A validation study. (a) Decontaminate the following prepared sample surfaces using the... must be 10 µg/100 cm2, then the validation study failed and the solvent may not be used for...

40 CFR 761.395 - A validation study.

Code of Federal Regulations, 2012 CFR

2012-07-01

... 40 Protection of Environment 32 2012-07-01 2012-07-01 false A validation study. 761.395 Section...)(4) § 761.395 A validation study. (a) Decontaminate the following prepared sample surfaces using the... must be 10 µg/100 cm2, then the validation study failed and the solvent may not be used for...

Community validation of the IDEA study cognitive screen in rural Tanzania.

PubMed

Gray, William K; Paddick, Stella Maria; Collingwood, Cecilia; Kisoli, Aloyce; Mbowe, Godfrey; Mkenda, Sarah; Lissu, Carolyn; Rogathi, Jane; Kissima, John; Walker, Richard W; Mushi, Declare; Chaote, Paul; Ogunniyi, Adesola; Dotchin, Catherine L

2016-11-01

The dementia diagnosis gap in sub-Saharan Africa (SSA) is large, partly because of difficulties in screening for cognitive impairment in the community. As part of the Identification and Intervention for Dementia in Elderly Africans (IDEA) study, we aimed to validate the IDEA cognitive screen in a community-based sample in rural Tanzania METHODS: Study participants were recruited from people who attended screening days held in villages within the rural Hai district of Tanzania. Criterion validity was assessed against the gold standard clinical dementia diagnosis using DSM-IV criteria. Construct validity was assessed against, age, education, sex and grip strength and instrumental activities of daily living (IADLs). Internal consistency and floor and ceiling effects were also examined. During community screening, the IDEA cognitive screen had high criterion validity, with an area under the receiver operating characteristic curve of 0.855 (95% CI 0.794 to 0.915). Higher scores on the screen were significantly correlated with lower age, male sex, having attended school, better grip strength and improved performance in activities of daily living. Factor analysis revealed a single factor with an eigenvalue greater than one, although internal consistency was only moderate (Cronbach's alpha = 0.534). The IDEA cognitive screen had high criterion and construct validity and is suitable for use as a cognitive screening instrument in a community setting in SSA. Only moderate internal consistency may partly reflect the multi-domain nature of dementia as diagnosed clinically. Copyright © 2016 John Wiley & Sons, Ltd. Copyright © 2016 John Wiley & Sons, Ltd.

The multi-dimensional measure of informed choice: a validation study.

PubMed

Michie, Susan; Dormandy, Elizabeth; Marteau, Theresa M

2002-09-01

The aim of this prospective study is to assess the reliability and validity of a multi-dimensional measure of informed choice (MMIC). Participants were 225 pregnant women in two general hospitals in the UK, women receiving low-risk results following serum screening for Down syndrome. The MMIC was administered before testing and the Ottawa Decisional Conflict Scale was administered 6 weeks later. The component scales of the MMIC, knowledge and attitude, were internally consistent (alpha values of 0.68 and 0.78, respectively). Those who made a choice categorised as informed using the MMIC rated their decision 6 weeks later as being more informed, better supported and of higher quality than women whose choice was categorised as uninformed. This provides evidence of predictive validity, whilst the lack of association between the MMIC and anxiety shows construct (discriminant) validity. Thus, the MMIC has been shown to be psychometrically robust in pregnant women offered the choice to undergo prenatal screening for Down syndrome and receiving a low-risk result. Replication of this finding in other groups, facing other decisions, with other outcomes, should be assessed in future research.

The Arabic version of the Mayo-Portland Adaptability Inventory 4: a validation study.

PubMed

Hamed, Razan; Tariah, Hashem Abu; Malkawi, Somaya; Holm, Margo B

2012-09-01

The Mayo-Portland Adaptability Inventory 4 (MPAI-4) is a valid and reliable assessment tool to detect clinical impairments in patients with acquired brain injury. The tool is widely used by rehabilitation therapists worldwide, given its good psychometric properties and its availability in several languages. The purpose of this study was to translate the tool into Arabic and to examine its validity and reliability with multiple sclerosis and stroke patients. A total of 128 participants were enrolled in this study: 49 with multiple sclerosis, 17 with stroke, and 62 healthy adults. The psychometric properties of discriminative and convergent construct validity as well as test-retest reliability were tested. The translated tool, the Arabic-MPAI-4 (A-MPAI-4), significantly discriminated among the three subgroups (F=50.93, P<0.001), correlated moderately but significantly with the Arabic version of the Performance Assessment of Self-Care Skills Self-Report as a measure of functional independence in daily activities (r=-0.35, P<0.001), and showed good stability over time (r=0.73, P<0.001). The A-MPAI-4 is a valid and reliable tool for clinical use with multiple sclerosis and stroke patients who speak Arabic.

40 CFR 761.392 - Preparing validation study samples.

Code of Federal Regulations, 2010 CFR

2010-07-01

... 40 Protection of Environment 30 2010-07-01 2010-07-01 false Preparing validation study samples..., AND USE PROHIBITIONS Comparison Study for Validating a New Performance-Based Decontamination Solvent Under § 761.79(d)(4) § 761.392 Preparing validation study samples. (a)(1) To validate a procedure to...

40 CFR 761.392 - Preparing validation study samples.

Code of Federal Regulations, 2011 CFR

2011-07-01

... 40 Protection of Environment 31 2011-07-01 2011-07-01 false Preparing validation study samples..., AND USE PROHIBITIONS Comparison Study for Validating a New Performance-Based Decontamination Solvent Under § 761.79(d)(4) § 761.392 Preparing validation study samples. (a)(1) To validate a procedure to...

Development and validation of a brief screening instrument for psychosocial risk associated with genetic testing: a pan-Canadian cohort study

PubMed Central

Esplen, Mary Jane; Cappelli, Mario; Wong, Jiahui; Bottorff, Joan L; Hunter, Jon; Carroll, June; Dorval, Michel; Wilson, Brenda; Allanson, Judith; Semotiuk, Kara; Aronson, Melyssa; Bordeleau, Louise; Charlemagne, Nicole; Meschino, Wendy

2013-01-01

Objectives To develop a brief, reliable and valid instrument to screen psychosocial risk among those who are undergoing genetic testing for Adult-Onset Hereditary Disease (AOHD). Design A prospective two-phase cohort study. Setting 5 genetic testing centres for AOHD, such as cancer, Huntington's disease or haemochromatosis, in ambulatory clinics of tertiary hospitals across Canada. Participants 141 individuals undergoing genetic testing were approached and consented to the instrument development phase of the study (Phase I). The Genetic Psychosocial Risk Instrument (GPRI) developed in Phase I was tested in Phase II for item refinement and validation. A separate cohort of 722 individuals consented to the study, 712 completed the baseline package and 463 completed all follow-up assessments. Most participants were female, at the mid-life stage. Individuals in advanced stages of the illness or with cognitive impairment or a language barrier were excluded. Interventions Phase I: GPRI items were generated from (1) a review of the literature, (2) input from genetic counsellors and (3) phase I participants. Phase II: further item refinement and validation were conducted with a second cohort of participants who completed the GPRI at baseline and were followed for psychological distress 1-month postgenetic testing results. Primary and secondary outcome measures GPRI, Hamilton Depression Rating Scale (HAM-D), Hamilton Anxiety Rating Scale (HAM-A), Brief Symptom Inventory (BSI) and Impact of Event Scale (IES). Results The final 20-item GPRI had a high reliability—Cronbach's α at 0.81. The construct validity was supported by high correlations between GPRI and BSI and IES. The predictive value was demonstrated by a receiver operating characteristic curve of 0.78 plotting GPRI against follow-up assessments using HAM-D and HAM-A. Conclusions With a cut-off score of 50, GPRI identified 84% of participants who displayed distress postgenetic testing results, supporting its

Dynamic Assessment of Reading Difficulties: Predictive and Incremental Validity on Attitude toward Reading and the Use of Dialogue/Participation Strategies in Classroom Activities.

PubMed

Navarro, Juan-José; Lara, Laura

2017-01-01

Dynamic Assessment (DA) has been shown to have more predictive value than conventional tests for academic performance. However, in relation to reading difficulties, further research is needed to determine the predictive validity of DA for specific aspects of the different processes involved in reading and the differential validity of DA for different subgroups of students with an academic disadvantage. This paper analyzes the implementation of a DA device that evaluates processes involved in reading (EDPL) among 60 students with reading comprehension difficulties between 9 and 16 years of age, of whom 20 have intellectual disabilities, 24 have reading-related learning disabilities, and 16 have socio-cultural disadvantages. We specifically analyze the predictive validity of the EDPL device over attitude toward reading, and the use of dialogue/participation strategies in reading activities in the classroom during the implementation stage. We also analyze if the EDPL device provides additional information to that obtained with a conventionally applied personal-social adjustment scale (APSL). Results showed that dynamic scores, obtained from the implementation of the EDPL device, significantly predict the studied variables. Moreover, dynamic scores showed a significant incremental validity in relation to predictions based on an APSL scale. In relation to differential validity, the results indicated the superior predictive validity for DA for students with intellectual disabilities and reading disabilities than for students with socio-cultural disadvantages. Furthermore, the role of metacognition and its relation to the processes of personal-social adjustment in explaining the results is discussed.

Dynamic Assessment of Reading Difficulties: Predictive and Incremental Validity on Attitude toward Reading and the Use of Dialogue/Participation Strategies in Classroom Activities

PubMed Central

Navarro, Juan-José; Lara, Laura

2017-01-01

Dynamic Assessment (DA) has been shown to have more predictive value than conventional tests for academic performance. However, in relation to reading difficulties, further research is needed to determine the predictive validity of DA for specific aspects of the different processes involved in reading and the differential validity of DA for different subgroups of students with an academic disadvantage. This paper analyzes the implementation of a DA device that evaluates processes involved in reading (EDPL) among 60 students with reading comprehension difficulties between 9 and 16 years of age, of whom 20 have intellectual disabilities, 24 have reading-related learning disabilities, and 16 have socio-cultural disadvantages. We specifically analyze the predictive validity of the EDPL device over attitude toward reading, and the use of dialogue/participation strategies in reading activities in the classroom during the implementation stage. We also analyze if the EDPL device provides additional information to that obtained with a conventionally applied personal-social adjustment scale (APSL). Results showed that dynamic scores, obtained from the implementation of the EDPL device, significantly predict the studied variables. Moreover, dynamic scores showed a significant incremental validity in relation to predictions based on an APSL scale. In relation to differential validity, the results indicated the superior predictive validity for DA for students with intellectual disabilities and reading disabilities than for students with socio-cultural disadvantages. Furthermore, the role of metacognition and its relation to the processes of personal-social adjustment in explaining the results is discussed. PMID:28243215

29 CFR 1607.5 - General standards for validity studies.

Code of Federal Regulations, 2010 CFR

2010-07-01

... 29 Labor 4 2010-07-01 2010-07-01 false General standards for validity studies. 1607.5 Section 1607... studies. A. Acceptable types of validity studies. For the purposes of satisfying these guidelines, users may rely upon criterion-related validity studies, content validity studies or construct validity...

Why Judges Choose to Participate in Continuing Professional Education.

ERIC Educational Resources Information Center

Catlin, Dennis W.; Anderson, William A.

A study was conducted to determine why judges voluntarily choose to participate in continuing judicial education programs, and to identify relationships between the factors and selected personal and professional characteristics of judges. Two instruments measuring participation reasons and personal characteristics were developed, validated, and…

Development and Validation Study of the Internet Overuse Screening Questionnaire

PubMed Central

Lee, Han-Kyeong; Lee, Hae-Woo; Han, Joo Hyun; Park, Subin; Ju, Seok-Jin; Choi, Kwanwoo; Lee, Ji Hyeon; Jeon, Hong Jin

2018-01-01

Objective Concerns over behavioral and emotional problems caused by excessive internet usage have been developed. This study intended to develop and a standardize questionnaire that can efficiently identify at-risk internet users through their internet usage habits. Methods Participants (n=158) were recruited at six I-will-centers located in Seoul, South Korea. From the initial 36 questionnaire item pool, 28 preliminary items were selected through expert evaluation and panel discussions. The construct validity, internal consistency, and concurrent validity were examined. We also conducted Receiver Operating Curve (ROC) analysis to assess diagnostic ability of the Internet Overuse Screening-Questionnaire (IOS-Q). Results The exploratory factor analysis yielded a five factor structure. Four factors with 17 items remained after items that had unclear factor loading were removed. The Cronbach’s alpha for the IOS-Q total score was 0.91, and test-retest reliability was 0.72. The correlation between Young’s internet addiction scale and K-scale supported concurrent validity. ROC analysis showed that the IOS-Q has superior diagnostic ability with the Area Under the Curve of 0.87. At the cut-off point of 25.5, the sensitivity was 0.93 and specificity was 0.86. Conclusion Overall, this study supports the use of IOS-Q for internet addiction research and for screening high-risk individuals. PMID:29669406

Transition to Postgraduate Study: Practice, Participation and the Widening Participation Agenda

ERIC Educational Resources Information Center

O'Donnell, Victoria L.; Tobbell, Jane; Lawthom, Rebecca; Zammit, Maria

2009-01-01

This article explores transition to postgraduate (PG) study in terms of the widening participation (WP) agenda. The research is located within a Communities of Practice framework, allowing for explanations of transition in terms of learning, identity and participation in practices. A qualitative ethnographic methodology is employed, and analysis…

A population based validation study of self-reported pensions and benefits: the Nord-Trøndelag health study (HUNT).

PubMed

Myrtveit, Solbjørg Makalani; Ariansen, Anja M S; Wilhelmsen, Ingvard; Krokstad, Steinar; Mykletun, Arnstein

2013-01-23

Measures of disability pensions, sickness certification and long-term health related benefits are often self-reported in epidemiological studies. Few studies have examined these measures, and the validity is yet to be established.We aimed to estimate the validity of self-reported disability pension, rehabilitation benefit and retirement pension and to explore the benefit status and basic characteristics of those not responding to these items.A large health survey (HUNT2) containing self-reported questionnaire data on sickness benefits and pensions was linked to a national registry of pensions and benefits, used as "gold standard" for the analysis. We investigated two main sources of bias in self-reported data; misclassification - due to participants answering questions incorrectly, and systematic missing/selection bias - when participants do not respond to the questions.Sensitivity, specificity, positive (PPV) and negative (NPV) predicative value, agreement and Cohen's Kappa were calculated for each benefit. Co-variables were compared between non-responders and responders. In the study-population of 40,633, 9.2% reported receiving disability pension, 1.4% rehabilitation benefits and 6.1% retirement pension. According to the registry, the corresponding numbers were 9.0%, 1.7% and 5.4%. Excluding non-responders, specificity, NPV and agreement were above 98% for all benefits. Sensitivity and PPV were lower. When including non-responders as non-receivers, specificity got higher, sensitivity dropped while the other measures changed less.Between 17.7% and 24.1% did not answer the questions on benefits. Non-responders were older and more likely to be female. They reported more anxiety, more depression, a higher number of somatic diagnoses, less physical activity and lower consumption of alcohol (p < 0.001 for all variables). For disability pension and retirement pension, non-responders were less likely to receive benefits than responders (p < 0.001). For each

Many participants in inpatient rehabilitation can quantify their exercise dosage accurately: an observational study.

PubMed

Scrivener, Katharine; Sherrington, Catherine; Schurr, Karl; Treacy, Daniel

2011-01-01

Are inpatients undergoing rehabilitation who appear able to count exercises able to quantify accurately the amount of exercise they undertake? Observational study. Inpatients in an aged care rehabilitation unit and a neurological rehabilitation unit, who appeared able to count their exercises during a 1-2 min observation by their treating physiotherapist. Participants were observed for 30 min by an external observer while they exercised in the physiotherapy gymnasium. Both the participants and the observer counted exercise repetitions with a hand-held tally counter and the two tallies were compared. Of the 60 people admitted for aged care rehabilitation during the study period, 49 (82%) were judged by their treating therapist to be able to count their own exercise repetitions accurately. Of the 30 people admitted for neurological rehabilitation during the study period, 20 (67%) were judged by their treating therapist to be able to count their repetitions accurately. Of the 69 people judged to be accurate, 40 underwent observation while exercising. There was excellent agreement between these participants' counts of their exercise repetitions and the observers' counts, ICC (3,1) of 0.99 (95% CI 0.98 to 0.99). Eleven participants (28%) were in complete agreement with the observer. A further 19 participants (48%) varied from the observer by less than 10%. Therapists were able to identify a group of rehabilitation participants who were accurate in counting their exercise repetitions. Counting of exercise repetitions by therapist-selected patients is a valid means of quantifying exercise dosage during inpatient rehabilitation. Copyright © 2011 Australian Physiotherapy Association. Published by .. All rights reserved.

Performing a Content Validation Study.

ERIC Educational Resources Information Center

Spool, Mark D.

Content validity is concerned with three components: (1) the job content; (2) the test content, and (3) the strength of the relationship between the two. A content validation study, to be considered adequate and defensible should include at least the following four procedures: (1) A thorough and accurate job analysis (to define the job content);…

MEPROCS framework for Craniofacial Superimposition: Validation study.

PubMed

Ibáñez, O; Vicente, R; Navega, D; Campomanes-Álvarez, C; Cattaneo, C; Jankauskas, R; Huete, M I; Navarro, F; Hardiman, R; Ruiz, E; Imaizumi, K; Cavalli, F; Veselovskaya, E; Humpire, D; Cardoso, J; Collini, F; Mazzarelli, D; Gibelli, D; Damas, S

2016-11-01

Craniofacial Superimposition (CFS) involves the process of overlaying a skull with a number of ante-mortem images of an individual and the analysis of their morphological correspondence. The lack of unified working protocols and the absence of commonly accepted standards, led to contradictory consensus regarding its reliability. One of the more important aims of 'New Methodologies and Protocols of Forensic Identification by Craniofacial Superimposition (MEPROCS)' project was to propose a common framework for CFS, what can be considered the first international standard in the field. The framework aimed to serve as a roadmap for avoiding particular assumptions that could bias the process. At the same time, it provides some empirical support to certain practices, technological means, and morphological criteria expected to facilitate the application of the CFS task and to improve its reliability. In order to confirm the utility and potential benefits of the framework use, there is a need to empirically evaluate it in CFS identification scenarios as close as possible to the reality. Thus, the purpose of this study is to validate the CFS framework developed. For that aim 12 participants were asked to report about a variable number of CFS following all the recommendations of the framework. The results are analysed and discussed according to the framework understanding and fulfilment, the participants' performance, and the correlation between expected decisions and those given by the participants. In view of the quantitative results and qualitative examination criteria we can conclude that those who follow the MEPROCS recommendations improve their performance. Copyright © 2016 Elsevier Ireland Ltd. All rights reserved.

The reliability and validity of a short food frequency questionnaire among 9–11-year olds: a multinational study on three middle-income and high-income countries

PubMed Central

Saloheimo, T; González, S A; Erkkola, M; Milauskas, D M; Meisel, J D; Champagne, C M; Tudor-Locke, C; Sarmiento, O; Katzmarzyk, P T; Fogelholm, M

2015-01-01

Objective: The main aim of this study was to assess the reliability and validity of a food frequency questionnaire with 23 food groups (I-FFQ) among a sample of 9–11-year-old children from three different countries that differ on economical development and income distribution, and to assess differences between country sites. Furthermore, we assessed factors associated with I-FFQ's performance. Methods: This was an ancillary study of the International Study of Childhood Obesity, Lifestyle and the Environment. Reliability (n=321) and validity (n=282) components of this study had the same participants. Participation rates were 95% and 70%, respectively. Participants completed two I-FFQs with a mean interval of 4.9 weeks to assess reliability. A 3-day pre-coded food diary (PFD) was used as the reference method in the validity analyses. Wilcoxon signed-rank tests, intraclass correlation coefficients and cross-classifications were used to assess the reliability of I-FFQ. Spearman correlation coefficients, percentage difference and cross-classifications were used to assess the validity of I-FFQ. A logistic regression model was used to assess the relation of selected variables with the estimate of validity. Analyses based on information in the PFDs were performed to assess how participants interpreted food groups. Results: Reliability correlation coefficients ranged from 0.37 to 0.78 and gross misclassification for all food groups was <5%. Validity correlation coefficients were below 0.5 for 22/23 food groups, and they differed among country sites. For validity, gross misclassification was <5% for 22/23 food groups. Over- or underestimation did not appear for 19/23 food groups. Logistic regression showed that country of participation and parental education were associated (P⩽0.05) with the validity of I-FFQ. Analyses of children's interpretation of food groups suggested that the meaning of most food groups was understood by the children. Conclusion: I-FFQ is a

Study on community Tai Chi Chuan participants' leisure benefits and well-being: Using Taoyuan City as an example.

PubMed

Lee, Cheng-Jong; Tseng, Chun-Chi; Liu, Mei-Yu

2015-01-01

The aim of this study was to discuss the Research of Community Tai Chi Chuan Participants' Leisure Benefits and Well-being. A questionnaire survey was conducted on the community Tai Chi Chuan participants in Taoyuan city. A total of 500 valid questionnaires were retrieved, and the data were analyzed with SPSS 12.0 and AMOS 7.0 structural equation model analysis (SEM). The findings were as followed: 1) The background variables of the community Tai Chi Chuan participants in Taoyuan City: Gender had no difference in the factor of ``psychological benefit'' of leisure benefits. Occupation, age, education, the number of times a week to participate community Tai Chi Chuan and participation in seniority reached significant difference in leisure benefits. 2) The background variables of the community Tai Chi Chuan participants in Taoyuan City: gender, occupation, age, education, the number of times a week to participate community Tai Chi Chuan, participation in seniority reached significant difference in well-being. 3) The study showed community Tai Chi Chuan participants' leisure benefits had a significant positive correlation in well-being. Based on the findings, suggestions were proposed to related Taiwan Tai Chi Chuan promotion for reference.

Comprehension of Written Grammar Test: Reliability and Known-Groups Validity Study with Hearing and Deaf and Hard-of-Hearing Students

ERIC Educational Resources Information Center

Cannon, Joanna E.; Hubley, Anita M.; Millhoff, Courtney; Mazlouman, Shahla

2016-01-01

The aim of the current study was to gather validation evidence for the "Comprehension of Written Grammar" (CWG; Easterbrooks, 2010) receptive test of 26 grammatical structures of English print for use with children who are deaf and hard of hearing (DHH). Reliability and validity data were collected for 98 participants (49 DHH and 49…

Gathering Validity Evidence for Surgical Simulation: A Systematic Review.

PubMed

Borgersen, Nanna Jo; Naur, Therese M H; Sørensen, Stine M D; Bjerrum, Flemming; Konge, Lars; Subhi, Yousif; Thomsen, Ann Sofia S

2018-06-01

To identify current trends in the use of validity frameworks in surgical simulation, to provide an overview of the evidence behind the assessment of technical skills in all surgical specialties, and to present recommendations and guidelines for future validity studies. Validity evidence for assessment tools used in the evaluation of surgical performance is of paramount importance to ensure valid and reliable assessment of skills. We systematically reviewed the literature by searching 5 databases (PubMed, EMBASE, Web of Science, PsycINFO, and the Cochrane Library) for studies published from January 1, 2008, to July 10, 2017. We included original studies evaluating simulation-based assessments of health professionals in surgical specialties and extracted data on surgical specialty, simulator modality, participant characteristics, and the validity framework used. Data were synthesized qualitatively. We identified 498 studies with a total of 18,312 participants. Publications involving validity assessments in surgical simulation more than doubled from 2008 to 2010 (∼30 studies/year) to 2014 to 2016 (∼70 to 90 studies/year). Only 6.6% of the studies used the recommended contemporary validity framework (Messick). The majority of studies used outdated frameworks such as face validity. Significant differences were identified across surgical specialties. The evaluated assessment tools were mostly inanimate or virtual reality simulation models. An increasing number of studies have gathered validity evidence for simulation-based assessments in surgical specialties, but the use of outdated frameworks remains common. To address the current practice, this paper presents guidelines on how to use the contemporary validity framework when designing validity studies.

MEASURING COERCION TO PARTICIPATE IN RESEARCH WITHIN A DOUBLY VULNERABLE POPULATION: INITIAL DEVELOPMENT OF THE COERCION ASSESSMENT SCALE

PubMed Central

Dugosh, Karen Leggett; Festinger, David S.; Croft, Jason R.; Marlowe, Douglas B.

2011-01-01

Despite many efforts aimed to ensure that research participation is autonomous and not coerced, there exists no reliable and valid measure of perceived coercion for the doubly vulnerable population of substance-abusing offenders. The current study describes the development and initial validation of an instrument measuring perceived coercion to participate in research among substance-abusing offenders. The results indicated that a substantial number of individuals report feeling coerced to participate in the study. In addition, the instrument has adequate levels of internal consistency, a one-dimensional factor structure, and evidence of discriminative validity. This study provides initial support for the instrument’s validity and clinical utility. PMID:20235867

Willingness of minorities to participate in biomedical studies: confirmatory findings from a follow-up study using the Tuskegee Legacy Project Questionnaire.

PubMed Central

Katz, Ralph V.; Green, B. Lee; Kressin, Nancy R.; Claudio, Cristina; Wang, Min Qi; Russell, Stefanie L.

2007-01-01

OBJECTIVES: The purposes of this analysis were to compare the self-reported willingness of blacks, Puerto-Rican Hispanics and whites to participate as research subjects in biomedical studies, and to determine the reliability of the Tuskegee Legacy Project Questionnaire (TLP). METHODS: The TLP Questionnaire, initially used in a four-city study in 1999-2000, was administered in a follow-up study within a random-digit-dial telephone survey to a stratified random sample of adults in three different U.S. cities: Baltimore, MD; New York City; and San Juan, PR. The questionnaire, a 60-item instrument, contains two validated scales: the Likelihood of Participation (LOP) Scale and the Guinea Pig Fear Factor (GPFF) Scale. RESULTS: Adjusting for age, sex, education, income and city, the LOP Scale was not statistically significantly different for the racial/ethnic groups (ANCOVA, p=87). The GPFF Scale was statistically significantly higher for blacks and Hispanics as compared to whites (adjusted ANCOVA, p<0.001). CONCLUSIONS: The of the findings from the current three-city study, as well as from our prior four-city study, are remarkably similar and reinforce the conclusion that blacks and Hispanics self-report that, despite having a higher fear of participation, they are just as likely as whites to participate in biomedical research. PMID:17913117

Willingness of minorities to participate in biomedical studies: confirmatory findings from a follow-up study using the Tuskegee Legacy Project Questionnaire.

PubMed

Katz, Ralph V; Green, B Lee; Kressin, Nancy R; Claudio, Cristina; Wang, Min Qi; Russell, Stefanie L

2007-09-01

The purposes of this analysis were to compare the self-reported willingness of blacks, Puerto-Rican Hispanics and whites to participate as research subjects in biomedical studies, and to determine the reliability of the Tuskegee Legacy Project Questionnaire (TLP). The TLP Questionnaire, initially used in a four-city study in 1999-2000, was administered in a follow-up study within a random-digit-dial telephone survey to a stratified random sample of adults in three different U.S. cities: Baltimore, MD; New York City; and San Juan, PR. The questionnaire, a 60-item instrument, contains two validated scales: the Likelihood of Participation (LOP) Scale and the Guinea Pig Fear Factor (GPFF) Scale. Adjusting for age, sex, education, income and city, the LOP Scale was not statistically significantly different for the racial/ethnic groups (ANCOVA, p=87). The GPFF Scale was statistically significantly higher for blacks and Hispanics as compared to whites (adjusted ANCOVA, p<0.001). The of the findings from the current three-city study, as well as from our prior four-city study, are remarkably similar and reinforce the conclusion that blacks and Hispanics self-report that, despite having a higher fear of participation, they are just as likely as whites to participate in biomedical research.

Refusal to participate in heart failure studies: do age and gender matter?

PubMed Central

Harrison, Jordan M; Jung, Miyeon; Lennie, Terry A; Moser, Debra K; Smith, Dean G; Dunbar, Sandra B; Ronis, David L; Koelling, Todd M; Giordani, Bruno; Riley, Penny L; Pressler, Susan J

2018-01-01

Aims and objectives The objective of this retrospective study was to evaluate reasons heart failure patients decline study participation, to inform interventions to improve enrollment. Background Failure to enrol older heart failure patients (age > 65) and women in studies may lead to sampling bias, threatening study validity. Design This study was a retrospective analysis of refusal data from four heart failure studies that enrolled 788 patients in four states. Methods Chi-Square and a pooled t-test were computed to analyse refusal data (n = 300) obtained from heart failure patients who were invited to participate in one of the four studies but declined. Results Refusal reasons from 300 patients (66% men, mean age 65 33) included: not interested (n = 163), too busy (n = 64), travel burden (n = 50), too sick (n = 38), family problems (n = 14), too much commitment (n = 13) and privacy concerns (n = 4). Chi-Square analyses showed no differences in frequency of reasons (p > 0 05) between men and women. Patients who refused were older, on average, than study participants. Conclusions Some reasons were patient-dependent; others were study-dependent. With ‘not interested’ as the most common reason, cited by over 50% of patients who declined, recruitment measures should be targeted at stimulating patients’ interest. Additional efforts may be needed to recruit older participants. However, reasons for refusal were consistent regardless of gender. Relevance to clinical practice Heart failure researchers should proactively approach a greater proportion of women and patients over age 65. With no gender differences in type of reasons for refusal, similar recruitment strategies can be used for men and women. However, enrolment of a representative proportion of women in heart failure studies has proven elusive and may require significant effort from researchers. Employing strategies to stimulate interest in studies is essential for recruiting heart failure patients, who

The Clinical Impression of Severity Index for Parkinson's Disease: international validation study.

PubMed

Martínez-Martín, Pablo; Rodríguez-Blázquez, Carmen; Forjaz, Maria João; de Pedro, Jesús

2009-01-30

This study sought to provide further information about the psychometric properties of the Clinical Impression of Severity Index for Parkinson's Disease (CISI-PD), in a large, international, cross-culturally diverse sample. Six hundred and fourteen patients with PD participated in the study. Apart from the CISI-PD, assessments were based on Hoehn & Yahr (HY) staging, the Scales for Outcomes in PD-Motor (SCOPA-M), -Cognition (SCOPA-COG) and -Psychosocial (SCOPA-PS), the Cumulative Illness Rating Scale-Geriatrics, and the Hospital Anxiety and Depression Scale. The total CISI-PD score displayed no floor or ceiling effects. Internal consistency was 0.81, the test-retest intraclass correlation coefficient was 0.84, and item homogeneity was 0.52. Exploratory and confirmatory factor analysis (CFI = 0.99, RMSEA = 0.07) confirmed CISI-PD's unifactorial structure. The CISI-PD showed adequate convergent validity with SCOPA-COG and SCOPA-M (r(S) = 0.46-0.85, respectively) and discriminative validity for HY stages and disease duration (P < 0.0001). In a multiple regression model, main CISI-PD predictors were SCOPA-M, disease duration, and depression. The results obtained were not only comparable to but also extended those yielded by the preliminary validation study, thus showing that the CISI-PD is a valid instrument to measure clinical impression of severity in PD. Its simplicity and easy application make it an attractive and useful tool for clinical practice and research.

Controlling for Frailty in Pharmacoepidemiologic Studies of Older Adults: Validation of an Existing Medicare Claims-based Algorithm.

PubMed

Cuthbertson, Carmen C; Kucharska-Newton, Anna; Faurot, Keturah R; Stürmer, Til; Jonsson Funk, Michele; Palta, Priya; Windham, B Gwen; Thai, Sydney; Lund, Jennifer L

2018-07-01

Frailty is a geriatric syndrome characterized by weakness and weight loss and is associated with adverse health outcomes. It is often an unmeasured confounder in pharmacoepidemiologic and comparative effectiveness studies using administrative claims data. Among the Atherosclerosis Risk in Communities (ARIC) Study Visit 5 participants (2011-2013; n = 3,146), we conducted a validation study to compare a Medicare claims-based algorithm of dependency in activities of daily living (or dependency) developed as a proxy for frailty with a reference standard measure of phenotypic frailty. We applied the algorithm to the ARIC participants' claims data to generate a predicted probability of dependency. Using the claims-based algorithm, we estimated the C-statistic for predicting phenotypic frailty. We further categorized participants by their predicted probability of dependency (<5%, 5% to <20%, and ≥20%) and estimated associations with difficulties in physical abilities, falls, and mortality. The claims-based algorithm showed good discrimination of phenotypic frailty (C-statistic = 0.71; 95% confidence interval [CI] = 0.67, 0.74). Participants classified with a high predicted probability of dependency (≥20%) had higher prevalence of falls and difficulty in physical ability, and a greater risk of 1-year all-cause mortality (hazard ratio = 5.7 [95% CI = 2.5, 13]) than participants classified with a low predicted probability (<5%). Sensitivity and specificity varied across predicted probability of dependency thresholds. The Medicare claims-based algorithm showed good discrimination of phenotypic frailty and high predictive ability with adverse health outcomes. This algorithm can be used in future Medicare claims analyses to reduce confounding by frailty and improve study validity.

Update of the German Diabetes Risk Score and external validation in the German MONICA/KORA study.

PubMed

Mühlenbruch, Kristin; Ludwig, Tonia; Jeppesen, Charlotte; Joost, Hans-Georg; Rathmann, Wolfgang; Meisinger, Christine; Peters, Annette; Boeing, Heiner; Thorand, Barbara; Schulze, Matthias B

2014-06-01

Several published diabetes prediction models include information about family history of diabetes. The aim of this study was to extend the previously developed German Diabetes Risk Score (GDRS) with family history of diabetes and to validate the updated GDRS in the Multinational MONItoring of trends and determinants in CArdiovascular Diseases (MONICA)/German Cooperative Health Research in the Region of Augsburg (KORA) study. We used data from the European Prospective Investigation into Cancer and Nutrition (EPIC)-Potsdam study for extending the GDRS, including 21,846 participants. Within 5 years of follow-up 492 participants developed diabetes. The definition of family history included information about the father, the mother and/or sibling/s. Model extension was evaluated by discrimination and reclassification. We updated the calculation of the score and absolute risks. External validation was performed in the MONICA/KORA study comprising 11,940 participants with 315 incident cases after 5 years of follow-up. The basic ROC-AUC of 0.856 (95%-CI: 0.842-0.870) was improved by 0.007 (0.003-0.011) when parent and sibling history was included in the GDRS. The net reclassification improvement was 0.110 (0.072-0.149), respectively. For the updated score we demonstrated good calibration across all tenths of risk. In MONICA/KORA, the ROC-AUC was 0.837 (0.819-0.855); regarding calibration we saw slight overestimation of absolute risks. Inclusion of the number of diabetes-affected parents and sibling history improved the prediction of type 2 diabetes. Therefore, we updated the GDRS algorithm accordingly. Validation in another German cohort study showed good discrimination and acceptable calibration for the vast majority of individuals. Copyright © 2014 Elsevier Ireland Ltd. All rights reserved.

Test-retest reliability and validity of a web-based food-frequency questionnaire for adolescents aged 13-14 to be used in the Norwegian Mother and Child Cohort Study (MoBa).

PubMed

Overby, Nina Cecilie; Johannesen, Elisabeth; Jensen, Grete; Skjaevesland, Anne-Kirsti; Haugen, Margaretha

2014-01-01

The assessment of food intake is challenging and prone to errors; it is therefore important to consider the reliability and validity of the assessment methods. The aim of this study was to analyze the reproducibility and validity of a developed food-frequency questionnaire (FFQ) for use among adolescents. In total, 58 students (aged 13-14) from four different schools in the southern part of Norway participated in the reproducibility study of filling out the FFQ 4 weeks apart. In addition, 93 students participated in the relative validity study where the FFQ was compared to 2×24-hour dietary recalls, while 92 students participated in the absolute validity study where the intakes of fatty acids and vitamin D from the FFQ were compared to fatty acids and 25-hydroxy-vitamin D3 in whole blood. The median Spearman correlation coefficient for all nutrients in the test-retest reliability study was 0.57. The median Spearman correlation for all nutrients in the relative validity study was 0.26, while the correlations coefficients were low in the absolute validity study with n-3 fatty acid coefficients ranging from 0.05 to 0.25, and absent for vitamin D (r=0.000). The test-retest reproducibility was considered good, the relative validity was considered poor to good, and the absolute validity was considered poor. However, the results are comparable to other studies among adolescents.

Three Validity Studies of the Daily Progress Report in Relationship to the Check, Connect, and Expect Intervention

ERIC Educational Resources Information Center

Stage, Scott A.; Cheney, Doug; Lynass, Lori; Mielenz, Christine; Flower, Andrea

2012-01-01

Elementary students (N = 104) at risk for severe behavior problems or with special education eligibility participated in three validity studies of the daily progress report (DPR) used in a Tier 2 behavioral intervention known as "Check, Connect, and Expect" (CCE). In Study 1, the relationship between teachers' ratings of students'…

Developing instruments concerning scientific epistemic beliefs and goal orientations in learning science: a validation study

NASA Astrophysics Data System (ADS)

Lin, Tzung-Jin; Tsai, Chin-Chung

2017-11-01

The purpose of this study was to develop and validate two survey instruments to evaluate high school students' scientific epistemic beliefs and goal orientations in learning science. The initial relationships between the sampled students' scientific epistemic beliefs and goal orientations in learning science were also investigated. A final valid sample of 600 volunteer Taiwanese high school students participated in this survey by responding to the Scientific Epistemic Beliefs Instrument (SEBI) and the Goal Orientations in Learning Science Instrument (GOLSI). Through both exploratory and confirmatory factor analyses, the SEBI and GOLSI were proven to be valid and reliable for assessing the participants' scientific epistemic beliefs and goal orientations in learning science. The path analysis results indicated that, by and large, the students with more sophisticated epistemic beliefs in various dimensions such as Development of Knowledge, Justification for Knowing, and Purpose of Knowing tended to adopt both Mastery-approach and Mastery-avoidance goals. Some interesting results were also found. For example, the students tended to set a learning goal to outperform others or merely demonstrate competence (Performance-approach) if they had more informed epistemic beliefs in the dimensions of Multiplicity of Knowledge, Uncertainty of Knowledge, and Purpose of Knowing.

Cognitive testing with female nutrition and education assistance program participants informs validity of the Satter eating competence inventory.

PubMed

Krall, Jodi Stotts; Lohse, Barbara

2010-01-01

Examine the validity of a self-report measure of eating competence with low-income women. Twenty-five females (18-49 years old) recruited from low-income venues in Pennsylvania completed cognitive testing through an iterative interview process. Respondents' oral responses were compared to researchers' intended meaning of ecSatter Inventory (ecSI) items; responses were mapped to evaluate the similarity between respondents' internally generated answers and their ecSI choices for survey items; and scored responses were compared among participants. Interview findings provided a rationale for modifying the ecSI prior to use with low-income women. Four items were misinterpreted for various reasons, including problems with clarity and wording. The modified ecSI, termed the ecSatter Inventory for Low-Income (ecSI/LI), was comprehended as intended by researchers. Congruence of cognitive responses and ecS/LI scores further supported the instrument's validity. Cognitive testing resulted in the development of an instrument to measure eating competence in low-income adults. The ecSI/LI requires validation with a large, heterogeneous low-income sample. Copyright 2010 Society for Nutrition Education. Published by Elsevier Inc. All rights reserved.

Random Qualitative Validation: A Mixed-Methods Approach to Survey Validation

ERIC Educational Resources Information Center

Van Duzer, Eric

2012-01-01

The purpose of this paper is to introduce the process and value of Random Qualitative Validation (RQV) in the development and interpretation of survey data. RQV is a method of gathering clarifying qualitative data that improves the validity of the quantitative analysis. This paper is concerned with validity in relation to the participants'…

Participation in Occupational Performance: Reliability and Validity of the Activity Card Sort.

ERIC Educational Resources Information Center

Katz, Noomi; Karpin, Hanah; Lak, Arit; Furman, Tania; Hartman-Maeir, Adina

2003-01-01

A study assessed the reliability and validity of the Activity Card Sort (ACS) within different adult groups (n=263): healthy adults, healthy older adults, Alzheimer's caregivers, multiple sclerosis patients, and stroke survivors. Found that the ACS had high internal consistency for daily living and social-cultural activities and a lower…

Assessing Patient Participation in Health Policy Decision-Making in Cyprus.

PubMed

Souliotis, Kyriakos; Agapidaki, Eirini; Peppou, Lily Evangelia; Tzavara, Chara; Samoutis, George; Theodorou, Mamas

2016-06-20

Although the importance of patient participation in the design and evaluation of health programs and services is well-documented, there is scarcity of research with regard to patient association (PA) participation in health policy decision-making processes. To this end, the present study aimed to validate further a previously developed instrument as well as to investigate the degree of PA participation in health policy decision-making in Cyprus. A convenient sample of 114 patients-members of patients associations took part in the study. Participants were recruited from an umbrella organization, the Pancyprian Federation of Patient Associations and Friends (PFPA). PA participation in health policy decision-making was assessed with the Health Democracy Index (HDI), an original 8-item tool. To explore its psychometric properties, Cronbach α was computed as regards to its internal consistency, while its convergent validity was tested against a self-rated question enquiring about the degree of PA participation in health policy decision-making. The findings revealed that the HDI has good internal consistency and convergent validity. Furthermore, PAs were found to participate more in consultations in health-related organizations and the Ministry of Health (MoH) as well as in reforms or crucial decisions in health policy. Lower levels were documented with regard to participation in hospital boards, ethics committees in clinical trials and health technology assessment (HTA) procedures. Overall, PA participation levels were found to be lower than the mid-point of the scale. Targeted interventions aiming to facilitate patients' involvement in health policy decision-making processes and to increase its impact are greatly needed in Cyprus. © 2016 by Kerman University of Medical Sciences.

Assessing Patient Participation in Health Policy Decision-Making in Cyprus

PubMed Central

Souliotis, Kyriakos; Agapidaki, Eirini; Peppou, Lily Evangelia; Tzavara, Chara; Samoutis, George; Theodorou, Mamas

2016-01-01

Although the importance of patient participation in the design and evaluation of health programs and services is well-documented, there is scarcity of research with regard to patient association (PA) participation in health policy decision-making processes. To this end, the present study aimed to validate further a previously developed instrument as well as to investigate the degree of PA participation in health policy decision-making in Cyprus. A convenient sample of 114 patients-members of patients associations took part in the study. Participants were recruited from an umbrella organization, the Pancyprian Federation of Patient Associations and Friends (PFPA). PA participation in health policy decision-making was assessed with the Health Democracy Index (HDI), an original 8-item tool. To explore its psychometric properties, Cronbach α was computed as regards to its internal consistency, while its convergent validity was tested against a self-rated question enquiring about the degree of PA participation in health policy decision-making. The findings revealed that the HDI has good internal consistency and convergent validity. Furthermore, PAs were found to participate more in consultations in health-related organizations and the Ministry of Health (MoH) as well as in reforms or crucial decisions in health policy. Lower levels were documented with regard to participation in hospital boards, ethics committees in clinical trials and health technology assessment (HTA) procedures. Overall, PA participation levels were found to be lower than the mid-point of the scale. Targeted interventions aiming to facilitate patients’ involvement in health policy decision-making processes and to increase its impact are greatly needed in Cyprus. PMID:27694659

Retaining Participants in Outpatient and Community-Based Health Studies: Researchers and Participants in Their Own Words.

PubMed

Odierna, Donna H; Bero, Lisa A

Loss to follow-up can introduce bias into research, making it difficult to develop inclusive evidence-based health policies and practice guidelines. We aimed to deepen understanding of reasons why participants leave or remain in longitudinal health studies. We interviewed 59 researchers and current and former research participants in six focus groups ( n = 55) or interviews ( n = 4) at three study centers in a large academic research institution. We used minimally structured interview guides and inductive thematic analysis to explore participant-level, study-level, and contextual participation barriers and facilitators. Four main themes emerged: transportation, incentives and motivation, caregiver concerns, and the social and physical environment. Themes shared crosscutting issues involving funding, flexibility, and relationships between researchers and research participants. Study-level and contextual factors appear to interact with participant characteristics, particularly socioeconomic status and disease severity to affect participant retention. Participants' characteristics do not seem to be the main cause of study dropout. Researchers and funders might be able to address contextual and study factors in ways that reduce barriers to participation.

[A Validation Study of the Modified Korean Version of Ethical Leadership at Work Questionnaire (K-ELW)].

PubMed

Kim, Jeong-Eon; Park, Eun-Jun

2015-04-01

The purpose of this study was to validate the Korean version of the Ethical Leadership at Work questionnaire (K-ELW) that measures RNs' perceived ethical leadership of their nurse managers. The strong validation process suggested by Benson (1998), including translation and cultural adaptation stage, structural stage, and external stage, was used. Participants were 241 RNs who reported their perceived ethical leadership using both the pre-version of K-ELW and a previously known Ethical Leadership Scale, and interactional justice of their managers, as well as their own demographics, organizational commitment and organizational citizenship behavior. Data analyses included descriptive statistics, Pearson correlation coefficients, reliability coefficients, exploratory factor analysis, and confirmatory factor analysis. SPSS 19.0 and Amos 18.0 versions were used. A modified K-ELW was developed from construct validity evidence and included 31 items in 7 domains: People orientation, task responsibility fairness, relationship fairness, power sharing, concern for sustainability, ethical guidance, and integrity. Convergent validity, discriminant validity, and concurrent validity were supported according to the correlation coefficients of the 7 domains with other measures. The results of this study provide preliminary evidence that the modified K-ELW can be adopted in Korean nursing organizations, and reliable and valid ethical leadership scores can be expected.

Validation of the Social Appearance Anxiety Scale: factor, convergent, and divergent validity.

PubMed

Levinson, Cheri A; Rodebaugh, Thomas L

2011-09-01

The Social Appearance Anxiety Scale (SAAS) was created to assess fear of overall appearance evaluation. Initial psychometric work indicated that the measure had a single-factor structure and exhibited excellent internal consistency, test-retest reliability, and convergent validity. In the current study, the authors further examined the factor, convergent, and divergent validity of the SAAS in two samples of undergraduates. In Study 1 (N = 323), the authors tested the factor structure, convergent, and divergent validity of the SAAS with measures of the Big Five personality traits, negative affect, fear of negative evaluation, and social interaction anxiety. In Study 2 (N = 118), participants completed a body evaluation that included measurements of height, weight, and body fat content. The SAAS exhibited excellent convergent and divergent validity with self-report measures (i.e., self-esteem, trait anxiety, ethnic identity, and sympathy), predicted state anxiety experienced during the body evaluation, and predicted body fat content. In both studies, results confirmed a single-factor structure as the best fit to the data. These results lend additional support for the use of the SAAS as a valid measure of social appearance anxiety.

Learning Methodology in the Classroom to Encourage Participation

ERIC Educational Resources Information Center

Luna, Esther; Folgueiras, Pilar

2014-01-01

Service learning is a methodology that promotes the participation of citizens in their community. This article presents a brief conceptualization of citizen participation, characteristics of service learning methodology, and validation of a programme that promotes service-learning projects. This validation highlights the suitability of this…

Japanese Study on Stratification, Health, Income, and Neighborhood: Study Protocol and Profiles of Participants

PubMed Central

Takada, Misato; Kondo, Naoki; Hashimoto, Hideki

2014-01-01

Background The Japanese Study on Stratification, Health, Income, and Neighborhood (J-SHINE) aims to clarify the complex associations between social factors and health from an interdisciplinary perspective and to provide a database for use in various health policy evaluations. Methods J-SHINE is an ongoing longitudinal panel study of households of adults aged 25–50 years. The wave 1 survey was carried out in 2010 among adults randomly selected from the resident registry of four urban and suburban municipalities in the greater Tokyo metropolitan area, Japan. In 2011, surveys for the participants’ spouse/partner and child were additionally conducted. The wave 2 survey was conducted in 2012 for the wave 1 participants and will be followed by the wave 2 survey for spouse/partner and child in 2013. Results Wave 1 sample sizes were 4357 for wave 1 participants (valid response rate: 31.3%; cooperation rate: 51.8%), 1873 for spouse/partner (response rate: 61.9%), and 1520 for child (response rate: 67.7%). Wave 2 captured 69.0% of wave 1 participants. Information gathered covered socio-demographics, household economy, self-reported health conditions and healthcare utilization, stress and psychological values, and developmental history. A subpopulation underwent physiological (n = 2468) and biomarker (n = 1205) measurements. Conclusions Longitudinal survey data, including repeated measures of social factors evaluated based on theories and techniques of various disciplines, like J-SHINE, should contribute toward opening a web of causality for society and health, which may have important policy implications for recent global health promotion strategies such as the World Health Organization’s Social Determinants of Health approach and the second round of Japan’s Healthy Japan 21. PMID:24814507

Urdu version of the neck disability index: a reliability and validity study.

PubMed

Farooq, Muhammad Nazim; Mohseni-Bandpei, Mohammad A; Gilani, Syed Amir; Hafeez, Ambreen

2017-04-08

Despite the wide use of the neck disability index (NDI) for assessing disability in patients with neck pain, the NDI has not yet been translated and validated in Urdu. The first purpose of the present study was to translate and cross-culturally adapt the NDI into the Urdu language (NDI-U). The second purpose was to investigate the reliability, validity and responsiveness of the NDI-U in Urdu-speaking patients experiencing chronic mechanical neck pain (CMNP). Translation and cross-cultural adaptation of the original version of the NDI were carried out using previously described procedures. Seventy-six patients with CMNP and thirty healthy participants were recruited for the study. NDI-U and visual analogue scales for pain intensity (VAS pain ) and disability (VAS disability ) were administered to all the participants at baseline and to the patients 3 weeks after receiving physiotherapy intervention. The global rating of change scale (GROC) was also administered at this time. Test-retest reliability and internal consistency were carried out on forty-six randomly selected patients two days after they completed the NDI-U. The NDI-U was evaluated for factor analysis, content validity, construct validity (discriminative and convergent validity) and responsiveness. An intra-class correlation coefficient (ICC 2,1 ) revealed excellent test-retest reliability for all items (ICC 2,1  = 0.86-0.98) and total scores (ICC 2,1  = 0.99) of the NDI-U. The NDI-U was found internally consistent with a Cronbach's alpha of 0.90 and a fair to good correlation between single items and the NDI-U total scores (r = 0.34 to 0.89). Factor analysis of the NDI-U produced two factors explaining 66.71% of the variance. Content validity was good, as no floor or ceiling effects were detected for the NDI-U total score. To determine discriminative validity, an independent t-test revealed a significant difference in the NDI-U total scores between the patients and healthy controls (P�

Correlates of lower comprehension of informed consent among participants enrolled in a cohort study in Pune, India.

PubMed

Joglekar, Neelam S; Deshpande, Swapna S; Sahay, Seema; Ghate, Manisha V; Bollinger, Robert C; Mehendale, Sanjay M

2013-03-01

Optimum comprehension of informed consent by research participants is essential yet challenging. This study explored correlates of lower comprehension of informed consent among 1334 participants of a cohort study aimed at estimating HIV incidence in Pune, India. As part of the informed consent process, a structured comprehension tool was administered to study participants. Participants scoring ≥90% were categorised into the 'optimal comprehension group', whilst those scoring 80-89% were categorised into the 'lower comprehension group'. Data were analysed to identify sociodemographic and behavioural correlates of lower consent comprehension. The mean ± SD comprehension score was 94.4 ± 5.00%. Information pertaining to study-related risks was not comprehended by 61.7% of participants. HIV-negative men (adjusted OR [AOR] = 4.36, 95% CI 1.71-11.05) or HIV-negative women (AOR = 13.54, 95% CI 6.42-28.55), illiteracy (AOR= 1.65, 95% CI 1.19-2.30), those with a history of multiple partners (AOR = 1.73, 95% CI 1.12-2.66) and those never using condoms (AOR = 1.35, 95% CI 1.01-1.82) were more likely to have lower consent comprehension. We recommend exploration of domains of lower consent comprehension using a validated consent comprehension tool. Improved education in these specific domains would optimise consent comprehension among research participants.

Participation in Decision Making as a Property of Complex Adaptive Systems: Developing and Testing a Measure

PubMed Central

Anderson, Ruth A.; Hsieh, Pi-Ching; Su, Hui Fang; Landerman, Lawrence R.; McDaniel, Reuben R.

2013-01-01

Objectives. To (1) describe participation in decision-making as a systems-level property of complex adaptive systems and (2) present empirical evidence of reliability and validity of a corresponding measure. Method. Study 1 was a mail survey of a single respondent (administrators or directors of nursing) in each of 197 nursing homes. Study 2 was a field study using random, proportionally stratified sampling procedure that included 195 organizations with 3,968 respondents. Analysis. In Study 1, we analyzed the data to reduce the number of scale items and establish initial reliability and validity. In Study 2, we strengthened the psychometric test using a large sample. Results. Results demonstrated validity and reliability of the participation in decision-making instrument (PDMI) while measuring participation of workers in two distinct job categories (RNs and CNAs). We established reliability at the organizational level aggregated items scores. We established validity of the multidimensional properties using convergent and discriminant validity and confirmatory factor analysis. Conclusions. Participation in decision making, when modeled as a systems-level property of organization, has multiple dimensions and is more complex than is being traditionally measured. Managers can use this model to form decision teams that maximize the depth and breadth of expertise needed and to foster connection among them. PMID:24349771

Participation in decision making as a property of complex adaptive systems: developing and testing a measure.

PubMed

Anderson, Ruth A; Plowman, Donde; Corazzini, Kirsten; Hsieh, Pi-Ching; Su, Hui Fang; Landerman, Lawrence R; McDaniel, Reuben R

2013-01-01

Objectives. To (1) describe participation in decision-making as a systems-level property of complex adaptive systems and (2) present empirical evidence of reliability and validity of a corresponding measure. Method. Study 1 was a mail survey of a single respondent (administrators or directors of nursing) in each of 197 nursing homes. Study 2 was a field study using random, proportionally stratified sampling procedure that included 195 organizations with 3,968 respondents. Analysis. In Study 1, we analyzed the data to reduce the number of scale items and establish initial reliability and validity. In Study 2, we strengthened the psychometric test using a large sample. Results. Results demonstrated validity and reliability of the participation in decision-making instrument (PDMI) while measuring participation of workers in two distinct job categories (RNs and CNAs). We established reliability at the organizational level aggregated items scores. We established validity of the multidimensional properties using convergent and discriminant validity and confirmatory factor analysis. Conclusions. Participation in decision making, when modeled as a systems-level property of organization, has multiple dimensions and is more complex than is being traditionally measured. Managers can use this model to form decision teams that maximize the depth and breadth of expertise needed and to foster connection among them.

Multivariate meta-analysis of individual participant data helped externally validate the performance and implementation of a prediction model.

PubMed

Snell, Kym I E; Hua, Harry; Debray, Thomas P A; Ensor, Joie; Look, Maxime P; Moons, Karel G M; Riley, Richard D

2016-01-01

Our aim was to improve meta-analysis methods for summarizing a prediction model's performance when individual participant data are available from multiple studies for external validation. We suggest multivariate meta-analysis for jointly synthesizing calibration and discrimination performance, while accounting for their correlation. The approach estimates a prediction model's average performance, the heterogeneity in performance across populations, and the probability of "good" performance in new populations. This allows different implementation strategies (e.g., recalibration) to be compared. Application is made to a diagnostic model for deep vein thrombosis (DVT) and a prognostic model for breast cancer mortality. In both examples, multivariate meta-analysis reveals that calibration performance is excellent on average but highly heterogeneous across populations unless the model's intercept (baseline hazard) is recalibrated. For the cancer model, the probability of "good" performance (defined by C statistic ≥0.7 and calibration slope between 0.9 and 1.1) in a new population was 0.67 with recalibration but 0.22 without recalibration. For the DVT model, even with recalibration, there was only a 0.03 probability of "good" performance. Multivariate meta-analysis can be used to externally validate a prediction model's calibration and discrimination performance across multiple populations and to evaluate different implementation strategies. Crown Copyright © 2016. Published by Elsevier Inc. All rights reserved.

Social capital elite, excluded participators, busy working parents and aging, participating less: types of community participators and their mental health.

PubMed

Berry, Helen Louise

2008-07-01

With the prevalence and costs of mental health problems increasing, safe, effective and economically viable prevention and treatment strategies are urgently needed. Community participation is protectively linked to mental health and is considered a valid mental health promotion strategy. However, little consideration has been given to socio-demographically driven patterns of participation that would differentially affect the success of such a strategy. The aims of this study were to group and describe members of a socio-economically disadvantaged rural region according to patterns of community participation, report on their levels of social cohesion and psychological distress and reflect on policy implications. Participants were 963 community members, aged 19-97, randomly selected from a socio-economically disadvantaged coastal Australian region, who voluntarily completed an anonymous postal survey. Measures included (1) frequency of fourteen types of participation, (2) thoughts and feelings about each type, and (3) five aspects of social cohesion. Two-step cluster analysis was undertaken to derive groupings of respondents based on their socio-demographic characteristics and levels of and perceptions about their participation. Psychological distress was assessed for each group. Four distinct groupings of participants were identified: social capital elite; busy working parents; aging, participating less; and excluded participators. The last of these reported particularly poor participation, cohesion and psychological distress. For mental health promotion strategies to be effective, they must be tailored to the circumstances of intended recipients. This requires a sophisticated analysis of target groups. This study has shown that members of a socio-economically disadvantaged rural region may be described according to systematically varying patterns of socio-demographic characteristics, participation, social cohesion and distress. Policy-makers might consider (1) how

Construct validity of the items on the Stroke Specific Quality of Life (SS-QOL) questionnaire that evaluate the participation component of the International Classification of Functioning, Disability and Health.

PubMed

Silva, Soraia Micaela; Corrêa, Fernanda Ishida; Pereira, Gabriela Santos; Faria, Christina Danielli Coelho de Morais; Corrêa, João Carlos Ferrari

2018-01-01

Analyze the construct validity and internal consistency of the Stroke Specific Quality of Life (SS-QOL) items that address the participation component of the ICF as well as analyze the ceiling and floor effects. One hundred subjects were analyzed: 85 community-dwelling and 15 institutionalized individuals. The analysis of construct validity was performed using classic psychometrics: (1) the comparison of known groups (individuals without restriction to participation vs. those with restriction to participation) using the Mann-Whitney test and (2) convergent validity - correlation between the scores on the SS-QOL items that address participation and the subscale scores of measures used to evaluate the similar constructs and concepts [the Short-Form Health Survey (SF-36), Functional Independence Measure (FIM) and grip strength test]. Spearman's correlation coefficients were calculated for this analysis. Cronbach's α was used for the analysis of internal consistency and both the ceiling and floor effects were analyzed. The level of significance for all analyses was α = 0.05. The a priori hypotheses regarding construct validity were partially demonstrated, as only five of the eight domains exhibited positive moderate to strong correlations (r > 0.40) with measures that address constructs similar to those addressed on the SS-QOL questionnaire. The items demonstrated adequate internal consistency and are capable of differentiating individuals with and without restriction to participation. The ceiling and floor effects were considered adequate for the total SS-QOL score, but beyond acceptable standards for some domains. The 26 items of the SS-QOL questionnaire measure a multidimensional construct and therefore do not only address participation. However, the items demonstrated adequate internal consistency and are capable of differentiating individuals with and without restriction to participation. Implications for rehabilitation The 26 items of the SS

Developing Scale for Determining the Social Participation Skills for Children and Analyzing Its Psychometric Characteristics

ERIC Educational Resources Information Center

Samanci, Osman; Ocakci, Ebru; Seçer, Ismail

2018-01-01

The purpose of this research is to conduct validity and reliability studies of the Scale for the Determining Social Participation for Children, developed to measure social participation skills of children aged 7-10 years. During the development of the scale, pilot schemes, validity analyzes, and reliability analyzes were conducted. In this…

A cross-validation study of the TGMD-2: The case of an adolescent population.

PubMed

Issartel, Johann; McGrane, Bronagh; Fletcher, Richard; O'Brien, Wesley; Powell, Danielle; Belton, Sarahjane

2017-05-01

This study proposes an extension of a widely used test evaluating fundamental movement skills proficiency to an adolescent population, with a specific emphasis on validity and reliability for this older age group. Cross-sectional observational study. A total of 844 participants (n=456 male, 12.03±0.49) participated in this study. The 12 fundamental movement skills of the TGMD-2 were assessed. Inter-rater reliability was examined to ensure a minimum of 95% consistency between coders. Confirmatory factor analysis was undertaken with a one-factor model (all 12 skills) and two-factor model (6 locomotor skills and 6 object-control skills) as proposed by Ulrich et al. (2000). The model fit was examined using χ 2 , TLI, CFI and RMSEA. Test-retest reliability was carried out with a subsample of 35 participants. The test-retest reliability reached Intraclass Correlation Coefficient of 0.78 (locomotor), 0.76 (object related) and 0.91 (gross motor skill proficiency). The confirmatory factor analysis did not display a good fit for either the one-factor or two-factor model due to a really low contribution of several skills. A reduction in the number of skills to just seven (run, gallop, hop, horizontal jump, bounce, kick and roll) revealed an overall good fit by TLI, CFI and RMSEA measures. The proposed new model offers the possibility of longitudinal studies to track the maturation of fundamental movement skills across the child and adolescent spectrum, while also giving researchers a valid assessment to tool to evaluate adolescent fundamental movement skills proficiency level. Copyright © 2016 Sports Medicine Australia. All rights reserved.

Validity and reliability of balance assessment software using the Nintendo Wii balance board: usability and validation.

PubMed

Park, Dae-Sung; Lee, GyuChang

2014-06-10

A balance test provides important information such as the standard to judge an individual's functional recovery or make the prediction of falls. The development of a tool for a balance test that is inexpensive and widely available is needed, especially in clinical settings. The Wii Balance Board (WBB) is designed to test balance, but there is little software used in balance tests, and there are few studies on reliability and validity. Thus, we developed a balance assessment software using the Nintendo Wii Balance Board, investigated its reliability and validity, and compared it with a laboratory-grade force platform. Twenty healthy adults participated in our study. The participants participated in the test for inter-rater reliability, intra-rater reliability, and concurrent validity. The tests were performed with balance assessment software using the Nintendo Wii balance board and a laboratory-grade force platform. Data such as Center of Pressure (COP) path length and COP velocity were acquired from the assessment systems. The inter-rater reliability, the intra-rater reliability, and concurrent validity were analyzed by an intraclass correlation coefficient (ICC) value and a standard error of measurement (SEM). The inter-rater reliability (ICC: 0.89-0.79, SEM in path length: 7.14-1.90, SEM in velocity: 0.74-0.07), intra-rater reliability (ICC: 0.92-0.70, SEM in path length: 7.59-2.04, SEM in velocity: 0.80-0.07), and concurrent validity (ICC: 0.87-0.73, SEM in path length: 5.94-0.32, SEM in velocity: 0.62-0.08) were high in terms of COP path length and COP velocity. The balance assessment software incorporating the Nintendo Wii balance board was used in our study and was found to be a reliable assessment device. In clinical settings, the device can be remarkably inexpensive, portable, and convenient for the balance assessment.

Validity Study of a Jump Mat Compared to the Reference Standard Force Plate.

PubMed

Rogan, Slavko; Radlinger, Lorenz; Imhasly, Caroline; Kneubuehler, Andrea; Hilfiker, Roger

2015-12-01

In the field of vertical jump diagnostics, force plates (FP) are the reference standard. Recently, despite a lack of evidence, jump mats have been used increasingly. Important factors in favor of jumping mats are their low cost and portability. This validity study compared the Haynl-Elektronik jump mat (HE jump mat) with the reference standard force plate. Ten healthy volunteers participated and each participant completed three series of five drop jumps (DJ). The parameters ground contact time (GCT) and vertical jump height (VJH) from the HE jump mat and the FP were used to evaluate the concurrent validity. The following statistical calculations were performed: Pearson's correlation (r), Bland-Altman plots (standard and for adjusted trend), and regression equations. The Bland-Altman plots suggest that the HE jump mat measures shorter contact times and higher jump heights than the FP. The trend-adjusted Bland-Altman plot shows higher mean differences and wider wing-spreads of confidence limits during longer GCT. During the VJH the mean differences and the wing-spreads of the confidence limits throughout the range present as relatively constant. The following regression equations were created, as close as possible to the true value: GCT = 5.920385 + 1.072293 × [value HE jump mat] and VJH = -1.73777 + 1.011156 × [value HE jump mat]. The HE jump mat can be recommended in relation to the validity of constraints. In this study, only a part of the quality criteria were examined. For the final recommendation it is advised to examine the HE jump mat on the other quality criteria (test-retest reliability, sensitivity change).

Validation of NOViSE.

PubMed

Korzeniowski, Przemyslaw; Brown, Daniel C; Sodergren, Mikael H; Barrow, Alastair; Bello, Fernando

2017-02-01

The goal of this study was to establish face, content, and construct validity of NOViSE-the first force-feedback enabled virtual reality (VR) simulator for natural orifice transluminal endoscopic surgery (NOTES). Fourteen surgeons and surgical trainees performed 3 simulated hybrid transgastric cholecystectomies using a flexible endoscope on NOViSE. Four of them were classified as "NOTES experts" who had independently performed 10 or more simulated or human NOTES procedures. Seven participants were classified as "Novices" and 3 as "Gastroenterologists" with no or minimal NOTES experience. A standardized 5-point Likert-type scale questionnaire was administered to assess the face and content validity. NOViSE showed good overall face and content validity. In 14 out of 15 statements pertaining to face validity (graphical appearance, endoscope and tissue behavior, overall realism), ≥50% of responses were "agree" or "strongly agree." In terms of content validity, 85.7% of participants agreed or strongly agreed that NOViSE is a useful training tool for NOTES and 71.4% that they would recommend it to others. Construct validity was established by comparing a number of performance metrics such as task completion times, path lengths, applied forces, and so on. NOViSE demonstrated early signs of construct validity. Experts were faster and used a shorter endoscopic path length than novices in all but one task. The results indicate that NOViSE authentically recreates a transgastric hybrid cholecystectomy and sets promising foundations for the further development of a VR training curriculum for NOTES without compromising patient safety or requiring expensive animal facilities.

Practical Aspects of Designing and Conducting Validation Studies Involving Multi-study Trials.

PubMed

Coecke, Sandra; Bernasconi, Camilla; Bowe, Gerard; Bostroem, Ann-Charlotte; Burton, Julien; Cole, Thomas; Fortaner, Salvador; Gouliarmou, Varvara; Gray, Andrew; Griesinger, Claudius; Louhimies, Susanna; Gyves, Emilio Mendoza-de; Joossens, Elisabeth; Prinz, Maurits-Jan; Milcamps, Anne; Parissis, Nicholaos; Wilk-Zasadna, Iwona; Barroso, João; Desprez, Bertrand; Langezaal, Ingrid; Liska, Roman; Morath, Siegfried; Reina, Vittorio; Zorzoli, Chiara; Zuang, Valérie

This chapter focuses on practical aspects of conducting prospective in vitro validation studies, and in particular, by laboratories that are members of the European Union Network of Laboratories for the Validation of Alternative Methods (EU-NETVAL) that is coordinated by the EU Reference Laboratory for Alternatives to Animal Testing (EURL ECVAM). Prospective validation studies involving EU-NETVAL, comprising a multi-study trial involving several laboratories or "test facilities", typically consist of two main steps: (1) the design of the validation study by EURL ECVAM and (2) the execution of the multi-study trial by a number of qualified laboratories within EU-NETVAL, coordinated and supported by EURL ECVAM. The approach adopted in the conduct of these validation studies adheres to the principles described in the OECD Guidance Document on the Validation and International Acceptance of new or updated test methods for Hazard Assessment No. 34 (OECD 2005). The context and scope of conducting prospective in vitro validation studies is dealt with in Chap. 4 . Here we focus mainly on the processes followed to carry out a prospective validation of in vitro methods involving different laboratories with the ultimate aim of generating a dataset that can support a decision in relation to the possible development of an international test guideline (e.g. by the OECD) or the establishment of performance standards.

Hypertension Knowledge-Level Scale (HK-LS): a study on development, validity and reliability.

PubMed

Erkoc, Sultan Baliz; Isikli, Burhanettin; Metintas, Selma; Kalyoncu, Cemalettin

2012-03-01

This study was conducted to develop a scale to measure knowledge about hypertension among Turkish adults. The Hypertension Knowledge-Level Scale (HK-LS) was generated based on content, face, and construct validity, internal consistency, test re-test reliability, and discriminative validity procedures. The final scale had 22 items with six sub-dimensions. The scale was applied to 457 individuals aged ≥ 18 years, and 414 of them were re-evaluated for test-retest reliability. The six sub-dimensions encompassed 60.3% of the total variance. Cronbach alpha coefficients were 0.82 for the entire scale and 0.92, 0.59, 0.67, 0.77, 0.72, and 0.76 for the sub-dimensions of definition, medical treatment, drug compliance, lifestyle, diet, and complications, respectively. The scale ensured internal consistency in reliability and construct validity, as well as stability over time. Significant relationships were found between knowledge score and age, gender, educational level, and history of hypertension of the participants. No correlation was found between knowledge score and working at an income-generating job. The present scale, developed to measure the knowledge level of hypertension among Turkish adults, was found to be valid and reliable.

Validation of self-reported cannabis dose and potency: an ecological study.

PubMed

van der Pol, Peggy; Liebregts, Nienke; de Graaf, Ron; Korf, Dirk J; van den Brink, Wim; van Laar, Margriet

2013-10-01

To assess the reliability and validity of self-reported cannabis dose and potency measures. Cross-sectional study comparing self-reports with objective measures of amount of cannabis and delta-9-tetrahydrocannabinol (THC) concentration. Ecological study with assessments at participants' homes or in a coffee shop. Young adult frequent cannabis users (n = 106) from the Dutch Cannabis Dependence (CanDep) study. The objectively measured amount of cannabis per joint (dose in grams) was compared with self-reported estimates using a prompt card and average number of joints made from 1 g of cannabis. In addition, objectively assessed THC concentration in the participant's cannabis was compared with self-reported level of intoxication, subjective estimate of cannabis potency and price per gram of cannabis. Objective estimates of doses per joint (0.07-0.88 g/joint) and cannabis potency (1.1-24.7%) varied widely. Self-reported measures of dose were imprecise, but at group level, average dose per joint was estimated accurately with the number of joints made from 1 g [limit of agreement (LOA) = -0.02 g, 95% confidence interval (CI) = -0.29; 0.26], whereas the prompt card resulted in serious underestimation (LOA = 0.14 g, 95% CI = -0.10; 0.37). THC concentration in cannabis was associated with subjective potency ['average' 3.77% (P = 0.002) and '(very) strong' 5.13% more THC (P < 0.001) than '(very) mild' cannabis] and with cannabis price (about 1% increase in THC concentration per euro spent on 1 g of cannabis, P < 0.001), but not with level of intoxication. Self-report measures relating to cannabis use appear at best to be associated weakly with objective measures. Of the self-report measures, number of joints per gram, cannabis price and subjective potency have at least some validity. © 2013 Society for the Study of Addiction.

Challenges in achieving patient participation: A review of how patient participation is addressed in empirical studies.

PubMed

Angel, Sanne; Frederiksen, Kirsten Norup

2015-09-01

For decades, it has been an ideal in western countries that individuals should participate in society as self-governing and autonomous subjects; however, this ideal does not always correspond to the actual experiences of individuals in their encounters with health professionals. This review identifies how empirical studies address challenges in achieving patient participation in clinical nursing. We conducted a literature search for studies of patient participation in PubMed, Cinahl, PsychInfo and Scopus. In a systematic review using Garrard's matrix method, we selected empirical studies that focused on patients' participation in health services. The empirical studies we investigated addressed the relationship between patient and nurse, knowledge, contact time with the patient, severity of illness and the effect of age on the degree of patient involvement. Every study thus investigated assessed patient participation as being achievable. None of the studies questioned the foundation for patient participation, which has been described in theoretical articles. The main explanation for difficulties in achieving patient participation was that expectations concerning the extent and quality of participation could be unrealistic and lead to dissatisfaction. Studies on patient participation identify challenges due to the nature of the relationship between laypersons and professionals, and the embedded difference in situation and knowledge. This difference may be reduced by time and a mutually positive attitude. But participation in its ideal form cannot be achieved because of this fundamental difference. Therefore, the optimal level of patient participation can only be achieved within a framework which provides both patients and health professionals with adequate time to build relationships and shared knowledge. Copyright © 2015 Elsevier Ltd. All rights reserved.

Craigslist versus print newspaper advertising for recruiting research participants for alcohol studies: Cost and participant characteristics

PubMed Central

Gioia, Christopher J.; Sobell, Linda Carter; Sobell, Mark B.; Agrawal, Sangeeta

2016-01-01

Introduction Technology has transformed our lifestyles in dramatic and significant ways, including new and less expensive options for recruiting study participants. This study examines cost and participant differences between two recruitment sources, Craigslist (CL), and print newspapers (PNs). This paper also reviewed and compared studies involving clinical trials published since 2010 that recruited participants using CL alone or in combination with other methods. Method Secondary data analyses from a parent study involving a randomized controlled trial of a mail-based intervention to promote self-change with problem drinkers. Results Significant differences were found between CL and PN participants on most demographic and pretreatment drinking variables. While all participants had AUDIT scores suggestive of an alcohol problem and reported drinking at high-risk levels, CL participants had less severe drinking problem histories, were considerably younger, and had a higher socioeconomic status than PN participants. The total advertising costs for the 65 CL ads ($275) were significantly less than the 69 PN ads ($33, 311). The recruiting cost per eligible participant was vastly less expensive using CL ($1.46) compared to print newspaper ads ($116.88). Conclusions Using CL is a viable recruitment method for soliciting participants, particularly those that are younger, for alcohol intervention studies. It is also less expensive than newspaper ads. When CL participants were recruited, they reported being slightly more confident to change their drinking than PN participants. Limitations of using CL are discussed, including that some initial ad responders gave inconsistent answers to similar questions and a few tried to enter the study more than once. PMID:26675247

Craigslist versus print newspaper advertising for recruiting research participants for alcohol studies: Cost and participant characteristics.

PubMed

Gioia, Christopher J; Sobell, Linda Carter; Sobell, Mark B; Agrawal, Sangeeta

2016-03-01

Technology has transformed our lifestyles in dramatic and significant ways, including new and less expensive options for recruiting study participants. This study examines cost and participant differences between two recruitment sources, Craigslist (CL), and print newspapers (PNs). This paper also reviewed and compared studies involving clinical trials published since 2010 that recruited participants using CL alone or in combination with other methods. Secondary data analyses from a parent study involving a randomized controlled trial of a mail-based intervention to promote self-change with problem drinkers. Significant differences were found between CL and PN participants on most demographic and pretreatment drinking variables. While all participants had AUDIT scores suggestive of an alcohol problem and reported drinking at high-risk levels, CL participants had less severe drinking problem histories, were considerably younger, and had a higher socioeconomic status than PN participants. The total advertising costs for the 65 CL ads ($275) were significantly less than the 69 PN ads ($33, 311). The recruiting cost per eligible participant was vastly less expensive using CL ($1.46) compared to print newspaper ads ($116.88). Using CL is a viable recruitment method for soliciting participants, particularly those that are younger, for alcohol intervention studies. It is also less expensive than newspaper ads. When CL participants were recruited, they reported being slightly more confident to change their drinking than PN participants. Limitations of using CL are discussed, including that some initial ad responders gave inconsistent answers to similar questions and a few tried to enter the study more than once. Copyright © 2015 Elsevier Ltd. All rights reserved.

Recruitment and Participation of Recreational Runners in a Large Epidemiological and Genetic Research Study: Retrospective Data Analysis

PubMed Central

Manzanero, Silvia; Kozlovskaia, Maria; Vlahovich, Nicole

2018-01-01

Background With the increasing capacity for remote collection of both data and samples for medical research, a thorough assessment is needed to determine the association of population characteristics and recruitment methodologies with response rates. Objective The aim of this research was to assess population representativeness in a two-stage study of health and injury in recreational runners, which consisted of an epidemiological arm and genetic analysis. Methods The cost and success of various classical and internet-based methods were analyzed, and demographic representativeness was assessed for recruitment to the epidemiological survey, reported willingness to participate in the genetic arm of the study, actual participation, sample return, and approval for biobank storage. Results A total of 4965 valid responses were received, of which 1664 were deemed eligible for genetic analysis. Younger age showed a negative association with initial recruitment rate, expressed willingness to participate in genetic analysis, and actual participation. Additionally, female sex was associated with higher initial recruitment rates, and ethnic origin impacted willingness to participate in the genetic analysis (all P<.001). Conclusions The sharp decline in retention through the different stages of the study in young respondents suggests the necessity to develop specific recruitment and retention strategies when investigating a young, physically active population. PMID:29792293

Validity Studies of the Filial Anxiety Scale.

ERIC Educational Resources Information Center

Murray, Paul D.; And Others

1996-01-01

Factor analytic and construct validity studies were conducted to explore the validity of Cicirelli's 13-item Filial Anxiety Scale (FAS). The State-Trait Anxiety Inventory and the Marlowe-Crowne Social Desirability Scale were a part of the investigation. Results offer support for the validity of the FAS subscales and the FAS' usefulness as an…

Beyond tokenistic participation: using representational artefacts to enable meaningful public participation in health service design.

PubMed

Morrison, Cecily; Dearden, Andy

2013-10-01

A number of recent policies promote public participation in health service design. Yet, a growing literature has articulated a gap between policy aims and actual practice resulting in public participation becoming tokenistic. Drawing on theory from participatory design, we argue that choosing appropriate artefacts to act as representations can structure discussions between public participants and health professionals in ways that both groups find meaningful and valid. Through a case study of a service improvement project in outpatient services for older people, we describe three representational artefacts: emotion maps, stories, and tracing paper, and explain how they helped to mediate interactions between public participants and health professionals. We suggest that using such representational artefacts can provide an alternative approach to participation that stands in contrast to the current focus on the professionalisation of public participants. We conclude that including participatory designers in projects, to chose or design appropriate representational artefacts, can help to address the policy-practice gap of including public participants in health service design. Copyright © 2013 The Authors. Published by Elsevier Ireland Ltd.. All rights reserved.

Validation of a low-cost EEG device for mood induction studies.

PubMed

Rodríguez, Alejandro; Rey, Beatriz; Alcañiz, Mariano

2013-01-01

New electroencephalography (EEG) devices, more portable and cheaper, are appearing on the market. Studying the reliability of these EEG devices for emotional studies would be interesting, as these devices could be more economical and compatible with Virtual Reality (VR) settings. Therefore, the aim in this work was to validate a low-cost EEG device (Emotiv Epoc) to monitor brain activity during a positive emotional induction procedure. Emotional pictures (IAPS) were used to induce a positive mood in sixteen participants. Changes in the brain activity of subjects were compared between positive induction and neutral conditions. Obtained results were in accordance with previous scientific literature regarding frontal EEG asymmetry, which supports the possibility of using this low-cost EEG device in future mood induction studies combined with VR.

Simulators' validation study: Problem solution logic

NASA Technical Reports Server (NTRS)

Schoultz, M. B.

1974-01-01

A study was conducted to validate the ground based simulators used for aircraft environment in ride-quality research. The logic to the approach for solving this problem is developed. The overall problem solution flow chart is presented. The factors which could influence the human response to the environment on board the aircraft are analyzed. The mathematical models used in the study are explained. The steps which were followed in conducting the validation tests are outlined.

Test–retest reliability and validity of a web-based food-frequency questionnaire for adolescents aged 13–14 to be used in the Norwegian Mother and Child Cohort Study (MoBa)

PubMed Central

Øverby, Nina Cecilie; Johannesen, Elisabeth; Jensen, Grete; Skjaevesland, Anne-Kirsti; Haugen, Margaretha

2014-01-01

Background The assessment of food intake is challenging and prone to errors; it is therefore important to consider the reliability and validity of the assessment methods. Objective The aim of this study was to analyze the reproducibility and validity of a developed food-frequency questionnaire (FFQ) for use among adolescents. Design In total, 58 students (aged 13–14) from four different schools in the southern part of Norway participated in the reproducibility study of filling out the FFQ 4 weeks apart. In addition, 93 students participated in the relative validity study where the FFQ was compared to 2×24-hour dietary recalls, while 92 students participated in the absolute validity study where the intakes of fatty acids and vitamin D from the FFQ were compared to fatty acids and 25-hydroxy-vitamin D3 in whole blood. Results The median Spearman correlation coefficient for all nutrients in the test–retest reliability study was 0.57. The median Spearman correlation for all nutrients in the relative validity study was 0.26, while the correlations coefficients were low in the absolute validity study with n-3 fatty acid coefficients ranging from 0.05 to 0.25, and absent for vitamin D (r=0.000). Conclusion The test–retest reproducibility was considered good, the relative validity was considered poor to good, and the absolute validity was considered poor. However, the results are comparable to other studies among adolescents. PMID:25371661

Impact of gender on the decision to participate in a clinical trial: a cross-sectional study.

PubMed

Lobato, Lucas; Bethony, Jeffrey Michael; Pereira, Fernanda Bicalho; Grahek, Shannon Lee; Diemert, David; Gazzinelli, Maria Flávia

2014-11-06

In order for Informed Consent to be ethical and valid each clinical trial participant must be able to make a voluntary decision to participate, free from pressure or coercion. Nonetheless, many factors may influence the decision reached, and such influences may be different for male and female volunteers. Being aware of these differences may help researches develop better processes for obtaining consent that safeguard the right of autonomy for all participants. The goal of this study was to evaluate potential gender-based differences in the factors influencing clinical trial participation. This cross-sectional study was conducted in the Northeast region of Minas Gerais, Brazil, in October 2011. A structured questionnaire was administered to 143 volunteers (48 male, 95 female) screened for participation in a clinical study of an investigational functional food with potential anthelminthic properties. Answers regarding their decision to participate in the study were compared, by gender, using chi-square and Mann Whitney tests. Odds ratios (OR) was used to measure association. A majority of subjects (58% of males, 59% of females) listed the desire to collaborate with the development of a product against parasitic worms as their main reason for participation. Females were significantly more likely to report a decision influenced by friends, family, or researchers (OR 3.14, 3.45, and 3.46 respectively, p < 0.005). Females were also significantly more likely to report a decision influenced by general altruistic considerations (OR 8.45, p < 0.005). There was no difference, by gender, in the report of decisions influenced by informational meetings, understanding of the disease, or the availability of medical treatments or exams. There was also no difference in knowledge of the rights of research participants. Study results indicate that there is a strong difference between male and female participants regarding social influences on the decision to participate in

Participation rates in the selection of population controls in a case-control study of colorectal cancer using two recruitment methods.

PubMed

Castaño-Vinyals, Gemma; Nieuwenhuijsen, Mark J; Moreno, Víctor; Carrasco, Estela; Guinó, Elisabet; Kogevinas, Manolis; Villanueva, Cristina M

2011-01-01

Low participation rates in the selection of population controls are an increasing concern for the validity of case-control studies worldwide. We conducted a pilot study to assess two approaches to recruiting population controls in a study of colorectal cancer, including a face-to-face interview and blood sample collection. In the first approach, persons identified through a population roster were invited to participate through a telephone call by an interviewer telephoning on behalf of our research center. In the second approach, individuals were identified from the lists of selected family practitioners and were telephoned on behalf of the family practitioner. When the second method was used, participation rates increased from 42% to 57% and the percentage of refusals decreased from 47% to 13%. The reasons for refusing to participate did not differ significantly between the two methods. Contact through the family practitioner yielded higher response rates in population controls in the study area. 2010 SESPAS. Published by Elsevier Espana. All rights reserved.

Virtual faces expressing emotions: an initial concomitant and construct validity study.

PubMed

Joyal, Christian C; Jacob, Laurence; Cigna, Marie-Hélène; Guay, Jean-Pierre; Renaud, Patrice

2014-01-01

Facial expressions of emotions represent classic stimuli for the study of social cognition. Developing virtual dynamic facial expressions of emotions, however, would open-up possibilities, both for fundamental and clinical research. For instance, virtual faces allow real-time Human-Computer retroactions between physiological measures and the virtual agent. The goal of this study was to initially assess concomitants and construct validity of a newly developed set of virtual faces expressing six fundamental emotions (happiness, surprise, anger, sadness, fear, and disgust). Recognition rates, facial electromyography (zygomatic major and corrugator supercilii muscles), and regional gaze fixation latencies (eyes and mouth regions) were compared in 41 adult volunteers (20 ♂, 21 ♀) during the presentation of video clips depicting real vs. virtual adults expressing emotions. Emotions expressed by each set of stimuli were similarly recognized, both by men and women. Accordingly, both sets of stimuli elicited similar activation of facial muscles and similar ocular fixation times in eye regions from man and woman participants. Further validation studies can be performed with these virtual faces among clinical populations known to present social cognition difficulties. Brain-Computer Interface studies with feedback-feedforward interactions based on facial emotion expressions can also be conducted with these stimuli.

GOSAT validation out standing in the field: A case study of satellite validation using the SSEC Portable Atmospheric Research Center (SPARC)

NASA Astrophysics Data System (ADS)

Wagner, T. J.; Borg, L. A.; Feltz, M.; Gero, P. J.; Knuteson, R. O.; Olson, E.

2016-12-01

The Space Science and Engineering Center (SSEC) at the University of Wisconsin-Madison has developed the SSEC Portable Atmospheric Research Center (SPARC), a mobile 11 m trailer that houses numerous in situ and ground-based remote sensing instruments. Available instrumentation includes the Atmospheric Emitted Radiance Interferometer (AERI), a hyperspectral infrared radiometer from which trace gas concentrations and profiles of temperature and water vapor can be retrieved; the High Spectral Resolution Lidar (HSRL), a multichannel lidar capable of directly retrieving profiles of optical depth and backscatter depolarization; and a Doppler lidar wind profiler. The remote instrumentation suite is complemented by surface meteorology observations and a radiosonde ground station. Collectively, these instruments enable SPARC to participate in a wide variety of field studies, including meteorological field experiments and ground-based satellite calibration and validation studies. In August 2016, SPARC traveled to the Chequamegon National Forest in northern Wisconsin for a two week long deployment alongside the WLEF-TV tower. This 447 m tower houses long-term observations of thermodynamic and atmospheric composition at multiple heights, enabling studies of phenomena like atmospheric/land surface interactions and carbon uptake. During this deployment, SPARC launched radiosondes coincident with clear-sky overpasses of the Greenhouse gases Observing SATellite (GOSAT). Thermodynamic profiles from the radiosondes and AERI combined with the trace gas observations from the tower were used to validate the GOSAT observations of carbon dioxide and methane. The on-site presence of SPARC allowed for better characterization of the environment and greater observational certainty than was possible with the tower alone. Examples from this particular validation study as well as a discussion of how SPARC can contribute to other satellite calibration and validation investigations will be

Validity and Reliability Study of Bahasa Malaysia Version of Voice Handicap Index-10.

PubMed

Ong, Fei Ming; Husna Nik Hassan, Nik Fariza; Azman, Mawaddah; Sani, Abdullah; Mat Baki, Marina

2018-05-21

This study aimed to determine the validity and reliability of Bahasa Malaysia version of Voice Handicap Index-10 (mVHI-10). This cross-sectional study was carried out in the Otorhinolaryngology, Head and Neck Surgery Department of Universiti Kebangsaan Malaysia Medical Centre (UKMMC) from June 2015 to May 2016. The mVHI-10 was produced following a rigorous forward and backward translation. One hundred participants, including 50 healthy volunteers (17 male, 33 female) and 50 patients with voice disorders (26 male, 24 female), were recruited to complete the mVHI-10 before flexible laryngoscopic examinations and acoustic analysis. The mVHI-10 was repeated in 2 weeks via telephone interview or clinic visit. Its reliability and validity were assessed using interclass correlation. The test-retest reliability for total mVHI-10 and each item score was high, with the Cronbach alpha of >0.90. The total mVHI-10 score and domain scores were significantly higher (P < 0.001) in the pathology groups (20.92 ± 8.74) than healthy volunteers (1.54 ± 1.97), depicting excellent discriminant validity. The Kaiser-Meyer-Olkin measure was 0.92, which depicted excellent construct validity. There was a significant positive correlation between the mVHI-10 score and jitter and shimmer result (P < 0.001). The present study showed good reliability and validity of the mVHI-10 when applied to both healthy volunteers and patients with voice disorders. We recommend the use of the mVHI-10 in daily clinical practice among Bahasa Malaysia-speaking population. Copyright © 2018 The Voice Foundation. Published by Elsevier Inc. All rights reserved.

Correlates of lower comprehension of informed consent among participants enrolled in a cohort study in Pune, India

PubMed Central

Joglekar, Neelam S.; Deshpande, Swapna S.; Sahay, Seema; Ghate, Manisha V.; Bollinger, Robert C.; Mehendale, Sanjay M.

2013-01-01

Background Optimum comprehension of informed consent by research participants is essential yet challenging. This study explored correlates of lower comprehension of informed consent among 1334 participants of a cohort study aimed at estimating HIV incidence in Pune, India. Methods As part of the informed consent process, a structured comprehension tool was administered to study participants. Participants scoring ≥90% were categorised into the ‘optimal comprehension group’, whilst those scoring 80–89% were categorised into the ‘lower comprehension group’. Data were analysed to identify sociodemographic and behavioural correlates of lower consent comprehension. Results The mean ± SD comprehension score was 94.4 ± 5.00%. Information pertaining to study-related risks was not comprehended by 61.7% of participants. HIV-negative men (adjusted OR [AOR] = 4.36, 95% CI 1.71–11.05) or HIV-negative women (AOR = 13.54, 95% CI 6.42–28.55), illiteracy (AOR= 1.65, 95% CI 1.19–2.30), those with a history of multiple partners (AOR = 1.73, 95% CI 1.12–2.66) and those never using condoms (AOR = 1.35, 95% CI 1.01–1.82) were more likely to have lower consent comprehension. Conclusions We recommend exploration of domains of lower consent comprehension using a validated consent comprehension tool. Improved education in these specific domains would optimise consent comprehension among research participants. PMID:24029848

Validity and Reliability of Turkish Version of Gilliam Autism Rating Scale-2: Results of Preliminary Study

ERIC Educational Resources Information Center

Diken, Ibrahim H.; Diken, Ozlem; Gilliam, James E.; Ardic, Avsar; Sweeney, Dwight

2012-01-01

The purpose of this preliminary study was to explore the validity and reliability of Turkish Version of the Gilliam Autism Rating Scale-2 (TV-GARS-2). Participants included 436 children diagnosed with autism (331 male and 105 female, mean of ages was 8.01 with SD = 3.77). Data were also collected from individuals diagnosed with intellectual…

The Hong Kong version of the Oxford Cognitive Screen (HK-OCS): validation study for Cantonese-speaking chronic stroke survivors.

PubMed

Kong, Anthony Pak-Hin; Lam, Pinky Hiu-Ping; Ho, Diana Wai-Lam; Lau, Johnny King; Humphreys, Glyn W; Riddoch, Jane; Weekes, Brendan

2016-09-01

This study reports the validation of the Hong Kong version of Oxford Cognitive Screen (HK-OCS). Seventy Cantonese-speaking healthy individuals participated to establish normative data and 46 chronic stroke survivors were assessed using the HK-OCS, Albert's Test of Visual Neglect, short test of gestural production, and Hong Kong version of the following assessments: Western Aphasia Battery, MMSE, MoCA, Modified Barthel Index, and Lawton Instrumental Activities of Daily Living scale. The validity of the HK-OCS was appraised by the difference between the two participant groups. Neurologically unimpaired individuals performed significantly better than stroke survivors on the HK-OCS. Positive and significant correlations found between cognitive subtests in the HK-OCS and related assessments indicated good concurrent validity. Excellent intra-rater and inter-rater reliabilities, fair test-retest reliability, and acceptable internal consistency suggested that the HK-OCS had good reliability. Specific HK-OCS subtests including semantics, episodic memory, number writing, and orientation were the best predictors of functional outcomes.

RhinAsthma patient perspective: A Rasch validation study.

PubMed

Molinengo, Giorgia; Baiardini, Ilaria; Braido, Fulvio; Loera, Barbara

2018-02-01

In daily practice, Health-Related Quality of Life (HRQoL) tools are useful for supplementing clinical data with the patient's perspective. To encourage their use by clinicians, the availability of tools that can quickly provide valid results is crucial. A new HRQoL tool has been proposed for patients with asthma and rhinitis: the RhinAsthma Patient Perspective-RAPP. The aim of this study was to evaluate the psychometric robustness of the RAPP using the Item Response Theory (IRT) approach, to evaluate the scalability of items and test whether or not patients use the items response scale correctly. 155 patients (53.5% women, mean age 39.1, range 16-76) were recruited during a multicenter study. RAPP metric properties were investigated using IRT models. Differential item functioning (DIF) was used for gender, age, and asthma control test (ACT). The RAPP adequately fitted the Rating Scale model, demonstrating the equality of the rating scale structure for all items. All statistics on items were satisfactory. The RAPP had adequate internal reliability and showed good ability to discriminate among different groups of participants. DIF analysis indicated that there were no differential item functioning issues for gender. One item showed a DIF by age and four items by ACT. The psychometric evaluation performed using IRT models demonstrated that the RAPP met all the criteria to be considered a reliable and valid method of measurement. From a clinical perspective, this will allow physicians to confidently interpret scores as good indicators of Quality of Life of patients with asthma.

Validity of a new food frequency questionnaire for pregnant women in the Norwegian Mother and Child Cohort Study (MoBa).

PubMed

Brantsaeter, Anne Lise; Haugen, Margaretha; Alexander, Jan; Meltzer, Helle Margrete

2008-01-01

The aim of the present study was to examine the relative validity of foods and nutrients calculated by a new food frequency questionnaire (FFQ) in the Norwegian Mother and Child Cohort Study (MoBa). Reference measures were a 4-day weighed food diary (FD), a motion sensor for measuring total energy expenditure, one 24-h urine collection for analysis of nitrogen and iodine excretion, and a venous blood specimen for analysis of plasma 25-hydroxy-vitamin D and serum folate. A total of 119 women participated in the validation study, and 112 completed the motion sensor registration. Overall, the level of agreement between the FFQ and the FD was satisfactory, and significant correlations were found for all major food groups and for all nutrients except vitamin E. The average correlation coefficient between the FFQ and the FD for daily intake was 0.48 for foods and 0.36 for nutrients, and on average, 68% of the participants were classified into the same or adjacent quintiles by the two methods. Estimated total energy expenditure indicated that under-reporting of energy intake was more extensive with the FD than with the FFQ. The biological markers confirmed that the FFQ was able to distinguish between high and low intakes of nutrients, as measured by vitamin D, folate, protein and iodine. This validation study indicates that the MoBa FFQ produces reasonable valid intake estimates and is a valid tool to rank pregnant women according to low and high intakes of energy, nutrients and foods.

Enabling participation for disabled young people: study protocol.

PubMed

Carroll, Penelope; Witten, Karen; Calder-Dawe, Octavia; Smith, Melody; Kearns, Robin; Asiasiga, Lanuola; Lin, Judy; Kayes, Nicola; Mavoa, Suzanne

2018-06-08

Participation in community life is vital for health and wellbeing, promoting a sense of belonging, networks of social support and opportunities for physical activity. Disabled young people have lower levels of mobility and participation in recreational activities (physical, social and cultural), education and employment, than their peers without disabilities. This has implications for their health and wellbeing and life course opportunities. Previous research on the participation levels of disabled young people has primarily relied on parent/caregiver reports and been oriented to home and school environments. This study investigates how physical and social environmental factors cohere to support or restrict the everyday mobility and participation of disabled young people. The study is located in Auckland, Aotearoa/New Zealand (NZ). Participants comprise 35 young people aged 12-25 years with mobility, vision or hearing impairments. A mixed-methods research design combines objective (global positioning systems, accelerometers, geographical information systems) and self-report measures (travel diaries, and questionnaires) to assess young people's mobility and levels of participation in leisure/educational and employment activities with in-depth interviews exploring their everyday experiences of inclusion/exclusion, and factors enabling or constraining community participation. Parents/caregivers and disability sector key informant viewpoints on the community participation of disabled young people have also been gathered through in-depth interviews. Follow-up workshops with young people and parents/caregivers will identify pathways to increase participation and challenge current disabling practices. This study looks beyond barriers in the physical environment to the interplay of personal, social and physical factors that enable or constrain the community participation of disabled young people. In keeping with the study's overarching goal of increasing opportunities for

Simulated Driving Assessment (SDA) for Teen Drivers: Results from a Validation Study

PubMed Central

McDonald, Catherine C.; Kandadai, Venk; Loeb, Helen; Seacrist, Thomas S.; Lee, Yi-Ching; Winston, Zachary; Winston, Flaura K.

2015-01-01

Background Driver error and inadequate skill are common critical reasons for novice teen driver crashes, yet few validated, standardized assessments of teen driving skills exist. The purpose of this study was to evaluate the construct and criterion validity of a newly developed Simulated Driving Assessment (SDA) for novice teen drivers. Methods The SDA's 35-minute simulated drive incorporates 22 variations of the most common teen driver crash configurations. Driving performance was compared for 21 inexperienced teens (age 16–17 years, provisional license ≤90 days) and 17 experienced adults (age 25–50 years, license ≥5 years, drove ≥100 miles per week, no collisions or moving violations ≤3 years). SDA driving performance (Error Score) was based on driving safety measures derived from simulator and eye-tracking data. Negative driving outcomes included simulated collisions or run-off-the-road incidents. A professional driving evaluator/instructor reviewed videos of SDA performance (DEI Score). Results The SDA demonstrated construct validity: 1.) Teens had a higher Error Score than adults (30 vs. 13, p=0.02); 2.) For each additional error committed, the relative risk of a participant's propensity for a simulated negative driving outcome increased by 8% (95% CI: 1.05–1.10, p<0.01). The SDA demonstrated criterion validity: Error Score was correlated with DEI Score (r=−0.66, p<0.001). Conclusions This study supports the concept of validated simulated driving tests like the SDA to assess novice driver skill in complex and hazardous driving scenarios. The SDA, as a standard protocol to evaluate teen driver performance, has the potential to facilitate screening and assessment of teen driving readiness and could be used to guide targeted skill training. PMID:25740939

Simulated Driving Assessment (SDA) for teen drivers: results from a validation study.

PubMed

McDonald, Catherine C; Kandadai, Venk; Loeb, Helen; Seacrist, Thomas S; Lee, Yi-Ching; Winston, Zachary; Winston, Flaura K

2015-06-01

Driver error and inadequate skill are common critical reasons for novice teen driver crashes, yet few validated, standardised assessments of teen driving skills exist. The purpose of this study is to evaluate the construct and criterion validity of a newly developed Simulated Driving Assessment (SDA) for novice teen drivers. The SDA's 35 min simulated drive incorporates 22 variations of the most common teen driver crash configurations. Driving performance was compared for 21 inexperienced teens (age 16-17 years, provisional license ≤90 days) and 17 experienced adults (age 25-50 years, license ≥5 years, drove ≥100 miles per week, no collisions or moving violations ≤3 years). SDA driving performance (Error Score) was based on driving safety measures derived from simulator and eye-tracking data. Negative driving outcomes included simulated collisions or run-off-the-road incidents. A professional driving evaluator/instructor (DEI Score) reviewed videos of SDA performance. The SDA demonstrated construct validity: (1) teens had a higher Error Score than adults (30 vs. 13, p=0.02); (2) For each additional error committed, the RR of a participant's propensity for a simulated negative driving outcome increased by 8% (95% CI 1.05 to 1.10, p<0.01). The SDA-demonstrated criterion validity: Error Score was correlated with DEI Score (r=-0.66, p<0.001). This study supports the concept of validated simulated driving tests like the SDA to assess novice driver skill in complex and hazardous driving scenarios. The SDA, as a standard protocol to evaluate teen driver performance, has the potential to facilitate screening and assessment of teen driving readiness and could be used to guide targeted skill training. Published by the BMJ Publishing Group Limited. For permission to use (where not already granted under a licence) please go to http://group.bmj.com/group/rights-licensing/permissions.

Web-Based, Participant-Driven Studies Yield Novel Genetic Associations for Common Traits

PubMed Central

Eriksson, Nicholas; Macpherson, J. Michael; Tung, Joyce Y.; Hon, Lawrence S.; Naughton, Brian; Saxonov, Serge; Avey, Linda; Wojcicki, Anne; Pe'er, Itsik; Mountain, Joanna

2010-01-01

Despite the recent rapid growth in genome-wide data, much of human variation remains entirely unexplained. A significant challenge in the pursuit of the genetic basis for variation in common human traits is the efficient, coordinated collection of genotype and phenotype data. We have developed a novel research framework that facilitates the parallel study of a wide assortment of traits within a single cohort. The approach takes advantage of the interactivity of the Web both to gather data and to present genetic information to research participants, while taking care to correct for the population structure inherent to this study design. Here we report initial results from a participant-driven study of 22 traits. Replications of associations (in the genes OCA2, HERC2, SLC45A2, SLC24A4, IRF4, TYR, TYRP1, ASIP, and MC1R) for hair color, eye color, and freckling validate the Web-based, self-reporting paradigm. The identification of novel associations for hair morphology (rs17646946, near TCHH; rs7349332, near WNT10A; and rs1556547, near OFCC1), freckling (rs2153271, in BNC2), the ability to smell the methanethiol produced after eating asparagus (rs4481887, near OR2M7), and photic sneeze reflex (rs10427255, near ZEB2, and rs11856995, near NR2F2) illustrates the power of the approach. PMID:20585627

Strategies for Enhancing Family Participation in Research in the ICU: Findings From a Qualitative Study.

PubMed

Dotolo, Danae; Nielsen, Elizabeth L; Curtis, J Randall; Engelberg, Ruth A

2017-08-01

Family members of critically ill patients who participate in research focused on palliative care issues have been found to be systematically different from those who do not. These differences threaten the validity of research and raise ethical questions about worsening disparities in care by failing to represent diverse perspectives. This study's aims were to explore: 1) barriers and facilitators influencing family members' decisions to participate in palliative care research; and 2) potential methods to enhance research participation. Family members who were asked to participate in a randomized trial testing the efficacy of a facilitator to improve clinician-family communication in the intensive care unit (ICU). Family members who participated (n = 17) and those who declined participation (n = 7) in Family Communication Study were interviewed about their recruitment experiences. We also included family members of currently critically ill patients to assess current experiences (n = 4). Interviews were audio-recorded and transcribed. Investigators used thematic analysis to identify factors influencing family members' decisions. Transcripts were co-reviewed to synthesize codes and themes. Three factors influencing participants' decisions were identified: Altruism, Research Experience, and Enhanced Resources. Altruism and Research Experience described intrinsic characteristics that are less amenable to strategies for improving participation rates. Enhanced Resources reflects families' desires for increased access to information and logistical and emotional support. Family members found their recruitment experiences to be positive when staff were knowledgeable about the ICU, sensitive to the stressful circumstances, and conveyed a caring attitude. By training research staff to be supportive of families' emotional needs and need for logistical knowledge about the ICU, recruitment of a potentially more diverse sample of families may be enhanced. Copyright © 2017

Self-reported eating rate is associated with weight status in a Dutch population: a validation study and a cross-sectional study.

PubMed

van den Boer, Janet H W; Kranendonk, Jentina; van de Wiel, Anne; Feskens, Edith J M; Geelen, Anouk; Mars, Monica

2017-09-08

Observational studies performed in Asian populations suggest that eating rate is related to BMI. This paper investigates the association between self-reported eating rate (SRER) and body mass index (BMI) in a Dutch population, after having validated SRER against actual eating rate. Two studies were performed; a validation and a cross-sectional study. In the validation study SRER (i.e., 'slow', 'average', or 'fast') was obtained from 57 participants (men/women = 16/41, age: mean ± SD = 22.6 ± 2.8 yrs., BMI: mean ± SD = 22.1 ± 2.8 kg/m 2 ) and in these participants actual eating rate was measured for three food products. Using analysis of variance the association between SRER and actual eating rate was studied. The association between SRER and BMI was investigated in cross-sectional data from the NQplus cohort (i.e., 1473 Dutch adults; men/women = 741/732, age: mean ± SD = 54.6 ± 11.7 yrs., BMI: mean ± SD = 25.9 ± 4.0 kg/m 2 ) using (multiple) linear regression analysis. In the validation study actual eating rate increased proportionally with SRER (for all three food products P < 0.01). In the cross-sectional study SRER was positively associated with BMI in both men and women (P = 0.03 and P < 0.001, respectively). Self-reported fast-eating women had a 1.13 kg/m 2 (95% CI 0.43, 1.84) higher BMI compared to average-speed-eating women, after adjusting for confounders. This was not the case in men; self-reported fast-eating men had a 0.29 kg/m 2 (95% CI -0.22, 0.80) higher BMI compared to average-speed-eating men, after adjusting for confounders. These studies show that self-reported eating rate reflects actual eating rate on a group-level, and that a high self-reported eating rate is associated with a higher BMI in this Dutch population.

Validity and reliability of an occupational exposure questionnaire for parkinsonism in welders.

PubMed

Hobson, Angela J; Sterling, David A; Emo, Brett; Evanoff, Bradley A; Sterling, Callen S; Good, Laura; Seixas, Noah; Checkoway, Harvey; Racette, Brad A

2009-06-01

This study assessed the validity and test-retest reliability of a medical and occupational history questionnaire for workers performing welding in the shipyard industry. This self-report questionnaire was developed for an epidemiologic study of the risk of parkinsonism in welders. Validity participants recruited from three similar shipyards were asked to give consent for access to personnel files and complete the questionnaire. Responses on the questionnaire were compared with information extracted from personnel records. Reliability participants were recruited from the same shipyards and were asked to complete the questionnaire at two different times approximately 4 weeks apart. Percent agreement, kappa, intraclass correlation coefficient (ICC), and sensitivity and specificity were used as measures of validity and/or reliability. Personnel files were obtained for 101 of 143 participants (70%) in the validity study, and 56 of the 95 (58.9%) participants in the reliability study completed the retest of the questionnaire. Validity scores for items extracted from personnel files were high. Percent agreement for employment dates and job titles ranged from 83-100%, while ICC for start and stop dates ranged from 0.93-0.99. Sensitivity and specificity for current job title ranged from 0.5-1.0. Reliability scores for demographic, medical and health behavior items were mainly moderate or high, but ranged from 0.19 to 1.0. Most recent job/title items such as title, types of welding performed, and material used showed substantial to perfect agreement. Certain determinants of exposure such as days and hours per week exposed to welding fumes demonstrated mainly moderate agreement (kappa= 0.42-0.47, percent agreement 63-77%); however, mean days and hours reported did not differ between test and retest. The results of this study suggest that participants' self-report for job title and dates employed are valid compared with employer records. While kappa scores were low for some

Assessment of Social Sciences Teacher Candidates' Epistemological Beliefs: A Validation and Reliability Study of Scale

ERIC Educational Resources Information Center

Kop, Yasar; Demir, Özden

2017-01-01

This research mainly aims to test the reliability and validity of the Epistemological Beliefs Scale developed by Kop and Demir (2014) on the level of social sciences teaching from Faculty of Education. A total of 176 students participated in the study, which was carried out on 1st, 2nd, 3rd and 4th grades of the Social Sciences Teaching Department…

Motivation, learning strategies, participation and medical school performance.

PubMed

Stegers-Jager, Karen M; Cohen-Schotanus, Janke; Themmen, Axel P N

2012-07-01

Medical schools wish to better understand why some students excel academically and others have difficulty in passing medical courses. Components of self-regulated learning (SRL), such as motivational beliefs and learning strategies, as well as participation in scheduled learning activities, have been found to relate to student performance. Although participation may be a form of SRL, little is known about the relationships among motivational beliefs, learning strategies, participation and medical school performance. This study aimed to test and cross-validate a hypothesised model of relationships among motivational beliefs (value and self-efficacy), learning strategies (deep learning and resource management), participation (lecture attendance, skills training attendance and completion of optional study assignments) and Year 1 performance at medical school. Year 1 medical students in the cohorts of 2008 (n = 303) and 2009 (n = 369) completed a questionnaire on motivational beliefs and learning strategies (sourced from the Motivated Strategies for Learning Questionnaire) and participation. Year 1 performance was operationalised as students' average Year 1 course examination grades. Structural equation modelling was used to analyse the data. Participation and self-efficacy beliefs were positively associated with Year 1 performance (β = 0.78 and β = 0.19, respectively). Deep learning strategies were negatively associated with Year 1 performance (β =- 0.31), but positively related to resource management strategies (β = 0.77), which, in turn, were positively related to participation (β = 0.79). Value beliefs were positively related to deep learning strategies only (β = 0.71). The overall structural model for the 2008 cohort accounted for 47% of the variance in Year 1 grade point average and was cross-validated in the 2009 cohort. This study suggests that participation mediates the relationships between motivation and learning strategies, and medical school

Recruitment and Participation of Recreational Runners in a Large Epidemiological and Genetic Research Study: Retrospective Data Analysis.

PubMed

Manzanero, Silvia; Kozlovskaia, Maria; Vlahovich, Nicole; Hughes, David C

2018-05-23

With the increasing capacity for remote collection of both data and samples for medical research, a thorough assessment is needed to determine the association of population characteristics and recruitment methodologies with response rates. The aim of this research was to assess population representativeness in a two-stage study of health and injury in recreational runners, which consisted of an epidemiological arm and genetic analysis. The cost and success of various classical and internet-based methods were analyzed, and demographic representativeness was assessed for recruitment to the epidemiological survey, reported willingness to participate in the genetic arm of the study, actual participation, sample return, and approval for biobank storage. A total of 4965 valid responses were received, of which 1664 were deemed eligible for genetic analysis. Younger age showed a negative association with initial recruitment rate, expressed willingness to participate in genetic analysis, and actual participation. Additionally, female sex was associated with higher initial recruitment rates, and ethnic origin impacted willingness to participate in the genetic analysis (all P<.001). The sharp decline in retention through the different stages of the study in young respondents suggests the necessity to develop specific recruitment and retention strategies when investigating a young, physically active population. ©Silvia Manzanero, Maria Kozlovskaia, Nicole Vlahovich, David C Hughes. Originally published in JMIR Research Protocols (http://www.researchprotocols.org), 23.05.2018.

Modeling the Relationship between Safety Climate and Safety Performance in a Developing Construction Industry: A Cross-Cultural Validation Study

PubMed Central

Zahoor, Hafiz; Chan, Albert P. C.; Utama, Wahyudi P.; Gao, Ran; Zafar, Irfan

2017-01-01

This study attempts to validate a safety performance (SP) measurement model in the cross-cultural setting of a developing country. In addition, it highlights the variations in investigating the relationship between safety climate (SC) factors and SP indicators. The data were collected from forty under-construction multi-storey building projects in Pakistan. Based on the results of exploratory factor analysis, a SP measurement model was hypothesized. It was tested and validated by conducting confirmatory factor analysis on calibration and validation sub-samples respectively. The study confirmed the significant positive impact of SC on safety compliance and safety participation, and negative impact on number of self-reported accidents/injuries. However, number of near-misses could not be retained in the final SP model because it attained a lower standardized path coefficient value. Moreover, instead of safety participation, safety compliance established a stronger impact on SP. The study uncovered safety enforcement and promotion as a novel SC factor, whereas safety rules and work practices was identified as the most neglected factor. The study contributed to the body of knowledge by unveiling the deviations in existing dimensions of SC and SP. The refined model is expected to concisely measure the SP in the Pakistani construction industry, however, caution must be exercised while generalizing the study results to other developing countries. PMID:28350366

Modeling the Relationship between Safety Climate and Safety Performance in a Developing Construction Industry: A Cross-Cultural Validation Study.

PubMed

Zahoor, Hafiz; Chan, Albert P C; Utama, Wahyudi P; Gao, Ran; Zafar, Irfan

2017-03-28

This study attempts to validate a safety performance (SP) measurement model in the cross-cultural setting of a developing country. In addition, it highlights the variations in investigating the relationship between safety climate (SC) factors and SP indicators. The data were collected from forty under-construction multi-storey building projects in Pakistan. Based on the results of exploratory factor analysis, a SP measurement model was hypothesized. It was tested and validated by conducting confirmatory factor analysis on calibration and validation sub-samples respectively. The study confirmed the significant positive impact of SC on safety compliance and safety participation , and negative impact on number of self-reported accidents/injuries . However, number of near-misses could not be retained in the final SP model because it attained a lower standardized path coefficient value. Moreover, instead of safety participation , safety compliance established a stronger impact on SP. The study uncovered safety enforcement and promotion as a novel SC factor, whereas safety rules and work practices was identified as the most neglected factor. The study contributed to the body of knowledge by unveiling the deviations in existing dimensions of SC and SP. The refined model is expected to concisely measure the SP in the Pakistani construction industry, however, caution must be exercised while generalizing the study results to other developing countries.

29 CFR 1607.7 - Use of other validity studies.

Code of Federal Regulations, 2011 CFR

2011-07-01

... 29 Labor 4 2011-07-01 2011-07-01 false Use of other validity studies. 1607.7 Section 1607.7 Labor... EMPLOYEE SELECTION PROCEDURES (1978) General Principles § 1607.7 Use of other validity studies. A. Validity studies not conducted by the user. Users may, under certain circumstances, support the use of selection...

Assessing Households Preparedness for Earthquakes: An Exploratory Study in the Development of a Valid and Reliable Persian-version Tool.

PubMed

Ardalan, Ali; Sohrabizadeh, Sanaz

2016-02-25

Iran is placed among countries suffering from the highest number of earthquake casualties. Household preparedness, as one component of risk reduction efforts, is often supported in quake-prone areas. In Iran, lack of a valid and reliable household preparedness tool was reported by previous disaster studies. This study is aimed to fill this gap by developing a valid and reliable tool for assessing household preparedness in the event of an earthquake.  This survey was conducted through three phases including literature review and focus group discussions with the participation of eight key informants, validity measurements and reliability measurements. Field investigation was completed with the participation of 450 households within three provinces of Iran. Content validity, construct validity, the use of factor analysis; internal consistency using Cronbach's alpha coefficient, and test-retest reliability were carried out to develop the tool.  Based on the CVIs, ranging from 0.80 to 0.100, and exploratory factor analysis with factor loading of more than 0.5, all items were valid. The amount of Cronbach's alpha (0.7) and test-retest examination by Spearman correlations indicated that the scale was also reliable. The final instrument consisted of six categories and 18 questions including actions at the time of earthquakes, nonstructural safety, structural safety, hazard map, communications, drill, and safety skills.  Using a Persian-version tool that is adjusted to the socio-cultural determinants and native language may result in more trustful information on earthquake preparedness. It is suggested that disaster managers and researchers apply this tool in their future household preparedness projects. Further research is needed to make effective policies and plans for transforming preparedness knowledge into behavior.

The Participation Scale: measuring a key concept in public health.

PubMed

van Brakel, Wim H; Anderson, Alison M; Mutatkar, R K; Bakirtzief, Zoica; Nicholls, Peter G; Raju, M S; Das-Pattanayak, Robert K

2006-02-28

To develop a scale to measure (social) participation for use in rehabilitation, stigma reduction and social integration programmes. A scale development study was carried out in Nepal, India and Brazil using standard methods. The instrument was to be based on the Participation domains of the International Classification of Functioning, Disability and Health (ICF), be cross-cultural in nature and assess client-perceived participation. Respondents rated their participation in comparison with a "peer", defined as "someone similar to the respondent in all respects except for the disease or disability". An 18-item instrument was developed in seven languages. Crohnbach's alpha was 0.92, intra-tester stability 0.83 and inter-tester reliability 0.80. Discrimination between controls and clients was good at a Participation Score threshold of 12. Responsiveness after a "life change" was according to expectation. The Participation Scale is reliable and valid to measure client-perceived participation in people affected by leprosy or disability. It is expected to be valid in other (stigmatised) conditions also, but this needs confirmation. The scale allows collection of participation data and impact assessment of interventions to improve social participation. Such data may be compared between clients, interventions and programmes. The scale is suitable for use in institutions, but also at the peripheral level.

Psychological well-being and social participation assessment in visually impaired subjects playing Torball: a controlled study.

PubMed

Di Cagno, A; Iuliano, E; Aquino, G; Fiorilli, G; Battaglia, C; Giombini, A; Calcagno, G

2013-04-01

The aim of this study was to evaluate the differences in psychological well-being, symptomatic psychological disorders and social participation, between blind Torball players and non-players. Thirty blind male participants were recruited, 17 Torball players (aged 36.27±3.46) and 13 non-players (aged 34.80±2.53), and evaluated for social participation level, psychological well-being and symptomatic psychological disorders, using three validated self-report questionnaires: Participation Scale (PS), Psychological Well-Being Scale (PWBS) and Symptom Checklist 90 R (SCL-90-R) respectively. ANOVA showed significant overall differences between the two groups. The social restriction score in the non-player group was significantly higher (p<0.01) than the player group. The Torball player group showed significant better scores than non-player group in 5 of the 6 dimensions of the PWB Scale (p<0.01) and in 8 of the 10 dimensions of the SCL-90-R (7 dimensions p<0.01; 1 dimension p<0.05) and in the three global scores of the SCL-90-R (p<0.01). The results of this study showed a relationship between psychological well-being and social skills of visually impaired people and their Torball practice. Copyright © 2012 Elsevier Ltd. All rights reserved.

Validating self-report of diabetes use by participants in the 45 and up study: a record linkage study

PubMed Central

2013-01-01

Background Prevalence studies usually depend on self-report of disease status in survey data or administrative data collections and may over- or under-estimate disease prevalence. The establishment of a linked data collection provided an opportunity to explore the accuracy and completeness of capture of information about diabetes in survey and administrative data collections. Methods Baseline questionnaire data at recruitment to the 45 and Up Study was obtained for 266,848 adults aged 45 years and over sampled from New South Wales, Australia in 2006–2009, and linked to administrative data about hospitalisation from the Admitted Patient Data Collection (APDC) for 2000–2009, claims for medical services (MBS) and pharmaceuticals (PBS) from Medicare Australia data for 2004–2009. Diabetes status was determined from response to a question ‘Has a doctor EVER told you that you have diabetes’ (n = 23,981) and augmented by examination of free text fields about diagnosis (n = 119) or use of insulin (n = 58). These data were used to identify the sub-group with type 1 diabetes. We explored the agreement between self-report of diabetes, identification of diabetes diagnostic codes in APDC data, claims for glycosylated haemoglobin (HbA1c) in MBS data, and claims for dispensed medication (oral hyperglycaemic agents and insulin) in PBS data. Results Most participants with diabetes were identified in APDC data if admitted to hospital (79.3%), in MBS data with at least one claim for HbA1c testing (84.7%; 73.4% if 2 tests claimed) or in PBS data through claim for diabetes medication (71.4%). Using these alternate data collections as an imperfect ‘gold standard’ we calculated sensitivities of 83.7% for APDC, 63.9% (80.5% for two tests) for MBS, and 96.6% for PBS data and specificities of 97.7%, 98.4% and 97.1% respectively. The lower sensitivity for HbA1c may reflect the use of this test to screen for diabetes suggesting that it is less useful in identifying

Worksite health promotion program participation: a study to examine the determinants of participation.

PubMed

Hall, Michael Edward; Bergman, Randall J; Nivens, Samantha

2014-09-01

This study explores the relationship between organizational health climate and worksite health promotion program participation, specifically engaging individuals who are unlikely to make positive health behavior choices on their own. Participants consisted of employees at three separate furniture-manufacturing facilities completing a voluntary survey. Using responses (n = 349) from the health climate instrument, which is a measure of the collective attitudes, beliefs, and readiness to change a health behavior, this study identified two factors that were significant contributors to worksite health promotion program participation. Health norms, the collective attitudes regarding healthy lifestyle, as measured by the subscales-health scale and intention to make a behavior change-and "optimistic bias," the overassessment of one's personal health, were found to be predictors of participation. Additionally, significant (p < .05) predictors of self-assessed health, included perceived control to initiate, competence to carry out, and the organizational support of the health behavior change. The findings suggest that the organization's health norms and self-assessed health are associated with the worker's motivation to become involved with health promotion interventions. Offering worksite health screenings and advanced programming and creating a culture of health at work can help address program participation. © 2013 Society for Public Health Education.

The Bahasa Melayu version of Cornell Musculoskeletal Discomfort Questionnaire (CMDQ): Reliability and validity study in Malaysia.

PubMed

Shariat, Ardalan; Tamrin, Shamsul Bahri Mohd; Arumugam, Manohar; Ramasamy, Rajesh

2016-03-09

The Cornell Musculoskeletal Discomfort Questionnaire (CMDQ) was developed to assess the level of musculoskeletal discomfort among office workers related to their ergonomic situation. The primary objective of this initial study is to analyze the validity and dependability of the Malay translation of the Cornell Musculoskeletal Discomfort Questionnaire. The questionnaire was self-administered two times, with an interval of two weeks in order to evaluate the accuracy of the original findings with a retest. The study involved 115 participants. The range of Cronbach Alpha coefficient showed a considerable consistency of the items for each sub-scale (Cronbach's a > 0.95). The range of Kappa coefficients was between (ICC = 0.690-0.949, p < 0.001), (ICC = 0.801-0.979, p < 0.001) and (ICC = 0.778-0.944, p < 0.001) for frequency, severity and interference scales. This research, introduced the Malay-language version of the CMDQ (CMDQ-M) as the first formal validation of the CMDQ, and confirmed a high reliability and validity for the evaluation of musculoskeletal discomfort among the study population.

Using standardised patients to measure physicians' practice: validation study using audio recordings

PubMed Central

Luck, Jeff; Peabody, John W

2002-01-01

Objective To assess the validity of standardised patients to measure the quality of physicians' practice. Design Validation study of standardised patients' assessments. Physicians saw unannounced standardised patients presenting with common outpatient conditions. The standardised patients covertly tape recorded their visit and completed a checklist of quality criteria immediately afterwards. Their assessments were compared against independent assessments of the recordings by a trained medical records abstractor. Setting Four general internal medicine primary care clinics in California. Participants 144 randomly selected consenting physicians. Main outcome measures Rates of agreement between the patients' assessments and independent assessment. Results 40 visits, one per standardised patient, were recorded. The overall rate of agreement between the standardised patients' checklists and the independent assessment of the audio transcripts was 91% (κ=0.81). Disaggregating the data by medical condition, site, level of physicians' training, and domain (stage of the consultation) gave similar rates of agreement. Sensitivity of the standardised patients' assessments was 95%, and specificity was 85%. The area under the receiver operator characteristic curve was 90%. Conclusions Standardised patients' assessments seem to be a valid measure of the quality of physicians' care for a variety of common medical conditions in actual outpatient settings. Properly trained standardised patients compare well with independent assessment of recordings of the consultations and may justify their use as a “gold standard” in comparing the quality of care across sites or evaluating data obtained from other sources, such as medical records and clinical vignettes. What is already known on this topicStandardised patients are valid and reliable reporters of physicians' practice in the medical education settingHowever, validating standardised patients' measurements of quality of care in

Validity and reliability of balance assessment software using the Nintendo Wii balance board: usability and validation

PubMed Central

2014-01-01

Background A balance test provides important information such as the standard to judge an individual’s functional recovery or make the prediction of falls. The development of a tool for a balance test that is inexpensive and widely available is needed, especially in clinical settings. The Wii Balance Board (WBB) is designed to test balance, but there is little software used in balance tests, and there are few studies on reliability and validity. Thus, we developed a balance assessment software using the Nintendo Wii Balance Board, investigated its reliability and validity, and compared it with a laboratory-grade force platform. Methods Twenty healthy adults participated in our study. The participants participated in the test for inter-rater reliability, intra-rater reliability, and concurrent validity. The tests were performed with balance assessment software using the Nintendo Wii balance board and a laboratory-grade force platform. Data such as Center of Pressure (COP) path length and COP velocity were acquired from the assessment systems. The inter-rater reliability, the intra-rater reliability, and concurrent validity were analyzed by an intraclass correlation coefficient (ICC) value and a standard error of measurement (SEM). Results The inter-rater reliability (ICC: 0.89-0.79, SEM in path length: 7.14-1.90, SEM in velocity: 0.74-0.07), intra-rater reliability (ICC: 0.92-0.70, SEM in path length: 7.59-2.04, SEM in velocity: 0.80-0.07), and concurrent validity (ICC: 0.87-0.73, SEM in path length: 5.94-0.32, SEM in velocity: 0.62-0.08) were high in terms of COP path length and COP velocity. Conclusion The balance assessment software incorporating the Nintendo Wii balance board was used in our study and was found to be a reliable assessment device. In clinical settings, the device can be remarkably inexpensive, portable, and convenient for the balance assessment. PMID:24912769

Predictors of grandmother participation in a multigenerational study.

PubMed

Poehlmann, J

2001-01-01

Results of a growing body of literature regarding multigenerational relationships indicate that grandparents directly and indirectly influence their grandchildren's development. However, multiple generations have been difficult to assemble for research purposes, with refusal rates ranging from 40 percent to over 80 percent. Despite difficulties in obtaining information from more than one generation of family members, data examining potential biases in the selection of participants have rarely been reported. The present study explored predictors of grandmother participation in a multigenerational study with 84 mothers, 84 infants, and 52 maternal grandmothers. Results indicated that grandmothers were less likely to participate in the study when grandchildren experienced preterm birth and when mothers reported less family of origin support. However, grandmothers who participated in the study reported high levels of intergenerational involvement and contact with daughters and grandchildren.

Validation of measures from the smartphone sway balance application: a pilot study.

PubMed

Patterson, Jeremy A; Amick, Ryan Z; Thummar, Tarunkumar; Rogers, Michael E

2014-04-01

A number of different balance assessment techniques are currently available and widely used. These include both subjective and objective assessments. The ability to provide quantitative measures of balance and posture is the benefit of objective tools, however these instruments are not generally utilized outside of research laboratory settings due to cost, complexity of operation, size, duration of assessment, and general practicality. The purpose of this pilot study was to assess the value and validity of using software developed to access the iPod and iPhone accelerometers output and translate that to the measurement of human balance. Thirty healthy college-aged individuals (13 male, 17 female; age = 26.1 ± 8.5 years) volunteered. Participants performed a static Athlete's Single Leg Test protocol for 10 sec, on a Biodex Balance System SD while concurrently utilizing a mobile device with balance software. Anterior/posterior stability was recorded using both devices, described as the displacement in degrees from level, and was termed the "balance score." There were no significant differences between the two reported balance scores (p = 0.818. Mean balance score on the balance platform was 1.41 ± 0.90, as compared to 1.38 ± 0.72 using the mobile device. There is a need for a valid, convenient, and cost-effective tool to objectively measure balance. Results of this study are promising, as balance score derived from the Smartphone accelerometers were consistent with balance scores obtained from a previously validated balance system. However, further investigation is necessary as this version of the mobile software only assessed balance in the anterior/posterior direction. Additionally, further testing is necessary on a healthy populations and as well as those with impairment of the motor control system. Level 2b (Observational study of validity)(1.)

The validation of a home food inventory.

PubMed

Fulkerson, Jayne A; Nelson, Melissa C; Lytle, Leslie; Moe, Stacey; Heitzler, Carrie; Pasch, Keryn E

2008-11-04

Home food inventories provide an efficient method for assessing home food availability; however, few are validated. The present study's aim was to develop and validate a home food inventory that is easily completed by research participants in their homes and includes a comprehensive range of both healthful and less healthful foods that are associated with obesity. A home food inventory (HFI) was developed and tested with two samples. Sample 1 included 51 adult participants and six trained research staff who independently completed the HFI in participants' homes. Sample 2 included 342 families in which parents completed the HFI and the Diet History Questionnaire (DHQ) and students completed three 24-hour dietary recall interviews. HFI items assessed 13 major food categories as well as two categories assessing ready-access to foods in the kitchen and the refrigerator. An obesogenic household food availability score was also created. To assess criterion validity, participants' and research staffs' assessment of home food availability were compared (staff = gold standard). Criterion validity was evaluated with kappa, sensitivity, and specificity. Construct validity was assessed with correlations of five HFI major food category scores with servings of the same foods and associated nutrients from the DHQ and dietary recalls. Kappa statistics for all 13 major food categories and the two ready-access categories ranged from 0.61 to 0.83, indicating substantial agreement. Sensitivity ranged from 0.69 to 0.89, and specificity ranged from 0.86 to 0.95. Spearman correlations between staff and participant major food category scores ranged from 0.71 to 0.97. Correlations between the HFI scores and food group servings and nutrients on the DHQ (parents) were all significant (p < .05) while about half of associations between the HFI and dietary recall interviews (adolescents) were significant (p < .05). The obesogenic home food availability score was significantly associated (p

Validity of preeclampsia registration in the Medical Birth Registry of Norway for women participating in the Norwegian Mother and Child Cohort Study, 1999-2010

PubMed Central

Harmon, Quaker E.; Skard, Linn Beate; Simonsen, Ingeborg; Austvoll, Elise; Alsaker, Elin Hilde Roti; Starling, Anne; Trogstad, Lill; Magnus, Per; Engel, Stephanie

2014-01-01

Background The Norwegian Mother and Child Cohort study (MoBa), a prospective population-based pregnancy cohort, is a valuable database for studying causes of preeclampsia. Preeclampsia data in MoBa comes from the Medical Birth Registry of Norway (MBRN), thus, we wanted to study the validity of MBRN preeclampsia registration for MoBa women. Methods We selected all MoBa pregnancies with preeclampsia registered in the MBRN (n=4081) and a random control group (n=2000) without preeclampsia registrations. After excluding two delivery units not participating in MoBa and one no longer operating, units were asked to provide copies of antenatal charts with blood pressure and urinary measurements from all antenatal visits during pregnancy, and hospital discharge codes from the delivery stay. We received data for 5340 pregnancies delivered 1999-2010 (87% of all eligible). We calculated positive predictive value (PPV), sensitivity and specificity of MBRN registration, using hypertension and proteinuria on the antenatal charts and/or hospital discharge codes indicating preeclampsia as gold standard. Results Overall PPV was 83.9% (95% confidence interval 82.7, 85.1), and was higher when women were primiparous, or delivered preterm or low birth weight infants. Severe preeclampsia in the MBRN was found to be a true severe preeclampsia in 70% of cases. Extrapolating to the total MoBa population, the estimated sensitivity was low: 43.0% (38.7, 48.2), while specificity was high: 99.2% (99.2, 99.3). False negative cases seemed to have mild forms of preeclampsia. Conclusions PPV and specificity of preeclampsia registration in the MBRN during 1999-2010 was satisfactory, while sensitivity was low. PMID:25040774

An Examination of Coach and Player Relationships According to the Adapted LMX 7 Scale: A Validity and Reliability Study

ERIC Educational Resources Information Center

Caliskan, Gokhan

2015-01-01

The current study aims to test the reliability and validity of the Leader-Member Exchange (LMX 7) scale with regard to coach--player relationships in sports settings. A total of 330 professional soccer players from the Turkish Super League as well as from the First and Second Leagues participated in this study. Factor analyses were performed to…

A survey of study participants' understanding of informed consent to participate in a randomised controlled trial of acupuncture.

PubMed

Smith, Caroline A; Fogarty, Sarah

2016-01-12

It is important that potential study participants are appropriately informed and understand what is involved with their research participation. A few studies have examined study participants' understanding of the informed consent process and the adequacy of the information they received when agreeing to participate in a randomised controlled trial. Deficiencies in the consent process have been found. This topic remains an under researched area of acupuncture research. The aim of this study was to examine participants' understanding of their informed consent and the adequacy of the information presented when agreeing to participate in a randomised controlled trial of acupuncture. All women who participated in a randomised controlled trial over an 11 month period were invited to participate in a survey. An anonymous self-completion questionnaire was designed and covered participants' understanding of informed consent in the clinical trial, their views of the information provided, the opportunity to ask questions, the use of sham acupuncture, their recall of study visits and processes for withdrawal, and their reason for participating in the trial. A response rate of 59% was obtained. Over 90% of subjects indicated there was plenty of opportunity to discuss the study prior to giving consent, and 89% indicated that questions asked were answered to their satisfaction. The majority of women indicated the amount of information describing acupuncture was about right, however 24% would have liked more. Information describing sham acupuncture was not considered adequate by 48% of women, and 35% would have liked more information, 30% could not recall why, or were uncertain why a sham group was used. Participants indicated less understanding of the information relating to payment if they became ill due to study participation, risks and discomforts from the study interventions, which of the procedures were experimental and for how long they would be involved in the study. Trial

Pregnant soldiers' participation in physical training: a descriptive study.

PubMed

Kwolek, Laurie A; Berry-Cabán, Cristóbal S; Thomas, Sean F

2011-08-01

This study identifies factors that influence U.S. Army soldiers' participation in the Pregnant Soldiers Wellness Program (PSWP), an exercise and wellness education program for soldiers who are either pregnant or in the postpartum period. A retrospective survey was administered prior to initial postpartum hospital discharge. Seventy-four soldiers who delivered babies at Womack Army Medical Center participated in this study. Of those surveyed, 66.2% of respondents participated in the PSWP, 59.5% were encouraged to participate by their provider. Few participants stated that the overall safety, structure, and quality of the PSWP were important factors contributing to their participation. Additionally, less than 20% reported that instructor's knowledge influenced their decision to participate in the PSWP. Most soldiers participated in the program for the health of their fetus and to quickly return to required Army weight standards. This study offers insights that will potentially increase the overall soldier participation rate in the PSWP, thus promoting greater health benefits for the pregnant soldier and increasing sustainment of force readiness.

Validation of the ArthroS virtual reality simulator for arthroscopic skills.

PubMed

Stunt, J J; Kerkhoffs, G M M J; van Dijk, C N; Tuijthof, G J M

2015-11-01

Virtual reality simulator training has become important for acquiring arthroscopic skills. A new simulator for knee arthroscopy ArthroS™ has been developed. The purpose of this study was to demonstrate face and construct validity, executed according to a protocol used previously to validate arthroscopic simulators. Twenty-seven participants were divided into three groups having different levels of arthroscopic experience. Participants answered questions regarding general information and the outer appearance of the simulator for face validity. Construct validity was assessed with one standardized navigation task. Face validity, educational value and user friendliness were further determined by giving participants three exercises and by asking them to fill out the questionnaire. Construct validity was demonstrated between experts and beginners. Median task times were not significantly different for all repetitions between novices and intermediates, and between intermediates and experts. Median face validity was 8.3 for the outer appearance, 6.5 for the intra-articular joint and 4.7 for surgical instruments. Educational value and user friendliness were perceived as nonsatisfactory, especially because of the lack of tactile feedback. The ArthroS™ demonstrated construct validity between novices and experts, but did not demonstrate full face validity. Future improvements should be mainly focused on the development of tactile feedback. It is necessary that a newly presented simulator is validated to prove it actually contributes to proficiency of skills.

Validation of the Virtual MET as an assessment tool for executive functions.

PubMed

Rand, Debbie; Basha-Abu Rukan, Soraya; Weiss, Patrice L Tamar; Katz, Noomi

2009-08-01

The purpose of this study was to establish ecological validity and initial construct validity of a Virtual Multiple Errands Test (VMET) as an assessment tool for executive functions. It was implemented within the Virtual Mall (VMall), a novel functional video-capture virtual shopping environment. The main objectives were (1) to examine the relationships between the performance of three groups of participants in the Multiple Errands Test (MET) carried out in a real shopping mall and their performance in the VMET, (2) to assess the relationships between the MET and VMET of the post-stroke participant's level of executive functioning and independence in instrumental activities of daily living, and (3) to compare the performance of post-stroke participants to those of healthy young and older controls in both the MET and VMET. The study population included three groups; post-stroke participants (n = 9), healthy young participants (n = 20), and healthy older participants (n = 20). The VMET was able to differentiate between two age groups of healthy participants and between healthy and post-stroke participants thus demonstrating that it is sensitive to brain injury and ageing and supports construct validity between known groups. In addition, significant correlations were found between the MET and the VMET for both the post-stroke participants and older healthy participants. This provides initial support for the ecological validity of the VMET as an assessment tool of executive functions. However, further psychometric data on temporal stability are needed, namely test-retest reliability and responsiveness, before it is ready for clinical application. Further research using the VMET as an assessment tool within the VMall with larger groups and in additional populations is also recommended.

The reliability, validity, and feasibility of physical activity measurement in adults with traumatic brain injury: an observational study.

PubMed

Hassett, Leanne; Moseley, Anne; Harmer, Alison; van der Ploeg, Hidde P

2015-01-01

To determine the reliability and validity of the Physical Activity Scale for Individuals with a Physical Disability (PASIPD) in adults with severe traumatic brain injury (TBI) and estimate the proportion of the sample participants who fail to meet the World Health Organization guidelines for physical activity. A single-center observational study recruited a convenience sample of 30 community-based ambulant adults with severe TBI. Participants completed the PASIPD on 2 occasions, 1 week apart, and wore an accelerometer (ActiGraph GT3X; ActiGraph LLC, Pensacola, Florida) for the 7 days between these 2 assessments. The PASIPD test-retest reliability was substantial (intraclass correlation coefficient = 0.85; 95% confidence interval, 0.70-0.92), and the correlation with the accelerometer ranged from too low to be meaningful (R = 0.09) to moderate (R = 0.57). From device-based measurement of physical activity, 56% of participants failed to meet the World Health Organization physical activity guidelines. The PASIPD is a reliable measure of the type of physical activity people with severe TBI participate in, but it is not a valid measure of the amount of moderate to vigorous physical activity in which they engage. Accelerometers should be used to quantify moderate to vigorous physical activity in people with TBI.

Multi-laboratory validation study of multilocus variable-number tandem repeat analysis (MLVA) for Salmonella enterica serovar Enteritidis, 2015

PubMed Central

Peters, Tansy; Bertrand, Sophie; Björkman, Jonas T; Brandal, Lin T; Brown, Derek J; Erdõsi, Tímea; Heck, Max; Ibrahem, Salha; Johansson, Karin; Kornschober, Christian; Kotila, Saara M; Le Hello, Simon; Lienemann, Taru; Mattheus, Wesley; Nielsen, Eva Møller; Ragimbeau, Catherine; Rumore, Jillian; Sabol, Ashley; Torpdahl, Mia; Trees, Eija; Tuohy, Alma; de Pinna, Elizabeth

2017-01-01

Multilocus variable-number tandem repeat analysis (MLVA) is a rapid and reproducible typing method that is an important tool for investigation, as well as detection, of national and multinational outbreaks of a range of food-borne pathogens. Salmonella enterica serovar Enteritidis is the most common Salmonella serovar associated with human salmonellosis in the European Union/European Economic Area and North America. Fourteen laboratories from 13 countries in Europe and North America participated in a validation study for MLVA of S. Enteritidis targeting five loci. Following normalisation of fragment sizes using a set of reference strains, a blinded set of 24 strains with known allele sizes was analysed by each participant. The S. Enteritidis 5-loci MLVA protocol was shown to produce internationally comparable results as more than 90% of the participants reported less than 5% discrepant MLVA profiles. All 14 participating laboratories performed well, even those where experience with this typing method was limited. The raw fragment length data were consistent throughout, and the inter-laboratory validation helped to standardise the conversion of raw data to repeat numbers with at least two countries updating their internal procedures. However, differences in assigned MLVA profiles remain between well-established protocols and should be taken into account when exchanging data. PMID:28277220

Multi-laboratory validation study of multilocus variable-number tandem repeat analysis (MLVA) for Salmonella enterica serovar Enteritidis, 2015.

PubMed

Peters, Tansy; Bertrand, Sophie; Björkman, Jonas T; Brandal, Lin T; Brown, Derek J; Erdõsi, Tímea; Heck, Max; Ibrahem, Salha; Johansson, Karin; Kornschober, Christian; Kotila, Saara M; Le Hello, Simon; Lienemann, Taru; Mattheus, Wesley; Nielsen, Eva Møller; Ragimbeau, Catherine; Rumore, Jillian; Sabol, Ashley; Torpdahl, Mia; Trees, Eija; Tuohy, Alma; de Pinna, Elizabeth

2017-03-02

Multilocus variable-number tandem repeat analysis (MLVA) is a rapid and reproducible typing method that is an important tool for investigation, as well as detection, of national and multinational outbreaks of a range of food-borne pathogens. Salmonella enterica serovar Enteritidis is the most common Salmonella serovar associated with human salmonellosis in the European Union/European Economic Area and North America. Fourteen laboratories from 13 countries in Europe and North America participated in a validation study for MLVA of S. Enteritidis targeting five loci. Following normalisation of fragment sizes using a set of reference strains, a blinded set of 24 strains with known allele sizes was analysed by each participant. The S. Enteritidis 5-loci MLVA protocol was shown to produce internationally comparable results as more than 90% of the participants reported less than 5% discrepant MLVA profiles. All 14 participating laboratories performed well, even those where experience with this typing method was limited. The raw fragment length data were consistent throughout, and the inter-laboratory validation helped to standardise the conversion of raw data to repeat numbers with at least two countries updating their internal procedures. However, differences in assigned MLVA profiles remain between well-established protocols and should be taken into account when exchanging data. This article is copyright of The Authors, 2017.

Use of the Method of Triads in the Validation of Sodium and Potassium Intake in the Brazilian Longitudinal Study of Adult Health (ELSA-Brasil)

PubMed Central

Pereira, Taísa Sabrina Silva; Cade, Nágela Valadão; Mill, José Geraldo; Sichieri, Rosely; Molina, Maria del Carmen Bisi

2016-01-01

Introduction Biomarkers are a good choice to be used in the validation of food frequency questionnaire due to the independence of their random errors. Objective To assess the validity of the potassium and sodium intake estimated using the Food Frequency Questionnaire ELSA-Brasil. Subjects/Methods A subsample of participants in the ELSA-Brasil cohort was included in this study in 2009. Sodium and potassium intake were estimated using three methods: Semi-quantitative food frequency questionnaire, 12-hour nocturnal urinary excretion and three 24-hour food records. Correlation coefficients were calculated between the methods, and the validity coefficient was calculated using the method of triads. The 95% confidence intervals for the validity coefficient were estimated using bootstrap sampling. Exact and adjacent agreement and disagreement of the estimated sodium and potassium intake quintiles were compared among three methods. Results The sample consisted of 246 participants, aged 53±8 years, 52% of women. Validity coefficient for sodium were considered weak (рfood frequency questionnaire actual intake = 0.37 and рbiomarker actual intake = 0.21) and moderate (рfood records actual intake 0.56). The validity coefficient were higher for potassium (рfood frequency questionnaire actual intake = 0.60; рbiomarker actual intake = 0.42; рfood records actual intake = 0.79). Conclusions: The Food Frequency Questionnaire ELSA-Brasil showed good validity in estimating potassium intake in epidemiological studies. For sodium validity was weak, likely due to the non-quantification of the added salt to prepared food. PMID:28030625

Use of the Method of Triads in the Validation of Sodium and Potassium Intake in the Brazilian Longitudinal Study of Adult Health (ELSA-Brasil).

PubMed

Pereira, Taísa Sabrina Silva; Cade, Nágela Valadão; Mill, José Geraldo; Sichieri, Rosely; Molina, Maria Del Carmen Bisi

2016-01-01

Biomarkers are a good choice to be used in the validation of food frequency questionnaire due to the independence of their random errors. To assess the validity of the potassium and sodium intake estimated using the Food Frequency Questionnaire ELSA-Brasil. A subsample of participants in the ELSA-Brasil cohort was included in this study in 2009. Sodium and potassium intake were estimated using three methods: Semi-quantitative food frequency questionnaire, 12-hour nocturnal urinary excretion and three 24-hour food records. Correlation coefficients were calculated between the methods, and the validity coefficient was calculated using the method of triads. The 95% confidence intervals for the validity coefficient were estimated using bootstrap sampling. Exact and adjacent agreement and disagreement of the estimated sodium and potassium intake quintiles were compared among three methods. The sample consisted of 246 participants, aged 53±8 years, 52% of women. Validity coefficient for sodium were considered weak (рfood frequency questionnaire actual intake = 0.37 and рbiomarker actual intake = 0.21) and moderate (рfood records actual intake 0.56). The validity coefficient were higher for potassium (рfood frequency questionnaire actual intake = 0.60; рbiomarker actual intake = 0.42; рfood records actual intake = 0.79). Conclusions: The Food Frequency Questionnaire ELSA-Brasil showed good validity in estimating potassium intake in epidemiological studies. For sodium validity was weak, likely due to the non-quantification of the added salt to prepared food.

Using a 3D Virtual Supermarket to Measure Food Purchase Behavior: A Validation Study

PubMed Central

Jiang, Yannan; Steenhuis, Ingrid Hendrika Margaretha; Ni Mhurchu, Cliona

2015-01-01

Background There is increasing recognition that supermarkets are an important environment for health-promoting interventions such as fiscal food policies or front-of-pack nutrition labeling. However, due to the complexities of undertaking such research in the real world, well-designed randomized controlled trials on these kinds of interventions are lacking. The Virtual Supermarket is a 3-dimensional computerized research environment designed to enable experimental studies in a supermarket setting without the complexity or costs normally associated with undertaking such research. Objective The primary objective was to validate the Virtual Supermarket by comparing virtual and real-life food purchasing behavior. A secondary objective was to obtain participant feedback on perceived sense of “presence” (the subjective experience of being in one place or environment even if physically located in another) in the Virtual Supermarket. Methods Eligible main household shoppers (New Zealand adults aged ≥18 years) were asked to conduct 3 shopping occasions in the Virtual Supermarket over 3 consecutive weeks, complete the validated Presence Questionnaire Items Stems, and collect their real supermarket grocery till receipts for that same period. Proportional expenditure (NZ$) and the proportion of products purchased over 18 major food groups were compared between the virtual and real supermarkets. Data were analyzed using repeated measures mixed models. Results A total of 123 participants consented to take part in the study. In total, 69.9% (86/123) completed 1 shop in the Virtual Supermarket, 64.2% (79/123) completed 2 shops, 60.2% (74/123) completed 3 shops, and 48.8% (60/123) returned their real supermarket till receipts. The 4 food groups with the highest relative expenditures were the same for the virtual and real supermarkets: fresh fruit and vegetables (virtual estimate: 14.3%; real: 17.4%), bread and bakery (virtual: 10.0%; real: 8.2%), dairy (virtual: 19.1%; real

Using a 3D virtual supermarket to measure food purchase behavior: a validation study.

PubMed

Waterlander, Wilma Elzeline; Jiang, Yannan; Steenhuis, Ingrid Hendrika Margaretha; Ni Mhurchu, Cliona

2015-04-28

There is increasing recognition that supermarkets are an important environment for health-promoting interventions such as fiscal food policies or front-of-pack nutrition labeling. However, due to the complexities of undertaking such research in the real world, well-designed randomized controlled trials on these kinds of interventions are lacking. The Virtual Supermarket is a 3-dimensional computerized research environment designed to enable experimental studies in a supermarket setting without the complexity or costs normally associated with undertaking such research. The primary objective was to validate the Virtual Supermarket by comparing virtual and real-life food purchasing behavior. A secondary objective was to obtain participant feedback on perceived sense of "presence" (the subjective experience of being in one place or environment even if physically located in another) in the Virtual Supermarket. Eligible main household shoppers (New Zealand adults aged ≥18 years) were asked to conduct 3 shopping occasions in the Virtual Supermarket over 3 consecutive weeks, complete the validated Presence Questionnaire Items Stems, and collect their real supermarket grocery till receipts for that same period. Proportional expenditure (NZ$) and the proportion of products purchased over 18 major food groups were compared between the virtual and real supermarkets. Data were analyzed using repeated measures mixed models. A total of 123 participants consented to take part in the study. In total, 69.9% (86/123) completed 1 shop in the Virtual Supermarket, 64.2% (79/123) completed 2 shops, 60.2% (74/123) completed 3 shops, and 48.8% (60/123) returned their real supermarket till receipts. The 4 food groups with the highest relative expenditures were the same for the virtual and real supermarkets: fresh fruit and vegetables (virtual estimate: 14.3%; real: 17.4%), bread and bakery (virtual: 10.0%; real: 8.2%), dairy (virtual: 19.1%; real: 12.6%), and meat and fish (virtual: 16

Development, validity and reproducibility of a food frequency questionnaire in pregnancy for the Universiti Sains Malaysia birth cohort study.

PubMed

Loy, S L; Marhazlina, M; Nor, Azwany Y; Hamid, Jan J M

2011-04-01

This study aimed to develop and examine the validity and reproducibility of a semi-quantitative food frequency questionnaire (FFQ) among Malay pregnant women in Kelantan, Malaysia. A total of 177 Malay pregnant women participated in the validation study while 85 of them participated in the reproducibility study which was carried out in the antenatal clinic of Universiti Sains Malaysia Hospital. The newly developed FFQ was validated against two 24-hour dietary recalls (DR). The FFQ was repeated 20 to 28 days apart. Results showed that the FFQ moderately over-estimated the nutrient and food intakes compared to the DR. Spearman correlation coefficients for nutrients ranged from 0.24 (fat) to 0.61 (calcium) and for foods, ranged from 0.13 (organ meats, onion and garlic) to 0.57 (malt drink). For nutrients, 72 to 85% of women were classified into the correct quartiles from the FFQ and the DR while for foods, 67 to 85% of women were classified correctly. Bland-Altman plot showed relatively good agreement between these two dietary methods. The intra-class correlation (ICC) was used to estimate reproducibility. It ranged from 0.75 (vitamin C) to 0.94 (phosphorus) for nutrients while it ranged from 0.73 (confectionary) to 0.96 (coffee) for foods. On average, at least 90% of pregnant women were correctly classified into the quartiles for nutrients and foods from the two sets of the FFQ. The FFQ presented acceptable reproducibility and appears to be a valid tool for categorising pregnant women according to dietary intake.

Emotion Recognition Ability Test Using JACFEE Photos: A Validity/Reliability Study of a War Veterans' Sample and Their Offspring.

PubMed

Castro-Vale, Ivone; Severo, Milton; Carvalho, Davide; Mota-Cardoso, Rui

2015-01-01

Emotion recognition is very important for social interaction. Several mental disorders influence facial emotion recognition. War veterans and their offspring are subject to an increased risk of developing psychopathology. Emotion recognition is an important aspect that needs to be addressed in this population. To our knowledge, no test exists that is validated for use with war veterans and their offspring. The current study aimed to validate the JACFEE photo set to study facial emotion recognition in war veterans and their offspring. The JACFEE photo set was presented to 135 participants, comprised of 62 male war veterans and 73 war veterans' offspring. The participants identified the facial emotion presented from amongst the possible seven emotions that were tested for: anger, contempt, disgust, fear, happiness, sadness, and surprise. A loglinear model was used to evaluate whether the agreement between the intended and the chosen emotions was higher than the expected. Overall agreement between chosen and intended emotions was 76.3% (Cohen kappa = 0.72). The agreement ranged from 63% (sadness expressions) to 91% (happiness expressions). The reliability by emotion ranged from 0.617 to 0.843 and the overall JACFEE photo set Cronbach alpha was 0.911. The offspring showed higher agreement when compared with the veterans (RR: 41.52 vs 12.12, p < 0.001), which confirms the construct validity of the test. The JACFEE set of photos showed good validity and reliability indices, which makes it an adequate instrument for researching emotion recognition ability in the study sample of war veterans and their respective offspring.

Emotion Recognition Ability Test Using JACFEE Photos: A Validity/Reliability Study of a War Veterans' Sample and Their Offspring

PubMed Central

Castro-Vale, Ivone; Severo, Milton; Carvalho, Davide; Mota-Cardoso, Rui

2015-01-01

Emotion recognition is very important for social interaction. Several mental disorders influence facial emotion recognition. War veterans and their offspring are subject to an increased risk of developing psychopathology. Emotion recognition is an important aspect that needs to be addressed in this population. To our knowledge, no test exists that is validated for use with war veterans and their offspring. The current study aimed to validate the JACFEE photo set to study facial emotion recognition in war veterans and their offspring. The JACFEE photo set was presented to 135 participants, comprised of 62 male war veterans and 73 war veterans’ offspring. The participants identified the facial emotion presented from amongst the possible seven emotions that were tested for: anger, contempt, disgust, fear, happiness, sadness, and surprise. A loglinear model was used to evaluate whether the agreement between the intended and the chosen emotions was higher than the expected. Overall agreement between chosen and intended emotions was 76.3% (Cohen kappa = 0.72). The agreement ranged from 63% (sadness expressions) to 91% (happiness expressions). The reliability by emotion ranged from 0.617 to 0.843 and the overall JACFEE photo set Cronbach alpha was 0.911. The offspring showed higher agreement when compared with the veterans (RR: 41.52 vs 12.12, p < 0.001), which confirms the construct validity of the test. The JACFEE set of photos showed good validity and reliability indices, which makes it an adequate instrument for researching emotion recognition ability in the study sample of war veterans and their respective offspring. PMID:26147938

Predictors of two forms of attrition in a longitudinal health study involving ageing participants: an analysis based on the Whitehall II study.

PubMed

Mein, Gill; Johal, Suneeta; Grant, Robert L; Seale, Clive; Ashcroft, Richard; Tinker, Anthea

2012-10-29

Longitudinal studies are crucial providers of information about the needs of an ageing population, but their external validity is affected if partipants drop out. Previous research has identified older age, impaired cognitive function, lower educational level, living alone, fewer social activities, and lower socio-economic status as predictors of attrition. This project examined attrition in participants of the Whitehall II study aged between 51-71 years, using data from questionnaires participants have completed biennially since 1985 when the study began. We examine the possibility of two distinct forms of attrition--non-response and formally requesting to withdraw--and whether they have different predictors. Potential predictors were age, gender, marital status, occupational grade, retirement, home ownership, presence of longstanding illness, SF-36 quality of life scores, social participation and educational level comparing participants and those who had withdrawn from the study. The two forms of attrition share many predictors and are associated but remain distinct. Being older, male, having a lower job grade, not being a home owner, not having a long standing illness, having higher levels of education, and not having retired, were all associated with a greater probability of non-response; being married was associated with higher probability in women and lower in men. Being older, male, having a lower job grade, not being a home owner, having lower SF-36 scores, taking part in fewer social activities, and not having a long standing illness, were all associated with greater probability of withdrawal. The results suggest a strong gender effect on both routes not previously considered in analyses of attrition. Investigators of longitudinal studies should take measures to retain older participants and lower level socio-economic participants, who are more likely to cease participating. Recognition should be given to the tendency for people with health problems to be

Assessing reliability and validity measures in managed care studies.

PubMed

Montoya, Isaac D

2003-01-01

To review the reliability and validity literature and develop an understanding of these concepts as applied to managed care studies. Reliability is a test of how well an instrument measures the same input at varying times and under varying conditions. Validity is a test of how accurately an instrument measures what one believes is being measured. A review of reliability and validity instructional material was conducted. Studies of managed care practices and programs abound. However, many of these studies utilize measurement instruments that were developed for other purposes or for a population other than the one being sampled. In other cases, instruments have been developed without any testing of the instrument's performance. The lack of reliability and validity information may limit the value of these studies. This is particularly true when data are collected for one purpose and used for another. The usefulness of certain studies without reliability and validity measures is questionable, especially in cases where the literature contradicts itself

In-Trail Procedure Air Traffic Control Procedures Validation Simulation Study

NASA Technical Reports Server (NTRS)

Chartrand, Ryan C.; Hewitt, Katrin P.; Sweeney, Peter B.; Graff, Thomas J.; Jones, Kenneth M.

2012-01-01

In August 2007, Airservices Australia (Airservices) and the United States National Aeronautics and Space Administration (NASA) conducted a validation experiment of the air traffic control (ATC) procedures associated with the Automatic Dependant Surveillance-Broadcast (ADS-B) In-Trail Procedure (ITP). ITP is an Airborne Traffic Situation Awareness (ATSA) application designed for near-term use in procedural airspace in which ADS-B data are used to facilitate climb and descent maneuvers. NASA and Airservices conducted the experiment in Airservices simulator in Melbourne, Australia. Twelve current operational air traffic controllers participated in the experiment, which identified aspects of the ITP that could be improved (mainly in the communication and controller approval process). Results showed that controllers viewed the ITP as valid and acceptable. This paper describes the experiment design and results.

Reliability and Validity Study of a Tool to Measure Cancer Stigma: Patient Version.

PubMed

Yılmaz, Medine; Dişsiz, Gülçin; Demir, Filiz; Irız, Sibel; Alacacioglu, Ahmet

2017-01-01

The aim of this methodological study is to establish the validity and reliability of the Turkish version of "A Questionnaire for Measuring Attitudes toward Cancer (Cancer Stigma) - Patient version." The sample comprised oncology patients who had active cancer treatment. The construct validity was assessed using the confirmatory and exploratory factor analysis. The mean age of the participants was 54.9±12.3 years. In the confirmatory factor analysis, fit values were determined as comparative fit index = 0.93, goodness of fit index = 0.91, normed-fit index=0.91, and root mean square error of approximation RMSEA = 0.09 ( P <0.05) (Kaiser-Meyer-Olkin = 0.88, χ 2 = 1084.41, Df = 66, and Barletta's test P <0.000). The first factor was "impossibility of recovery and experience of social discrimination" and the second factor was "stereotypes of cancer patients." The two-factor structure accounted for 56.74% of the variance. The Cronbach's alpha value was determined as 0.88 for the two-factor scale. "A questionnaire for measuring attitudes toward cancer (cancer stigma) - Patient version" is a reliable and valid questionnaire to assess stigmatization of cancer in cancer patients.

40 CFR 761.392 - Preparing validation study samples.

Code of Federal Regulations, 2014 CFR

2014-07-01

... establish a surface concentration to be included in the standard operating procedure. The surface levels of... Under § 761.79(d)(4) § 761.392 Preparing validation study samples. (a)(1) To validate a procedure to... surfaces must be ≥20 µg/100 cm2. (2) To validate a procedure to decontaminate a specified surface...

40 CFR 761.392 - Preparing validation study samples.

Code of Federal Regulations, 2012 CFR

2012-07-01

... establish a surface concentration to be included in the standard operating procedure. The surface levels of... Under § 761.79(d)(4) § 761.392 Preparing validation study samples. (a)(1) To validate a procedure to... surfaces must be ≥20 µg/100 cm2. (2) To validate a procedure to decontaminate a specified surface...

40 CFR 761.392 - Preparing validation study samples.

Code of Federal Regulations, 2013 CFR

2013-07-01

... establish a surface concentration to be included in the standard operating procedure. The surface levels of... Under § 761.79(d)(4) § 761.392 Preparing validation study samples. (a)(1) To validate a procedure to... surfaces must be ≥20 µg/100 cm2. (2) To validate a procedure to decontaminate a specified surface...

Individual- and County-Level Religious Participation, Corporal Punishment, and Physical Abuse of Children: An Exploratory study.

PubMed

Wolf, Jennifer Price; Kepple, Nancy Jo

2016-10-01

Parental religiosity has been associated with corporal punishment. However, most of this research has focused exclusively on Christians and has not examined physical abuse. In addition, little is known about how the larger religious environment might be associated with discipline behaviors. In this exploratory study, we examine how individual- and county-level religious attendance are related to corporal punishment and physical abuse. We sampled and surveyed 3,023 parents of children aged 12 and younger from 50 mid-sized California cities. We used weighted Poisson models to calculate the frequency of corporal punishment and physical abuse in the past year. Parents who attend religious groups used corporal punishment more frequently than parents who did not attend religious groups. However, those who lived in counties with greater rates of religious participation used corporal punishment less frequently than those living in counties with lower rates of religious participation. There were no effects for religious participation on physical abuse at the individual or county level. This exploratory study suggests that parents who attend religious groups may be more likely to use some types of physical discipline with children. Religious groups could be imparting parenting norms supporting corporal punishment at the individual level. More research examining specific doctrines and faiths is needed to validate the study findings.

Development and Construct Validation of the Mentor Behavior Scale

ERIC Educational Resources Information Center

Brodeur, Pascale; Larose, Simon; Tarabulsy, George; Feng, Bei; Forget-Dubois, Nadine

2015-01-01

Researchers suggest that certain supportive behaviors of mentors could increase the benefits of school-based mentoring for youth. However, the literature contains few validated instruments to measure these behaviors. In our present study, we aimed to construct and validate a tool to measure the supportive behaviors of mentors participating in…

Estimation of low back moments from video analysis: a validation study.

PubMed

Coenen, Pieter; Kingma, Idsart; Boot, Cécile R L; Faber, Gert S; Xu, Xu; Bongers, Paulien M; van Dieën, Jaap H

2011-09-02

This study aimed to develop, compare and validate two versions of a video analysis method for assessment of low back moments during occupational lifting tasks since for epidemiological studies and ergonomic practice relatively cheap and easily applicable methods to assess low back loads are needed. Ten healthy subjects participated in a protocol comprising 12 lifting conditions. Low back moments were assessed using two variants of a video analysis method and a lab-based reference method. Repeated measures ANOVAs showed no overall differences in peak moments between the two versions of the video analysis method and the reference method. However, two conditions showed a minor overestimation of one of the video analysis method moments. Standard deviations were considerable suggesting that errors in the video analysis were random. Furthermore, there was a small underestimation of dynamic components and overestimation of the static components of the moments. Intraclass correlations coefficients for peak moments showed high correspondence (>0.85) of the video analyses with the reference method. It is concluded that, when a sufficient number of measurements can be taken, the video analysis method for assessment of low back loads during lifting tasks provides valid estimates of low back moments in ergonomic practice and epidemiological studies for lifts up to a moderate level of asymmetry. Copyright © 2011 Elsevier Ltd. All rights reserved.

41 CFR 60-3.7 - Use of other validity studies.

Code of Federal Regulations, 2010 CFR

2010-07-01

... studies. 60-3.7 Section 60-3.7 Public Contracts and Property Management Other Provisions Relating to... of other validity studies. A. Validity studies not conducted by the user. Users may, under certain circumstances, support the use of selection procedures by validity studies conducted by other users or conducted...

41 CFR 60-3.7 - Use of other validity studies.

Code of Federal Regulations, 2011 CFR

2011-07-01

... studies. 60-3.7 Section 60-3.7 Public Contracts and Property Management Other Provisions Relating to... of other validity studies. A. Validity studies not conducted by the user. Users may, under certain circumstances, support the use of selection procedures by validity studies conducted by other users or conducted...

Predicting Chinese Children and Youth's Energy Expenditure Using ActiGraph Accelerometers: A Calibration and Cross-Validation Study

ERIC Educational Resources Information Center

Zhu, Zheng; Chen, Peijie; Zhuang, Jie

2013-01-01

Purpose: The purpose of this study was to develop and cross-validate an equation based on ActiGraph accelerometer GT3X output to predict children and youth's energy expenditure (EE) of physical activity (PA). Method: Participants were 367 Chinese children and youth (179 boys and 188 girls, aged 9 to 17 years old) who wore 1 ActiGraph GT3X…

Body Dysmorphic Symptoms Scale for patients seeking esthetic surgery: cross-cultural validation study.

PubMed

Ramos, Tatiana Dalpasquale; Brito, Maria José Azevedo de; Piccolo, Mônica Sarto; Rosella, Maria Fernanda Normanha da Silva Martins; Sabino, Miguel; Ferreira, Lydia Masako

2016-07-21

Rhinoplasty is one of the most sought-after esthetic operations among individuals with body dysmorphic disorder. The aim of this study was to cross-culturally adapt and validate the Body Dysmorphic Symptoms Scale. Cross-cultural validation study conducted in a plastic surgery outpatient clinic of a public university hospital. Between February 2014 and March 2015, 80 consecutive patients of both sexes seeking rhinoplasty were selected. Thirty of them participated in the phase of cultural adaptation of the instrument. Reproducibility was tested on 20 patients and construct validity was assessed on 50 patients, with correlation against the Yale-Brown Obsessive Compulsive Scale for Body Dysmorphic Disorder. The Brazilian version of the instrument showed Cronbach's alpha of 0.805 and excellent inter-rater reproducibility (intraclass correlation coefficient, ICC = 0.873; P < 0.001) and intra-rater reproducibility (ICC = 0.939; P < 0.001). Significant differences in total scores were found between patients with and without symptoms (P < 0.001). A strong correlation (r = 0.841; P < 0.001) was observed between the Yale-Brown Obsessive Compulsive Scale for Body Dysmorphic Disorder and the Body Dysmorphic Symptoms Scale. The area under the receiver operating characteristic curve was 0.981, thus showing good accuracy for discriminating between presence and absence of symptoms of body dysmorphic disorder. Forty-six percent of the patients had body dysmorphic symptoms and 54% had moderate to severe appearance-related obsessive-compulsive symptoms. The Brazilian version of the Body Dysmorphic Symptoms Scale is a reproducible instrument that presents face, content and construct validity.

Body Dysmorphic Symptoms Scale for patients seeking esthetic surgery: cross-cultural validation study.

PubMed

Ramos, Tatiana Dalpasquale; Brito, Maria José Azevedo de; Piccolo, Mônica Sarto; Rosella, Maria Fernanda Normanha da Silva Martins; Sabino, Miguel; Ferreira, Lydia Masako

2016-01-01

Rhinoplasty is one of the most sought-after esthetic operations among individuals with body dysmorphic disorder. The aim of this study was to cross-culturally adapt and validate the Body Dysmorphic Symptoms Scale. Cross-cultural validation study conducted in a plastic surgery outpatient clinic of a public university hospital. Between February 2014 and March 2015, 80 consecutive patients of both sexes seeking rhinoplasty were selected. Thirty of them participated in the phase of cultural adaptation of the instrument. Reproducibility was tested on 20 patients and construct validity was assessed on 50 patients, with correlation against the Yale-Brown Obsessive Compulsive Scale for Body Dysmorphic Disorder. The Brazilian version of the instrument showed Cronbach's alpha of 0.805 and excellent inter-rater reproducibility (intraclass correlation coefficient, ICC = 0.873; P < 0.001) and intra-rater reproducibility (ICC = 0.939; P < 0.001). Significant differences in total scores were found between patients with and without symptoms (P < 0.001). A strong correlation (r = 0.841; P < 0.001) was observed between the Yale-Brown Obsessive Compulsive Scale for Body Dysmorphic Disorder and the Body Dysmorphic Symptoms Scale. The area under the receiver operating characteristic curve was 0.981, thus showing good accuracy for discriminating between presence and absence of symptoms of body dysmorphic disorder. Forty-six percent of the patients had body dysmorphic symptoms and 54% had moderate to severe appearance-related obsessive-compulsive symptoms. The Brazilian version of the Body Dysmorphic Symptoms Scale is a reproducible instrument that presents face, content and construct validity.

A Validity Study of the Working Group's Autobiographical Memory Test for Individuals with Moderate to Severe Intellectual Disability

ERIC Educational Resources Information Center

Pyo, Geunyeong; Ala, Tom; Kyrouac, Gregory A.; Verhulst, Steven J.

2011-01-01

The purpose of the present study was to investigate the validity of the Working Group's Autobiographical Memory Test as a dementia screening tool for individuals with moderate to severe intellectual disabilities (ID). Twenty-one participants with Dementia of Alzheimer's Type (DAT) and moderate to severe ID and 42 controls with similar levels of ID…

Does a Multi-Media Program Enhance Job Matching for a Population with Intellectual Disabilities? A Social Validity Study

ERIC Educational Resources Information Center

Michaud, Kim M.

2017-01-01

This dissertation describes a mixed method design study on the social validity of a multi-media job search tool, the YES tool, at a four-year Comprehensive Transition Program at an East Coast University. The participants included twelve students, randomly selected from those who, with their parents' assent, agreed to volunteer for this study…

A qualitative study of participants' experiences with dietary assessment.

PubMed

Vuckovic, N; Ritenbaugh, C; Taren, D L; Tobar, M

2000-09-01

This article reports on the use of focus groups and an experimental participatory activity to investigate factors influencing participants' decisions about what to eat and what to report on food records and food frequency questionnaires. Four focus groups examined participants' experience with diet records and 3 focus groups explored the topic of food portions using a group consensus activity. Twenty-two women participated in the diet record focus groups, and 15 participated in portion estimation groups. Focus group participants were equally distributed by age and body mass index values. Each woman completed a 10-day doubly labeled water protocol to measure total energy expenditure, 7 days of diet records (before and during total energy expenditure), and a food frequency questionnaire after the total energy expenditure. Transcripts of the focus groups were coded to index categories of responses and to identify themes within and across those responses. Themes discussed in this article are those that were discussed most often and at greatest length by all groups. The diet record focus groups revealed that 2 major factors influenced reporting on diet records: honesty vs social acceptability, and simplifying food intake. The portion estimation focus groups revealed 5 factors that influenced perceptions of portion size: the role of food in the meal, the type of food, personal preferences, product serving sizes, and comparison of personal servings with those of others. The validity and reliability of self-reported food consumption is greatly influenced by the ways people interpret and respond to dietary assessment instruments. These findings indicate that dietetics professionals need to take extra steps to address issues of accurately recording "bad" foods when training patients to complete diet records. Extra probing is needed when dietary records do not include snacks and include simple meals and a large amount of prepared and packaged food because this may indicate

Physiotherapy Questionnaires App to Deliver Main Musculoskeletal Assessment Questionnaires: Development and Validation Study

PubMed Central

Teixeira Neto, Nestor Cavalcante; Lima, Yuri Lopes; Almeida, Gabriel Peixoto Leão; Bezerra, Márcio Almeida; Lima, Pedro Olavo De Paula

2018-01-01

Background Patient-reported outcomes (PROs) translate subjective outcomes into objective data that can be quantified and analyzed. Nevertheless, the use of PROs in their traditional paper format is not practical for clinical practice due to limitations associated with the analysis and management of the data. To address the need for a viable way to group and utilize the main functioning assessment tools in the field of musculoskeletal disorders, the Physiotherapy Questionnaires app was developed. Objective This study aims to explain the development of the app, to validate it using two questionnaires, and to analyze whether participants prefer to use the app or the paper version of the questionnaires. Methods In the first stage, the app for an Android operational system was developed. In the second stage, the aim was to select questionnaires that were most often used in musculoskeletal clinical practice and research. The Foot and Ankle Outcome Score (FAOS) and American Orthopaedic Foot and Ankle Society (AOFAS) questionnaire were selected to validate the app. In total, 50 participants completed the paper and app versions of the AOFAS and 50 completed the FAOS. The study’s outcomes were the correlation of the data between the paper and app versions as well as the preference of the participants between the two versions. Results The app was approved by experts after the adaptations of the layout for mobile phones and a total of 18 questionnaires were included in the app. Moreover, the app allows the generation of PDF and Excel files with the patients’ data. In regards to validity, the mean of the total scores of the FAOS were 91.54% (SD 8.86%) for the paper version and 91.74% (SD 9.20%) for the app. There was no statistically significant differences in the means of the total scores or the subscales (P=.11-.94). The mean total scores for the AOFAS were 93.94 (SD 8.47) for the paper version and 93.96 (SD 8.48) for the app. No statistically significant differences were

Relative validity of a semi-quantitative, web-based FFQ used in the 'Snart Forældre' cohort - a Danish study of diet and fertility.

PubMed

Knudsen, Vibeke K; Hatch, Elizabeth E; Cueto, Heidi; Tucker, Katherine L; Wise, Lauren; Christensen, Tue; Mikkelsen, Ellen M

2016-04-01

To assess the relative validity of a semi-quantitative, web-based FFQ completed by female pregnancy planners in the Danish 'Snart Forældre' study. We validated a web-based FFQ based on the FFQ used in the Danish National Birth Cohort against a 4 d food diary (FD) and assessed the relative validity of intakes of foods and nutrients. We compared means and medians of intakes, and calculated Pearson correlation coefficients and de-attenuated coefficients to assess agreement between the two methods. We also calculated the proportion correctly classified based on the same or adjacent quintile of intake and the proportion of grossly misclassified (extreme quintiles). Participants (n 128) in the 'Snart Forældre' study who had completed the web-based FFQ were invited to participate in the validation study. Participants in the 'Snart Forældre' study, in total ninety-seven women aged 20-42 years. Reported intakes of dairy products, vegetables and potatoes were higher in the FFQ compared with the FD, whereas reported intakes of fruit, meat, sugar and beverages were lower in the FFQ than in the FD. Overall the de-attenuated correlation coefficients were acceptable, ranging from 0·33 for energy to 0·93 for vitamin D. The majority of the women were classified in the same or adjacent quintile and few women were misclassified (extreme quintiles). The web-based FFQ performs well for ranking women of reproductive age according to high or low intake of foods and nutrients and, thus, provides a solid basis for investigating associations between diet and fertility.

Validity of self-measured waist and hip circumferences: results from a community study in Malaysia.

PubMed

Reidpath, Daniel D; Cheah, Julius Chee-Ho; Lam, Fui-Ching; Yasin, Shahjahan; Soyiri, Ireneous; Allotey, Pascale

2013-10-05

Measures of central adiposity are better predictors of adverse health events than BMI. Nonetheless, BMI is more widely used in health research. One reason for this may be the limited research supporting the self-measurement of waist and hip circumference. The lack of validity studies is particularly acute in Asia. The main objective was to establish the validity of self-measurement of waist and hip circumference in a community setting and the correlation of those measures with BMI, blood pressure, and blood glucose levels. A community based, cross-sectional survey. A "healthy living expo" at a shopping mall in a rural town on peninsular Malaysia One hundred and thirty six (136) individuals volunteered to participate in the study, 125 of whom met the inclusion criteria. The ethnic distribution of the participants was 80% Chinese, 17% Malay and 3% Indian. Most participants were female (60%), with participants' ages ranging from 18 to 78 years (mean, 47.2). Self and assisted measurements of waist and hip were taken. Blood pressure, non-fasting blood glucose, height, and weight were also measured. Bland Altman plots and Lin's concordance coefficient were used to measure agreement between self and assisted measures. Pearson's correlation was used to examine the association of self and assisted measures with blood pressure, blood glucose, and BMI. There was a downwards bias in self measured waist (-0.81 cm) and hip (-1 cm) circumferences compared with assisted measures. The concordance for the self and assisted measures of waist, hip and the ratio of the two were, respectively, .96, .93 , and .84. The correlation between measures of central adiposity and BMI, blood pressure and blood glucose were similar for self and assisted measures. The results provide additional support for the use of self-measurement of waist and hip circumference studies of central adiposity, but is limited by the specificity of the setting.

Translation and validation of the Brown attention-deficit disorder scale for use in Brazil: identifying cases of attention-deficit/hyperactivity disorder among samples of substance users and non-users. Cross-cultural validation study.

PubMed

Kakubo, Simone Mayumi; Mendez, Mariel; Silveira, Juliana Doering; Maringolo, Leonardo; Nitta, Conrado; Silveira, Dartiu Xavier da; Fidalgo, Thiago Marques

2018-04-23

The Brown Attention-Deficit Disorder Scale (BADDS) was developed as a self-report assessment that was designed to screen for presence of symptoms of attention deficit hyperactivity disorder (ADHD). The objective here was to translate and validate the adult self-report BADDS for use in Brazil. Cross-cultural validation study conducted in an addiction unit at a public university hospital. This study included a control group (n = 100) and a drug-user group (n = 100). Both groups included subjects aged 18 to 60 years old. The control group had no prior diagnosis of drug addiction and the drug-user group included participants with a diagnosis of addiction. Each participant answered Brazilian Portuguese translations of both the BADDS and the Adult Attention Deficit Hyperactivity Disorder Self-Report Scale (ASRS) questionnaires, in paper-and-pencil format. The drug-user group scored higher than the control group on both scales. The mean scores on ASRS were 27.26 (standard deviation, SD: 11.99) and 25.85 (SD: 8.65) respectively (P > 0.05). The mean scores on BADDS were 79.56 (SD: 29.61) and 79.31 (SD: 18.09), respectively (P > 0.05). Cronbach's alpha for BADDS was 0.95. BADDS presented fair sensitivity (72% accuracy) and fair specificity (88% accuracy). This study provides discriminative validity evidence for use of BADDS among Brazilian adults with substance-use disorders.

The predictive validity of selection for entry into postgraduate training in general practice: evidence from three longitudinal studies.

PubMed

Patterson, Fiona; Lievens, Filip; Kerrin, Máire; Munro, Neil; Irish, Bill

2013-11-01

The selection methodology for UK general practice is designed to accommodate several thousand applicants per year and targets six core attributes identified in a multi-method job-analysis study To evaluate the predictive validity of selection methods for entry into postgraduate training, comprising a clinical problem-solving test, a situational judgement test, and a selection centre. A three-part longitudinal predictive validity study of selection into training for UK general practice. In sample 1, participants were junior doctors applying for training in general practice (n = 6824). In sample 2, participants were GP registrars 1 year into training (n = 196). In sample 3, participants were GP registrars sitting the licensing examination after 3 years, at the end of training (n = 2292). The outcome measures include: assessor ratings of performance in a selection centre comprising job simulation exercises (sample 1); supervisor ratings of trainee job performance 1 year into training (sample 2); and licensing examination results, including an applied knowledge examination and a 12-station clinical skills objective structured clinical examination (OSCE; sample 3). Performance ratings at selection predicted subsequent supervisor ratings of job performance 1 year later. Selection results also significantly predicted performance on both the clinical skills OSCE and applied knowledge examination for licensing at the end of training. In combination, these longitudinal findings provide good evidence of the predictive validity of the selection methods, and are the first reported for entry into postgraduate training. Results show that the best predictor of work performance and training outcomes is a combination of a clinical problem-solving test, a situational judgement test, and a selection centre. Implications for selection methods for all postgraduate specialties are considered.

Impact of participation in a theatre programme on quality of life among older adults with chronic conditions: a pilot study.

PubMed

Yuen, Hon Keung; Mueller, Kris; Mayor, Ellise; Azuero, Andres

2011-12-01

The purpose of this mixed methods study was to evaluate the effect of participation in the "Seasoned Arts At the Samford for You" (SAASY) programme, which included a 6-week acting class and four public performances, on the psychological well-being and health-related quality of life of older adults. Twelve older adults with chronic conditions from a low-income senior apartment and a senior living community participated in the programme. The acting class, led by two professional artists, met for a 2-hour class weekly for six weeks. Participants completed the General Well-being Schedule (GWBS) and the 36-Item Short-Form Health Survey (SF-36) both at the beginning of the programme and one month after the programme ended. In addition, participants were individually interviewed to explore the perceived impact of the theatre programme on their well-being. Participants reported a significantly higher score in the GWBS and on the physical but not on the mental component summary of the SF-36 at post-SAASY programme. Content analysis of the interview transcripts revealed that participants attained an improved sense of self-worth and self-advocacy and overcame self-imposed limitations. Results showed improvement in psychological well-being and health-related quality of life, most notably in the physical health component of SF-36 after participating in the programme. Practice implications for occupational therapists using drama as a creative leisure occupation to promote health among older adults with chronic conditions may involve analysis of participants' occupational profile, identification of deficit areas and adaptation of the acting programme content to meet specific needs and goals. The present study used a pretest and post test one group design that has numerous inherent limitations that affect the ability to make valid inferences from study findings. A more rigorous research design with a wait-listed control group and collection of outcome measures immediately after

[Study of adaptation and validation of the Practice environment scale of the nursing work index for the Portuguese reality].

PubMed

Ferreira, Maria Regina Sardinheiro do Céu Furtado; Martins, José Joaquim Penedos Amendoeira

2014-08-01

Testing the psychometric properties of the Portuguese version of the Practice Environment Scale of the Nursing Work Index. A descriptive, analytical and cross-sectional study, for the cross-cultural adaptation and validation of the psychometric properties of the scale. The study participants were 236 nurses from two hospitals in the regions of Lisbon and Vale do Tejo. The 0.92 Cronbach's alpha was obtained for overall reliability and support of a five-dimension structure. The excellent quality of adjustment of analysis confirms the validity of the adapted version to hospital care settings, although there was no total coincidence of items in the five dimensions

Psychometric properties of the medical outcomes study: social support survey among methadone maintenance patients in Ho Chi Minh City, Vietnam: a validation study.

PubMed

Khuong, Long Quynh; Vu, Tuong-Vi Thi; Huynh, Van-Anh Ngoc; Thai, Truc Thanh

2018-02-14

Social support plays a crucial role in the treatment and recovery process of patients engaging in methadone maintenance treatment (MMT). However, there is a paucity of research about social support among MMT patients, possibly due to a lack of appropriate measuring tools. This study aimed to evaluate the psychometric properties of the Vietnamese version of the Medical Outcomes Study: Social Support Survey (MOS-SSS) among MMT patients. A cross-sectional survey of 300 patients was conducted in a methadone clinic in Ho Chi Minh City, Vietnam. MMT patients who agreed to participate in the study completed a face-to-face interview in a private room. The MOS-SSS was translated into Vietnamese using standard forward-backward process. Internal consistency was measured by Cronbach's alpha. The intra-class correlation coefficient was used to determine the test-retest reliability of the MOS-SSS in 75 participants two weeks after the first survey. Concurrent validity of the MOS-SSS was evaluated by correlations with the Multidimensional Scale of Perceived Social Support (MSPSS) and the Perceived Stigma of Addiction Scale (PSAS). Construct validity was investigated by confirmatory factor analysis. The MOS-SSS had good internal consistency with Cronbach's alpha from 0.95 to 0.97 for the four subscales and 0.97 for the overall scale. The two-week test-retest reliability was at moderate level with intra-class correlation coefficients of 0.61-0.73 for the four subscales and 0.76 for the overall scale. Strong significant correlations between the MOS-SSS and the MSPSS (r = 0.77; p < 0.001) and the PSAS (r = - 0.76; p < 0.001) indicated good concurrent validity. Construct validity of the MOS-SSS was established since a final four-factor model fitted the data well with Comparative Fit Index (0.97), Tucker-Lewis Index (0.97), Standardized Root Mean Square Residual (0.03) and Root Mean Square Error of Approximation (0.068; 90% CI = 0.059-0.077). The MOS-SSS is a

Participant dropout as a function of survey length in internet-mediated university studies: implications for study design and voluntary participation in psychological research.

PubMed

Hoerger, Michael

2010-12-01

Internet-mediated research has offered substantial advantages over traditional laboratory-based research in terms of efficiently and affordably allowing for the recruitment of large samples of participants for psychology studies. Core technical, ethical, and methodological issues have been addressed in recent years, but the important issue of participant dropout has received surprisingly little attention. Specifically, web-based psychology studies often involve undergraduates completing lengthy and time-consuming batteries of online personality questionnaires, but no known published studies to date have closely examined the natural course of participant dropout during attempted completion of these studies. The present investigation examined participant dropout among 1,963 undergraduates completing one of six web-based survey studies relatively representative of those conducted in university settings. Results indicated that 10% of participants could be expected to drop out of these studies nearly instantaneously, with an additional 2% dropping out per 100 survey items included in the study. For individual project investigators, these findings hold ramifications for study design considerations, such as conducting a priori power analyses. The present results also have broader ethical implications for understanding and improving voluntary participation in research involving human subjects. Nonetheless, the generalizability of these conclusions may be limited to studies involving similar design or survey content.

The Women's Health Initiative (WHI) Life and Longevity After Cancer (LILAC) Study: Description and Baseline Characteristics of Participants.

PubMed

Paskett, Electra D; Caan, Bette J; Johnson, Lisa; Bernardo, Brittany M; Young, Gregory S; Pennell, Michael L; Ray, Roberta M; Kroenke, Candyce H; Porter, Peggy L; Anderson, Garnet L

2018-02-01

Background: The Women's Health Initiative (WHI) Life and Longevity After Cancer (LILAC) study offers an important opportunity to advance cancer research by extending the original WHI studies to examine survivorship in women diagnosed with cancer during their participation in WHI. Methods: The goals of LILAC are to (i) obtain cancer treatment information and long-term cancer outcomes for women diagnosed with one of eight selected cancers (breast, endometrial, ovarian, lung, and colorectal cancers, and melanoma, lymphoma, and leukemia); (ii) augment the existing WHI biorepository with fixed tumor tissue from the solid tumor sites for cancers diagnosed since 2002; and (iii) develop, refine, and validate methods to use administrative data to capture treatment and recurrence data. Methods for accomplishing these goals are described, as are results from the initial LILAC participant survey. Results: A total of 9,934 WHI participants living with cancer were eligible for LILAC participation, of which 78% ( N = 7,760) agreed to participate. Among the three most prevalent cancer types, 54% are breast cancer survivors, 11% are melanoma survivors, and 10% are survivors of colorectal cancer. Conclusions: In addition to describing this resource, we present pertinent lessons that may assist other investigators interested in embedding survivorship research into existing large epidemiologic cohorts. Impact: The LILAC resource offers a valuable opportunity for researchers to study cancer survivorship and issues pertinent to cancer survivors in future studies. Cancer Epidemiol Biomarkers Prev; 27(2); 125-37. ©2017 AACR . ©2017 American Association for Cancer Research.

Intra- and inter-tester reliability and validity of normal finger size measurement using the Japanese ring gauge system.

PubMed

Suzuki, T; Sato, Y; Sotome, S; Arai, H; Arai, A; Yoshida, H

2017-06-01

This study was designed to investigate the reliability and validity of measurements of finger diameters with a ring gauge. A reliability study enrolled two independent samples (50 participants and seven examiners in Study I; 26 participants and 26 examiners in Study II). The sizes of each participant's little fingers were measured twice with a ring gauge by each examiner. To investigate the validity of the measurements, five hand therapists compared the finger size and hand volume of 30 participants with the ring gauge and with a figure-of-eight technique (Study III). The intra-class correlation coefficient for intra-observer reliability ranged from 0.97 to 0.99 in Study I, and 0.90 to 0.97 in Study II. The intra-class correlation coefficient for inter-observer reliability was 0.95 in Study I and 0.94 in Study II. The validity study showed a Pearson product moment correlation coefficient of 0.75. The ring gauge showed high reliability and validity for measurement of finger size. III, diagnostic.

Triangulation, Respondent Validation, and Democratic Participation in Mixed Methods Research

ERIC Educational Resources Information Center

Torrance, Harry

2012-01-01

Over the past 10 years or so the "Field" of "Mixed Methods Research" (MMR) has increasingly been exerting itself as something separate, novel, and significant, with some advocates claiming paradigmatic status. Triangulation is an important component of mixed methods designs. Triangulation has its origins in attempts to validate research findings…

Validation of Physical Activity Tracking via Android Smartphones Compared to ActiGraph Accelerometer: Laboratory-Based and Free-Living Validation Studies.

PubMed

Hekler, Eric B; Buman, Matthew P; Grieco, Lauren; Rosenberger, Mary; Winter, Sandra J; Haskell, William; King, Abby C

2015-04-15

There is increasing interest in using smartphones as stand-alone physical activity monitors via their built-in accelerometers, but there is presently limited data on the validity of this approach. The purpose of this work was to determine the validity and reliability of 3 Android smartphones for measuring physical activity among midlife and older adults. A laboratory (study 1) and a free-living (study 2) protocol were conducted. In study 1, individuals engaged in prescribed activities including sedentary (eg, sitting), light (sweeping), moderate (eg, walking 3 mph on a treadmill), and vigorous (eg, jogging 5 mph on a treadmill) activity over a 2-hour period wearing both an ActiGraph and 3 Android smartphones (ie, HTC MyTouch, Google Nexus One, and Motorola Cliq). In the free-living study, individuals engaged in usual daily activities over 7 days while wearing an Android smartphone (Google Nexus One) and an ActiGraph. Study 1 included 15 participants (age: mean 55.5, SD 6.6 years; women: 56%, 8/15). Correlations between the ActiGraph and the 3 phones were strong to very strong (ρ=.77-.82). Further, after excluding bicycling and standing, cut-point derived classifications of activities yielded a high percentage of activities classified correctly according to intensity level (eg, 78%-91% by phone) that were similar to the ActiGraph's percent correctly classified (ie, 91%). Study 2 included 23 participants (age: mean 57.0, SD 6.4 years; women: 74%, 17/23). Within the free-living context, results suggested a moderate correlation (ie, ρ=.59, P<.001) between the raw ActiGraph counts/minute and the phone's raw counts/minute and a strong correlation on minutes of moderate-to-vigorous physical activity (MVPA; ie, ρ=.67, P<.001). Results from Bland-Altman plots suggested close mean absolute estimates of sedentary (mean difference=-26 min/day of sedentary behavior) and MVPA (mean difference=-1.3 min/day of MVPA) although there was large variation. Overall, results suggest

Representativeness of the participants in the smoking Cessation in Pregnancy Incentives Trial (CPIT): a cross-sectional study.

PubMed

Bessing, Barnabas; Bauld, Linda; Sinclair, Lesley; Mackay, Daniel F; Spence, William; Tappin, David M

2016-08-26

The limited representativeness of trial samples may restrict external validity. The aim of this study was to ascertain the representativeness of the population enrolled in the Cessation in Pregnancy Incentives Trial (CPIT), a therapeutic exploratory study to examine the effectiveness of financial incentives for smoking cessation during pregnancy. CPIT participants (n = 492) were compared with all self-reported smokers at maternity booking who did not participate in the trial (n = 1982). Both groups were drawn from the National Health Service (NHS) Greater Glasgow and Clyde area over a 1-year trial enrolment period. Variables used for comparison were age, area-based deprivation index, body mass index, gestation, and carbon monoxide (CO) breath test level. Chi-square and Mann-Whitney U tests were used to compare groups. From January to December 2012, 2474/13,945 (17.7 %) women, who booked for maternity care, self-reported as current smokers (at least one cigarette in the last week). Seven hundred and fifty-two were ineligible for trial participation because of a CO breath test level of less than 7 parts per million (ppm) used as a biochemical cut-off to corroborate self-report of current smoking. At telephone consent 301 could not be contacted, 11 had miscarried, 16 did not give consent and 3 opted out after randomisation, leaving 492 participants for analysis. There were no differences in demographic or clinical characteristics between trial participants, and self-reported smokers not enrolled in the trial in terms of CO breath test (as a measure of smoking level for those with a CO level of 7 ppm or higher), material deprivation (using an area-based measure), maternal age and maternal body mass index. Gestation at booking was statistically significantly lower for participants. To ensure that all trial participants were smokers, biochemical validation excluded self-reported smokers with a CO level of less than 7 ppm from taking part in the trial, which

Assessment study of insight ARTHRO VR (®) arthroscopy virtual training simulator: face, content, and construct validities.

PubMed

Bayona, Sofía; Fernández-Arroyo, José Manuel; Martín, Isaac; Bayona, Pilar

2008-09-01

The aims of this study were to test the face, content, and construct validities of a virtual-reality haptic arthroscopy simulator and to validate four assessment hypothesis. The participants in our study were 94 arthroscopists attending an international conference on arthroscopy. The interviewed surgeons had been performing arthroscopies for a mean of 8.71 years (σ = 6.94 years). We explained the operation, functionality, instructions for use, and the exercises provided by the simulator. They performed a trial exercise and then an exercise in which performance was recorded. After having using it, the arthroscopists answered a questionnaire. The simulator was classified as one of the best training methods (over phantoms), and obtained a mark of 7.10 out of 10 as an evaluation tool. The simulator was considered more useful for inexperienced surgeons than for surgeons with experience (mean difference 1.88 out of 10, P value < 0.001). The participants valued the simulator at 8.24 as a tool for learning skills, its fidelity at 7.41, the quality of the platform at 7.54, and the content of the exercises at 7.09. It obtained a global score of 7.82. Of the subjects, 30.8% said they would practise with the simulator more than 6 h per week. Of the surgeons, 89.4% affirmed that they would recommend the simulator to their colleagues. The data gathered support the first three hypotheses, as well as face and content validities. Results show statistically significant differences between experts and novices, thus supporting the construct validity, but studies with a larger sample must be carried out to verify this. We propose concrete solutions and an equation to calculate economy of movement. Analogously, we analyze competence measurements and propose an equation to provide a single measurement that contains them all and that, according to the surgeons' criteria, is as reliable as the judgment of experts observing the performance of an apprentice.

Development and validation of a work stressor scale for Australian farming families.

PubMed

McShane, Connar J; Quirk, Frances; Swinbourne, Anne

2016-08-01

The aim of this research was to gain insight into the key stressors for Australian farming families. It is well established that the farming work environment consists of a number of unique stressors which arise from dependency on factors beyond an individual's control (e.g. climate conditions) as well as the overlap between work and family environments. Despite this, limited research has included family factors in the assessment of stress felt by farmers and their families. This research sought to develop a scale of stressors for farming families in an Australian sample. A survey design was used for validity and reliability studies. The validity study involved assessment of factor structure, concurrent validity and discriminant validity. The reliability study used a test-retest reliability design. Participants were recruited from across Australia (38% Queensland; 30% New South Wales) and multiple industries (43% beef; 27% broadacre cropping; 26% horticulture). The validity study involved 278 participants and the reliability study involved 53 participants. Development of a Farming Family Stressor scale. The generated Farming Family Stressor scale presented satisfactory levels of concurrent validity (e.g. r = .73 against the Farm Stress Survey total score), discriminant validity (e.g. r = -.42 to r = .53 against the Satisfaction with Life and Kessler-10 total scores, respectively), internal consistency (Cronbach's alpha >.90) and test-retest reliability (rho > .66). This research lends insight into the complexity of stressors for farming families and has implications for occupational health and mental health programs that seek to reduce stress and improve health outcomes for that group. © 2015 National Rural Health Alliance Inc.

41 CFR 60-3.14 - Technical standards for validity studies.

Code of Federal Regulations, 2010 CFR

2010-07-01

... likely to affect validity differences; or that these factors are included in the design of the study and... construct validity is both an extensive and arduous effort involving a series of research studies, which... validity studies. 60-3.14 Section 60-3.14 Public Contracts and Property Management Other Provisions...

41 CFR 60-3.14 - Technical standards for validity studies.

Code of Federal Regulations, 2013 CFR

2013-07-01

... likely to affect validity differences; or that these factors are included in the design of the study and... construct validity is both an extensive and arduous effort involving a series of research studies, which... validity studies. 60-3.14 Section 60-3.14 Public Contracts and Property Management Other Provisions...

41 CFR 60-3.14 - Technical standards for validity studies.

Code of Federal Regulations, 2014 CFR

2014-07-01

... likely to affect validity differences; or that these factors are included in the design of the study and... construct validity is both an extensive and arduous effort involving a series of research studies, which... validity studies. 60-3.14 Section 60-3.14 Public Contracts and Property Management Other Provisions...

41 CFR 60-3.14 - Technical standards for validity studies.

Code of Federal Regulations, 2011 CFR

2011-07-01

... likely to affect validity differences; or that these factors are included in the design of the study and... construct validity is both an extensive and arduous effort involving a series of research studies, which... validity studies. 60-3.14 Section 60-3.14 Public Contracts and Property Management Other Provisions...

41 CFR 60-3.14 - Technical standards for validity studies.

Code of Federal Regulations, 2012 CFR

2012-07-01

... likely to affect validity differences; or that these factors are included in the design of the study and... construct validity is both an extensive and arduous effort involving a series of research studies, which... validity studies. 60-3.14 Section 60-3.14 Public Contracts and Property Management Other Provisions...

Ecological validity of virtual reality daily living activities screening for early dementia: longitudinal study.

PubMed

Tarnanas, Ioannis; Schlee, Winfried; Tsolaki, Magda; Müri, René; Mosimann, Urs; Nef, Tobias

2013-08-06

Dementia is a multifaceted disorder that impairs cognitive functions, such as memory, language, and executive functions necessary to plan, organize, and prioritize tasks required for goal-directed behaviors. In most cases, individuals with dementia experience difficulties interacting with physical and social environments. The purpose of this study was to establish ecological validity and initial construct validity of a fire evacuation Virtual Reality Day-Out Task (VR-DOT) environment based on performance profiles as a screening tool for early dementia. The objectives were (1) to examine the relationships among the performances of 3 groups of participants in the VR-DOT and traditional neuropsychological tests employed to assess executive functions, and (2) to compare the performance of participants with mild Alzheimer's-type dementia (AD) to those with amnestic single-domain mild cognitive impairment (MCI) and healthy controls in the VR-DOT and traditional neuropsychological tests used to assess executive functions. We hypothesized that the 2 cognitively impaired groups would have distinct performance profiles and show significantly impaired independent functioning in ADL compared to the healthy controls. The study population included 3 groups: 72 healthy control elderly participants, 65 amnestic MCI participants, and 68 mild AD participants. A natural user interface framework based on a fire evacuation VR-DOT environment was used for assessing physical and cognitive abilities of seniors over 3 years. VR-DOT focuses on the subtle errors and patterns in performing everyday activities and has the advantage of not depending on a subjective rating of an individual person. We further assessed functional capacity by both neuropsychological tests (including measures of attention, memory, working memory, executive functions, language, and depression). We also evaluated performance in finger tapping, grip strength, stride length, gait speed, and chair stands separately and

Reliability and validity of the English and Malay versions of the Driving and Riding Questionnaire: a pilot study amongst older car drivers and motorcycle riders.

PubMed

Ang, B H; Chen, W S; Ngin, C K; Oxley, J A; Lee, S W H

2018-02-01

This study aimed to examine the reliability and validity of the English and Malay versions of the Driving and Riding Questionnaire. An observational study with a mix-method approach by utilising both questionnaire and short debriefing interviews. Forward and backward translations of the original questionnaire were performed. The translated questionnaire was assessed for clarity by a multidisciplinary research team, translators, and several Malay native speakers. A total of 24 subjects participated in the pilot study. Reliability (Cronbach's alpha) and validity (content validity) of the original and translated questionnaires were examined. The English and Malay versions of the Driving and Riding Questionnaire were found to be reliable tools in measuring driving behaviours amongst older drivers and riders, with Cronbach's alpha of 0.9158 and 0.8919, respectively. For content validity, the questionnaires were critically reviewed in terms of relevance, clarity, simplicity, and ambiguity. The feedback obtained from participants addressed various aspects of the questionnaire related to the improvement of wordings used and inclusion of visual guide to enhance the understanding of the items in the questionnaire. This feedback was incorporated into the final versions of the English and Malay questionnaires. The findings of this study demonstrated both the English and Malay versions of the Driving and Riding Questionnaire to be valid and reliable. Copyright © 2017 The Royal Society for Public Health. Published by Elsevier Ltd. All rights reserved.

Validation of the Fibromyalgia Survey Questionnaire within a Cross-Sectional Survey

PubMed Central

Häuser, Winfried; Jung, Eva; Erbslöh-Möller, Brigitte; Gesmann, Mechthild; Kühn-Becker, Hedi; Petermann, Franz; Langhorst, Jost; Weiss, Thomas; Winkelmann, Andreas; Wolfe, Frederick

2012-01-01

The Fibromyalgia Survey Questionnaire (FSQ) assesses the key symptoms of fibromyalgia syndrome. The FSQ can be administrated in survey research and settings where the use of interviews to evaluate the number of pain sites and extent of somatic symptom intensity and tender point examination would be difficult. We validated the FSQ in a cross-sectional survey with FMS patients. In a cross-sectional survey, participants with physician diagnosis of FMS were recruited by FMS-self help organisations and nine clinical institutions of different levels of care. Participants answered the FSQ (composed by the Widespread Pain Index [WPI] and the Somatic Severity Score [SSS]) assessing the Fibromyalgia Survey Diagnostic Criteria (FSDC) and the Patient Health Questionnaire PHQ 4. American College of Rheumatology 1990 classification criteria were assessed in a subgroup of participants. 1,651 persons diagnosed with FMS were included into analysis. The acceptance of the FSQ-items ranged between 78.9 to 98.1% completed items. The internal consistency of the items of the SSS ranged between 0.75–0.82. 85.5% of the study participants met the FSDC. The concordance rate of the FSDC and ACR 1990 criteria was 72.7% in a subsample of 128 patients. The Pearson correlation of the SSS with the PHQ 4 depression score was 0.52 (p<0.0001) and with the PHQ anxiety score was 0.51 (p<0.0001) (convergent validity). 64/202 (31.7%) of the participants not meeting the FSDC criteria and 152/1283 (11.8%) of the participants meeting the FSDC criteria reported an improvement (slightly too very much better) in their health status since FMS-diagnosis (Chi2 = 55, p<0.0001) (discriminant validity). The study demonstrated the feasibility of the FSQ in a cross-sectional survey with FMS-patients. The reliability, convergent and discriminant validity of the FSQ were good. Further validation studies of the FSQ in clinical and general population settings are necessary. PMID:22662163

Validation of different instruments for caffeine measurement among premenopausal women in the BioCycle study.

PubMed

Schliep, Karen C; Schisterman, Enrique F; Mumford, Sunni L; Perkins, Neil J; Ye, Aijun; Pollack, Anna Z; Zhang, Cuilin; Porucznik, Christina A; VanDerslice, James A; Stanford, Joseph B; Wactawski-Wende, Jean

2013-04-01

Effects of caffeine on women's health are inconclusive, in part because of inadequate exposure assessment. In this study we determined 1) validity of a food frequency questionnaire compared with multiple 24-hour dietary recalls (24HDRs) for measuring monthly caffeine and caffeinated beverage intakes; and 2) validity of the 24HDR compared with the prior day's diary record for measuring daily caffeinated coffee intake. BioCycle Study (2005-2007) participants, women (n = 259) aged 18-44 years from western New York State, were followed for 2 menstrual cycles. Participants completed a food frequency questionnaire at the end of each cycle, four 24HDRs per cycle, and daily diaries. Caffeine intakes reported for the food frequency questionnaires were greater than those reported for the 24HDRs (mean = 114.1 vs. 92.6mg/day, P = 0.01) but showed high correlation (r = 0.73, P < 0.001) and moderate agreement (К = 0.51, 95% confidence interval: 0.43, 0.57). Women reported less caffeinated coffee intake in their 24HDRs compared with their corresponding diary days (mean = 0.51 vs. 0.80 cups/day, P < 0.001) (1 cup = 237 mL). Although caffeine and coffee exposures were highly correlated, absolute intakes differed significantly between measurement tools. These results highlight the importance of considering potential misclassification of caffeine exposure.

Validation of Different Instruments for Caffeine Measurement Among Premenopausal Women in the BioCycle Study

PubMed Central

Schliep, Karen C.; Schisterman, Enrique F.; Mumford, Sunni L.; Perkins, Neil J.; Ye, Aijun; Pollack, Anna Z.; Zhang, Cuilin; Porucznik, Christina A.; VanDerslice, James A.; Stanford, Joseph B.; Wactawski-Wende, Jean

2013-01-01

Effects of caffeine on women's health are inconclusive, in part because of inadequate exposure assessment. In this study we determined 1) validity of a food frequency questionnaire compared with multiple 24-hour dietary recalls (24HDRs) for measuring monthly caffeine and caffeinated beverage intakes; and 2) validity of the 24HDR compared with the prior day's diary record for measuring daily caffeinated coffee intake. BioCycle Study (2005–2007) participants, women (n = 259) aged 18–44 years from western New York State, were followed for 2 menstrual cycles. Participants completed a food frequency questionnaire at the end of each cycle, four 24HDRs per cycle, and daily diaries. Caffeine intakes reported for the food frequency questionnaires were greater than those reported for the 24HDRs (mean = 114.1 vs. 92.6mg/day, P = 0.01) but showed high correlation (r = 0.73, P < 0.001) and moderate agreement (К = 0.51, 95% confidence interval: 0.43, 0.57). Women reported less caffeinated coffee intake in their 24HDRs compared with their corresponding diary days (mean = 0.51 vs. 0.80 cups/day, P < 0.001) (1 cup = 237 mL). Although caffeine and coffee exposures were highly correlated, absolute intakes differed significantly between measurement tools. These results highlight the importance of considering potential misclassification of caffeine exposure. PMID:23462965

Evaluation of Psychometric Properties of Voice Activity and Participation Profile (VAPP): A Spanish Version.

PubMed

Bermúdez-de-Alvear, Rosa M; Gálvez-Ruiz, Pablo; Martínez-Arquero, A Ginés; Rando-Márquez, Sara; Fernández-Contreras, Elena

2018-06-11

This study aimed to analyze the psychometric properties of the Spanish version of the Voice Activity and Participation Profile (SVAPP) questionnaire. A randomized, cross-sectional sampling strategy with controls was used. Two samples with a total of 169 participants were analyzed, specifically 61 men (mean age 37.02) and 108 women (mean age 37.78). Of these participants, 112 were patients and 57 were controls. The instrument was submitted to reliability (internal consistency and corrected item-total correlations) and reproducibility analyses. Validation assessment was based on the construct validity, convergent validity, discriminant validity, and concurrent validity. The global internal consistency was excellent (Cronbach's α = 0.976), corrected item-total correlations were satisfactory and ranged 0.63-0.89, and factor loadings were above 0.50. The different subscales showed good internal consistency (alpha coefficients ranged 0.830-0.956) and test-retest values were consistently associated. The exploratory factor analysis evidenced a strongly defined five factors internal structure, with factors loadings ranging 0.51-0.86. Convergent validity demonstrated that all subscales and scores were very strongly correlated (Pearson r above 0.735) and significantly associated. The discriminant validity analysis showed that SVAPP had good specificity to distinguish dysphonic from healthy voice subjects. Concurrent validity with Voice Handicap Index Spanish version (SVHI) showed very strong correlations between total scores, and between SVHI total score and SVAPP Daily and Social Communication subscales; correlations between both tests subscales were strong; only between SVAPP Work and SVHI Physical sections correlations were moderate. The findings of the present study demonstrated evidence for the SVAPP questionnaire reliability and validity, and provided insightful implications of voice disorders on Spanish patients' quality of life. However, further investigations

Reliability and Validity Testing of the Physical Resilience Measure

ERIC Educational Resources Information Center

Resnick, Barbara; Galik, Elizabeth; Dorsey, Susan; Scheve, Ann; Gutkin, Susan

2011-01-01

Objective: The purpose of this study was to test reliability and validity of the Physical Resilience Scale. Methods: A single-group repeated measure design was used and 130 older adults from three different housing sites participated. Participants completed the Physical Resilience Scale, Hardy-Gill Resilience Scale, 14-item Resilience Scale,…

Development and validation of clinical prediction models for mortality, functional outcome and cognitive impairment after stroke: a study protocol

PubMed Central

Fahey, Marion; Rudd, Anthony; Béjot, Yannick; Wolfe, Charles; Douiri, Abdel

2017-01-01

Introduction Stroke is a leading cause of adult disability and death worldwide. The neurological impairments associated with stroke prevent patients from performing basic daily activities and have enormous impact on families and caregivers. Practical and accurate tools to assist in predicting outcome after stroke at patient level can provide significant aid for patient management. Furthermore, prediction models of this kind can be useful for clinical research, health economics, policymaking and clinical decision support. Methods 2869 patients with first-ever stroke from South London Stroke Register (SLSR) (1995–2004) will be included in the development cohort. We will use information captured after baseline to construct multilevel models and a Cox proportional hazard model to predict cognitive impairment, functional outcome and mortality up to 5 years after stroke. Repeated random subsampling validation (Monte Carlo cross-validation) will be evaluated in model development. Data from participants recruited to the stroke register (2005–2014) will be used for temporal validation of the models. Data from participants recruited to the Dijon Stroke Register (1985–2015) will be used for external validation. Discrimination, calibration and clinical utility of the models will be presented. Ethics Patients, or for patients who cannot consent their relatives, gave written informed consent to participate in stroke-related studies within the SLSR. The SLSR design was approved by the ethics committees of Guy’s and St Thomas’ NHS Foundation Trust, Kings College Hospital, Queens Square and Westminster Hospitals (London). The Dijon Stroke Registry was approved by the Comité National des Registres and the InVS and has authorisation of the Commission Nationale de l’Informatique et des Libertés. PMID:28821511

A Community-Based Validation Study of the Short-Form 36 Version 2 Philippines (Tagalog) in Two Cities in the Philippines

PubMed Central

Castillo-Carandang, Nina T.; Sison, Olivia T.; Grefal, Mary Lenore; Sy, Rody G.; Alix, Oliver C.; Llanes, Elmer Jasper B.; Reganit, Paul Ferdinand M.; Gumatay, Allan Wilbert G.; Punzalan, Felix Eduardo R.; Velandria, Felicidad V.; Tai, E. Shyong; Wee, Hwee-Lin

2013-01-01

Objective To evaluate the validity and reliability of the Philippines (Tagalog) Short Form 36 Health Survey version 2 (SF-36v2®) standard questionnaire among Filipinos residing in two cities. Study Design and Setting The official Philippines (Tagalog) SF-36v2 standard (4-week recall) version was pretested on 30 participants followed by formal and informal cognitive debriefing. To obtain the feedback on translation by bilingual respondents, each SF-36v2 question was stated first in English followed by Tagalog. No revisions to the original questionnaire were needed except that participants thought it was appropriate to incorporate "po" in the instructions to make it more polite. Face-to-face interviews of 562 participants aged 20-50 years living in two barangays (villages) in the highly urbanized city of Makati City (Metro Manila) and in urban and rural barangays in Tanauan City (province of Batangas) were subsequently conducted. Content validity, item level validity, reliability and factor structure of the SF-36v2 (Tagalog) were examined. Results Content validity of the SF-36v2 was assessed to be adequate for assessing health status among Filipinos. Item means of Philippines (Tagalog) SF-36v2 were similar with comparable scales in the US English, Singapore (English and Chinese) and Thai SF-36 version 1. Item-scale correlation exceeded 0.4 for all items except the bathing item in PF (correlation: 0.31). In exploratory factor analysis, the US two-component model was supported. However, in confirmatory factor analysis, the Japanese three-component model fit the Tagalog data better than the US two-component model. Conclusions The Philippines (Tagalog) SF-36v2 is a valid and reliable instrument for measuring health status among residents of Makati City (Metro Manila) and Tanauan City (Province of Batangas). PMID:24386281

Measuring participation in patients with chronic back pain-the 5-Item Pain Disability Index.

PubMed

McKillop, Ashley B; Carroll, Linda J; Dick, Bruce D; Battié, Michele C

2018-02-01

Of the three broad outcome domains of body functions and structures, activities, and participation (eg, engaging in valued social roles) outlined in the World Health Organization's (WHO) International Classification of Functioning, Disability and Health (ICF), it has been argued that participation is the most important to individuals, particularly those with chronic health problems. Yet, participation is not commonly measured in back pain research. The aim of this study was to investigate the construct validity of a modified 5-Item Pain Disability Index (PDI) score as a measure of participation in people with chronic back pain. A validation study was conducted using cross-sectional data. Participants with chronic back pain were recruited from a multidisciplinary pain center in Alberta, Canada. The outcome measure of interest is the 5-Item PDI. Each study participant was given a questionnaire package containing measures of participation, resilience, anxiety and depression, pain intensity, and pain-related disability, in addition to the PDI. The first five items of the PDI deal with social roles involving family responsibilities, recreation, social activities with friends, work, and sexual behavior, and comprised the 5-Item PDI seeking to measure participation. The last two items of the PDI deal with self-care and life support functions and were excluded. Construct validity of the 5-Item PDI as a measure of participation was examined using Pearson correlations or point-biserial correlations to test each hypothesized association. Participants were 70 people with chronic back pain and a mean age of 48.1 years. Forty-four (62.9%) were women. As hypothesized, the 5-Item PDI was associated with all measures of participation, including the Participation Assessment with Recombined Tools-Objective (r=-0.61), Late-Life Function and Disability Instrument: Disability Component (frequency: r=-0.66; limitation: r=-0.65), Work and Social Adjustment Scale (r=0.85), a global

Measuring reflection on participation in quality improvement activities for maintenance of certification.

PubMed

Wittich, Christopher M; Reed, Darcy A; Ting, Henry H; Berger, Richard A; Nowicki, Kelly M; Blachman, Morris J; Mandrekar, Jayawant N; Beckman, Thomas J

2014-10-01

To validate a measure of reflection on participation in quality improvement (QI) activities and to identify associations with characteristics of QI projects, participants, and teams. This was a prospective validation study of all Mayo Clinic team participants who submitted QI projects for maintenance of certification (MOC) credit from 2010 to 2012. The authors developed a measure of reflection on participation in QI activities and explored associations between participants' overall reflection scores and characteristics of projects, participants, and teams. A total of 922 participants (567 physicians) on 118 teams completed QI projects and reflections. Factor analysis revealed a two-dimensional model with good internal consistency reliabilities (Cronbach alpha) for high (0.85) and low (0.81) reflection. Reflection scores (mean [standard deviation]) were associated with projects that changed practice (yes: 4.30 [0.51]; no: 3.71 [0.57]; P < .0001), changed the health care system (yes: 4.25 [0.54]; no: 4.03 [0.62]; P < .0001), and impacted patient safety (P < .0001). Physicians' reflection scores (4.27 [0.57]) were higher than support staff scores (4.07 [0.55]; P = .0005). A positive association existed between reflection scores and the number of QI roles per participant (P < .0001). There were no associations with participant gender, team size, or team diversity. The authors identified associations between participant reflection and the impact of QI projects, participants' professional roles, and participants' involvement with projects. With further study, the authors anticipate that the new measure of reflection will be useful for determining meaningful engagement in MOC.

Measuring awareness of financial skills: reliability and validity of a new measure.

PubMed

Cramer, K; Tuokko, H A; Mateer, C A; Hultsch, D F

2004-03-01

This paper examines the psychometric properties of a three-part (participant, informant, and performance) Measure for assessing Awareness of Financial Skills (MAFS). The MAFS was administered to 10 seniors with dementia and 25 well-functioning seniors, and their informants. Measures of cognitive functioning, social desirability, neuroticism, and perceived control were administered to each participant to allow for an assessment of validity. Internal consistency estimates for the participant and informant questionnaires were found to be 0.92 and 0.97, respectively. Convergent validity analysis indicated that performance on this measure was related to level of cognitive functioning, with higher level of unawareness associated with decreased cognitive ability. Discriminant validity analysis showed that performance on this measure was not related to social desirability or neuroticism. This study provides evidence that the MAFS is a reliable and valid tool for assessing awareness of financial skills in older adults.

First quality score for referral letters in gastroenterology—a validation study

PubMed Central

Eskeland, Sigrun Losada; Brunborg, Cathrine; Seip, Birgitte; Wiencke, Kristine; Hovde, Øistein; Owen, Tanja; Skogestad, Erik; Huppertz-Hauss, Gert; Halvorsen, Fred-Arne; Garborg, Kjetil; Aabakken, Lars; de Lange, Thomas

2016-01-01

Objective To create and validate an objective and reliable score to assess referral quality in gastroenterology. Design An observational multicentre study. Setting and participants 25 gastroenterologists participated in selecting variables for a Thirty Point Score (TPS) for quality assessment of referrals to gastroenterology specialist healthcare for 9 common indications. From May to September 2014, 7 hospitals from the South-Eastern Norway Regional Health Authority participated in collecting and scoring 327 referrals to a gastroenterologist. Main outcome measure Correlation between the TPS and a visual analogue scale (VAS) for referral quality. Results The 327 referrals had an average TPS of 13.2 (range 1–25) and an average VAS of 4.7 (range 0.2–9.5). The reliability of the score was excellent, with an intra-rater intraclass correlation coefficient (ICC) of 0.87 and inter-rater ICC of 0.91. The overall correlation between the TPS and the VAS was moderate (r=0.42), and ranged from fair to substantial for the various indications. Mean agreement was good (ICC=0.47, 95% CI (0.34 to 0.57)), ranging from poor to good. Conclusions The TPS is reliable, objective and shows good agreement with the subjective VAS. The score may be a useful tool for assessing referral quality in gastroenterology, particularly important when evaluating the effect of interventions to improve referral quality. PMID:27855107

A population based validation study of self-reported pensions and benefits: the Nord-Trøndelag health study (HUNT)

PubMed Central

2013-01-01

Background Measures of disability pensions, sickness certification and long-term health related benefits are often self-reported in epidemiological studies. Few studies have examined these measures, and the validity is yet to be established. We aimed to estimate the validity of self-reported disability pension, rehabilitation benefit and retirement pension and to explore the benefit status and basic characteristics of those not responding to these items. A large health survey (HUNT2) containing self-reported questionnaire data on sickness benefits and pensions was linked to a national registry of pensions and benefits, used as “gold standard” for the analysis. We investigated two main sources of bias in self-reported data; misclassification - due to participants answering questions incorrectly, and systematic missing/selection bias - when participants do not respond to the questions. Sensitivity, specificity, positive (PPV) and negative (NPV) predicative value, agreement and Cohen’s Kappa were calculated for each benefit. Co-variables were compared between non-responders and responders. Results In the study-population of 40,633, 9.2% reported receiving disability pension, 1.4% rehabilitation benefits and 6.1% retirement pension. According to the registry, the corresponding numbers were 9.0%, 1.7% and 5.4%. Excluding non-responders, specificity, NPV and agreement were above 98% for all benefits. Sensitivity and PPV were lower. When including non-responders as non-receivers, specificity got higher, sensitivity dropped while the other measures changed less. Between 17.7% and 24.1% did not answer the questions on benefits. Non-responders were older and more likely to be female. They reported more anxiety, more depression, a higher number of somatic diagnoses, less physical activity and lower consumption of alcohol (p < 0.001 for all variables). For disability pension and retirement pension, non-responders were less likely to receive benefits than responders

41 CFR 60-3.5 - General standards for validity studies.

Code of Federal Regulations, 2010 CFR

2010-07-01

... should avoid making employment decisions on the basis of measures of knowledges, skills, or abilities... General standards for validity studies. A. Acceptable types of validity studies. For the purposes of... of these guidelines, section 14 of this part. New strategies for showing the validity of selection...

Validation of the Female Sexual Function Index (FSFI) for web-based administration.

PubMed

Crisp, Catrina C; Fellner, Angela N; Pauls, Rachel N

2015-02-01

Web-based questionnaires are becoming increasingly valuable for clinical research. The Female Sexual Function Index (FSFI) is the gold standard for evaluating female sexual function; yet, it has not been validated in this format. We sought to validate the Female Sexual Function Index (FSFI) for web-based administration. Subjects enrolled in a web-based research survey of sexual function from the general population were invited to participate in this validation study. The first 151 respondents were included. Validation participants completed the web-based version of the FSFI followed by a mailed paper-based version. Demographic data were collected for all subjects. Scores were compared using the paired t test and the intraclass correlation coefficient. One hundred fifty-one subjects completed both web- and paper-based versions of the FSFI. Those subjects participating in the validation study did not differ in demographics or FSFI scores from the remaining subjects in the general population study. Total web-based and paper-based FSFI scores were not significantly different (mean 20.31 and 20.29 respectively, p = 0.931). The six domains or subscales of the FSFI were similar when comparing web and paper scores. Finally, intraclass correlation analysis revealed a high degree of correlation between total and subscale scores, r = 0.848-0.943, p < 0.001. Web-based administration of the FSFI is a valid alternative to the paper-based version.

The Michigan Alcoholism Screening Test (MAST): A Statistical Validation Analysis

ERIC Educational Resources Information Center

Laux, John M.; Newman, Isadore; Brown, Russ

2004-01-01

This study extends the Michigan Alcoholism Screening Test (MAST; M. L. Selzer, 1971) literature base by examining 4 issues related to the validity of the MAST scores. Specifically, the authors examine the validity of the MAST scores in light of the presence of impression management, participant demographic variables, and item endorsement…

Reproducibility and validity of the Shanghai Women's Health Study physical activity questionnaire.

PubMed

Matthews, Charles E; Shu, Xiao-Ou; Yang, Gong; Jin, Fan; Ainsworth, Barbara E; Liu, Dake; Gao, Yu-Tang; Zheng, Wei

2003-12-01

In this investigation, the authors evaluated the reproducibility and validity of the Shanghai Women's Health Study (SWHS) physical activity questionnaire (PAQ), which was administered in a cohort study of approximately 75,000 Chinese women aged 40-70 years. Reproducibility (2-year test-retest) was evaluated using kappa statistics and intraclass correlation coefficients (ICCs). Validity was evaluated by comparing Spearman correlations (r) for the SWHS PAQ with two criterion measures administered over a period of 12 months: four 7-day physical activity logs and up to 28 7-day PAQs. Women were recruited from the SWHS cohort (n = 200). Results indicated that the reproducibility of adolescent and adult exercise participation (kappa = 0.85 and kappa = 0.64, respectively) and years of adolescent exercise and adult exercise energy expenditure (ICC = 0.83 and ICC = 0.70, respectively) was reasonable. Reproducibility values for adult lifestyle activities were lower (ICC = 0.14-0.54). Significant correlations between the PAQ and criterion measures of adult exercise were observed for the first PAQ administration (physical activity log, r = 0.50; 7-day PAQ, r = 0.62) and the second PAQ administration (physical activity log, r = 0.74; 7-day PAQ, r = 0.80). Significant correlations between PAQ lifestyle activities and the 7-day PAQ were also noted (r = 0.33-0.88). These data indicate that the SWHS PAQ is a reproducible and valid measure of exercise behaviors and that it demonstrates utility in stratifying women by levels of important lifestyle activities (e.g., housework, walking, cycling).

Item Response Theory Modeling and Categorical Regression Analyses of the Five-Factor Model Rating Form: A Study on Italian Community-Dwelling Adolescent Participants and Adult Participants.

PubMed

Fossati, Andrea; Widiger, Thomas A; Borroni, Serena; Maffei, Cesare; Somma, Antonella

2017-06-01

To extend the evidence on the reliability and construct validity of the Five-Factor Model Rating Form (FFMRF) in its self-report version, two independent samples of Italian participants, which were composed of 510 adolescent high school students and 457 community-dwelling adults, respectively, were administered the FFMRF in its Italian translation. Adolescent participants were also administered the Italian translation of the Borderline Personality Features Scale for Children-11 (BPFSC-11), whereas adult participants were administered the Italian translation of the Triarchic Psychopathy Measure (TriPM). Cronbach α values were consistent with previous findings; in both samples, average interitem r values indicated acceptable internal consistency for all FFMRF scales. A multidimensional graded item response theory model indicated that the majority of FFMRF items had adequate discrimination parameters; information indices supported the reliability of the FFMRF scales. Both categorical (i.e., item-level) and scale-level regression analyses suggested that the FFMRF scores may predict a nonnegligible amount of variance in the BPFSC-11 total score in adolescent participants, and in the TriPM scale scores in adult participants.

Reaction time as an indicator of insufficient effort: Development and validation of an embedded performance validity parameter.

PubMed

Stevens, Andreas; Bahlo, Simone; Licha, Christina; Liske, Benjamin; Vossler-Thies, Elisabeth

2016-11-30

Subnormal performance in attention tasks may result from various sources including lack of effort. In this report, the derivation and validation of a performance validity parameter for reaction time is described, using a set of malingering-indices ("Slick-criteria"), and 3 independent samples of participants (total n =893). The Slick-criteria yield an estimate of the probability of malingering based on the presence of an external incentive, evidence from neuropsychological testing, from self-report and clinical data. In study (1) a validity parameter is derived using reaction time data of a sample, composed of inpatients with recent severe brain lesions not involved in litigation and of litigants with and without brain lesion. In study (2) the validity parameter is tested in an independent sample of litigants. In study (3) the parameter is applied to an independent sample comprising cooperative and non-cooperative testees. Logistic regression analysis led to a derived validity parameter based on median reaction time and standard deviation. It performed satisfactorily in studies (2) and (3) (study 2 sensitivity=0.94, specificity=1.00; study 3 sensitivity=0.79, specificity=0.87). The findings suggest that median reaction time and standard deviation may be used as indicators of negative response bias. Copyright © 2016 Elsevier Ireland Ltd. All rights reserved.

Individual and county-level religious participation, corporal punishment, and physical abuse of children: An exploratory study

PubMed Central

Wolf, Jennifer Price; Kepple, Nancy J.

2016-01-01

Background Parental religiosity has been associated with corporal punishment. However, most of this research has focused exclusively on Christians and has not examined physical abuse. Additionally, little is known about how the larger religious environment might be associated with discipline behaviors. In this exploratory study, we examine how individual and county-level religious attendance are related to corporal punishment and physical abuse. Method We sampled and surveyed 3,023 parents of children aged 12 and younger from 50 mid-sized California cities. We used weighted Poisson models to calculate the frequency of corporal punishment and physical abuse in the past year. Results Parents who attend religious groups used corporal punishment more frequently than parents who did not attend religious groups. However, those who lived in counties with greater rates of religious participation used corporal punishment less frequently than those living in counties with lower rates of religious participation. There were no effects for religious participation on physical abuse at the individual or county level. Discussion This exploratory study suggests that parents who attend religious groups may be more likely to use some types of physical discipline with children. Religious groups could be imparting parenting norms supporting corporal punishment at the individual level. More research examining specific doctrines and faiths is needed to validate the study findings. PMID:29294609

Measurement properties of questionnaires assessing participation in children and adolescents with a disability: a systematic review.

PubMed

Rainey, Linda; van Nispen, Ruth; van der Zee, Carlijn; van Rens, Ger

2014-12-01

To critically appraise the measurement properties of questionnaires measuring participation in children and adolescents (0-18 years) with a disability. Bibliographic databases were searched for studies evaluating the measurement properties of self-report or parent-report questionnaires measuring participation in children and adolescents (0-18 years) with a disability. The methodological quality of the included studies and the results of the measurement properties were evaluated using a checklist developed on consensus-based standards. The search strategy identified 3,977 unique publications, of which 22 were selected; these articles evaluated the development and measurement properties of eight different questionnaires. The Child and Adolescent Scale of Participation was evaluated most extensively, generally showing moderate positive results on content validity, internal consistency, reliability and construct validity. The remaining questionnaires also demonstrated positive results. However, at least 50 % of the measurement properties per questionnaire were not (or only poorly) assessed. Studies of high methodological quality, using modern statistical methods, are needed to accurately assess the measurement properties of currently available questionnaires. Moreover, consensus is required on the definition of the construct 'participation' to determine content validity and to enable meaningful interpretation of outcomes.

Retention of minority participants in clinical research studies.

PubMed

Keller, Colleen S; Gonzales, Adelita; Fleuriet, K Jill

2005-04-01

Recruitment of minority participants for clinical research studies has been the topic of several analytical works. Yet retention of participants, most notably minority and underserved populations, is less reported and understood, even though these populations have elevated health risks. This article describes two related, intervention-based formative research projects in which researchers used treatment theory to address issues of recruitment and retention of minority women participants in an exercise program to reduce obesity. Treatment theory incorporates a model of health promotion that allows investigators to identify and control sources of extraneous variables. The authors' research demonstrates that treatment theory can improve retention of minority women participants by considering critical inputs, mediating processes, and substantive participant characteristics in intervention design.

Reliability and Validity Study of a Tool to Measure Cancer Stigma: Patient Version

PubMed Central

Yılmaz, Medine; Dişsiz, Gülçin; Demir, Filiz; Irız, Sibel; Alacacioglu, Ahmet

2017-01-01

Objective: The aim of this methodological study is to establish the validity and reliability of the Turkish version of “A Questionnaire for Measuring Attitudes toward Cancer (Cancer Stigma) - Patient version.” Methods: The sample comprised oncology patients who had active cancer treatment. The construct validity was assessed using the confirmatory and exploratory factor analysis. Results: The mean age of the participants was 54.9±12.3 years. In the confirmatory factor analysis, fit values were determined as comparative fit index = 0.93, goodness of fit index = 0.91, normed-fit index=0.91, and root mean square error of approximation RMSEA = 0.09 (P <0.05) (Kaiser–Meyer–Olkin = 0.88, χ2 = 1084.41, Df = 66, and Barletta's test P <0.000). The first factor was “impossibility of recovery and experience of social discrimination” and the second factor was “stereotypes of cancer patients.” The two-factor structure accounted for 56.74% of the variance. The Cronbach's alpha value was determined as 0.88 for the two-factor scale. Conclusions: “A questionnaire for measuring attitudes toward cancer (cancer stigma) - Patient version” is a reliable and valid questionnaire to assess stigmatization of cancer in cancer patients. PMID:28503649

The predictive validity of selection for entry into postgraduate training in general practice: evidence from three longitudinal studies

PubMed Central

Patterson, Fiona; Lievens, Filip; Kerrin, Máire; Munro, Neil; Irish, Bill

2013-01-01

Background The selection methodology for UK general practice is designed to accommodate several thousand applicants per year and targets six core attributes identified in a multi-method job-analysis study Aim To evaluate the predictive validity of selection methods for entry into postgraduate training, comprising a clinical problem-solving test, a situational judgement test, and a selection centre. Design and setting A three-part longitudinal predictive validity study of selection into training for UK general practice. Method In sample 1, participants were junior doctors applying for training in general practice (n = 6824). In sample 2, participants were GP registrars 1 year into training (n = 196). In sample 3, participants were GP registrars sitting the licensing examination after 3 years, at the end of training (n = 2292). The outcome measures include: assessor ratings of performance in a selection centre comprising job simulation exercises (sample 1); supervisor ratings of trainee job performance 1 year into training (sample 2); and licensing examination results, including an applied knowledge examination and a 12-station clinical skills objective structured clinical examination (OSCE; sample 3). Results Performance ratings at selection predicted subsequent supervisor ratings of job performance 1 year later. Selection results also significantly predicted performance on both the clinical skills OSCE and applied knowledge examination for licensing at the end of training. Conclusion In combination, these longitudinal findings provide good evidence of the predictive validity of the selection methods, and are the first reported for entry into postgraduate training. Results show that the best predictor of work performance and training outcomes is a combination of a clinical problem-solving test, a situational judgement test, and a selection centre. Implications for selection methods for all postgraduate specialties are considered. PMID:24267856

The ad-libitum alcohol 'taste test': secondary analyses of potential confounds and construct validity.

PubMed

Jones, Andrew; Button, Emily; Rose, Abigail K; Robinson, Eric; Christiansen, Paul; Di Lemma, Lisa; Field, Matt

2016-03-01

Motivation to drink alcohol can be measured in the laboratory using an ad-libitum 'taste test', in which participants rate the taste of alcoholic drinks whilst their intake is covertly monitored. Little is known about the construct validity of this paradigm. The objective of this study was to investigate variables that may compromise the validity of this paradigm and its construct validity. We re-analysed data from 12 studies from our laboratory that incorporated an ad-libitum taste test. We considered time of day and participants' awareness of the purpose of the taste test as potential confounding variables. We examined whether gender, typical alcohol consumption, subjective craving, scores on the Alcohol Use Disorders Identification Test and perceived pleasantness of the drinks predicted ad-libitum consumption (construct validity). We included 762 participants (462 female). Participant awareness and time of day were not related to ad-libitum alcohol consumption. Males drank significantly more alcohol than females (p < 0.001), and individual differences in typical alcohol consumption (p = 0.04), craving (p < 0.001) and perceived pleasantness of the drinks (p = 0.04) were all significant predictors of ad-libitum consumption. We found little evidence that time of day or participant awareness influenced alcohol consumption. The construct validity of the taste test was supported by relationships between ad-libitum consumption and typical alcohol consumption, craving and pleasantness ratings of the drinks. The ad-libitum taste test is a valid method for the assessment of alcohol intake in the laboratory.

The prone bridge test: Performance, validity, and reliability among older and younger adults.

PubMed

Bohannon, Richard W; Steffl, Michal; Glenney, Susan S; Green, Michelle; Cashwell, Leah; Prajerova, Kveta; Bunn, Jennifer

2018-04-01

The prone bridge maneuver, or plank, has been viewed as a potential alternative to curl-ups for assessing trunk muscle performance. The purpose of this study was to assess prone bridge test performance, validity, and reliability among younger and older adults. Sixty younger (20-35 years old) and 60 older (60-79 years old) participants completed this study. Groups were evenly divided by sex. Participants completed surveys regarding physical activity and abdominal exercise participation. Height, weight, body mass index (BMI), and waist circumference were measured. On two occasions, 5-9 days apart, participants held a prone bridge until volitional exhaustion or until repeated technique failure. Validity was examined using data from the first session: convergent validity by calculating correlations between survey responses, anthropometrics, and prone bridge time, known groups validity by using an ANOVA comparing bridge times of younger and older adults and of men and women. Test-retest reliability was examined by using a paired t-test to compare prone bridge times for Session1 and Session 2. Furthermore, an intraclass correlation coefficient (ICC) was used to characterize relative reliability and minimal detectable change (MDC 95% ) was used to describe absolute reliability. The mean prone bridge time was 145.3 ± 71.5 s, and was positively correlated with physical activity participation (p ≤ 0.001) and negatively correlated with BMI and waist circumference (p ≤ 0.003). Younger participants had significantly longer plank times than older participants (p = 0.003). The ICC between testing sessions was 0.915. The prone bridge test is a valid and reliable measure for evaluating abdominal performance in both younger and older adults. Copyright © 2017 Elsevier Ltd. All rights reserved.

Validation of the Motivation to Teach Scale

ERIC Educational Resources Information Center

Kauffman, Douglas F.; Yilmaz Soylu, Meryem; Duke, Bryan

2011-01-01

The purpose of this study was to develop and validate a self-report psychological instrument assessing pre-service teachers' relative intrinsic and extrinsic motivation to teach. One hundred forty seven undergraduate students taking Educational Psychology courses from a large US University participated in this study completed the 12 item MTS along…

Predictors of Study Abroad Intent, Participation, and College Outcomes

ERIC Educational Resources Information Center

Luo, Jiali; Jamieson-Drake, David

2015-01-01

This study examined US undergraduate students' intent to study abroad upon college entry and their actual participation in study abroad during their undergraduate years, correlating the college outcomes of three cohorts to identify trends. The findings show that study abroad intent and participation are interrelated and shaped by an array of…

Concurrent and face validity of the MacArthur scale for assessing subjective social status: Brazilian Longitudinal Study of Adult Health (ELSA-Brasil).

PubMed

Ferreira, Wasney de Almeida; Giatti, Luana; Figueiredo, Roberta Carvalho de; Mello, Heliana Ribeiro de; Barreto, Sandhi Maria

2018-04-01

This work assessed the concurrent and face validity of the MacArthur scale, which attempts to capture subjective social status in society, neighborhood and work contexts. The study population comprised a convenience sample made up of 159 adult participants of the ELSA-Brasil cohort study conducted in Minas Gerais between 2012 and 2014. The analysis was conducted drawing on Conceptual Metaphor Theory and using corpus linguistic methods. Concurrent validity was shown to be moderate for the society ladder (Kappaw = 0.55) and good for the neighborhood (Kappaw = 0.60) and work (Kappaw = 0,67) ladders. Face validity indicated that the MacArthur scale really captures subjective social status across indicators of socioeconomic position, thus confirming that it is a valuable tool for the study of social inequalities in health Brazil.

Validity and Reliability of the Academic Resilience Scale in Turkish High School

ERIC Educational Resources Information Center

Kapikiran, Sahin

2012-01-01

The present study aims to determine the validity and reliability of the academic resilience scale in Turkish high school. The participances of the study includes 378 high school students in total (192 female and 186 male). A set of analyses were conducted in order to determine the validity and reliability of the study. Firstly, both exploratory…

Design and validation of instruments to measure knowledge.

PubMed

Elliott, T E; Regal, R R; Elliott, B A; Renier, C M

2001-01-01

Measuring health care providers' learning after they have participated in educational interventions that use experimental designs requires valid, reliable, and practical instruments. A literature review was conducted. In addition, experience gained from designing and validating instruments for measuring the effect of an educational intervention informed this process. The eight main steps for designing, validating, and testing the reliability of instruments for measuring learning outcomes are presented. The key considerations and rationale for this process are discussed. Methods for critiquing and adapting existent instruments and creating new ones are offered. This study may help other investigators in developing valid, reliable, and practical instruments for measuring the outcomes of educational activities.

A prospective study evaluating cochlear implant management skills: development and validation of the Cochlear Implant Management Skills survey.

PubMed

Bennett, R J; Jayakody, D M P; Eikelboom, R H; Taljaard, D S; Atlas, M D

2016-02-01

To investigate the ability of cochlear implant (CI) recipients to physically handle and care for their hearing implant device(s) and to identify factors that may influence skills. To assess device management skills, a clinical survey was developed and validated on a clinical cohort of CI recipients. Survey development and validation. A prospective convenience cohort design study. Specialist hearing implant clinic. Forty-nine post-lingually deafened, adult CI recipients, at least 12 months postoperative. Survey test-retest reliability, interobserver reliability and responsiveness. Correlations between management skills and participant demographic, audiometric, clinical outcomes and device factors. The Cochlear Implant Management Skills survey was developed, demonstrating high test-retest reliability (0.878), interobserver reliability (0.972) and responsiveness to intervention (skills training) [t(20) = -3.913, P = 0.001]. Cochlear Implant Management Skills survey scores range from 54.69% to 100% (mean: 83.45%, sd: 12.47). No associations were found between handling skills and participant factors. This is the first study to demonstrate a range in cochlear implant device handling skills in CI recipients and offers clinicians and researchers a tool to systematically and objectively identify shortcomings in CI recipients' device handling skills. © 2015 John Wiley & Sons Ltd.

Assessment of the Validity of the Research Diagnostic Criteria for Temporomandibular Disorders: Overview and Methodology

PubMed Central

Schiffman, Eric L.; Truelove, Edmond L.; Ohrbach, Richard; Anderson, Gary C.; John, Mike T.; List, Thomas; Look, John O.

2011-01-01

AIMS The purpose of the Research Diagnostic Criteria for Temporomandibular Disorders (RDC/TMD) Validation Project was to assess the diagnostic validity of this examination protocol. An overview is presented, including Axis I and II methodology and descriptive statistics for the study participant sample. This paper details the development of reliable methods to establish the reference standards for assessing criterion validity of the Axis I RDC/TMD diagnoses. Validity testing for the Axis II biobehavioral instruments was based on previously validated reference standards. METHODS The Axis I reference standards were based on the consensus of 2 criterion examiners independently performing a comprehensive history, clinical examination, and evaluation of imaging. Intersite reliability was assessed annually for criterion examiners and radiologists. Criterion exam reliability was also assessed within study sites. RESULTS Study participant demographics were comparable to those of participants in previous studies using the RDC/TMD. Diagnostic agreement of the criterion examiners with each other and with the consensus-based reference standards was excellent with all kappas ≥ 0.81, except for osteoarthrosis (moderate agreement, k = 0.53). Intrasite criterion exam agreement with reference standards was excellent (k ≥ 0.95). Intersite reliability of the radiologists for detecting computed tomography-disclosed osteoarthrosis and magnetic resonance imaging-disclosed disc displacement was good to excellent (k = 0.71 and 0.84, respectively). CONCLUSION The Validation Project study population was appropriate for assessing the reliability and validity of the RDC/TMD Axis I and II. The reference standards used to assess the validity of Axis I TMD were based on reliable and clinically credible methods. PMID:20213028

Beware of external validation! - A Comparative Study of Several Validation Techniques used in QSAR Modelling.

PubMed

Majumdar, Subhabrata; Basak, Subhash C

2018-04-26

Proper validation is an important aspect of QSAR modelling. External validation is one of the widely used validation methods in QSAR where the model is built on a subset of the data and validated on the rest of the samples. However, its effectiveness for datasets with a small number of samples but large number of predictors remains suspect. Calculating hundreds or thousands of molecular descriptors using currently available software has become the norm in QSAR research, owing to computational advances in the past few decades. Thus, for n chemical compounds and p descriptors calculated for each molecule, the typical chemometric dataset today has high value of p but small n (i.e. n < p). Motivated by the evidence of inadequacies of external validation in estimating the true predictive capability of a statistical model in recent literature, this paper performs an extensive and comparative study of this method with several other validation techniques. We compared four validation methods: leave-one-out, K-fold, external and multi-split validation, using statistical models built using the LASSO regression, which simultaneously performs variable selection and modelling. We used 300 simulated datasets and one real dataset of 95 congeneric amine mutagens for this evaluation. External validation metrics have high variation among different random splits of the data, hence are not recommended for predictive QSAR models. LOO has the overall best performance among all validation methods applied in our scenario. Results from external validation are too unstable for the datasets we analyzed. Based on our findings, we recommend using the LOO procedure for validating QSAR predictive models built on high-dimensional small-sample data. Copyright© Bentham Science Publishers; For any queries, please email at epub@benthamscience.org.

Don't ask, don't tell: a systematic review of the extent to which participant characteristics are reported in social anxiety treatment studies.

PubMed

Johnson, Suzanne B; Anderson, Page L

2016-11-01

This study examined the extent to which social anxiety treatment studies report the demographic characteristics of their participants. One hundred and 56 treatment studies published in English between 2001 and 2012 articles were collected. Each study was evaluated on whether or not it reported information on gender, age, race, relationship status, education, socioeconomic status, sexual orientation, and disability and also the extent to which the racial composition of the sample was described. The majority of studies reported information on age (96.2%) and gender (94.2%), but the percentage of studies that reported anything else is much lower: race (50.0%), education (42.3%), relationship status (37.8%), socioeconomic status (5.1%), disability (2.6%), and sexual orientation (1.3%). One third (34.0%) of studies reported the race of all participants in their samples, while the remaining reported no information or information for only a subset of participants (e.g. "mostly white"). Participants of social anxiety disorder treatment studies generally are not described beyond their age and gender. Standards for reporting participant characteristics of treatment studies (similar to standards for reporting the methodology of treatment studies) could improve clinical researchers' and clinicians' ability to evaluate the external validity of this body of work.

Parent Reports of Young Spanish-English Bilingual Children's Productive Vocabulary: A Development and Validation Study.

PubMed

Mancilla-Martinez, Jeannette; Gámez, Perla B; Vagh, Shaher Banu; Lesaux, Nonie K

2016-01-01

This 2-phase study aims to extend research on parent report measures of children's productive vocabulary by investigating the development (n = 38) of the Spanish Vocabulary Extension and validity (n = 194) of the 100-item Spanish and English MacArthur-Bates Communicative Development Inventories Toddler Short Forms and Upward Extension (Fenson et al., 2000, 2007; Jackson-Maldonado, Marchman, & Fernald, 2013) and the Spanish Vocabulary Extension for use with parents from low-income homes and their 24- to 48-month-old Spanish-English bilingual children. Study participants were drawn from Early Head Start and Head Start collaborative programs in the Northeastern United States in which English was the primary language used in the classroom. All families reported Spanish or Spanish-English as their home language(s). The MacArthur Communicative Development Inventories as well as the researcher-designed Spanish Vocabulary Extension were used as measures of children's English and Spanish productive vocabularies. Findings revealed the forms' concurrent and discriminant validity, on the basis of standardized measures of vocabulary, as measures of productive vocabulary for this growing bilingual population. These findings suggest that parent reports, including our researcher-designed form, represent a valid, cost-effective mechanism for vocabulary monitoring purposes in early childhood education settings.

Validation of standard operating procedures in a multicenter retrospective study to identify -omics biomarkers for chronic low back pain.

PubMed

Dagostino, Concetta; De Gregori, Manuela; Gieger, Christian; Manz, Judith; Gudelj, Ivan; Lauc, Gordan; Divizia, Laura; Wang, Wei; Sim, Moira; Pemberton, Iain K; MacDougall, Jane; Williams, Frances; Van Zundert, Jan; Primorac, Dragan; Aulchenko, Yurii; Kapural, Leonardo; Allegri, Massimo

2017-01-01

Chronic low back pain (CLBP) is one of the most common medical conditions, ranking as the greatest contributor to global disability and accounting for huge societal costs based on the Global Burden of Disease 2010 study. Large genetic and -omics studies provide a promising avenue for the screening, development and validation of biomarkers useful for personalized diagnosis and treatment (precision medicine). Multicentre studies are needed for such an effort, and a standardized and homogeneous approach is vital for recruitment of large numbers of participants among different centres (clinical and laboratories) to obtain robust and reproducible results. To date, no validated standard operating procedures (SOPs) for genetic/-omics studies in chronic pain have been developed. In this study, we validated an SOP model that will be used in the multicentre (5 centres) retrospective "PainOmics" study, funded by the European Community in the 7th Framework Programme, which aims to develop new biomarkers for CLBP through three different -omics approaches: genomics, glycomics and activomics. The SOPs describe the specific procedures for (1) blood collection, (2) sample processing and storage, (3) shipping details and (4) cross-check testing and validation before assays that all the centres involved in the study have to follow. Multivariate analysis revealed the absolute specificity and homogeneity of the samples collected by the five centres for all genetics, glycomics and activomics analyses. The SOPs used in our multicenter study have been validated. Hence, they could represent an innovative tool for the correct management and collection of reliable samples in other large-omics-based multicenter studies.

Cross-cultural construct validity study of professionalism of Vietnamese medical students.

PubMed

Nhan, Vo Thanh; Violato, Claudio; Le An, Pham; Beran, Tanya N

2014-01-01

Although many studies have made efforts to define and assess medical professionalism, few have addressed issues of construct validity. The purpose of this article is to explore further construct validity of medical professionalism employing exploratory and confirmatory factor analysis. The 32-item instrument by the American Board of Internal Medicine (ABIM) was adapted to assess the perceptions on medical professionalism of Vietnamese medical students. A sample of 1,196 (487 first-year, 341 third-year, 368 sixth-year) medical students participated voluntarily in the completion of the instrument. The data were randomly divided into three samples to assess the construct validity of medical professionalism by empirically deriving and confirming a model of professionalism. Exploratory and confirmatory factor analytic techniques resulted in a six-factor well-fitting model with a comparative fit index of .963 and root mean square error approximation of .029, 90% confidence interval [016, .039]: integrity, social responsibility, professional practice habits, ensuring quality care, altruism, and self-awareness. Social responsibility was perceived least important, and self-awareness was perceived most important by Vietnamese medical students. These constructs of medical professionalism were relatively similar with those found in Taiwanese medical students and the ABIM definitions but with some Vietnamese cultural differences. Although the results confirm that medical professionalism is a somewhat culturally sensitive construct, it nonetheless has many elements of medical professionalism that are universal. Future research should be conducted to test the generalizability of our six-factor model of professionalism with various samples (e.g., residents, physicians), cultures, and language groups.

29 CFR 1607.7 - Use of other validity studies.

Code of Federal Regulations, 2012 CFR

2012-07-01

... EMPLOYEE SELECTION PROCEDURES (1978) General Principles § 1607.7 Use of other validity studies. A. Validity studies not conducted by the user. Users may, under certain circumstances, support the use of selection... described in test manuals. While publishers of selection procedures have a professional obligation to...

29 CFR 1607.7 - Use of other validity studies.

Code of Federal Regulations, 2014 CFR

2014-07-01

... EMPLOYEE SELECTION PROCEDURES (1978) General Principles § 1607.7 Use of other validity studies. A. Validity studies not conducted by the user. Users may, under certain circumstances, support the use of selection... described in test manuals. While publishers of selection procedures have a professional obligation to...

29 CFR 1607.7 - Use of other validity studies.

Code of Federal Regulations, 2013 CFR

2013-07-01

... EMPLOYEE SELECTION PROCEDURES (1978) General Principles § 1607.7 Use of other validity studies. A. Validity studies not conducted by the user. Users may, under certain circumstances, support the use of selection... described in test manuals. While publishers of selection procedures have a professional obligation to...

Sport Participation and Academic Achievement: A Longitudinal Study.

PubMed

Dyer, Angela M; Kristjansson, Alfgeir L; Mann, Michael J; Smith, Megan L; Allegrante, John P

2017-03-01

We examined the relation- ship between sport participation and academic achievement in a sample of adolescents, while accounting for socioeconomic status (SES) and sex. We analyzed data from a cohort of 271 Mid-Atlantic high school students who participated in a longitudinal study of risk and protective factors for substance use, teen parenting, and school drop out. Sport participation at year one predicted academic achievement in English (p < .05) and mathematics (p < .05) at year 2, while controlling for academic achievement at year one. In both instances over other independent variables and covariates in the models, sport participation explains almost 7% of additional variance in the outcomes variables. We also found a positive relationship for participants who reported parents with some college experience as opposed to parents with no college experience, between sport participation and grades in English (p < .05) but not for mathematics. Sport participation is positively related to academic achievement but the relationship diverges when students are compared across sex and by parental education. These findings suggest that the relation ship between sport participation and academic achievement may be influenced by SES and is related to sex.

Measuring Long-Distance Romantic Relationships: A Validity Study

ERIC Educational Resources Information Center

Pistole, M. Carole; Roberts, Amber

2011-01-01

This study investigated aspects of construct validity for the scores of a new long-distance romantic relationship measure. A single-factor structure of the long-distance romantic relationship index emerged, with convergent and discriminant evidence of external validity, high internal consistency reliability, and applied utility of the scores.…

The Self-Consciousness Scale: A Discriminant Validity Study

ERIC Educational Resources Information Center

Carver, Charles S.; Glass, David C.

1976-01-01

A validity study is conducted of the Self-Consciousness Scale components with male undergraduates. The components, Private and Public Self Consciousness and Social Anxiety did not correlate with any other measures used to establish their validity and thus seem to be independent of other measures tested. (Author/DEP)

Development and validation of clinical prediction models for mortality, functional outcome and cognitive impairment after stroke: a study protocol.

PubMed

Fahey, Marion; Rudd, Anthony; Béjot, Yannick; Wolfe, Charles; Douiri, Abdel

2017-08-18

Stroke is a leading cause of adult disability and death worldwide. The neurological impairments associated with stroke prevent patients from performing basic daily activities and have enormous impact on families and caregivers. Practical and accurate tools to assist in predicting outcome after stroke at patient level can provide significant aid for patient management. Furthermore, prediction models of this kind can be useful for clinical research, health economics, policymaking and clinical decision support. 2869 patients with first-ever stroke from South London Stroke Register (SLSR) (1995-2004) will be included in the development cohort. We will use information captured after baseline to construct multilevel models and a Cox proportional hazard model to predict cognitive impairment, functional outcome and mortality up to 5 years after stroke. Repeated random subsampling validation (Monte Carlo cross-validation) will be evaluated in model development. Data from participants recruited to the stroke register (2005-2014) will be used for temporal validation of the models. Data from participants recruited to the Dijon Stroke Register (1985-2015) will be used for external validation. Discrimination, calibration and clinical utility of the models will be presented. Patients, or for patients who cannot consent their relatives, gave written informed consent to participate in stroke-related studies within the SLSR. The SLSR design was approved by the ethics committees of Guy's and St Thomas' NHS Foundation Trust, Kings College Hospital, Queens Square and Westminster Hospitals (London). The Dijon Stroke Registry was approved by the Comité National des Registres and the InVS and has authorisation of the Commission Nationale de l'Informatique et des Libertés. © Article author(s) (or their employer(s) unless otherwise stated in the text of the article) 2017. All rights reserved. No commercial use is permitted unless otherwise expressly granted.

Construct validity of the individual work performance questionnaire.

PubMed

Koopmans, Linda; Bernaards, Claire M; Hildebrandt, Vincent H; de Vet, Henrica C W; van der Beek, Allard J

2014-03-01

To examine the construct validity of the Individual Work Performance Questionnaire (IWPQ). A total of 1424 Dutch workers from three occupational sectors (blue, pink, and white collar) participated in the study. First, IWPQ scores were correlated with related constructs (convergent validity). Second, differences between known groups were tested (discriminative validity). First, IWPQ scores correlated weakly to moderately with absolute and relative presenteeism, and work engagement. Second, significant differences in IWPQ scores were observed for workers differing in job satisfaction, and workers differing in health. Overall, the results indicate acceptable construct validity of the IWPQ. Researchers are provided with a reliable and valid instrument to measure individual work performance comprehensively and generically, among workers from different occupational sectors, with and without health problems.

Validated and longitudinally stable asthma phenotypes based on cluster analysis of the ADEPT study.

PubMed

Loza, Matthew J; Djukanovic, Ratko; Chung, Kian Fan; Horowitz, Daniel; Ma, Keying; Branigan, Patrick; Barnathan, Elliot S; Susulic, Vedrana S; Silkoff, Philip E; Sterk, Peter J; Baribaud, Frédéric

2016-12-15

Asthma is a disease of varying severity and differing disease mechanisms. To date, studies aimed at stratifying asthma into clinically useful phenotypes have produced a number of phenotypes that have yet to be assessed for stability and to be validated in independent cohorts. The aim of this study was to define and validate, for the first time ever, clinically driven asthma phenotypes using two independent, severe asthma cohorts: ADEPT and U-BIOPRED. Fuzzy partition-around-medoid clustering was performed on pre-specified data from the ADEPT participants (n = 156) and independently on data from a subset of U-BIOPRED asthma participants (n = 82) for whom the same variables were available. Models for cluster classification probabilities were derived and applied to the 12-month longitudinal ADEPT data and to a larger subset of the U-BIOPRED asthma dataset (n = 397). High and low type-2 inflammation phenotypes were defined as high or low Th2 activity, indicated by endobronchial biopsies gene expression changes downstream of IL-4 or IL-13. Four phenotypes were identified in the ADEPT (training) cohort, with distinct clinical and biomarker profiles. Phenotype 1 was "mild, good lung function, early onset", with a low-inflammatory, predominantly Type-2, phenotype. Phenotype 2 had a "moderate, hyper-responsive, eosinophilic" phenotype, with moderate asthma control, mild airflow obstruction and predominant Type-2 inflammation. Phenotype 3 had a "mixed severity, predominantly fixed obstructive, non-eosinophilic and neutrophilic" phenotype, with moderate asthma control and low Type-2 inflammation. Phenotype 4 had a "severe uncontrolled, severe reversible obstruction, mixed granulocytic" phenotype, with moderate Type-2 inflammation. These phenotypes had good longitudinal stability in the ADEPT cohort. They were reproduced and demonstrated high classification probability in two subsets of the U-BIOPRED asthma cohort. Focusing on the biology of the four clinical

Characteristics of School Districts That Participate in Rigorous National Educational Evaluations

PubMed Central

Stuart, Elizabeth A.; Bell, Stephen H.; Ebnesajjad, Cyrus; Olsen, Robert B.; Orr, Larry L.

2017-01-01

Given increasing interest in evidence-based policy, there is growing attention to how well the results from rigorous program evaluations may inform policy decisions. However, little attention has been paid to documenting the characteristics of schools or districts that participate in rigorous educational evaluations, and how they compare to potential target populations for the interventions that were evaluated. Utilizing a list of the actual districts that participated in 11 large-scale rigorous educational evaluations, we compare those districts to several different target populations of districts that could potentially be affected by policy decisions regarding the interventions under study. We find that school districts that participated in the 11 rigorous educational evaluations differ from the interventions’ target populations in several ways, including size, student performance on state assessments, and location (urban/rural). These findings raise questions about whether, as currently implemented, the results from rigorous impact studies in education are likely to generalize to the larger set of school districts—and thus schools and students—of potential interest to policymakers, and how we can improve our study designs to retain strong internal validity while also enhancing external validity. PMID:29276552

Life Participation for Parents: a tool for family-centered occupational therapy.

PubMed

Fingerhut, Patricia E

2013-01-01

This study describes the continued development of the Life Participation for Parents (LPP), a measurement tool to facilitate family-centered pediatric practice. LPP questionnaires were completed by 162 parents of children with special needs receiving intervention at 15 pediatric private practice clinics. Results were analyzed to establish instrument reliability and validity. Good internal consistency (α = .90) and test-retest reliability (r = .89) were established. Construct validity was examined through assessment of internal structure and comparison of the instrument to related variables. A principal components analysis resulted in a two-factor model accounting for 43.81% of the variance. As hypothesized, the LPP correlated only moderately with the Parenting Stress Index-Short Form (r = .54). The variables of child's diagnoses, age, and time in therapy did not predict parental responses. The LPP is a reliable and valid instrument for measuring satisfaction with parental participation in life occupations. Copyright © 2013 by the American Occupational Therapy Association, Inc.

The Brief Fear of Negative Evaluation Scale (BFNE): translation and validation study of the Iranian version

PubMed Central

Tavoli, Azadeh; Melyani, Mahdiyeh; Bakhtiari, Maryam; Ghaedi, Gholam Hossein; Montazeri, Ali

2009-01-01

Background The Brief Fear of Negative Evaluation Scale (BFNE) is a commonly used instrument to measure social anxiety. This study aimed to translate and to test the reliability and validity of the BFNE in Iran. Methods The English language version of the BFNE was translated into Persian (Iranian language) and was used in this study. The questionnaire was administered to a consecutive sample of 235 students with (n = 33, clinical group) and without social phobia (n = 202, non-clinical group). In addition to the BFNE, two standard instruments were used to measure social phobia severity: the Social Phobia Inventory (SPIN), and the Social Interaction Anxiety Scale (SIAS). All participants completed a brief background information questionnaire, the SPIN, the SIAS and the BFNE scales. Statistical analysis was performed to test the reliability and validity of the BFNE. Results In all 235 students were studied (111 male and 124 female). The mean age for non-clinical group was 22.2 (SD = 2.1) years and for clinical sample it was 22.4 (SD = 1.8) years. Cronbach's alpha coefficient (to test reliability) was acceptable for both non-clinical and clinical samples (α = 0.90 and 0.82 respectively). In addition, 3-week test-retest reliability was performed in non-clinical sample and the intraclass correlation coefficient (ICC) was quite high (ICC = 0.71). Validity as performed using convergent and discriminant validity showed satisfactory results. The questionnaire correlated well with established measures of social phobia such as the SPIN (r = 0.43, p < 0.001) and the SIAS (r = 0.54, p < 0.001). Also the BFNE discriminated well between men and women with and without social phobia in the expected direction. Factor analysis supported a two-factor solution corresponding to positive and reverse-worded items. Conclusion This validation study of the Iranian version of BFNE proved that it is an acceptable, reliable and valid measure of social phobia. However, since the scale showed a

The Brief Fear of Negative Evaluation Scale (BFNE): translation and validation study of the Iranian version.

PubMed

Tavoli, Azadeh; Melyani, Mahdiyeh; Bakhtiari, Maryam; Ghaedi, Gholam Hossein; Montazeri, Ali

2009-07-09

The Brief Fear of Negative Evaluation Scale (BFNE) is a commonly used instrument to measure social anxiety. This study aimed to translate and to test the reliability and validity of the BFNE in Iran. The English language version of the BFNE was translated into Persian (Iranian language) and was used in this study. The questionnaire was administered to a consecutive sample of 235 students with (n = 33, clinical group) and without social phobia (n = 202, non-clinical group). In addition to the BFNE, two standard instruments were used to measure social phobia severity: the Social Phobia Inventory (SPIN), and the Social Interaction Anxiety Scale (SIAS). All participants completed a brief background information questionnaire, the SPIN, the SIAS and the BFNE scales. Statistical analysis was performed to test the reliability and validity of the BFNE. In all 235 students were studied (111 male and 124 female). The mean age for non-clinical group was 22.2 (SD = 2.1) years and for clinical sample it was 22.4 (SD = 1.8) years. Cronbach's alpha coefficient (to test reliability) was acceptable for both non-clinical and clinical samples (alpha = 0.90 and 0.82 respectively). In addition, 3-week test-retest reliability was performed in non-clinical sample and the intraclass correlation coefficient (ICC) was quite high (ICC = 0.71). Validity as performed using convergent and discriminant validity showed satisfactory results. The questionnaire correlated well with established measures of social phobia such as the SPIN (r = 0.43, p < 0.001) and the SIAS (r = 0.54, p < 0.001). Also the BFNE discriminated well between men and women with and without social phobia in the expected direction. Factor analysis supported a two-factor solution corresponding to positive and reverse-worded items. This validation study of the Iranian version of BFNE proved that it is an acceptable, reliable and valid measure of social phobia. However, since the scale showed a two-factor structure and this does

Validation and Reliability of a Smartphone Application for the International Prostate Symptom Score Questionnaire: A Randomized Repeated Measures Crossover Study

PubMed Central

Shim, Sung Ryul; Sun, Hwa Yeon; Ko, Young Myoung; Chun, Dong-Il; Yang, Won Jae

2014-01-01

Background Smartphone-based assessment may be a useful diagnostic and monitoring tool for patients. There have been many attempts to create a smartphone diagnostic tool for clinical use in various medical fields but few have demonstrated scientific validity. Objective The purpose of this study was to develop a smartphone application of the International Prostate Symptom Score (IPSS) and to demonstrate its validity and reliability. Methods From June 2012 to May 2013, a total of 1581 male participants (≥40 years old), with or without lower urinary tract symptoms (LUTS), visited our urology clinic via the health improvement center at Soonchunhyang University Hospital (Republic of Korea) and were enrolled in this study. A randomized repeated measures crossover design was employed using a smartphone application of the IPSS and the conventional paper form of the IPSS. Paired t test under a hypothesis of non-inferior trial was conducted. For the reliability test, the intraclass correlation coefficient (ICC) was measured. Results The total score of the IPSS (P=.289) and each item of the IPSS (P=.157-1.000) showed no differences between the paper version and the smartphone version of the IPSS. The mild, moderate, and severe LUTS groups showed no differences between the two versions of the IPSS. A significant correlation was noted in the total group (ICC=.935, P<.001). The mild, moderate, and severe LUTS groups also showed significant correlations (ICC=.616, .549, and .548 respectively, all P<.001).There was selection bias in this study, as only participants who had smartphones could participate. Conclusions The validity and reliability of the smartphone application version were comparable to the conventional paper version of the IPSS. The smartphone application of the IPSS could be an effective method for measuring lower urinary tract symptoms. PMID:24513507

Validation of the 10/66 Dementia Research Group diagnostic assessment for dementia in Arabic: a study in Lebanon

PubMed Central

Phung, Kieu T. T.; Chaaya, Monique; Waldemar, Gunhild; Atweh, Samir; Asmar, Khalil; Ghusn, Husam; Karam, Georges; Sawaya, Raja; Khoury, Rose Mary; Zeinaty, Ibrahim; Salman, Sandrine; Hammoud, Salem; Radwan, Wael; Bassil, Nazem; Prince, Martin

2014-01-01

Objectives In the North Africa and Middle East region, the illiteracy rates among older people are high, posing a great challenge to cognitive assessment. Validated diagnostic instruments for dementia in Arabic are lacking, hampering the development of dementia research in the region. The study aimed at validating the Arabic version of the 10/66 Dementia Research Group (DRG) diagnostic assessment for dementia to determine if it is suitable for case ascertainment in epidemiological research. Methods 244 participants older than 65 years were included, 100 with normal cognition and 144 with mild to moderate dementia. Dementia was diagnosed by clinicians according to DSM-IV criteria. Depression was diagnosed using the Geriatric Mental State. Trained interviewers blind to the cognitive status of the participants administered the 10/66 DRG diagnostic assessment to the participants and interviewed the caregivers. The discriminatory ability of the 10/66 DRG assessment and its subcomponents were evaluated against the clinical diagnoses. Results Half of the participants had no formal education and 49% of them were depressed. The 10/66 DRG diagnostic assessment showed excellent sensitivity (92.0%), specificity (95.1%), positive predictive value (PPV, 92.9%), and low false positive rates (FPR) among controls with no formal education (8.1%) and depression (5.6%). Each subcomponent of the 10/66 DRG diagnostic assessment independently predicted dementia diagnosis. The predictive ability of the 10/66 DRG assessment was superior to that of its subcomponents. Conclusion 10/66 DRG diagnostic assessment for dementia is well suited for case ascertainment in epidemiological studies among Arabic speaking older population with high prevalence of illiteracy. PMID:24771602

Lymphoedema Functioning, Disability and Health Questionnaire for Lower Limb Lymphoedema (Lymph-ICF-LL): reliability and validity.

PubMed

Devoogdt, Nele; De Groef, An; Hendrickx, Ad; Damstra, Robert; Christiaansen, Anke; Geraerts, Inge; Vervloesem, Nele; Vergote, Ignace; Van Kampen, Marijke

2014-05-01

Patients may develop primary (congenital) or secondary (acquired) lymphedema, causing significant physical and psychosocial problems. To plan treatment for lymphedema and monitor a patient's progress, swelling, and problems in functioning associated with lymphedema development should be assessed at baseline and follow-up. The purpose of this study was to investigate the reliability (test-retest, internal consistency, and measurement variability) and validity (content and construct) of data obtained with the Lymphoedema Functioning, Disability and Health Questionnaire for Lower Limb Lymphoedema (Lymph-ICF-LL). This was a multicenter, cross-sectional study. The Lymph-ICF-LL is a descriptive, evaluative tool containing 28 questions about impairments in function, activity limitations, and participation restrictions in patients with lower limb lymphedema. The questionnaire has 5 domains: physical function, mental function, general tasks/household activities, mobility activities, and life domains/social life. The reliability and validity of the Lymph-ICF-LL were examined in 30 participants with objective lower limb lymphedema. Intraclass correlation coefficients for test-retest reliability ranged from .69 to .94, and Cronbach alpha coefficients for internal consistency ranged from .82 to .97. Measurement variability was acceptable (standard error of measurement=5.9-12.6). Content validity was good because all questions were understandable for 93% of participants, the scoring system (visual analog scale) was clear, and the questionnaire was comprehensive for 90% of participants. Construct validity was good. All hypotheses for assessing convergent validity and divergent validity were accepted. The known-groups validity and responsiveness of the Dutch Lymph-ICF-LL and the cross-cultural validity of the English version of the Lymph-ICF-LL were not investigated. The Lymph-ICF-LL is a Dutch questionnaire with evidence of reliability and validity for assessing impairments in

I Spy with My Little Eye: Jurors' Detection of Internal Validity Threats in Expert Evidence

PubMed Central

McAuliff, Bradley D.; Duckworth, Tejah D.

2010-01-01

This experiment examined whether jury-eligible community members (N = 223) were able to detect internally invalid psychological science presented at trial. Participants read a simulated child sexual abuse case in which the defense expert described a study he had conducted on witness memory and suggestibility. We varied the study's internal validity (valid, missing control group, confound, and experimenter bias) and publication status (published, unpublished). Expert evidence quality ratings were higher for the valid versus missing control group version only. Publication increased ratings of defendant guilt when the study was missing a control group. Variations in internal validity did not influence perceptions of child victim credibility or police interview quality. Participants' limited detection of internal validity threats underscores the need to examine the effectiveness of traditional legal safeguards against junk science in court and improve the scientific reasoning ability of lay people and legal professionals. PMID:20162342

Validation of new psychosocial factors questionnaires: a Colombian national study.

PubMed

Villalobos, Gloria H; Vargas, Angélica M; Rondón, Martin A; Felknor, Sarah A

2013-01-01

The study of workers' health problems possibly associated with stressful conditions requires valid and reliable tools for monitoring risk factors. The present study validates two questionnaires to assess psychosocial risk factors for stress-related illnesses within a sample of Colombian workers. The validation process was based on a representative sample survey of 2,360 Colombian employees, aged 18-70 years. Worker response rate was 90%; 46% of the responders were women. Internal consistency was calculated, construct validity was tested with factor analysis and concurrent validity was tested with Spearman correlations. The questionnaires demonstrated adequate reliability (0.88-0.95). Factor analysis confirmed the dimensions proposed in the measurement model. Concurrent validity resulted in significant correlations with stress and health symptoms. "Work and Non-work Psychosocial Factors Questionnaires" were found to be valid and reliable for the assessment of workers' psychosocial factors, and they provide information for research and intervention. Copyright © 2012 Wiley Periodicals, Inc.

Validation of Yoon's Critical Thinking Disposition Instrument.

PubMed

Shin, Hyunsook; Park, Chang Gi; Kim, Hyojin

2015-12-01

The lack of reliable and valid evaluation tools targeting Korean nursing students' critical thinking (CT) abilities has been reported as one of the barriers to instructing and evaluating students in undergraduate programs. Yoon's Critical Thinking Disposition (YCTD) instrument was developed for Korean nursing students, but few studies have assessed its validity. This study aimed to validate the YCTD. Specifically, the YCTD was assessed to identify its cross-sectional and longitudinal measurement invariance. This was a validation study in which a cross-sectional and longitudinal (prenursing and postnursing practicum) survey was used to validate the YCTD using 345 nursing students at three universities in Seoul, Korea. The participants' CT abilities were assessed using the YCTD before and after completing an established pediatric nursing practicum. The validity of the YCTD was estimated and then group invariance test using multigroup confirmatory factor analysis was performed to confirm the measurement compatibility of multigroups. A test of the seven-factor model showed that the YCTD demonstrated good construct validity. Multigroup confirmatory factor analysis findings for the measurement invariance suggested that this model structure demonstrated strong invariance between groups (i.e., configural, factor loading, and intercept combined) but weak invariance within a group (i.e., configural and factor loading combined). In general, traditional methods for assessing instrument validity have been less than thorough. In this study, multigroup confirmatory factor analysis using cross-sectional and longitudinal measurement data allowed validation of the YCTD. This study concluded that the YCTD can be used for evaluating Korean nursing students' CT abilities. Copyright © 2015. Published by Elsevier B.V.

Facebook: an effective tool for participant retention in longitudinal research.

PubMed

Mychasiuk, R; Benzies, K

2012-09-01

Facebook is currently one of the world's most visited websites, and home to millions of users who access their accounts on a regular basis. Owing to the website's ease of accessibility and free service, demographic characteristics of users span all domains. As such, Facebook may be a valuable tool for locating and communicating with participants in longitudinal research studies. This article outlines the benefit gained in a longitudinal follow-up study, of an intervention programme for at-risk families, through the use of Facebook as a search engine. Using Facebook as a resource, we were able to locate 19 participants that were otherwise 'lost' to follow-up, decreasing attrition in our study by 16%. Additionally, analysis indicated that hard-to-reach participants located with Facebook differed significantly on measures of receptive language and self-esteem when compared to their easier-to-locate counterparts. These results suggest that Facebook is an effective means of improving participant retention in a longitudinal intervention study and may help improve study validity by reaching participants that contribute differing results. © 2011 Blackwell Publishing Ltd.

Nursing Student Self-efficacy in Psychomotor Skills: Findings From a Validation, Longitudinal, and Correlational Study.

PubMed

Bulfone, Giampiera; Fida, Roberta; Ghezzi, Valerio; Macale, Loreana; Sili, Alessandro; Alvaro, Rosaria; Palese, Alvisa

Student perceptions of self-efficacy (SE) prevent stress and burnout and improve engagement in nursing education, thus increasing learning outcomes. The study aims were to (1) validate a scale measuring nursing SE in psychomotor skills (NSE-PS), (2) describe changes in NSE-PS over time, and (3) explore NSE-PS correlations with burnout and engagement. A total of 1117 nursing students participated. A significant increase in the NSE-PS scores over the years has emerged; in addition, all NSE-PS dimensions were correlated negatively with burnout and positively with engagement.

Spanish translation and validation of the Preschool Activity Card Sort.

PubMed

Stoffel, Ashley; Berg, Christine

2008-05-01

Few standardized assessments exist for children living in the United States who are Hispanic/Latino. This study reports the Spanish translation process for the Preschool Activity Card Sort (PACS), which is a measure of participation in preschool children, and examines content, construct, and concurrent validity. Methods of verifying accuracy of translation included expert review and back translation and supported content validity of the Tarjetas de Actividades Preescolares (TAP). Subsequently, a sample of 37 parents of children between 3 and 6 years of age completed the PACS/TAP by structured interview. Twenty-six parents were Spanish speaking, and 11 were English speaking. A comparison of reported participation by Spanish- and English-speaking children provides initial construct validity of the TAP. Results indicate that the TAP differentiates among children of recent immigrants as compared to preschoolers who were born in the United States on domains of self-care, high and low demand leisure, and educational activities. Results emphasize the importance of considering sociocultural influences when assessing participation. PACS/TAP scores were moderately correlated with Pediatric Evaluation of Disability Inventory scores for the self-care domain, but did not correlate with the mobility or social function domains. The PACS/TAP appears to provide a useful means of understanding preschoolers' participation. Future research is needed to further establish the validity of this assessment.

49 CFR Schedule A to Subpart B of... - Class I Participating Carriers' Revenue Data

Code of Federal Regulations, 2010 CFR

2010-10-01

... provide a data base for the continuing evaluation of the validity and usefulness of the “study carrier... 49 Transportation 8 2010-10-01 2010-10-01 false Class I Participating Carriers' Revenue Data A...—Class I Participating Carriers' Revenue Data [Dollars in thousands] Line No. and carrier annual report...

49 CFR Schedule A to Subpart B of... - Class I Participating Carriers' Revenue Data

Code of Federal Regulations, 2012 CFR

2012-10-01

... provide a data base for the continuing evaluation of the validity and usefulness of the “study carrier... 49 Transportation 8 2012-10-01 2012-10-01 false Class I Participating Carriers' Revenue Data A...—Class I Participating Carriers' Revenue Data [Dollars in thousands] Line No. and carrier annual report...

49 CFR Schedule A to Subpart B of... - Class I Participating Carriers' Revenue Data

Code of Federal Regulations, 2013 CFR

2013-10-01

... provide a data base for the continuing evaluation of the validity and usefulness of the “study carrier... 49 Transportation 8 2013-10-01 2013-10-01 false Class I Participating Carriers' Revenue Data A...—Class I Participating Carriers' Revenue Data [Dollars in thousands] Line No. and carrier annual report...

49 CFR Schedule A to Subpart B of... - Class I Participating Carriers' Revenue Data

Code of Federal Regulations, 2014 CFR

2014-10-01

... provide a data base for the continuing evaluation of the validity and usefulness of the “study carrier... 49 Transportation 8 2014-10-01 2014-10-01 false Class I Participating Carriers' Revenue Data A...—Class I Participating Carriers' Revenue Data [Dollars in thousands] Line No. and carrier annual report...

49 CFR Schedule A to Subpart B of... - Class I Participating Carriers' Revenue Data

Code of Federal Regulations, 2011 CFR

2011-10-01

... provide a data base for the continuing evaluation of the validity and usefulness of the “study carrier... 49 Transportation 8 2011-10-01 2011-10-01 false Class I Participating Carriers' Revenue Data A...—Class I Participating Carriers' Revenue Data [Dollars in thousands] Line No. and carrier annual report...

Helping Students Evaluate the Validity of a Research Study.

ERIC Educational Resources Information Center

Morgan, George A.; Gliner, Jeffrey A.

Students often have difficulty in evaluating the validity of a study. A conceptually and linguistically meaningful framework for evaluating research studies is proposed that is based on the discussion of internal and external validity of T. D. Cook and D. T. Campbell (1979). The proposal includes six key dimensions, three related to internal…

Participant comprehension of research for which they volunteer: a systematic review.

PubMed

Montalvo, Wanda; Larson, Elaine

2014-11-01

Evidence indicates that research participants often do not fully understand the studies for which they have volunteered. The aim of this systematic review was to examine the relationship between the process of obtaining informed consent for research and participant comprehension and satisfaction with the research. Systematic review of published research on informed consent and participant comprehension of research for which they volunteer using the Preferred Reporting Items for Systematic Review and Meta-Analysis (PRISMA) Statement as a guide. PubMed, Cumulative Index for Nursing and Allied Health Literature, Cochrane Central Register of Controlled Trails, and Cochrane Database of Systematic Reviews were used to search the literature for studies meeting the following inclusion criteria: (a) published between January 1, 2006, and December 31, 2013, (b) interventional or descriptive quantitative design, (c) published in a peer-reviewed journal, (d) written in English, and (e) assessed participant comprehension or satisfaction with the research process. Studies were assessed for quality using seven indicators: sampling method, use of controls or comparison groups, response rate, description of intervention, description of outcome, statistical method, and health literacy assessment. Of 176 studies identified, 27 met inclusion criteria: 13 (48%) were randomized interventional designs and 14 (52%) were descriptive. Three categories of studies included projects assessing (a) enhanced consent process or form, (b) multimedia methods, and (c) education to improve participant understanding. Most (78%) used investigator-developed tools to assess participant comprehension, did not assess participant health literacy (74%), or did not assess the readability level of the consent form (89%). Researchers found participants lacked basic understanding of research elements: randomization, placebo, risks, and therapeutic misconception. Findings indicate (a) inconsistent assessment of

Construct validation of an interactive digital algorithm for ostomy care.

PubMed

Beitz, Janice M; Gerlach, Mary A; Schafer, Vickie

2014-01-01

The purpose of this study was to evaluate construct validity for a previously face and content validated Ostomy Algorithm using digital real-life clinical scenarios. A cross-sectional, mixed-methods Web-based survey design study was conducted. Two hundred ninety-seven English-speaking RNs completed the study; participants practiced in both acute care and postacute settings, with 1 expert ostomy nurse (WOC nurse) and 2 nonexpert nurses. Following written consent, respondents answered demographic questions and completed a brief algorithm tutorial. Participants were then presented with 7 ostomy-related digital scenarios consisting of real-life photos and pertinent clinical information. Respondents used the 11 assessment components of the digital algorithm to choose management options. Participant written comments about the scenarios and the research process were collected. The mean overall percentage of correct responses was 84.23%. Mean percentage of correct responses for respondents with a self-reported basic ostomy knowledge was 87.7%; for those with a self-reported intermediate ostomy knowledge was 85.88% and those who were self-reported experts in ostomy care achieved 82.77% correct response rate. Five respondents reported having no prior ostomy care knowledge at screening and achieved an overall 45.71% correct response rate. No negative comments regarding the algorithm were recorded by participants. The new standardized Ostomy Algorithm remains the only face, content, and construct validated digital clinical decision instrument currently available. Further research on application at the bedside while tracking patient outcomes is warranted.

Development and validation of self-reported line drawings for assessment of knee malalignment and foot rotation: a cross-sectional comparative study

PubMed Central

2010-01-01

Background For large scale epidemiological studies clinical assessments and radiographs can be impractical and expensive to apply to more than just a sample of the population examined. The study objectives were to develop and validate two novel instruments for self-reported knee malalignment and foot rotation suitable for use in questionnaire studies of knee pain and osteoarthritis. Methods Two sets of line drawings were developed using similar methodology. Each instrument consisted of an explanatory question followed by a set of drawings showing straight alignment, then two each at 7.5° angulation and 15° angulation in the varus/valgus (knee) and inward/outward (foot) directions. Forty one participants undertaking a community study completed the instruments on two occasions. Participants were assessed once by a blinded expert clinical observer with demonstrated excellent reproducibility. Validity was assessed by sensitivity, specificity and likelihood ratio (LR) using the observer as the reference standard. Reliability was assessed using weighted kappa (κ). Knee malalignment was measured on 400 knee radiographs. General linear model was used to assess for the presence of a linear increase in knee alignment angle (measured medially) from self-reported severe varus to mild varus, straight, mild valgus and severe valgus deformity. Results Observer reproducibility (κ) was 0.89 and 0.81 for the knee malalignment and foot rotation instruments respectively. Self-reported participant reproducibility was also good for the knee (κ 0.73) and foot (κ 0.87) instruments. Validity was excellent for the knee malalignment instrument, with a sensitivity of 0.74 (95%CI 0.54, 0.93) and specificity of 0.97 (95%CI 0.94, 1.00). Similarly the foot rotation instrument was also found to have high sensitivity (0.92, 95%CI 0.83, 1.01) and specificity (0.96, 95%CI 0.93, 1.00). The knee alignment angle increased progressively from self reported severe varus to mild varus, straight, mild

The Research Diagnostic Criteria for Temporomandibular Disorders. I: overview and methodology for assessment of validity.

PubMed

Schiffman, Eric L; Truelove, Edmond L; Ohrbach, Richard; Anderson, Gary C; John, Mike T; List, Thomas; Look, John O

2010-01-01

The purpose of the Research Diagnostic Criteria for Temporomandibular Disorders (RDC/TMD) Validation Project was to assess the diagnostic validity of this examination protocol. The aim of this article is to provide an overview of the project's methodology, descriptive statistics, and data for the study participant sample. This article also details the development of reliable methods to establish the reference standards for assessing criterion validity of the Axis I RDC/TMD diagnoses. The Axis I reference standards were based on the consensus of two criterion examiners independently performing a comprehensive history, clinical examination, and evaluation of imaging. Intersite reliability was assessed annually for criterion examiners and radiologists. Criterion examination reliability was also assessed within study sites. Study participant demographics were comparable to those of participants in previous studies using the RDC/TMD. Diagnostic agreement of the criterion examiners with each other and with the consensus-based reference standards was excellent with all kappas > or = 0.81, except for osteoarthrosis (moderate agreement, k = 0.53). Intrasite criterion examiner agreement with reference standards was excellent (k > or = 0.95). Intersite reliability of the radiologists for detecting computed tomography-disclosed osteoarthrosis and magnetic resonance imaging-disclosed disc displacement was good to excellent (k = 0.71 and 0.84, respectively). The Validation Project study population was appropriate for assessing the reliability and validity of the RDC/TMD Axis I and II. The reference standards used to assess the validity of Axis I TMD were based on reliable and clinically credible methods.

Participant and service provider perceptions of an outpatient rehabilitation program for people with acquired brain injury.

PubMed

Poncet, Frédérique; Pradat-Diehl, Pascale; Lamontagne, Marie-Eve; Alifax, Anne; Fradelizi, Pascaline; Barette, Maude; Swaine, Bonnie

2017-09-01

A holistic, intensive and interdisciplinary rehabilitation program for people with acquired brain injury (ABI) was developed at the Pitié-Salpêtrière Hospital, France (5 days/week for 7 weeks). This program, recently demonstrated effective, aimed to optimize the ability of people with ABI to perform activities and improve their participation by using individual and group interventions involving ecologically valid activities inside (e.g., in the gym and kitchen) and outside the hospital. However, the perception of the quality of the program by participants and service providers has not yet been reported. This study had 3 objectives: (1) report the perception of participants (adults with ABI) in terms of service quality of the program, (2) report the strengths, weaknesses, opportunities, and threats (SWOT analysis) of the program as perceived by service providers, and (3) triangulate findings to draw conclusions about the program's quality and provide recommendations for quality improvement. We used a mixed-methods design with a validated questionnaire (Perception of Quality of Rehabilitation Services [PQRS-Montreal]) and interviews (structured around a SWOT analysis) involving program participants and service providers. We included 33 program participants (mean age 43.6 years) and 12 service providers (mean years with program 7.6 years). In general, study participants showed a convergence of opinion about the high quality of the program, particularly regarding the team and its participant-focused approach. Specific aspects of the program were viewed more negatively by both participants and service providers (i.e., addressing sexuality, family involvement and return to work/volunteer work/school). Participant and service provider perceptions of the rehabilitation program under study were generally positive. A reliable and valid questionnaire and interviews helped identify aspects of the program that worked well and those that could be targeted for future quality

JaCVAM-organized international validation study of the in vivo rodent alkaline comet assay for the detection of genotoxic carcinogens: I. Summary of pre-validation study results.

PubMed

Uno, Yoshifumi; Kojima, Hajime; Omori, Takashi; Corvi, Raffaella; Honma, Masamistu; Schechtman, Leonard M; Tice, Raymond R; Burlinson, Brian; Escobar, Patricia A; Kraynak, Andrew R; Nakagawa, Yuzuki; Nakajima, Madoka; Pant, Kamala; Asano, Norihide; Lovell, David; Morita, Takeshi; Ohno, Yasuo; Hayashi, Makoto

2015-07-01

The in vivo rodent alkaline comet assay (comet assay) is used internationally to investigate the in vivo genotoxic potential of test chemicals. This assay, however, has not previously been formally validated. The Japanese Center for the Validation of Alternative Methods (JaCVAM), with the cooperation of the U.S. NTP Interagency Center for the Evaluation of Alternative Toxicological Methods (NICEATM)/the Interagency Coordinating Committee on the Validation of Alternative Methods (ICCVAM), the European Centre for the Validation of Alternative Methods (ECVAM), and the Japanese Environmental Mutagen Society/Mammalian Mutagenesis Study Group (JEMS/MMS), organized an international validation study to evaluate the reliability and relevance of the assay for identifying genotoxic carcinogens, using liver and stomach as target organs. The ultimate goal of this validation effort was to establish an Organisation for Economic Co-operation and Development (OECD) test guideline. The purpose of the pre-validation studies (i.e., Phase 1 through 3), conducted in four or five laboratories with extensive comet assay experience, was to optimize the protocol to be used during the definitive validation study. Copyright © 2015 Elsevier B.V. All rights reserved.

Who enrolls in prevention trials? Discordance in perception of risk by professionals and participants.

PubMed

Stein, R E; Bauman, L J; Ireys, H T

1991-08-01

Internal and external validity problems permeate all intervention studies but are accentuated in primary preventive intervention research, particularly when studies target or recruit individuals based on their risk for psychopathology. Since many people who are at risk do not yet experience distress, they may not perceive the need for intervention. Recruitment tactics based on explaining extent of risk are unlikely to be persuasive and may have negative consequences. If respondents are not motivated to participate, a small or biased subset of the target population will participate in the intervention. Bias is of special concern when those enrolled represent only part of the continuum of risk. Selective enrollment may compromise both internal validity (the interpretation of the research results) and external validity (the generalizability of the findings) of intervention trials in primary prevention. This article discusses the effects of partial enrollment and the resultant bias. It suggests several strategies for increasing the enrollment of the target population and examines some of their ethical ramifications. It also stresses the importance of collecting systematic data documenting how the participants in the intervention differ from the target group as a whole.

The Internal Consistency and Validity of the Vaccination Attitudes Examination Scale: A Replication Study.

PubMed

Wood, Louise; Smith, Michael; Miller, Christopher B; O'Carroll, Ronan E

2018-06-19

Vaccinations are important preventative health behaviors. The recently developed Vaccination Attitudes Examination (VAX) Scale aims to measure the reasons behind refusal/hesitancy regarding vaccinations. The aim of this replication study is to conduct an independent test of the newly developed VAX Scale in the UK. We tested (a) internal consistency (Cronbach's α); (b) convergent validity by assessing its relationships with beliefs about medication, medical mistrust, and perceived sensitivity to medicines; and (c) construct validity by testing how well the VAX Scale discriminated between vaccinators and nonvaccinators. A sample of 243 UK adults completed the VAX Scale, the Beliefs About Medicines Questionnaire, the Perceived Sensitivity to Medicines Scale, and the Medical Mistrust Index, in addition to demographics of age, gender, education levels, and social deprivation. Participants were asked (a) whether they received an influenza vaccination in the past year and (b) if they had a young child, whether they had vaccinated the young child against influenza in the past year. The VAX (a) demonstrated high internal consistency (α = .92); (b) was positively correlated with medical mistrust and beliefs about medicines, and less strongly correlated with perceived sensitivity to medicines; and (c) successfully differentiated parental influenza vaccinators from nonvaccinators. The VAX demonstrated good internal consistency, convergent validity, and construct validity in an independent UK sample. It appears to be a useful measure to help us understand the health beliefs that promote or deter vaccination behavior.

The Development and Validation of the School-Based Counseling Self-Efficacy Scale

ERIC Educational Resources Information Center

Boughfman, Erica M.

2010-01-01

The purpose of this study was to develop and validate the School-Based Counseling Self-Efficacy Scale (SB-SES). Two hundred sixty-five (N = 265) licensed mental health professionals participated in this study. Fifty-eight percent of the participants reported experience working as a school-based counselor with the remaining 42% reporting no…

Validation of Recipes for Double-Blind Placebo-Controlled Challenges With Milk, Egg White, and Hazelnut.

PubMed

González-Mancebo, E; Alonso Díaz de Durana, M D; García Estringana, Y; Meléndez Baltanás, A; Rodriguez-Alvarez, M; de la Hoz Caballer, B; Del Prado, N; Fernández-Rivas, M

The double-blind, placebo-controlled food challenge (DBPCFC) is considered the definitive diagnostic test for food allergy. Nevertheless, validated recipes for masking the foods are scarce, have not been standardized, and differ between centers. Sensory evaluation techniques such as the triangle test are necessary to validate the recipes used for DBPCFC. We developed 3 recipes for use in DBPCFC with milk, egg white, and hazelnut and used the triangle test to validate them in a 2-phase study in which 197 volunteers participated. In each phase, participants tried 3 samples (2 active-1 placebo or 2 placebo-1 active) and had to identify the odd one. In phase 1, the 3 samples were given simultaneously, whereas in phase 2, the 3 samples of foods that failed validation in phase 1 were given sequentially. A visual analog scale (VAS) ranging from 1 to 10 was used to evaluate how much participants liked the recipes. In phase 1, the egg white recipe was validated (n=89 volunteers, 38.9% found the odd sample, P=.16). Milk and hazelnut recipes were validated in phase 2 (for both foods, n=30 participants, 36.7% found the odd sample, P=.36). Median VAS scores for the 3 recipes ranged from 6.6 to 9.7. We used sensory testing to validate milk, egg white, and hazelnut recipes for use in DBPCFC. The validated recipes are easy to prepare in a clinical setting, provide the equivalent of 1 serving dose, and were liked by most participants.

A new questionnaire to assess endorsement of normative ethics in primary health care: development, reliability and validity study.

PubMed

González-de Paz, Luis; Devant-Altimir, Meritxell; Kostov, Belchin; Mitjavila-López, Joan; Navarro-Rubio, M Dolors; Sisó-Almirall, Antoni

2013-12-01

Assessing ethical endorsement is crucial to the study of professional performance and moral conduct. There are no specific instruments that verify patients and professional experiences of ethical practice in the specific area of primary health care (PHC). To study the psychometric properties of two questionnaires to identify professional and patient endorsement of normative ethics. A methodological study conducted in PHC centres from an urban area (Barcelona). A group of items from an ethical code were generated using a qualitative study with focus groups. Items underwent expert validation, item refinement and test-retest reliability. Two groups of items for PHC professionals and patients were validated. The structure of the constructs and the internal consistency were studied after participants completed the questionnaires. Principal component analysis with supplementary variables showed the utility of the validated questionnaires. The patients' questionnaire consisted of 17 general items plus 11 additional items on specific conditions, and the health professional's contained 24 general and 9 specific items. The construct of the questionnaires comprised a three-factor solution for patients and a five-factor solution for professionals. Principal component analysis with supplementary variables showed that patients with higher scores on ethical perception were associated with better opinions on health care quality and more confidence in professionals. In PHC professionals, higher scores were associated with effective knowledge of the code. Both questionnaires showed good psychometric properties and are valid to screen ethical attitudes. The instrument warrants further testing and use with culturally diverse patients and PHC professionals.

Identifying Careless Responding With the Psychopathic Personality Inventory-Revised Validity Scales.

PubMed

Marcus, David K; Church, Abere Sawaqdeh; O'Connell, Debra; Lilienfeld, Scott O

2018-01-01

The Psychopathic Personality Inventory-Revised (PPI-R) includes validity scales that assess Deviant Responding (DR), Virtuous Responding, and Inconsistent Responding. We examined the utility of these scales for identifying careless responding using data from two online studies that examined correlates of psychopathy in college students (Sample 1: N = 583; Sample 2: N = 454). Compared with those below the cut scores, those above the cut on the DR scale yielded consistently lower validity coefficients when PPI-R scores were correlated with corresponding scales from the Triarchic Psychopathy Measure. The other three PPI-R validity scales yielded weaker and less consistent results. Participants who completed the studies in an inordinately brief amount of time scored significantly higher on the DR and Virtuous Responding scales than other participants. Based on the findings from the current studies, researchers collecting PPI-R data online should consider identifying and perhaps screening out respondents with elevated scores on the DR scale.

Content validation of terms and definitions in a wound glossary.

PubMed

Milne, Catherine T; Paine, Tim; Sullivan, Valerie; Sawyer, Allen

2011-12-01

A common language and lexicon provide the easiest means of mutual understanding. Inconsistency in terminology makes effective information exchange difficult. Previous studies identified the need to determine standard, accepted definitions for the vocabulary frequently used in wound care. The objective of this study was to establish content validation for these terms and develop an evidence-based glossary for this specialty. Members of the Association for the Advancement of Wound Care Quality of Care Task Force reviewed literature to determine glossary content generation and the associated literature-based definitions. Thirty-nine wound care professionals from wound care stakeholder professional organizations in the United States and Canada participated in the content validation process. Participants were asked to quantify the degree of validity using a 367-item, 4-point Likert-type scale. On a scale of 1 to 4, the mean score of the entire instrument was 3.84. The instrument's overall scale content validity index was 0.96. Terms with an item content validity index of less than 0.70 were removed from the glossary, leaving 365 items with established content validity. Qualitative data analysis revealed themes suggesting that enhanced communication between providers improves patient outcomes. The need for ongoing updates of the glossary was also identified. The wound care glossary in its finalized form proved valid. An evidence-based glossary bridges the chasm of miscommunication and nonstandardization so that wound care, as an emerging specialized medical science field, can move forward to optimize both process and clinical outcomes.

Validation study of a Chinese version of Partners in Health in Hong Kong (C-PIH HK).

PubMed

Chiu, Teresa Mei Lee; Tam, Katharine Tai Wo; Siu, Choi Fong; Chau, Phyllis Wai Ping; Battersby, Malcolm

2017-01-01

The Partners in Health (PIH) scale is a measure designed to assess the generic knowledge, attitudes, behaviors, and impacts of self-management. A cross-cultural adaptation of the PIH for use in Hong Kong was evaluated in this study. This paper reports the validity and reliability of the Chinese version of PIH (C-PIH[HK]). A 12-item PIH was translated using forward-backward translation technique and reviewed by individuals with chronic diseases and health professionals. A total of 209 individuals with chronic diseases completed the scale. The construct validity, internal consistency, and test-retest reliability were evaluated in two waves. The findings in Wave 1 (n = 73) provided acceptable psychometric properties of the C-PIH(HK) but supported the adaptation of question 5 to improve the cultural relevance, validity, and reliability of the scale. An adapted version of C-PIH(HK) was evaluated in Wave 2. The findings in Wave 2 (n = 136) demonstrated good construct validity and internal consistency of C-PIH(HK). A principal component analysis with Oblimin rotation yielded a 3-factor solution, and the Cronbach's alphas of the subscales ranged from 0.773 to 0.845. Participants were asked whether they perceived the self-management workshops they attended and education provided by health professionals as useful or not. The results showed that the C-PIH(HK) was able to discriminate those who agreed and those who disagreed related to the usefulness of individual health education (p < 0.0001 in all subscales) and workshops (p < 0.001 in the knowledge subscale) as hypothesized. The test-retest reliability was high (ICC = 0.818). A culturally adapted version of PIH for use in Hong Kong was evaluated. The study supported good construct validity, discriminate validity, internal consistency, and test-retest reliability of the C-PIH(HK).

On measuring community participation in research.

PubMed

Khodyakov, Dmitry; Stockdale, Susan; Jones, Andrea; Mango, Joseph; Jones, Felica; Lizaola, Elizabeth

2013-06-01

Active participation of community partners in research aspects of community-academic partnered projects is often assumed to have a positive impact on the outcomes of such projects. The value of community engagement in research, however, cannot be empirically determined without good measures of the level of community participation in research activities. Based on our recent evaluation of community-academic partnered projects centered around behavioral health issues, this article uses semistructured interview and survey data to outline two complementary approaches to measuring the level of community participation in research-a "three-model" approach that differentiates between the levels of community participation and a Community Engagement in Research Index (CERI) that offers a multidimensional view of community engagement in the research process. The primary goal of this article is to present and compare these approaches, discuss their strengths and limitations, summarize the lessons learned, and offer directions for future research. We find that whereas the three-model approach is a simple measure of the perception of community participation in research activities, CERI allows for a more nuanced understanding by capturing multiple aspects of such participation. Although additional research is needed to validate these measures, our study makes a significant contribution by illustrating the complexity of measuring community participation in research and the lack of reliability in simple scores offered by the three-model approach.

Examining the Factor Structure and Reliability of the Safe Patient Handling Perception Scale: An Initial Validation Study.

PubMed

White-Heisel, Regina; Canfield, James P; Young-Hughes, Sadie

Perceiving imminent safe patient handling and movement (SPH&M) dangers may reduce musculoskeletal (MSK) injuries for nurses in the workplace. The purpose of this study is to develop and validate the 17-item Safe Patient Handling Perception Scale (SPHPS) as an evaluation instrument assessing perceptual risk of MSK injury based on SPH&M knowledge, practice, and resource accessibility in the workplace. Data were collected from a convenience sample (N = 117) of nursing employees at a Veteran Affairs Medical Center. Factor analysis identified three factors: knowledge, practice, and accessibility. The SPHPS demonstrated high levels of reliability, supported by acceptable alpha scores (SPHM knowledge [α = .866], SPHM practices [α = .901], and access to SPHM resources [α = .855]), in addition to the relatively low standard error of measurement scores (SEM). The study outcomes suggest that the SPHPS is a valid and reliable tool that can measure participants' perceived risk factors for MSK injuries.

Verification, Validation and Sensitivity Studies in Computational Biomechanics