Validating a two-high-threshold measurement model for confidence rating data in recognition.

PubMed

Bröder, Arndt; Kellen, David; Schütz, Julia; Rohrmeier, Constanze

2013-01-01

Signal Detection models as well as the Two-High-Threshold model (2HTM) have been used successfully as measurement models in recognition tasks to disentangle memory performance and response biases. A popular method in recognition memory is to elicit confidence judgements about the presumed old/new status of an item, allowing for the easy construction of ROCs. Since the 2HTM assumes fewer latent memory states than response options are available in confidence ratings, the 2HTM has to be extended by a mapping function which models individual rating scale usage. Unpublished data from 2 experiments in Bröder and Schütz (2009) validate the core memory parameters of the model, and 3 new experiments show that the response mapping parameters are selectively affected by manipulations intended to affect rating scale use, and this is independent of overall old/new bias. Comparisons with SDT show that both models behave similarly, a case that highlights the notion that both modelling approaches can be valuable (and complementary) elements in a researcher's toolbox.

Validation of the secretion severity rating scale.

PubMed

Pluschinski, Petra; Zaretsky, Eugen; Stöver, Timo; Murray, Joseph; Sader, Robert; Hey, Christiane

2016-10-01

Accumulation of secretions within the hypopharynx, aditus laryngis, and trachea is one characteristic of severe dysphagia and is of high clinical and therapeutic relevance. For the graduation of the secretion severity level, a secretion scale was provided by Murray et al. in 1996. The purpose of the study presented here is the validation of this scale by analyzing the intra-rater and inter-rater reliability as well as concurrent validity. For examination of reliability and validity, a reference standard was defined by two expert clinicians who reviewed 40 video recordings of fiberendoscopic swallowing evaluations, with 10 videos for each severity grade. These videos were rated and rerated independently and blinded by 4 ENT-residents with an interval of 4 weeks. Both the intra-rater (Kendall's τ > 0.847***) and inter-rater reliability (Kendall's W > 0.951***) were highly significant and can be considered good or very good. Correlation of the median of all ratings with the reference standard was close to the highest possible value 1 (τ = 0.984***). The scale was proved to be a reliable and valid instrument for graduation of one of the principal symptoms of oropharyngeal dysphagia and is recommended as an evidence-based instrument for standardized fiberoptic endoscopic evaluation of swallowing.

Patterns of Cognitive Strengths and Weaknesses: Identification Rates, Agreement, and Validity for Learning Disabilities Identification

PubMed Central

Miciak, Jeremy; Fletcher, Jack M.; Stuebing, Karla; Vaughn, Sharon; Tolar, Tammy D.

2014-01-01

Purpose Few empirical investigations have evaluated LD identification methods based on a pattern of cognitive strengths and weaknesses (PSW). This study investigated the reliability and validity of two proposed PSW methods: the concordance/discordance method (C/DM) and cross battery assessment (XBA) method. Methods Cognitive assessment data for 139 adolescents demonstrating inadequate response to intervention was utilized to empirically classify participants as meeting or not meeting PSW LD identification criteria using the two approaches, permitting an analysis of: (1) LD identification rates; (2) agreement between methods; and (3) external validity. Results LD identification rates varied between the two methods depending upon the cut point for low achievement, with low agreement for LD identification decisions. Comparisons of groups that met and did not meet LD identification criteria on external academic variables were largely null, raising questions of external validity. Conclusions This study found low agreement and little evidence of validity for LD identification decisions based on PSW methods. An alternative may be to use multiple measures of academic achievement to guide intervention. PMID:24274155

Validity of the Children's Orientation to Book Reading Rating Scale

ERIC Educational Resources Information Center

Kaderavek, Joan N.; Guo, Ying; Justice, Laura M.

2014-01-01

The present study investigates the validity of a 4-point rating scale used to measure the level of preschool children's orientation to literacy during shared book reading. Validity was explored by (a) comparing the children's level of literacy orientation as measured with the "Children's Orientation to Book Reading Rating Scale" (COB)…

Parents rate the ratings: a test of the validity of the American movie, television, and video game ratings.

PubMed

Walsh, D A; Gentile, D A; Van Brederode, T M

2002-02-01

Numerous studies have documented the potential effects on young audiences of violent content in media products, including movies, television programs, and computer and video games. Similar studies have evaluated the effects associated with sexual content and messages. Cumulatively, these effects represent a significant public health risk for increased aggressive and violent behavior, spread of sexually transmitted diseases, and pediatric pregnancy. In partial response to these risks and to public and legislative pressure, the movie, television, and gaming industries have implemented ratings systems intended to provide information about the content and appropriate audiences for different films, shows, and games. We conducted a panel study to test the validity of the current movie, television, and video game rating systems. Participants used the KidScore media evaluation tool, which evaluates films, television shows, and video and computer games on 10 aspects, including the appropriateness of the media product for children on the basis of age. Results revealed that when an entertainment industry rates a product as inappropriate for children, parent raters agree that it is inappropriate for children. However, parent raters disagree with industry usage of many of the ratings designating material suitable for children of different ages. Products rated as appropriate for adolescents are of the greatest concern. The level of disagreement varies from industry to industry and even from rating to rating. Analysis indicates that the amount of violent content and portrayals of violence are the primary markers for disagreement between parent raters and industry ratings. Short-term and long-term recommendations are suggested.

Representativeness and response rates from the Domestic/International Gastroenterology Surveillance Study (DIGEST).

PubMed

Tijssen, J G

1999-01-01

The Domestic/international Gastroenterology Surveillance Study (DIGEST) examined the prevalence of upper gastrointestinal symptoms among the general population in 10 countries, and the impact of these symptoms on healthcare usage and quality of life. This report discusses the validation of the DIGEST sample and reviews the response rates from the survey. External validation of the DIGEST sample was conducted by comparing the age, age by gender and annual household incomes of the sample with census-derived data. A comparison was also made between Psychological General Well-Being Index (PGWBI) scores from study subjects in the Scandinavian countries and the USA and the total sample population norms. Under- and oversampling, defined as > or =5% difference from the population norms, was evident in eight out of 10 countries, but no systematic bias was evident. The final distribution of the sample by gender was 51% female and 49% male. Although differences in PGWBI scores were noted between DIGEST subjects and population norms, these differences were <0.30 standard deviations--markedly below the difference considered as relevant for the PGWBI. Response for the survey in individual countries ranged from 17% in the USA to 61% in Norway, with a survey-wide rate of 27%. The overall response rate, including primary non-respondents, was 13.4%. The majority of nonresponse (51.4%) was attributed to failure to establish contact with the subjects, with 41.7% of subjects declining to be interviewed and the remaining 6.9% of subjects not meeting the age and sex criteria used for the survey. The DIGEST sample exhibited good external validity, providing a foundation for comparison between data derived from individual countries in the survey.

Psychiatric symptoms and response quality to self-rated personality tests: Evidence from the PsyCoLaus study.

PubMed

Dupuis, Marc; Meier, Emanuele; Rudaz, Dominique; Strippoli, Marie-Pierre F; Castelao, Enrique; Preisig, Martin; Capel, Roland; Vandeleur, Caroline L

2017-06-01

Despite the fact that research has demonstrated consistent associations between self-rated measures of personality dimensions and mental disorders, little has been undertaken to investigate the relation between psychiatric symptoms and response patterns to self-rated tests. The aim of this study was to investigate the association between psychiatric symptoms and response quality using indices from our functional method. A sample of 1,784 participants from a Swiss population-based cohort completed a personality inventory (NEO-FFI) and a symptom checklist of 90 items (SCL-90-R). Different indices of response quality were calculated based on the responses given to the NEO-FFI. Associations among the responses to indices of response quality, sociodemographic characteristics and the SCL-90-R dimensions were then established. Psychiatric symptoms were associated with several important differences in response quality, questioning subjects' ability to provide valid information using self-rated instruments. As suggested by authors, psychiatric symptoms seem associated with differences in personality scores. Nonetheless, our study shows that symptoms are also related to differences in terms of response patterns as sources of differences in personality scores. This could constitute a bias for clinical assessment. Future studies could still determine whether certain subpopulations of subjects are more unable to provide valid information to self-rated questionnaires than others. Copyright © 2017 Elsevier Ireland Ltd. All rights reserved.

Validating independent ratings of executive functioning following acquired brain injury using Rasch analysis.

PubMed

Simblett, Sara K; Badham, Rachel; Greening, Kate; Adlam, Anna; Ring, Howard; Bateman, Andrew

2012-01-01

Assessment of everyday problems with executive functioning following acquired brain injury (ABI) is greatly valued by neurorehabilitation services. Reliance on self-report measures alone is problematic within this client group who may experience difficulties with awareness and memory. The construct validity and reliability of independent ratings (i.e., ratings provided by a carer/relative) on the Dysexecutive Questionnaire (DEX-I) was explored in this study. Consistent with the results recently reported on the self-rated version of the DEX (DEX-S; Simblett & Bateman, 2011 ), Rasch analysis completed on 271 responses to the DEX-I revealed that the scale did not fit the Rasch model and did not meet the assumption of unidimensionality, that is, a single underlying construct could not be found for the DEX-I that would allow development of an interval-level measure as a whole. Subscales, based on theoretical conceptualisations of executive functioning (Stuss, 2007 ) previously suggested for the DEX-S, were able to demonstrate fit to the Rasch model and unidimensionality. Reliability of independent responses to these subscales in comparison to self-reported ratings is discussed. These results contribute to a greater understanding of how assessment of executive functioning can be improved.

Determining the Scoring Validity of a Co-Constructed CEFR-Based Rating Scale

ERIC Educational Resources Information Center

Deygers, Bart; Van Gorp, Koen

2015-01-01

Considering scoring validity as encompassing both reliable rating scale use and valid descriptor interpretation, this study reports on the validation of a CEFR-based scale that was co-constructed and used by novice raters. The research questions this paper wishes to answer are (a) whether it is possible to construct a CEFR-based rating scale with…

Validity of portfolio assessment: which qualities determine ratings?

PubMed

Driessen, Erik W; Overeem, Karlijn; van Tartwijk, Jan; van der Vleuten, Cees P M; Muijtjens, Arno M M

2006-09-01

The portfolio is becoming increasingly accepted as a valuable tool for learning and assessment. The validity of portfolio assessment, however, may suffer from bias due to irrelevant qualities, such as lay-out and writing style. We examined the possible effects of such qualities in a portfolio programme aimed at stimulating Year 1 medical students to reflect on their professional and personal development. In later curricular years, this portfolio is also used to judge clinical competence. We developed an instrument, the Portfolio Analysis Scoring Inventory, to examine the impact of form and content aspects on portfolio assessment. The Inventory consists of 15 items derived from interviews with experienced mentors, the literature, and the criteria for reflective competence used in the regular portfolio assessment procedure. Forty portfolios, selected from 231 portfolios for which ratings from the regular assessment procedure were available, were rated by 2 researchers, independently, using the Inventory. Regression analysis was used to estimate the correlation between the ratings from the regular assessment and those resulting from the Inventory items. Inter-rater agreement ranged from 0.46 to 0.87. The strongest predictor of the variance in the regular ratings was 'quality of reflection' (R 0.80; R2 66%). No further items accounted for a significant proportion of variance. Irrelevant items, such as writing style and lay-out, had negligible effects. The absence of an impact of irrelevant criteria appears to support the validity of the portfolio assessment procedure. Further studies should examine the portfolio's validity for the assessment of clinical competence.

Validation of the XDP-MDSP rating scale for the evaluation of patients with X-linked dystonia-parkinsonism.

PubMed

Pasco, Paul Matthew D; Jamora, Roland Dominic G; Rosales, Raymond L; Diesta, Cid Czarina E; Ng, Arlene R; Teleg, Rosalia A; Go, Criscely L; Lee, Lillian; Fernandez, Hubert H

2017-01-01

X-linked dystonia-parkinsonism(XDP) is a neurodegenerative disorder endemic to the Philippines. A rating scale was developed by the authors under the guidance of the Movement Disorder Society of the Philippines (MDSP) to assess XDP severity and progression, functional impact, and response to treatment in future clinical trials. Our main objective was to validate our new scale, the XDP-MDSP scale. The initial validation process included pragmatic testing to XDP patients followed by a modified Delphi procedure with an international advisory panel of dystonia, parkinsonism and scale development experts. Pearson correlation was used to assess construct validity of our new scale versus the assess construct validity of our new scale versus standard dystonia, parkinsonism, non-motor and functional scales; and also to assess divergent validity against behavioral and cognitive scales. The 37-item XDP-MDSP scale has five parts: I-dystonia, II-parkinsonism, III-non-motor features, IV-ADL, and V-global impression. After initial validation, the scale was administered to 204 XDP patients. Inter-domain correlation for the first four parts was acceptable. The correlation between these domains and the global rating was slightly lower. Correlations between Parts I, II, III, and IV versus standard dystonia, parkinsonism, non-motor and functional scales were acceptable with values ranging from 0.323 to 0.428. For divergent validity, a significant correlation was seen with behavioral scales. No significant correlation was noted with the cognitive scale. The proposed XDP-MDSP scale is internally valid but the global rating subscale may need to be modified or eliminated. While there is convergent validity, divergent validation was successful only on cognitive and not behavioral scales. The frequent co-occurrence of anxiety and depression, and its effect on the motor and functional state, may explain this finding.

Response Rates and Response Bias for 50 Surveys of Pediatricians

PubMed Central

Cull, William L; O'Connor, Karen G; Sharp, Sanford; Tang, Suk-fong S

2005-01-01

Research Objective To track response rates across time for surveys of pediatricians, to explore whether response bias is present for these surveys, and to examine whether response bias increases with lower response rates. Data Source/Study Setting A total of 63,473 cases were gathered from 50 different surveys of pediatricians conducted by the American Academy of Pediatrics (AAP) since 1994. Thirty-one surveys targeted active U.S. members of the AAP, six targeted pediatric residents, and the remaining 13 targeted AAP-member and nonmember pediatric subspecialists. Information for the full target samples, including nonrespondents, was collected using administrative databases of the AAP and the American Board of Pediatrics. Study Design To assess bias for each survey, age, gender, location, and AAP membership type were compared for respondents and the full target sample. Correlational analyses were conducted to examine whether surveys with lower response rates had increasing levels of response bias. Principal Findings Response rates to the 50 surveys examined declined significantly across survey years (1994–2002). Response rates ranged from 52 to 81 percent with an average of 68 percent. Comparisons between respondents and the full target samples showed the respondent group to be younger, to have more females, and to have less specialty-fellow members. Response bias was not apparent for pediatricians' geographical location. The average response bias, however, was fairly small for all factors: age (0.45 years younger), gender (1.4 percentage points more females), and membership type (1.1 percentage points fewer specialty-fellow members). Gender response bias was found to be inversely associated with survey response rates (r=−0.38). Even for the surveys with the lowest response rates, amount of response bias never exceeded 5 percentage points for gender, 3 years for age, or 3 percent for membership type. Conclusions While response biases favoring women, young

Effect of paper quality on the response rate to a postal survey: A randomised controlled trial. [ISRCTN32032031

PubMed Central

Clark, T Justin; Khan, Khalid S; Gupta, Janesh K

2001-01-01

Background Response rates to surveys are declining and this threatens the validity and generalisability of their findings. We wanted to determine whether paper quality influences the response rate to postal surveys Methods A postal questionnaire was sent to all members of the British Society of Gynaecological Endoscopy (BSGE). Recipients were randomised to receiving the questionnaire printed on standard quality paper or high quality paper. Results The response rate for the recipients of high quality paper was 43/195 (22%) and 57/194 (29%) for standard quality paper (relative rate of response 0.75, 95% CI 0.33–1.05, p = 0.1 Conclusion The use of high quality paper did not increase response rates to a questionnaire survey of gynaecologists affiliated to an endoscopic society. PMID:11782286

Reliability and validity of the Wolfram Unified Rating Scale (WURS)

PubMed Central

2012-01-01

Background Wolfram syndrome (WFS) is a rare, neurodegenerative disease that typically presents with childhood onset insulin dependent diabetes mellitus, followed by optic atrophy, diabetes insipidus, deafness, and neurological and psychiatric dysfunction. There is no cure for the disease, but recent advances in research have improved understanding of the disease course. Measuring disease severity and progression with reliable and validated tools is a prerequisite for clinical trials of any new intervention for neurodegenerative conditions. To this end, we developed the Wolfram Unified Rating Scale (WURS) to measure the severity and individual variability of WFS symptoms. The aim of this study is to develop and test the reliability and validity of the Wolfram Unified Rating Scale (WURS). Methods A rating scale of disease severity in WFS was developed by modifying a standardized assessment for another neurodegenerative condition (Batten disease). WFS experts scored the representativeness of WURS items for the disease. The WURS was administered to 13 individuals with WFS (6-25 years of age). Motor, balance, mood and quality of life were also evaluated with standard instruments. Inter-rater reliability, internal consistency reliability, concurrent, predictive and content validity of the WURS were calculated. Results The WURS had high inter-rater reliability (ICCs>.93), moderate to high internal consistency reliability (Cronbach’s α = 0.78-0.91) and demonstrated good concurrent and predictive validity. There were significant correlations between the WURS Physical Assessment and motor and balance tests (rs>.67, p<.03), between the WURS Behavioral Scale and reports of mood and behavior (rs>.76, p<.04) and between WURS Total scores and quality of life (rs=-.86, p=.001). The WURS demonstrated acceptable content validity (Scale-Content Validity Index=0.83). Conclusions These preliminary findings demonstrate that the WURS has acceptable reliability and validity and

Reliability and Validity of Scores on the IFSP Rating Scale

ERIC Educational Resources Information Center

Jung, Lee Ann; McWilliam, R. A.

2005-01-01

Evidence is presented regarding the construct validity and internal consistency reliability of scores for an investigator-developed individualized family service plan (IFSP) rating scale. One hundred and twenty IFSPs were rated using a 12-item instrument, the IFSP Rating Scale (McWilliam & Jung, 2001). Using principal components factor…

Validation of the Adult ADHD Investigator Symptom Rating Scale (AISRS)

ERIC Educational Resources Information Center

Spencer, Thomas J.; Adler, Lenard A.; Qiao, Meihua; Saylor, Keith E.; Brown, Thomas E.; Holdnack, James A.; Schuh, Kory J.; Trzepacz, Paula T.; Kelsey, Douglas K.

2010-01-01

Objective: Validation of the Adult ADHD Investigator Symptom Rating Scale (AISRS) that measures aspects of ADHD in adults. Method: Psychometric properties of the AISRS total and AISRS subscales are analyzed and compared to the Conners' Adult Attention-Deficit/Hyperactivity Disorder Rating Scale-Investigator Rated: Screening Version (CAARS-Inv:SV)…

Clinical validity of prototype personality disorder ratings in adolescents.

PubMed

Defife, Jared A; Haggerty, Greg; Smith, Scott W; Betancourt, Luis; Ahmed, Zain; Ditkowsky, Keith

2015-01-01

A growing body of research shows that personality pathology in adolescents is clinically distinctive and frequently stable into adulthood. A reliable and useful method for rating personality pathology in adolescent patients has the potential to enhance conceptualization, dissemination, and treatment effectiveness. The aim of this study is to examine the clinical validity of a prototype matching approach (derived from the Shedler Westen Assessment Procedure-Adolescent Version) for quantifying personality pathology in an adolescent inpatient sample. Sixty-six adolescent inpatients and their parents or legal guardians completed forms of the Child Behavior Checklist (CBCL) assessing emotional and behavioral problems. Clinical criterion variables including suicide history, substance use, and fights with peers were also assessed. Patients' individual and group therapists on the inpatient unit completed personality prototype ratings. Prototype diagnoses demonstrated substantial reliability (median intraclass correlation coefficient =.75) across independent ratings from individual and group therapists. Personality prototype ratings correlated with the CBCL scales and clinical criterion variables in anticipated and meaningful ways. As seen in prior research with adult samples, prototype personality ratings show clinical validity across independent clinician raters previously unfamiliar with the approach, and they are meaningfully related to clinical symptoms, behavioral problems, and adaptive functioning.

Clinical Validity of Prototype Personality Disorder Ratings in Adolescents

PubMed Central

DeFife, Jared A.; Haggerty, Greg; Smith, Scott W.; Betancourt, Luis; Ahmed, Zain; Ditkowsky, Keith

2015-01-01

A growing body of research shows that personality pathology in adolescents is clinically distinctive and frequently stable into adulthood. A reliable and useful method for rating personality pathology in adolescent patients has the potential to enhance conceptualization, dissemination, and treatment effectiveness. The aim of this study is to examine the clinical validity of a prototype matching approach (derived from the Shedler Westen Assessment Procedure – Adolescent Version) for quantifying personality pathology in an adolescent inpatient sample. Sixty-six adolescent inpatients and their parents or legal guardians completed forms of the Child Behavior Checklist (CBCL) assessing emotional and behavioral problems. Clinical criterion variables including suicide history, substance use, and fights with peers were also assessed. Patients’ individual and group therapists on the inpatient unit completed personality prototype ratings. Prototype diagnoses demonstrated substantial reliability (median ICC = .75) across independent ratings from individual and group therapists. Personality prototype ratings correlated with the CBCL scales and clinical criterion variables in anticipated and meaningful ways. As seen in prior research with adult samples, prototype personality ratings show clinical validity across independent clinician raters previously unfamiliar with the approach, and they are meaningfully related to clinical symptoms, behavioral problems, and adaptive functioning. PMID:25457971

Continual Response Measurement: Design and Validation.

ERIC Educational Resources Information Center

Baggaley, Jon

1987-01-01

Discusses reliability and validity of continual response measurement (CRM), a computer-based measurement technique, and its use in social science research. Highlights include the importance of criterion-referencing the data, guidelines for designing studies using CRM, examples typifying their deductive and inductive functions, and a discussion of…

Preliminary Validation of a New Measure of Negative Response Bias: The Temporal Memory Sequence Test.

PubMed

Hegedish, Omer; Kivilis, Naama; Hoofien, Dan

2015-01-01

The Temporal Memory Sequence Test (TMST) is a new measure of negative response bias (NRB) that was developed to enrich the forced-choice paradigm. The TMST does not resemble the common structure of forced-choice tests and is presented as a temporal recall memory test. The validation sample consisted of 81 participants: 21 healthy control participants, 20 coached simulators, and 40 patients with acquired brain injury (ABI). The TMST had high reliability and significantly high positive correlations with the Test of Memory Malingering and Word Memory Test effort scales. Moreover, the TMST effort scales exhibited high negative correlations with the Glasgow Coma Scale, thus validating the previously reported association between probable malingering and mild traumatic brain injury. A suggested cutoff score yielded acceptable classification rates in the ABI group as well as in the simulator and control groups. The TMST appears to be a promising measure of NRB detection, with respectable rates of reliability and construct and criterion validity.

Validation of the Gifted Rating Scales–School Form in China

PubMed Central

Li, Huijun; Pfeiffer, Steven I.; Petscher, Yaacov; Kumtepe, Alper T.; Mo, Guofang

2015-01-01

The Gifted Rating Scales–School Form (GRS-S), a teacher-completed rating scale, is designed to identify five types of giftedness and motivation. This study examines the reliability and validity of a Chinese-translated version of the GRS-S with a sample of Chinese elementary and middle school students (N = 499). The Chinese GRSS was found to have high internal consistency. Results of the confirmatory factor analysis corroborated the six-factor solution of the original GRS-S. Comparison of the GRS-S scores and measures of academic performance provide preliminary support for the criterion validity of the Chinese-translated GRS-S. Significant age and gender differences on the Chinese GRS-S were found. Results provide preliminary support for the Chinese version of the GRS-S as a reliable and valid measure of giftedness for Chinese students. PMID:26346730

Assessing Construct Validity Using Multidimensional Item Response Theory.

ERIC Educational Resources Information Center

Ackerman, Terry A.

The concept of a user-specified validity sector is discussed. The idea of the validity sector combines the work of M. D. Reckase (1986) and R. Shealy and W. Stout (1991). Reckase developed a methodology to represent an item in a multidimensional latent space as a vector. Item vectors are computed using multidimensional item response theory item…

The Validity and Responsiveness of Isometric Lower Body Multi-Joint Tests of Muscular Strength: a Systematic Review.

PubMed

Drake, David; Kennedy, Rodney; Wallace, Eric

2017-12-01

Researchers and practitioners working in sports medicine and science require valid tests to determine the effectiveness of interventions and enhance understanding of mechanisms underpinning adaptation. Such decision making is influenced by the supportive evidence describing the validity of tests within current research. The objective of this study is to review the validity of lower body isometric multi-joint tests ability to assess muscular strength and determine the current level of supporting evidence. Preferred Reporting Items for Systematic Reviews and Meta-Analysis (PRISMA) guidelines were followed in a systematic fashion to search, assess and synthesize existing literature on this topic. Electronic databases such as Web of Science, CINAHL and PubMed were searched up to 18 March 2015. Potential inclusions were screened against eligibility criteria relating to types of test, measurement instrument, properties of validity assessed and population group and were required to be published in English. The Consensus-based Standards for the Selection of health Measurement Instruments (COSMIN) checklist was used to assess methodological quality and measurement property rating of included studies. Studies rated as fair or better in methodological quality were included in the best evidence synthesis. Fifty-nine studies met the eligibility criteria for quality appraisal. The ten studies that rated fair or better in methodological quality were included in the best evidence synthesis. The most frequently investigated lower body isometric multi-joint tests for validity were the isometric mid-thigh pull and isometric squat. The validity of each of these tests was strong in terms of reliability and construct validity. The evidence for responsiveness of tests was found to be moderate for the isometric squat test and unknown for the isometric mid-thigh pull. No tests using the isometric leg press met the criteria for inclusion in the best evidence synthesis. Researchers and

42 CFR 493.565 - Selection for validation inspection-laboratory responsibilities.

Code of Federal Regulations, 2010 CFR

2010-10-01

... 42 Public Health 5 2010-10-01 2010-10-01 false Selection for validation inspection-laboratory... Program § 493.565 Selection for validation inspection—laboratory responsibilities. A laboratory selected for a validation inspection must do the following: (a) Authorize its accreditation organization or...

42 CFR 493.565 - Selection for validation inspection-laboratory responsibilities.

Code of Federal Regulations, 2012 CFR

2012-10-01

... 42 Public Health 5 2012-10-01 2012-10-01 false Selection for validation inspection-laboratory... Program § 493.565 Selection for validation inspection—laboratory responsibilities. A laboratory selected for a validation inspection must do the following: (a) Authorize its accreditation organization or...

42 CFR 493.565 - Selection for validation inspection-laboratory responsibilities.

Code of Federal Regulations, 2011 CFR

2011-10-01

... 42 Public Health 5 2011-10-01 2011-10-01 false Selection for validation inspection-laboratory... Program § 493.565 Selection for validation inspection—laboratory responsibilities. A laboratory selected for a validation inspection must do the following: (a) Authorize its accreditation organization or...

42 CFR 493.565 - Selection for validation inspection-laboratory responsibilities.

Code of Federal Regulations, 2013 CFR

2013-10-01

... 42 Public Health 5 2013-10-01 2013-10-01 false Selection for validation inspection-laboratory... Program § 493.565 Selection for validation inspection—laboratory responsibilities. A laboratory selected for a validation inspection must do the following: (a) Authorize its accreditation organization or...

42 CFR 493.565 - Selection for validation inspection-laboratory responsibilities.

Code of Federal Regulations, 2014 CFR

2014-10-01

... 42 Public Health 5 2014-10-01 2014-10-01 false Selection for validation inspection-laboratory... Program § 493.565 Selection for validation inspection—laboratory responsibilities. A laboratory selected for a validation inspection must do the following: (a) Authorize its accreditation organization or...

Response rates in case-control studies of cancer by era of fieldwork and by characteristics of study design.

PubMed

Xu, Mengting; Richardson, Lesley; Campbell, Sally; Pintos, Javier; Siemiatycki, Jack

2018-04-09

The purpose of this study was to describe time trends in response rates in case-control studies of cancer and identify study design factors that influence response rate. We reviewed 370 case-control studies of cancer published in 12 journals during indicator years in each of the last four decades. We estimated time trends of response rates and reasons for nonresponse in each of the following types of study subjects: cases, medical source controls, and population controls. We also estimated response rates according to characteristics of study context. Median response rates among cases and population controls were between 75% and 80% in the 1970s. Between 1971 and 2010, study response rates declined by 0.31% per year for cases and 0.78% for population controls. Only a minority of studies reported reasons for nonparticipation; subject refusal was the most common reported reason. Studies conducted in North America had lower median response rates than studies conducted in Europe. In-person and telephone interviews elicited higher response rates than mail questionnaires. Response rates from case-control studies of cancer have declined, and this could threaten the validity of results derived from these studies. Copyright © 2018 Elsevier Inc. All rights reserved.

Reliability and validity of a smartphone pulse rate application for the assessment of resting and elevated pulse rate.

PubMed

Mitchell, Katy; Graff, Megan; Hedt, Corbin; Simmons, James

2016-08-01

Purpose/hypothesis: This study was designed to investigate the test-retest reliability, concurrent validity, and the standard error of measurement (SEm) of a pulse rate assessment application (Azumio®'s Instant Heart Rate) on both Android® and iOS® (iphone operating system) smartphones as compared to a FT7 Polar® Heart Rate monitor. Number of subjects: 111. Resting (sitting) pulse rate was assessed twice and then the participants were asked to complete a 1-min standing step test and then immediately re-assessed. The smartphone assessors were blinded to their measurements. Test-retest reliability (intraclass correlation coefficient [ICC 2,1] and 95% confidence interval) for the three tools at rest (time 1/time 2): iOS® (0.76 [0.67-0.83]); Polar® (0.84 [0.78-0.89]); and Android® (0.82 [0.75-0.88]). Concurrent validity at rest time 2 (ICC 2,1) with the Polar® device: IOS® (0.92 [0.88-0.94]) and Android® (0.95 [0.92-0.96]). Concurrent validity post-exercise (time 3) (ICC) with the Polar® device: iOS® (0.90 [0.86-0.93]) and Android® (0.94 [0.91-0.96]). The SEm values for the three devices at rest: iOS® (5.77 beats per minute [BPM]), Polar® (4.56 BPM) and Android® (4.96 BPM). The Android®, iOS®, and Polar® devices showed acceptable test-retest reliability at rest and post-exercise. Both the smartphone platforms demonstrated concurrent validity with the Polar® at rest and post-exercise. The Azumio® Instant Heart Rate application when used by either platform appears to be a reliable and valid tool to assess pulse rate in healthy individuals.

Validation of the Mayo Hip Score: construct validity, reliability and responsiveness to change.

PubMed

Singh, Jasvinder A; Schleck, Cathy; Harmsen, W Scott; Lewallen, David G

2016-01-19

Previous studies have provided the initial evidence for construct validity and test-retest reliability of the Mayo Hip Score. Instruments used for Total Hip Arthroplasty (THA) outcomes assessment should be valid, reliable and responsive to change. Our main objective was to examine the responsiveness to change, association with subsequent revision and the construct validity of the Mayo hip score. Discriminant ability was assessed by calculating effect size (ES), standardized response mean (SRM) and Guyatt's responsiveness index (GRI). Minimal clinically important difference (MCII) and moderate improvement thresholds were calculated. We assessed construct validity by examining association of scores with preoperative patient characteristics and correlation with Harris hip score, and assessed association of scores with the risk of subsequent revision. Five thousand three hundred seven provided baseline data; of those with baseline data, 2,278 and 2,089 (39%) provided 2- and 5-year data, respectively. Large ES, SRM and GRI ranging 2.66-2.78, 2.42-2.61 and 1.67-1.88 were noted for Mayo hip scores with THA, respectively. The MCII and moderate improvement thresholds were 22.4-22.7 and 39.4-40.5 respectively. Hazard ratios of revision surgery were higher with lower final score or less improvement in Mayo hip score at 2-years and borderline significant/non-significant at 5-years, respectively: (1) score ≤55 with hazard ratios of 2.24 (95% CI, 1.45, 3.46; p = 0.0003) and 1.70 (95% CI, 1.00, 2.92; p = 0.05) of implant revision subsequently, compared to 72-80 points; (2) no improvement or worsening score with hazard ratios 3.94 (95% CI, 1.50, 10.30; p = 0.005) and 2.72 (95% CI, 0.85,8.70; p = 0.09), compared to improvement >50-points. Mayo hip score had significant positive correlation with younger age, male gender, lower BMI, lower ASA class and lower Deyo-Charlson index (p ≤ 0.003 for each) and with Harris hip scores (p < 0.001). Mayo Hip Score is

Experimental validation of the RATE tool for inferring HLA restrictions of T cell epitopes.

PubMed

Paul, Sinu; Arlehamn, Cecilia S Lindestam; Schulten, Veronique; Westernberg, Luise; Sidney, John; Peters, Bjoern; Sette, Alessandro

2017-06-21

The RATE tool was recently developed to computationally infer the HLA restriction of given epitopes from immune response data of HLA typed subjects without additional cumbersome experimentation. Here, RATE was validated using experimentally defined restriction data from a set of 191 tuberculosis-derived epitopes and 63 healthy individuals with MTB infection from the Western Cape Region of South Africa. Using this experimental dataset, the parameters utilized by the RATE tool to infer restriction were optimized, which included relative frequency (RF) of the subjects responding to a given epitope and expressing a given allele as compared to the general test population and the associated p-value in a Fisher's exact test. We also examined the potential for further optimization based on the predicted binding affinity of epitopes to potential restricting HLA alleles, and the absolute number of individuals expressing a given allele and responding to the specific epitope. Different statistical measures, including Matthew's correlation coefficient, accuracy, sensitivity and specificity were used to evaluate performance of RATE as a function of these criteria. Based on our results we recommend selection of HLA restrictions with cutoffs of p-value < 0.01 and RF ≥ 1.3. The usefulness of the tool was demonstrated by inferring new HLA restrictions for epitope sets where restrictions could not be experimentally determined due to lack of necessary cell lines and for an additional data set related to recognition of pollen derived epitopes from allergic patients. Experimental data sets were used to validate RATE tool and the parameters used by the RATE tool to infer restriction were optimized. New HLA restrictions were identified using the optimized RATE tool.

Concurrent Validity and Sensitivity to Change of Direct Behavior Rating Single-Item Scales (DBR-SIS) within an Elementary Sample

ERIC Educational Resources Information Center

Smith, Rhonda L.; Eklund, Katie; Kilgus, Stephen P.

2018-01-01

The purpose of this study was to evaluate the concurrent validity, sensitivity to change, and teacher acceptability of Direct Behavior Rating single-item scales (DBR-SIS), a brief progress monitoring measure designed to assess student behavioral change in response to intervention. Twenty-four elementary teacher-student dyads implemented a daily…

Percent Grammatical Responses as a General Outcome Measure: Initial Validity

ERIC Educational Resources Information Center

Eisenberg, Sarita L.; Guo, Ling-Yu

2018-01-01

Purpose: This report investigated the validity of using percent grammatical responses (PGR) as a measure for assessing grammaticality. To establish construct validity, we computed the correlation of PGR with another measure of grammar skills and with an unrelated skill area. To establish concurrent validity for PGR, we computed the correlation of…

Baseline response rates affect resistance to change.

PubMed

Kuroda, Toshikazu; Cook, James E; Lattal, Kennon A

2018-01-01

The effect of response rates on resistance to change, measured as resistance to extinction, was examined in two experiments. In Experiment 1, responding in transition from a variable-ratio schedule and its yoked-interval counterpart to extinction was compared with pigeons. Following training on a multiple variable-ratio yoked-interval schedule of reinforcement, in which response rates were higher in the former component, reinforcement was removed from both components during a single extended extinction session. Resistance to extinction in the yoked-interval component was always either greater or equal to that in the variable-ratio component. In Experiment 2, resistance to extinction was compared for two groups of rats that exhibited either high or low response rates when maintained on identical variable-interval schedules. Resistance to extinction was greater for the lower-response-rate group. These results suggest that baseline response rate can contribute to resistance to change. Such effects, however, can only be revealed when baseline response rate and reinforcement rate are disentangled (Experiments 1 and 2) from the more usual circumstance where the two covary. Furthermore, they are more cleanly revealed when the programmed contingencies controlling high and low response rates are identical, as in Experiment 2. © 2017 Society for the Experimental Analysis of Behavior.

Reliability, construct validity, and responsiveness of the neck disability index, patient-specific functional scale, and numeric pain rating scale in patients with cervical radiculopathy.

PubMed

Young, Ian A; Cleland, Joshua A; Michener, Lori A; Brown, Chris

2010-10-01

To examine the psychometric properties of the Neck Disability Index, Patient-Specific Functional Scale, and the Numeric Pain Rating Scale in a cohort of patients with cervical radiculopathy. A single-group repeated-measures design. Patients (n = 165) presenting to physical therapy with cervical radiculopathy completed the Neck Disability Index, Patient-Specific Functional Scale, and Numeric Pain Rating Scale at the baseline examination and at a follow-up. At the time of follow-up, all patients also completed the Global Rating of Change, which was used to dichotomize patients as improved or stable. Baseline and follow-up scores were used to determine the test-retest reliability, construct validity, and minimal levels of detectable and clinically important change for the Neck Disability Index, Patient-Specific Functional Scale, and Numeric Pain Rating Scale. Both the Neck Disability Index and Numeric Pain Rating Scale exhibited fair test-retest reliability, whereas the Patient-Specific Functional Scale exhibited poor reliability in patients with cervical radiculopathy. All three outcome measures showed adequate responsiveness in this patient population. The minimal detectable change was 13.4 for the Neck Disability Index, 3.3 for the Patient-Specific Functional Scale, and 4.1 for the Numeric Pain Rating Scale. The threshold for the minimal clinically important difference was 8.5 for the Neck Disability Index and 2.2 for both the Patient-Specific Functional Scale and Numeric Pain Rating Scale. In light of the varied distribution of symptoms in patients with cervical radiculopathy, future studies should investigate the psychometric properties of other neck-related disability measures in this patient population.

Feedback Functions, Optimization, and the Relation of Response Rate to Reinforcer Rate

ERIC Educational Resources Information Center

Soto, Paul L.; McDowell, Jack J.; Dallery, Jesse

2006-01-01

The present experiment arranged a series of inverted U-shaped feedback functions relating reinforcer rate to response rate to test whether responding was consistent with an optimization account or with a one-to-one relation of response rate to reinforcer rate such as linear system theory's rate equation or Herrnstein's hyperbola. Reinforcer rate…

Brain Responses to Smoking Cues Differ Based on Nicotine Metabolism Rate

PubMed Central

Falcone, Mary; Cao, Wen; Bernardo, Leah; Tyndale, Rachel F; Loughead, James; Lerman, Caryn

2017-01-01

Background Inherited differences in the rate of metabolism of nicotine, the addictive chemical in tobacco, affect smoking behavior and quitting success. The nicotine metabolite ratio (NMR, 3′-hydroxycotinine/cotinine) is a reliable measure of nicotine clearance, and a well validated predictive biomarker of response to pharmacotherapy. To clarify the mechanisms underlying these associations, we investigated the neural responses to smoking cues in normal and slow nicotine metabolizers. Methods Sixty-nine treatment-seeking smokers (30 slow, 39 normal metabolizers) completed a visual cue reactivity task during functional magnetic resonance imaging on two separate occasions: once during smoking satiety and once following 24 hours of smoking abstinence. Results In whole brain analysis, normal (compared to slow) metabolizers exhibited heightened abstinence-induced neural responses to smoking cues in the left caudate, left inferior frontal gyrus, and left frontal pole. These effects were even more pronounced when extreme groups of slow and normal metabolizers were examined. Greater activation in the left caudate and left frontal pole was associated with abstinence-induced subjective cravings to smoke. Conclusion Inherited differences in rate of nicotine elimination may drive neural responses to smoking cues during early abstinence, providing a plausible mechanism to explain differences in smoking behaviors and response to cessation treatment. Normal metabolizers may benefit from adjunctive behavioral smoking cessation treatments, such as cue exposure therapy. PMID:26805583

Brain Responses to Smoking Cues Differ Based on Nicotine Metabolism Rate.

PubMed

Falcone, Mary; Cao, Wen; Bernardo, Leah; Tyndale, Rachel F; Loughead, James; Lerman, Caryn

2016-08-01

Inherited differences in the rate of metabolism of nicotine, the addictive chemical in tobacco, affect smoking behavior and quitting success. The nicotine metabolite ratio (3'-hydroxycotinine/cotinine) is a reliable measure of nicotine clearance and a well-validated predictive biomarker of response to pharmacotherapy. To clarify the mechanisms underlying these associations, we investigated the neural responses to smoking cues in normal and slow nicotine metabolizers. Treatment-seeking smokers (N = 69; 30 slow metabolizers and 39 normal metabolizers) completed a visual cue reactivity task during functional magnetic resonance imaging on two separate occasions: once during smoking satiety and once after 24 hours of smoking abstinence. In whole-brain analysis, normal (compared with slow) metabolizers exhibited heightened abstinence-induced neural responses to smoking cues in the left caudate, left inferior frontal gyrus, and left frontal pole. These effects were more pronounced when extreme groups of slow and normal metabolizers were examined. Greater activation in the left caudate and left frontal pole was associated with abstinence-induced subjective cravings to smoke. Inherited differences in rate of nicotine elimination may drive neural responses to smoking cues during early abstinence, providing a plausible mechanism to explain differences in smoking behaviors and response to cessation treatment. Normal metabolizers may benefit from adjunctive behavioral smoking cessation treatments, such as cue exposure therapy. Copyright © 2016 Society of Biological Psychiatry. Published by Elsevier Inc. All rights reserved.

Validation of Heart Rate Monitor Polar RS800 for Heart Rate Variability Analysis During Exercise.

PubMed

Hernando, David; Garatachea, Nuria; Almeida, Rute; Casajús, Jose A; Bailón, Raquel

2018-03-01

Hernando, D, Garatachea, N, Almeida, R, Casajús, JA, and Bailón, R. Validation of heart rate monitor Polar RS800 for heart rate variability analysis during exercise. J Strength Cond Res 32(3): 716-725, 2018-Heart rate variability (HRV) analysis during exercise is an interesting noninvasive tool to measure the cardiovascular response to the stress of exercise. Wearable heart rate monitors are a comfortable option to measure interbeat (RR) intervals while doing physical activities. It is necessary to evaluate the agreement between HRV parameters derived from the RR series recorded by wearable devices and those derived from an electrocardiogram (ECG) during dynamic exercise of low to high intensity. Twenty-three male volunteers performed an exercise stress test on a cycle ergometer. Subjects wore a Polar RS800 device, whereas ECG was also recorded simultaneously to extract the reference RR intervals. A time-frequency spectral analysis was performed to extract the instantaneous mean heart rate (HRM), and the power of low-frequency (PLF) and high-frequency (PHF) components, the latter centered on the respiratory frequency. Analysis was done in intervals of different exercise intensity based on oxygen consumption. Linear correlation, reliability, and agreement were computed in each interval. The agreement between the RR series obtained from the Polar device and from the ECG is high throughout the whole test although the shorter the RR is, the more differences there are. Both methods are interchangeable when analyzing HRV at rest. At high exercise intensity, HRM and PLF still presented a high correlation (ρ > 0.8) and excellent reliability and agreement indices (above 0.9). However, the PHF measurements from the Polar showed reliability and agreement coefficients around 0.5 or lower when the level of the exercise increases (for levels of O2 above 60%).

Convergent and Discriminant Validation of Student Ratings of College Instructors.

ERIC Educational Resources Information Center

Hillery, Joseph M.; Yukl, Gary A.

This paper reports the results of a validation study of data obtained from a teacher rating survey conducted by the University of Akron Student Council during the Fall 1969. The rating questionnaire consisted of 14 times: two items measured the student's overall evaluation of his instructor; 5 items measured specific performance dimensions such as…

The Validity of Online Patient Ratings of Physicians: Analysis of Physician Peer Reviews and Patient Ratings.

PubMed

McGrath, Robert J; Priestley, Jennifer Lewis; Zhou, Yiyun; Culligan, Patrick J

2018-04-09

Information from ratings sites are increasingly informing patient decisions related to health care and the selection of physicians. The current study sought to determine the validity of online patient ratings of physicians through comparison with physician peer review. We extracted 223,715 reviews of 41,104 physicians from 10 of the largest cities in the United States, including 1142 physicians listed as "America's Top Doctors" through physician peer review. Differences in mean online patient ratings were tested for physicians who were listed and those who were not. Overall, no differences were found between the online patient ratings based upon physician peer review status. However, statistical differences were found for four specialties (family medicine, allergists, internal medicine, and pediatrics), with online patient ratings significantly higher for those physicians listed as a peer-reviewed "Top Doctor" versus those who were not. The results of this large-scale study indicate that while online patient ratings are consistent with physician peer review for four nonsurgical, primarily in-office specializations, patient ratings were not consistent with physician peer review for specializations like anesthesiology. This result indicates that the validity of patient ratings varies by medical specialization. ©Robert J McGrath, Jennifer Lewis Priestley, Yiyun Zhou, Patrick J Culligan. Originally published in the Interactive Journal of Medical Research (http://www.i-jmr.org/), 09.04.2018.

Development and validation of a Chinese music quality rating test.

PubMed

Cai, Yuexin; Zhao, Fei; Zheng, Yiqing

2013-09-01

The present study aims to develop and validate a Chinese music quality rating test (MQRT). In Experiment 1, 22 music pieces were initially selected and paired as a 'familiar music piece' and 'unfamiliar music piece' based on familiarities amongst the general public in the categories of classical music (6), Chinese folk music (8), and pop music (8). Following the selection criteria, one pair of music pieces from each music category was selected and used for the MQRT in Experiment 2. In Experiment 2, the MQRT was validated using these music pieces in the categories 'Pleasantness', 'Naturalness', 'Fullness', 'Roughness', and 'Sharpness'. Seventy-two adult participants and 30 normal-hearing listeners were recruited in Experiments 1 and 2, respectively. Significant differences between the familiar and unfamiliar music pieces were found in respect of pleasantness rating for folk and pop music pieces as well as in sharpness rating for pop music pieces. The comparison of music category effect on MQRT found significant differences in pleasantness, fullness, and sharpness ratings. The Chinese MQRT developed in the present study is an effective tool for assessing music quality.

Concurrent validity and sensitivity to change of Direct Behavior Rating Single-Item Scales (DBR-SIS) within an elementary sample.

PubMed

Smith, Rhonda L; Eklund, Katie; Kilgus, Stephen P

2018-03-01

The purpose of this study was to evaluate the concurrent validity, sensitivity to change, and teacher acceptability of Direct Behavior Rating single-item scales (DBR-SIS), a brief progress monitoring measure designed to assess student behavioral change in response to intervention. Twenty-four elementary teacher-student dyads implemented a daily report card intervention to promote positive student behavior during prespecified classroom activities. During both baseline and intervention, teachers completed DBR-SIS ratings of 2 target behaviors (i.e., Academic Engagement, Disruptive Behavior) whereas research assistants collected systematic direct observation (SDO) data in relation to the same behaviors. Five change metrics (i.e., absolute change, percent of change from baseline, improvement rate difference, Tau-U, and standardized mean difference; Gresham, 2005) were calculated for both DBR-SIS and SDO data, yielding estimates of the change in student behavior in response to intervention. Mean DBR-SIS scores were predominantly moderately to highly correlated with SDO data within both baseline and intervention, demonstrating evidence of the former's concurrent validity. DBR-SIS change metrics were also significantly correlated with SDO change metrics for both Disruptive Behavior and Academic Engagement, yielding evidence of the former's sensitivity to change. In addition, teacher Usage Rating Profile-Assessment (URP-A) ratings indicated they found DBR-SIS to be acceptable and usable. Implications for practice, study limitations, and areas of future research are discussed. (PsycINFO Database Record (c) 2018 APA, all rights reserved).

Validating indicators of treatment response: application to trichotillomania.

PubMed

Nelson, Samuel O; Rogers, Kate; Rusch, Natalie; McDonough, Lauren; Malloy, Elizabeth J; Falkenstein, Martha J; Banis, Maria; Haaga, David A F

2014-09-01

Different studies of the treatment of trichotillomania (TTM) have used varying standards to determine the proportion of patients who obtain clinically meaningful benefits, but there is little information on the similarity of results yielded by these methods or on their comparative validity. Data from a stepped-care (Step 1: Web-based self-help; Step 2: Individual behavior therapy; N = 60) treatment study of TTM were used to evaluate 7 potential standards: complete abstinence, ≥ 25% symptom reduction, recovery of normal functioning, and clinical significance (recovery + statistically reliable change), each of the last 3 being measured by self-report (Massachusetts General Hospital Hairpulling Scale; MGH-HPS) or interview (Psychiatric Institute Trichotillomania Scale). Depending on the metric, response rates ranged from 25 to 68%. All standards were significantly associated with one another, though less strongly for the 25% symptom reduction metrics. Concurrent (with deciding to enter Step 2 treatment) and predictive (with 3-month follow-up treatment satisfaction, TTM-related impairment, quality of life, and diagnosis) validity results were variable but generally strongest for clinical significance as measured via self-report. Routine reporting of the proportion of patients who make clinically significant improvement on the MGH-HPS, supplemented by data on complete abstinence, would bolster the interpretability of TTM treatment outcome findings. PsycINFO Database Record (c) 2014 APA, all rights reserved.

Patient-Reported Outcome Measures for Hand and Wrist Trauma: Is There Sufficient Evidence of Reliability, Validity, and Responsiveness?

PubMed

Dacombe, Peter Jonathan; Amirfeyz, Rouin; Davis, Tim

2016-03-01

Patient-reported outcome measures (PROMs) are important tools for assessing outcomes following injuries to the hand and wrist. Many commonly used PROMs have no evidence of reliability, validity, and responsiveness in a hand and wrist trauma population. This systematic review examines the PROMs used in the assessment of hand and wrist trauma patients, and the evidence for reliability, validity, and responsiveness of each measure in this population. A systematic review of Pubmed, Medline, and CINAHL searching for randomized controlled trials of patients with traumatic injuries to the hand and wrist was carried out to identify the PROMs. For each identified PROM, evidence of reliability, validity, and responsiveness was identified using a further systematic review of the Pubmed, Medline, CINAHL, and reverse citation trail audit procedure. The PROM used most often was the Disabilities of the Arm, Shoulder and Hand (DASH) questionnaire; the Patient-Rated Wrist Evaluation (PRWE), Gartland and Werley score, Michigan Hand Outcomes score, Mayo Wrist Score, and Short Form 36 were also commonly used. Only the DASH and PRWE have evidence of reliability, validity, and responsiveness in patients with traumatic injuries to the hand and wrist; other measures either have incomplete evidence or evidence gathered in a nontraumatic population. The DASH and PRWE both have evidence of reliability, validity, and responsiveness in a hand and wrist trauma population. Other PROMs used to assess hand and wrist trauma patients do not. This should be considered when selecting a PROM for patients with traumatic hand and wrist pathology.

Validity and Responsiveness of the Two-Minute Walk Test for Measuring Functional Recovery After Total Knee Arthroplasty.

PubMed

Unnanuntana, Aasis; Ruangsomboon, Pakpoom; Keesukpunt, Worawut

2018-06-01

The 2-minute walk test (2mwt) is a performance-based test that evaluates functional recovery after total knee arthroplasty (TKA). This study evaluated its validity compared with the modified Western Ontario and McMaster Universities Osteoarthritis Index (WOMAC), Oxford Knee Score (OKS), modified Knee Score, Numerical Pain Rating Scale, and Timed Up and Go test, and its responsiveness in assessing functional recovery in TKA patients. This prospective cohort study included 162 patients undergoing primary TKA between 2013 and 2015. We used patient-reported outcome measures (modified WOMAC, OKS, modified Knee Score, Numerical Pain Rating Scale) and performance-based tests (2mwt and Timed Up and Go test) at baseline and 3, 6, and 12 months postoperatively. The construct validity of 2mwt was determined between the 2mwt distances walked and other outcome measurements. To assess responsiveness, effect size and standardized response mean were analyzed. Minimal clinically important difference of 2mwt at 12 months after TKA was also calculated. All outcome measurements improved significantly from baseline to 3, 6, and 12 months postoperatively. Bivariate analysis revealed mild to moderate associations between the 2mwt and modified WOMAC function subscales, and moderate to strong associations with OKS. Mild to moderate correlations were found for pain and stiffness between 2mwt and other outcome measurements. The effect size and standardized response mean at 12 months were large, with a minimal clinically important difference of 12.7 m. 2mwt is a validated performance-based test with responsiveness properties. Being simple and easy to perform, it can be used routinely in clinical practice to evaluate functional recovery after TKA. Copyright © 2018 The Authors. Published by Elsevier Inc. All rights reserved.

Validation of Biofeedback Wearables for Photoplethysmographic Heart Rate Tracking

PubMed Central

Jo, Edward; Lewis, Kiana; Directo, Dean; Kim, Michael J.; Dolezal, Brett A.

2016-01-01

The purpose of this study was to examine the validity of HR measurements by two commercial-use activity trackers in comparison to ECG. Twenty-four healthy participants underwent the same 77-minute protocol during a single visit. Each participant completed an initial rest period of 15 minutes followed by 5 minute periods of each of the following activities: 60W and 120W cycling, walking, jogging, running, resisted arm raises, resisted lunges, and isometric plank. In between each exercise task was a 5-minute rest period. Each subject wore a Basis Peak (BPk) on one wrist and a Fitbit Charge HR (FB) on the opposite wrist. Criterion measurement of HR was administered by 12-lead ECG. Time synced data from each device and ECG were concurrently and electronically acquired throughout the entire 77-minute protocol. When examining data in aggregate, there was a strong correlation between BPk and ECG for HR (r = 0.92, p < 0.001) with a mean bias of -2.5 bpm (95% LoA 19.3, -24.4). The FB demonstrated a moderately strong correlation with ECG for HR (r = 0.83, p < 0.001) with an average mean bias of -8.8 bpm (95% LoA 24.2, -41.8). During physical efforts eliciting ECG HR > 116 bpm, the BPk demonstrated an r = 0.77 and mean bias = -4.9 bpm (95% LoA 21.3, -31.0) while the FB demonstrated an r = 0.58 and mean bias = -12.7 bpm (95% LoA 28.6, -54.0). The BPk satisfied validity criteria for HR monitors, however showed a marginal decline in accuracy with increasing physical effort (ECG HR > 116 bpm). The FB failed to satisfy validity criteria and demonstrated a substantial decrease in accuracy during higher exercise intensities. Key points Modern day wearable multi-sensor activity trackers incorporate reflective photoplethymography (PPG) for heart rate detection and monitoring at the dorsal wrist. This study examined the validity of two PPG-based activity trackers, the Basis Peak and Fitbit Charge HR. The Basis Peak performed with accuracy compared with ECG and results substantiate

HPA and SAM axis responses as correlates of self- vs parental ratings of anxiety in boys with an Autistic Disorder.

PubMed

Bitsika, Vicki; Sharpley, Christopher F; Sweeney, John A; McFarlane, James R

2014-03-29

Anxiety and Autistic Disorder (AD) are both neurological conditions and both disorders share some features that make it difficult to precisely allocate specific symptoms to each disorder. HPA and SAM axis activities have been conclusively associated with anxiety, and may provide a method of validating anxiety rating scale assessments given by parents and their children with AD about those children. Data from HPA axis (salivary cortisol) and SAM axis (salivary alpha amylase) responses were collected from a sample of 32 high-functioning boys (M age=11yr) with an Autistic Disorder (AD) and were compared with the boys' and their mothers' ratings of the boys' anxiety. There was a significant difference between the self-ratings given by the boys and ratings given about them by their mothers. Further, only the boys' self-ratings of their anxiety significantly predicted the HPA axis responses and neither were significantly related to SAM axis responses. Some boys showed cortisol responses which were similar to that previously reported in children who had suffered chronic and severe anxiety arising from stressful social interactions. As well as suggesting that some boys with an AD can provide valid self-assessments of their anxiety, these data also point to the presence of very high levels of chronic HPA-axis arousal and consequent chronic anxiety in these boys. Copyright © 2014 Elsevier Inc. All rights reserved.

Validity of a heart rate monitor during work in the laboratory and on the Space Shuttle

NASA Technical Reports Server (NTRS)

Moore, A. D. Jr; Lee, S. M.; Greenisen, M. C.; Bishop, P.

1997-01-01

Accurate heart rate measurement during work is required for many industrial hygiene and ergonomics situations. The purpose of this investigation was to determine the validity of heart rate measurements obtained by a simple, lightweight, commercially available wrist-worn heart rate monitor (HRM) during work (cycle exercise) sessions conducted in the laboratory and also during the particularly challenging work environment of space flight. Three different comparisons were made. The first compared HRM data to simultaneous electrocardiogram (ECG) recordings of varying heart rates that were generated by an ECG simulator. The second compared HRM data to ECG recordings collected during work sessions of 14 subjects in the laboratory. Finally, ECG downlink and HRM data were compared in four astronauts who performed cycle exercise during space flight. The data were analyzed using regression techniques. The results were that the HRM recorded virtually identical heart rates compared with ECG recordings for the data set generated by an ECG simulator. The regression equation for the relationship between ECG versus HRM heart rate data during work in the laboratory was: ECG HR = 0.99 x (HRM) + 0.82 (r2 = 0.99). Finally, the agreement between ECG downlink data and HRM data during space flight was also very high, with the regression equation being: Downlink ECG HR = 1.05 x (HRM) -5.71 (r2 = 0.99). The results of this study indicate that the HRM provides accurate data and may be used to reliably obtain valid data regarding heart rate responses during work.

Content Validity and Psychometric Characteristics of the "Knowledge about Older Patients Quiz" for Nurses Using Item Response Theory.

PubMed

Dikken, Jeroen; Hoogerduijn, Jita G; Kruitwagen, Cas; Schuurmans, Marieke J

2016-11-01

To assess the content validity and psychometric characteristics of the Knowledge about Older Patients Quiz (KOP-Q), which measures nurses' knowledge regarding older hospitalized adults and their certainty regarding this knowledge. Cross-sectional. Content validity: general hospitals. Psychometric characteristics: nursing school and general hospitals in the Netherlands. Content validity: 12 nurse specialists in geriatrics. Psychometric characteristics: 107 first-year and 78 final-year bachelor of nursing students, 148 registered nurses, and 20 nurse specialists in geriatrics. Content validity: The nurse specialists rated each item of the initial KOP-Q (52 items) on relevance. Ratings were used to calculate Item-Content Validity Index and average Scale-Content Validity Index (S-CVI/ave) scores. Items with insufficient content validity were removed. Psychometric characteristics: Ratings of students, nurses, and nurse specialists were used to test for different item functioning (DIF) and unidimensionality before item characteristics (discrimination and difficulty) were examined using Item Response Theory. Finally, norm references were calculated and nomological validity was assessed. Content validity: Forty-three items remained after assessing content validity (S-CVI/ave = 0.90). Psychometric characteristics: Of the 43 items, two demonstrating ceiling effects and 11 distorting ability estimates (DIF) were subsequently excluded. Item characteristics were assessed for the remaining 30 items, all of which demonstrated good discrimination and difficulty parameters. Knowledge was positively correlated with certainty about this knowledge. The final 30-item KOP-Q is a valid, psychometrically sound, comprehensive instrument that can be used to assess the knowledge of nursing students, hospital nurses, and nurse specialists in geriatrics regarding older hospitalized adults. It can identify knowledge and certainty deficits for research purposes or serve as a tool in educational

Translation, Cross-Cultural Adaptation, and Validation of the Activity Rating Scale for Disorders of the Knee.

PubMed

Flosadottir, Vala; Roos, Ewa M; Ageberg, Eva

2017-09-01

The Activity Rating Scale (ARS) for disorders of the knee evaluates the level of activity by the frequency of participation in 4 separate activities with high demands on knee function, with a score ranging from 0 (none) to 16 (pivoting activities 4 times/wk). To translate and cross-culturally adapt the ARS into Swedish and to assess measurement properties of the Swedish version of the ARS. Cohort study (diagnosis); Level of evidence, 2. The COSMIN guidelines were followed. Participants (N = 100 [55 women]; mean age, 27 years) who were undergoing rehabilitation for a knee injury completed the ARS twice for test-retest reliability. The Knee injury and Osteoarthritis Outcome Score (KOOS), Tegner Activity Scale (TAS), and modernized Saltin-Grimby Physical Activity Level Scale (SGPALS) were administered at baseline to validate the ARS. Construct validity and responsiveness of the ARS were evaluated by testing predefined hypotheses regarding correlations between the ARS, KOOS, TAS, and SGPALS. The Cronbach alpha, intraclass correlation coefficients, absolute reliability, standard error of measurement, smallest detectable change, and Spearman rank-order correlation coefficients were calculated. The ARS showed good internal consistency (α ≈ 0.96), good test-retest reliability (intraclass correlation coefficient >0.9), and no systematic bias between measurements. The standard error of measurement was less than 2 points, and the smallest detectable change was less than 1 point at the group level and less than 5 points at the individual level. More than 75% of the hypotheses were confirmed, indicating good construct validity and good responsiveness of the ARS. The Swedish version of the ARS is valid, reliable, and responsive for evaluating the level of activity based on the frequency of participation in high-demand knee sports activities in young adults with a knee injury.

Translation, Cross-Cultural Adaptation, and Validation of the Activity Rating Scale for Disorders of the Knee

PubMed Central

Flosadottir, Vala; Roos, Ewa M.; Ageberg, Eva

2017-01-01

Background: The Activity Rating Scale (ARS) for disorders of the knee evaluates the level of activity by the frequency of participation in 4 separate activities with high demands on knee function, with a score ranging from 0 (none) to 16 (pivoting activities 4 times/wk). Purpose: To translate and cross-culturally adapt the ARS into Swedish and to assess measurement properties of the Swedish version of the ARS. Study Design: Cohort study (diagnosis); Level of evidence, 2. Methods: The COSMIN guidelines were followed. Participants (N = 100 [55 women]; mean age, 27 years) who were undergoing rehabilitation for a knee injury completed the ARS twice for test-retest reliability. The Knee injury and Osteoarthritis Outcome Score (KOOS), Tegner Activity Scale (TAS), and modernized Saltin-Grimby Physical Activity Level Scale (SGPALS) were administered at baseline to validate the ARS. Construct validity and responsiveness of the ARS were evaluated by testing predefined hypotheses regarding correlations between the ARS, KOOS, TAS, and SGPALS. The Cronbach alpha, intraclass correlation coefficients, absolute reliability, standard error of measurement, smallest detectable change, and Spearman rank-order correlation coefficients were calculated. Results: The ARS showed good internal consistency (α ≈ 0.96), good test-retest reliability (intraclass correlation coefficient >0.9), and no systematic bias between measurements. The standard error of measurement was less than 2 points, and the smallest detectable change was less than 1 point at the group level and less than 5 points at the individual level. More than 75% of the hypotheses were confirmed, indicating good construct validity and good responsiveness of the ARS. Conclusion: The Swedish version of the ARS is valid, reliable, and responsive for evaluating the level of activity based on the frequency of participation in high-demand knee sports activities in young adults with a knee injury. PMID:28979920

Validity criteria for Fermi's golden rule scattering rates applied to metallic nanowires.

PubMed

Moors, Kristof; Sorée, Bart; Magnus, Wim

2016-09-14

Fermi's golden rule underpins the investigation of mobile carriers propagating through various solids, being a standard tool to calculate their scattering rates. As such, it provides a perturbative estimate under the implicit assumption that the effect of the interaction Hamiltonian which causes the scattering events is sufficiently small. To check the validity of this assumption, we present a general framework to derive simple validity criteria in order to assess whether the scattering rates can be trusted for the system under consideration, given its statistical properties such as average size, electron density, impurity density et cetera. We derive concrete validity criteria for metallic nanowires with conduction electrons populating a single parabolic band subjected to different elastic scattering mechanisms: impurities, grain boundaries and surface roughness.

A symptom self-rating scale for schizophrenia (4S): psychometric properties, reliability and validity.

PubMed

Lindström, Eva; Jedenius, Erik; Levander, Sten

2009-01-01

The objective of the study was to validate a self-administrated symptom rating scale for use in patients with schizophrenia spectrum disorders by item analysis, exploration of factor structure, and analyses of reliability and validity. Data on 151 patients, initially treated by risperidone, obtained within the framework of a naturalistic Phase IV longitudinal study, were analysed by comparing patient and clinician ratings of symptoms, side-effects and global indices of illness. The Symptom Self-rating Scale for Schizophrenia (4S) is psychometrically adequate (item analysis, internal consistency, factor structure). Side-effect ratings were reliable. Symptom ratings displayed consistent associations with clinicians' ratings of corresponding symptom dimensions, suggesting construct validity. Patients had most difficulties assessing negative symptom items. Patients were well able to assess their own symptoms and drug side-effects. The factor structure of symptom ratings differs between patients and clinicians as well as how they construe global indices of illness. Clinicians focus on psychotic, patients on affective symptoms. Use of symptom self-ratings is one way to improve communication and thereby strengthen the therapeutic alliance and increase treatment adherence.

Validation of an auditory startle response system using chemicals or parametric modulation as positive controls.

PubMed

Marable, Brian R; Maurissen, Jacques P J

2004-01-01

Neurotoxicity regulatory guidelines mandate that automated test systems be validated using chemicals. However, in some cases, chemicals may not necessarily be needed to prove test system validity. To examine this issue, two independent experiments were conducted to validate an automated auditory startle response (ASR) system. In Experiment 1, we used adult (PND 63) and weanling (PND 22) Sprague-Dawley rats (10/sex/dose) to determine the effect of either d-amphetamine (4.0 or 8.0 mg/kg) or clonidine (0.4 or 0.8 mg/kg) on the ASR peak amplitude (ASR PA). The startle response of each rat to a short burst of white noise (120 dB SPL) was recorded over 50 consecutive trials. The ASR PA was significantly decreased (by clonidine) and increased (by d-amphetamine) compared to controls in PND 63 rats. In PND 22 rats, the response to clonidine was similar to adults, but d-amphetamine effects were not significant. Neither drug affected the rate of the decrease in ASR PA over time (habituation). In Experiment 2, PND 31 Sprague-Dawley rats (8/sex) were presented with 150 trials consisting of either white noise bursts of variable intensity (70-120 dB SPL in 10 dB increments, presented in random order) or null (0 dB SPL) trials. Statistically significant sex- and intensity-dependent differences were detected in the ASR PA. These results suggest that in some cases, parametric modulation may be an alternative to using chemicals for test system validation.

Development and Validation of Children's Responsible Environmental Behavior Scale

ERIC Educational Resources Information Center

Erdogan, Mehmet; Ok, Ahmet; Marcinkowski, Thomas Joseph

2012-01-01

Though environmentally responsible behavior (ERB) has been a focus of many studies in the field of environmental education, very few scales have been developed to assess children's ERB. In this regard, this article focuses on the development and validation of Children's Responsible Environmental Behavior Scale (CREBS) and also reports the…

Heart Rate and VO[subscript 2] Responses to Cycle Ergometry in White and African American Men

ERIC Educational Resources Information Center

Vehrs, Pat R.; Fellingham, Gilbert W.

2006-01-01

The validity of estimates of peak oxygen consumption (VO[subscript 2]peak) using submaximal exercise tests may be compromised when the participants being tested are not similar to the participants used to develop the test. This study compared ethnic differences in the heart rate (HR) and oxygen consumption (VO[subscript 2]) responses to submaximal…

The Parent Trauma Response Questionnaire (PTRQ): development and preliminary validation.

PubMed

Williamson, Victoria; Hiller, Rachel M; Meiser-Stedman, Richard; Creswell, Cathy; Dalgleish, Tim; Fearon, Pasco; Goodall, Ben; McKinnon, Anna; Smith, Patrick; Wright, Isobel; Halligan, Sarah L

2018-01-01

Background : Following a child's experience of trauma, parental response is thought to play an important role in either facilitating or hindering their psychological adjustment. However, the ability to investigate the role of parenting responses in the post-trauma period has been hampered by a lack of valid and reliable measures. Objectives : The aim of this study was to design, and provide a preliminary validation of, the Parent Trauma Response Questionnaire (PTRQ), a self-report measure of parental appraisals and support for children's coping, in the aftermath of child trauma. Methods : We administered an initial set of 78 items to 365 parents whose children, aged 2-19 years, had experienced a traumatic event. We conducted principal axis factoring and then assessed the validity of the reduced measure against a standardized general measure of parental overprotection and via the measure's association with child post-trauma mental health. Results : Factor analysis generated three factors assessing parental maladaptive appraisals: (i) permanent change/damage, (ii) preoccupation with child's vulnerability, and (iii) self-blame. In addition, five factors were identified that assess parental support for child coping: (i) behavioural avoidance, (ii) cognitive avoidance, (iii) overprotection, (iv) maintaining pre-trauma routines, and (v) approach coping. Good validity was evidenced against the measure of parental overprotection and child post-traumatic stress symptoms. Good test-retest reliability of the measure was also demonstrated. Conclusions : The PTRQ is a valid and reliable self-report assessment of parenting cognitions and coping in the aftermath of child trauma.

Validation of a High Sampling Rate Inertial Measurement Unit for Acceleration During Running.

PubMed

Provot, Thomas; Chiementin, Xavier; Oudin, Emeric; Bolaers, Fabrice; Murer, Sébastien

2017-08-25

The musculo-skeletal response of athletes to various activities during training exercises has become a critical issue in order to optimize their performance and minimize injuries. However, dynamic and kinematic measures of an athlete's activity are generally limited by constraints in data collection and technology. Thus, the choice of reliable and accurate sensors is crucial for gathering data in indoor and outdoor conditions. The aim of this study is to validate the use of the accelerometer of a high sampling rate ( 1344 Hz ) Inertial Measurement Unit (IMU) in the frame of running activities. To this end, two validation protocols are imposed: a classical one on a shaker, followed by another one during running, the IMU being attached to a test subject. For each protocol, the response of the IMU Accelerometer (IMUA) is compared to a calibrated industrial accelerometer, considered as the gold standard for dynamic and kinematic data collection. The repeatability, impact of signal frequency and amplitude (on shaker) as well as the influence of speed (while running) are investigated. Results reveal that the IMUA exhibits good repeatability. Coefficient of Variation CV is 1 % 8.58 ± 0.06 m / s 2 on the shaker and 3 % 26.65 ± 0.69 m / s 2 while running. However, the shaker test shows that the IMUA is affected by the signal frequency (error exceeds 10 % beyond 80 Hz ), an observation confirmed by the running test. Nevertheless, the IMUA provides a reliable measure in the range 0-100 Hz, i.e., the most relevant part in the energy spectrum over the range 0-150 Hz during running. In our view, these findings emphasize the validity of IMUs for the measurement of acceleration during running.

Validation of the Intestinal Part of the Prostate Cancer Questionnaire 'QUFW94': Psychometric Properties, Responsiveness, and Content Validity

DOE Office of Scientific and Technical Information (OSTI.GOV)

Reidunsdatter, Randi J.; Lund, Jo-Asmund; Department of Oncology, St. Olavs University Hospital, Trondheim

Purpose: Several treatment options are available for patients with prostate cancer. Applicable and valid self-assessment instruments for assessing health-related quality of life (HRQOL) are of paramount importance. The aim of this study was to explore the validity and responsiveness of the intestinal part of the prostate cancer-specific questionnaire QUFW94. Methods and Materials: The content of the intestinal part of QUFW94 was examined by evaluation of experienced clinicians and reviewing the literature. The psychometric properties and responsiveness were assessed by analyzing HRQOL data from the randomized study Scandinavian Prostate Cancer Group 7 (SPCG)/Swedish Association for Urological Oncology 3 (SFUO). Subscales weremore » constructed by means of exploratory factor analyses. Internal consistency was assessed by Cronbach's alpha. Responsiveness was investigated by comparing baseline scores with the 4-year posttreatment follow-up. Results: The content validity was found acceptable, but some amendments were proposed. The factor analyses revealed two symptom scales. The first scale comprised five items regarding general stool problems, frequency, incontinence, need to plan toilet visits, and daily activity. Cronbach's alpha at 0.83 indicated acceptable homogeneity. The second scale was less consistent with a Cronbach's alpha at 0.55. The overall responsiveness was found to be very satisfactory. Conclusion: Two scales were identified in the bowel dimension of the QUFW94; the first one had good internal consistency. The responsiveness was excellent, and some modifications are suggested to strengthen the content validity.« less

Measuring older adults' sedentary time: reliability, validity, and responsiveness.

PubMed

Gardiner, Paul A; Clark, Bronwyn K; Healy, Genevieve N; Eakin, Elizabeth G; Winkler, Elisabeth A H; Owen, Neville

2011-11-01

With evidence that prolonged sitting has deleterious health consequences, decreasing sedentary time is a potentially important preventive health target. High-quality measures, particularly for use with older adults, who are the most sedentary population group, are needed to evaluate the effect of sedentary behavior interventions. We examined the reliability, validity, and responsiveness to change of a self-report sedentary behavior questionnaire that assessed time spent in behaviors common among older adults: watching television, computer use, reading, socializing, transport and hobbies, and a summary measure (total sedentary time). In the context of a sedentary behavior intervention, nonworking older adults (n = 48, age = 73 ± 8 yr (mean ± SD)) completed the questionnaire on three occasions during a 2-wk period (7 d between administrations) and wore an accelerometer (ActiGraph model GT1M) for two periods of 6 d. Test-retest reliability (for the individual items and the summary measure) and validity (self-reported total sedentary time compared with accelerometer-derived sedentary time) were assessed during the 1-wk preintervention period, using Spearman (ρ) correlations and 95% confidence intervals (CI). Responsiveness to change after the intervention was assessed using the responsiveness statistic (RS). Test-retest reliability was excellent for television viewing time (ρ (95% CI) = 0.78 (0.63-0.89)), computer use (ρ (95% CI) = 0.90 (0.83-0.94)), and reading (ρ (95% CI) = 0.77 (0.62-0.86)); acceptable for hobbies (ρ (95% CI) = 0.61 (0.39-0.76)); and poor for socializing and transport (ρ < 0.45). Total sedentary time had acceptable test-retest reliability (ρ (95% CI) = 0.52 (0.27-0.70)) and validity (ρ (95% CI) = 0.30 (0.02-0.54)). Self-report total sedentary time was similarly responsive to change (RS = 0.47) as accelerometer-derived sedentary time (RS = 0.39). The summary measure of total sedentary time has good repeatability and modest validity and is

The work role functioning questionnaire 2.0 (Dutch version): examination of its reliability, validity and responsiveness in the general working population.

PubMed

Abma, Femke I; van der Klink, Jac J L; Bültmann, Ute

2013-03-01

The promotion of a sustainable, healthy and productive working life attracts more and more attention. Recently the Work Role Functioning Questionnaire (WRFQ) has been cross-culturally translated and adapted to Dutch. This questionnaire aims to measure the health-related work functioning of workers with health problems. The aim of this study is to evaluate the reliability, validity (including five new items) and responsiveness of the WRFQ 2.0 in the working population. A longitudinal study was conducted among workers. The reliability (internal consistency, test-retest reliability, measurement error), validity (structural validity-factor analysis, construct validity by means of hypotheses testing) and responsiveness of the WRFQ 2.0 were evaluated. A total of N = 553 workers completed the survey. The final WRFQ 2.0 has four subscales and showed very good internal consistency, moderate test-retest reliability, good construct validity and moderate responsiveness in the working population. The WRFQ was able to distinguish between groups with different levels of mental health, physical health, fatigue and need for recovery. A moderate correlation was found between WRFQ and related constructs respectively work ability and work productivity. A weak relationship was found with general self-rated health, work engagement and work involvement. The WRFQ 2.0 is a reliable and valid instrument to measure health-related work functioning in the working population. Further validation in larger samples is recommended, especially for test-retest reliability, responsiveness and the questionnaire's ability to predict the future course of health-related work functioning.

Validity of response assessment criteria in neoadjuvant chemotherapy for gastric cancer (JCOG0507-A).

PubMed

Kurokawa, Yukinori; Shibata, Taro; Sasako, Mitsuru; Sano, Takeshi; Tsuburaya, Akira; Iwasaki, Yoshiaki; Fukuda, Haruhiko

2014-01-01

Neoadjuvant chemotherapy may improve outcomes in gastric cancer. Tumor responses can be evaluated with RECIST, Japanese Classification of Gastric Carcinoma (JCGC), and histological criteria. These approaches have not yet been compared. We analyzed two phase II trials of neoadjuvant chemotherapy using S-1 plus cisplatin. JCOG0210 included patients with linitis plastica and large ulcero-invasive tumors, whereas JCOG0405 comprised those with para-aortic or bulky lymph node metastases. Radiologic evaluations were conducted using RECIST in JCOG0405 and JCGC criteria in JCOG0210, because the latter included many patients without measurable lesions. A histological responder was defined as a patient in whom one third or more of the tumor was affected. The hazard ratios (HR) for death between responders and non-responders and response rate differences between short- and long-term survivors were estimated. In JCOG0210 (n = 49), HR was 0.54 in JCGC responders (P = 0.059) and 0.40 in histological responders (P = 0.005). The difference in response rates between short- and long-term survivors using histological criteria (34 %, P = 0.023) was greater than that using JCGC criteria (24 %, P = 0.15). In JCOG0405 (n = 51), HR was 0.67 in RECIST responders (P = 0.35) and 0.39 in histological responders (P = 0.030). In short- and long-term survivors, respectively, RECIST response rates were 62  and 67 % (P = 0.77), whereas histological response rates were 33  and 63 % (P = 0.048). Histological criteria showed higher response assessment validity than RECIST or JCGC criteria and yielded the best surrogate endpoint for overall survival.

Getting a Valid Survey Response From 662 Plastic Surgeons in the 21st Century.

PubMed

Reinisch, John F; Yu, Daniel C; Li, Wai-Yee

2016-01-01

Web-based surveys save time and money. As electronic questionnaires have increased in popularity, telephone and mailed surveys have declined. With any survey, a response rate of 75% or greater is critical for the validity of any study. We wanted to determine which survey method achieved the highest response among academic plastic surgeons. All American Association of Plastic Surgeons members were surveyed regarding authorship issues. They were randomly assigned to receive the questionnaire through 1 of 4 methods: (A) emailed with a link to an online survey; (B) regular mail; (C) regular mail + $1 bill, and (D) regular mail + $5 bill. Two weeks after the initial mailing, the number of responses was collected, and nonresponders were contacted to remind them to participate. The study was closed after 10 weeks. Survey costs were calculated based on the actual cost of sending the initial survey, including stationary, printing, postage (groups B-D), labor, and cost of any financial incentives. Cost of reminders to nonresponders was calculated at $5 per reminder, giving a total survey cost. Of 662 surveys sent, 54 were returned because of incorrect address/email, retirement, or death. Four hundred seventeen of the remaining 608 surveys were returned and analyzed. The response rate was lowest in the online group and highest in those mailed with a monetary incentive. Despite the convenience and low initial cost of web-based surveys, this generated the lowest response. We obtained statistically significant response rates (79% and 84%) only by using postal mail with monetary incentives and reminders. The inclusion of a $1 bill represented the greatest value and cost-effective survey method, based on cost per response.

In-Flight Validation of a Pilot Rating Scale for Evaluating Failure Transients in Electronic Flight Control Systems

NASA Technical Reports Server (NTRS)

Kalinowski, Kevin F.; Tucker, George E.; Moralez, Ernesto, III

2006-01-01

Engineering development and qualification of a Research Flight Control System (RFCS) for the Rotorcraft Aircrew Systems Concepts Airborne Laboratory (RASCAL) JUH-60A has motivated the development of a pilot rating scale for evaluating failure transients in fly-by-wire flight control systems. The RASCAL RFCS includes a highly-reliable, dual-channel Servo Control Unit (SCU) to command and monitor the performance of the fly-by-wire actuators and protect against the effects of erroneous commands from the flexible, but single-thread Flight Control Computer. During the design phase of the RFCS, two piloted simulations were conducted on the Ames Research Center Vertical Motion Simulator (VMS) to help define the required performance characteristics of the safety monitoring algorithms in the SCU. Simulated failures, including hard-over and slow-over commands, were injected into the command path, and the aircraft response and safety monitor performance were evaluated. A subjective Failure/Recovery Rating (F/RR) scale was developed as a means of quantifying the effects of the injected failures on the aircraft state and the degree of pilot effort required to safely recover the aircraft. A brief evaluation of the rating scale was also conducted on the Army/NASA CH-47B variable stability helicopter to confirm that the rating scale was likely to be equally applicable to in-flight evaluations. Following the initial research flight qualification of the RFCS in 2002, a flight test effort was begun to validate the performance of the safety monitors and to validate their design for the safe conduct of research flight testing. Simulated failures were injected into the SCU, and the F/RR scale was applied to assess the results. The results validate the performance of the monitors, and indicate that the Failure/Recovery Rating scale is a very useful tool for evaluating failure transients in fly-by-wire flight control systems.

Rating reliability and representation validity in scenic landscape assessments

Treesearch

James F. Palmer; Robin E. Hoffman

2001-01-01

The US Supreme Court recently determined that experts from all fields of knowledge must demonstrate the reliability and validity of their testimony. While the broader implications of their finding have yet to manifest itself, it clearly has the potential to challenge all manner of professional practices. This paper explores the reliability of visual quality ratings of...

Maximising nurses' and midwives' response rates to surveys.

PubMed

Cooper, Alannah Louise; Brown, Janie

2017-12-18

Low response rates to surveys have been a long-standing issue in research. This includes research involving nurses and midwives. To gain representative samples, appropriate measures to maximise response rates need to be used. To explore ways to maximise response rates from nurses and midwives, using a hospital-wide survey as an example. All nurses and midwives at the study hospital were invited to participate in a survey. To encourage participation and elicit an adequate response rate, several strategies were used. A total of 1,000 surveys were distributed and 319 (32%) were returned. All the required age groups, levels of experience and types of nursing registration were represented in the responses and data saturation was achieved. It is important to pay attention to obtaining a representative sample. Further investigation of response rates to surveys by nurses and midwives is warranted. Strategies to maximise response rates from a target population should be used when conducting surveys. ©2017 RCN Publishing Company Ltd. All rights reserved. Not to be copied, transmitted or recorded in any way, in whole or part, without prior permission of the publishers.

Validation and Use of a Predictive Modeling Tool: Employing Scientific Findings to Improve Responsible Conduct of Research Education.

PubMed

Mulhearn, Tyler J; Watts, Logan L; Todd, E Michelle; Medeiros, Kelsey E; Connelly, Shane; Mumford, Michael D

2017-01-01

Although recent evidence suggests ethics education can be effective, the nature of specific training programs, and their effectiveness, varies considerably. Building on a recent path modeling effort, the present study developed and validated a predictive modeling tool for responsible conduct of research education. The predictive modeling tool allows users to enter ratings in relation to a given ethics training program and receive instantaneous evaluative information for course refinement. Validation work suggests the tool's predicted outcomes correlate strongly (r = 0.46) with objective course outcomes. Implications for training program development and refinement are discussed.

Quality Rating and Improvement System (QRIS) Validation Study Designs. CEELO FastFacts

ERIC Educational Resources Information Center

Schilder, D.

2013-01-01

In this "Fast Facts," a state has received Race to the Top Early Learning Challenge funds and is seeking information to inform the design of the Quality Rating and Improvement System (QRIS) validation study. The Center on Enhancing Early Learning Outcomes (CEELO) responds that according to Resnick (2012), validation of a QRIS is an…

Cross-validation of clinical characteristics and treatment patterns associated with phenotypes for lithium response defined by the Alda scale.

PubMed

Scott, Jan; Geoffroy, Pierre Alexis; Sportiche, Sarah; Brichant-Petit-Jean, Clara; Gard, Sebastien; Kahn, Jean-Pierre; Azorin, Jean-Michel; Henry, Chantal; Etain, Bruno; Bellivier, Frank

2017-01-15

It is increasingly recognised that reliable and valid assessments of lithium response are needed in order to target more efficiently the use of this medication in bipolar disorders (BD) and to identify genotypes, endophenotypes and biomarkers of response. In a large, multi-centre, clinically representative sample of 300 cases of BD, we assess external clinical validators of lithium response phenotypes as defined using three different recommended approaches to scoring the Alda lithium response scale. The scale comprises an A scale (rating lithium response) and a B scale (assessing confounders). Analysis of the two continuous scoring methods (A scale score minus the B scale score, or A scale score in those with a low B scale score) demonstrated that 21-23% of the explained variance in lithium response was accounted for by a positive family history of BD I and the early introduction of lithium. Categorical definitions of response suggest poor response is also associated with a positive history of alcohol and/or substance use comorbidities. High B scale scores were significantly associated with longer duration of illness prior to receiving lithium and the presence of psychotic symptoms. The original sample was not recruited specifically to study lithium response. The Alda scale is designed to assess response retrospectively. This cross-validation study identifies different clinical phenotypes of lithium response when defined by continuous or categorical measures. Future clinical, genetic and biomarker studies should report both the findings and the method employed to assess lithium response according to the Alda scale. Copyright © 2016 Elsevier B.V. All rights reserved.

The Parent Trauma Response Questionnaire (PTRQ): development and preliminary validation

PubMed Central

Creswell, Cathy; Dalgleish, Tim; Fearon, Pasco; Goodall, Ben; McKinnon, Anna; Smith, Patrick; Wright, Isobel

2018-01-01

ABSTRACT Background: Following a child’s experience of trauma, parental response is thought to play an important role in either facilitating or hindering their psychological adjustment. However, the ability to investigate the role of parenting responses in the post-trauma period has been hampered by a lack of valid and reliable measures. Objectives: The aim of this study was to design, and provide a preliminary validation of, the Parent Trauma Response Questionnaire (PTRQ), a self-report measure of parental appraisals and support for children’s coping, in the aftermath of child trauma. Methods: We administered an initial set of 78 items to 365 parents whose children, aged 2–19 years, had experienced a traumatic event. We conducted principal axis factoring and then assessed the validity of the reduced measure against a standardized general measure of parental overprotection and via the measure’s association with child post-trauma mental health. Results: Factor analysis generated three factors assessing parental maladaptive appraisals: (i) permanent change/damage, (ii) preoccupation with child’s vulnerability, and (iii) self-blame. In addition, five factors were identified that assess parental support for child coping: (i) behavioural avoidance, (ii) cognitive avoidance, (iii) overprotection, (iv) maintaining pre-trauma routines, and (v) approach coping. Good validity was evidenced against the measure of parental overprotection and child post-traumatic stress symptoms. Good test–retest reliability of the measure was also demonstrated. Conclusions: The PTRQ is a valid and reliable self-report assessment of parenting cognitions and coping in the aftermath of child trauma. PMID:29938010

Addressing Participant Validity in a Small Internet Health Survey (The Restore Study): Protocol and Recommendations for Survey Response Validation

PubMed Central

Dewitt, James; Capistrant, Benjamin; Kohli, Nidhi; Mitteldorf, Darryl; Merengwa, Enyinnaya; West, William

2018-01-01

Background While deduplication and cross-validation protocols have been recommended for large Web-based studies, protocols for survey response validation of smaller studies have not been published. Objective This paper reports the challenges of survey validation inherent in a small Web-based health survey research. Methods The subject population was North American, gay and bisexual, prostate cancer survivors, who represent an under-researched, hidden, difficult-to-recruit, minority-within-a-minority population. In 2015-2016, advertising on a large Web-based cancer survivor support network, using email and social media, yielded 478 completed surveys. Results Our manual deduplication and cross-validation protocol identified 289 survey submissions (289/478, 60.4%) as likely spam, most stemming from advertising on social media. The basic components of this deduplication and validation protocol are detailed. An unexpected challenge encountered was invalid survey responses evolving across the study period. This necessitated the static detection protocol be augmented with a dynamic one. Conclusions Five recommendations for validation of Web-based samples, especially with smaller difficult-to-recruit populations, are detailed. PMID:29691203

Validity analysis on merged and averaged data using within and between analysis: focus on effect of qualitative social capital on self-rated health.

PubMed

Shin, Sang Soo; Shin, Young-Jeon

2016-01-01

With an increasing number of studies highlighting regional social capital (SC) as a determinant of health, many studies are using multi-level analysis with merged and averaged scores of community residents' survey responses calculated from community SC data. Sufficient examination is required to validate if the merged and averaged data can represent the community. Therefore, this study analyzes the validity of the selected indicators and their applicability in multi-level analysis. Within and between analysis (WABA) was performed after creating community variables using merged and averaged data of community residents' responses from the 2013 Community Health Survey in Korea, using subjective self-rated health assessment as a dependent variable. Further analysis was performed following the model suggested by WABA result. Both E-test results (1) and WABA results (2) revealed that single-level analysis needs to be performed using qualitative SC variable with cluster mean centering. Through single-level multivariate regression analysis, qualitative SC with cluster mean centering showed positive effect on self-rated health (0.054, p<0.001), although there was no substantial difference in comparison to analysis using SC variables without cluster mean centering or multi-level analysis. As modification in qualitative SC was larger within the community than between communities, we validate that relational analysis of individual self-rated health can be performed within the group, using cluster mean centering. Other tests besides the WABA can be performed in the future to confirm the validity of using community variables and their applicability in multi-level analysis.

Validating Microwave-Based Satellite Rain Rate Retrievals Over TRMM Ground Validation Sites

NASA Astrophysics Data System (ADS)

Fisher, B. L.; Wolff, D. B.

2008-12-01

Multi-channel, passive microwave instruments are commonly used today to probe the structure of rain systems and to estimate surface rainfall from space. Until the advent of meteorological satellites and the development of remote sensing techniques for measuring precipitation from space, there was no observational system capable of providing accurate estimates of surface precipitation on global scales. Since the early 1970s, microwave measurements from satellites have provided quantitative estimates of surface rainfall by observing the emission and scattering processes due to the existence of clouds and precipitation in the atmosphere. This study assesses the relative performance of microwave precipitation estimates from seven polar-orbiting satellites and the TRMM TMI using four years (2003-2006) of instantaneous radar rain estimates obtained from Tropical Rainfall Measuring Mission (TRMM) Ground Validation (GV) sites at Kwajalein, Republic of the Marshall Islands (KWAJ) and Melbourne, Florida (MELB). The seven polar orbiters include three different sensor types: SSM/I (F13, F14 and F15), AMSU-B (N15, N16 and N17), and AMSR-E. The TMI aboard the TRMM satellite flies in a sun asynchronous orbit between 35 S and 35 N latitudes. The rain information from these satellites are combined and used to generate several multi-satellite rain products, namely the Goddard TRMM Multi-satellite Precipitation Analysis (TMPA), NOAA's CPC Morphing Technique (CMORPH) and Precipitation Estimation from Remotely Sensed Information using Artificial Neural Networks (PERSIANN). Instantaneous rain rates derived from each sensor were matched to the GV estimates in time and space at a resolution of 0.25 degrees. The study evaluates the measurement and error characteristics of the various satellite estimates through inter-comparisons with GV radar estimates. The GV rain observations provided an empirical ground-based reference for assessing the relative performance of each sensor and sensor

Validation of biomarkers to predict response to immunotherapy in cancer: Volume I - pre-analytical and analytical validation.

PubMed

Masucci, Giuseppe V; Cesano, Alessandra; Hawtin, Rachael; Janetzki, Sylvia; Zhang, Jenny; Kirsch, Ilan; Dobbin, Kevin K; Alvarez, John; Robbins, Paul B; Selvan, Senthamil R; Streicher, Howard Z; Butterfield, Lisa H; Thurin, Magdalena

2016-01-01

Immunotherapies have emerged as one of the most promising approaches to treat patients with cancer. Recently, there have been many clinical successes using checkpoint receptor blockade, including T cell inhibitory receptors such as cytotoxic T-lymphocyte-associated antigen 4 (CTLA-4) and programmed cell death-1 (PD-1). Despite demonstrated successes in a variety of malignancies, responses only typically occur in a minority of patients in any given histology. Additionally, treatment is associated with inflammatory toxicity and high cost. Therefore, determining which patients would derive clinical benefit from immunotherapy is a compelling clinical question. Although numerous candidate biomarkers have been described, there are currently three FDA-approved assays based on PD-1 ligand expression (PD-L1) that have been clinically validated to identify patients who are more likely to benefit from a single-agent anti-PD-1/PD-L1 therapy. Because of the complexity of the immune response and tumor biology, it is unlikely that a single biomarker will be sufficient to predict clinical outcomes in response to immune-targeted therapy. Rather, the integration of multiple tumor and immune response parameters, such as protein expression, genomics, and transcriptomics, may be necessary for accurate prediction of clinical benefit. Before a candidate biomarker and/or new technology can be used in a clinical setting, several steps are necessary to demonstrate its clinical validity. Although regulatory guidelines provide general roadmaps for the validation process, their applicability to biomarkers in the cancer immunotherapy field is somewhat limited. Thus, Working Group 1 (WG1) of the Society for Immunotherapy of Cancer (SITC) Immune Biomarkers Task Force convened to address this need. In this two volume series, we discuss pre-analytical and analytical (Volume I) as well as clinical and regulatory (Volume II) aspects of the validation process as applied to predictive biomarkers

Validity criteria for Fermi’s golden rule scattering rates applied to metallic nanowires

NASA Astrophysics Data System (ADS)

Moors, Kristof; Sorée, Bart; Magnus, Wim

2016-09-01

Fermi’s golden rule underpins the investigation of mobile carriers propagating through various solids, being a standard tool to calculate their scattering rates. As such, it provides a perturbative estimate under the implicit assumption that the effect of the interaction Hamiltonian which causes the scattering events is sufficiently small. To check the validity of this assumption, we present a general framework to derive simple validity criteria in order to assess whether the scattering rates can be trusted for the system under consideration, given its statistical properties such as average size, electron density, impurity density et cetera. We derive concrete validity criteria for metallic nanowires with conduction electrons populating a single parabolic band subjected to different elastic scattering mechanisms: impurities, grain boundaries and surface roughness.

The Predictive Validity of Savry Ratings for Assessing Youth Offenders in Singapore

PubMed Central

Chu, Chi Meng; Goh, Mui Leng; Chong, Dominic

2015-01-01

Empirical support for the usage of the SAVRY has been reported in studies conducted in many Western contexts, but not in a Singaporean context. This study compared the predictive validity of the SAVRY ratings for violent and general recidivism against the Youth Level of Service/Case Management Inventory (YLS/CMI) ratings within the Singaporean context. Using a sample of 165 male young offenders (Mfollow-up = 4.54 years), results showed that the SAVRY Total Score and Summary Risk Rating, as well as YLS/CMI Total Score and Overall Risk Rating, predicted violent and general recidivism. SAVRY Protective Total Score was only significantly predictive of desistance from general recidivism, and did not show incremental predictive validity for violent and general recidivism over the SAVRY Total Score. Overall, the results suggest that the SAVRY is suited (to varying degrees) for assessing the risk of violent and general recidivism in young offenders within the Singaporean context, but might not be better than the YLS/CMI. PMID:27231403

A clinician-administered severity rating scale for illness anxiety: development, reliability, and validity of the H-YBOCS-M.

PubMed

Skritskaya, Natalia A; Carson-Wong, Amanda R; Moeller, James R; Shen, Sa; Barsky, Arthur J; Fallon, Brian A

2012-07-01

Clinician-administered measures to assess severity of illness anxiety and response to treatment are few. The authors evaluated a modified version of the hypochondriasis-Y-BOCS (H-YBOCS-M), a 19-item, semistructured, clinician-administered instrument designed to rate severity of illness-related thoughts, behaviors, and avoidance. The scale was administered to 195 treatment-seeking adults with DSM-IV hypochondriasis. Test-retest reliability was assessed in a subsample of 20 patients. Interrater reliability was assessed by 27 interviews independently rated by four raters. Sensitivity to change was evaluated in a subsample of 149 patients. Convergent and discriminant validity was examined by comparing H-YBOCS-M scores to other measures administered. Item clustering was examined with confirmatory and exploratory factor analyses. The H-YBOCS-M demonstrated good internal consistency, interrater and test-retest reliability, and sensitivity to symptom change with treatment. Construct validity was supported by significant higher correlations with scores on other measures of hypochondriasis than with nonhypochondriacal measures. Improvement over time in response to treatment correlated with improvement both on measures of hypochondriasis and on measures of somatization, depression, anxiety, and functional status. Confirmatory factor analysis did not show adequate fit for a three-factor model. Exploratory factor analysis revealed a five-factor solution with the first two factors consistent with the separation of the H-YBOCS-M items into the subscales of illness-related avoidance and compulsions. H-YBOCS-M appears to be valid, reliable, and appropriate as an outcome measure for treatment studies of illness anxiety. Study results highlight "avoidance" as a key feature of illness anxiety-with potentially important nosologic and treatment implications. © 2012 Wiley Periodicals, Inc.

A CLINICIAN-ADMINISTERED SEVERITY RATING SCALE FOR ILLNESS ANXIETY: DEVELOPMENT, RELIABILITY, AND VALIDITY OF THE H-YBOCS-M

PubMed Central

Skritskaya, Natalia A.; Carson-Wong, Amanda R.; Moeller, James R.; Shen, Sa; Barsky, Arthur J.; Fallon, Brian A.

2012-01-01

Background Clinician-administered measures to assess severity of illness anxiety and response to treatment are few. The authors evaluated a modified version of the hypochondriasis-Y-BOCS (H-YBOCS-M), a 19-item, semistructured, clinician-administered instrument designed to rate severity of illness-related thoughts, behaviors, and avoidance. Methods The scale was administered to 195 treatment-seeking adults with DSM-IV hypochondriasis. Test–retest reliability was assessed in a subsample of 20 patients. Interrater reliability was assessed by 27 interviews independently rated by four raters. Sensitivity to change was evaluated in a subsample of 149 patients. Convergent and discriminant validity was examined by comparing H-YBOCS-M scores to other measures administered. Item clustering was examined with confirmatory and exploratory factor analyses. Results The H-YBOCS-M demonstrated good internal consistency, interrater and test–retest reliability, and sensitivity to symptom change with treatment. Construct validity was supported by significant higher correlations with scores on other measures of hypochondriasis than with nonhypochondriacal measures. Improvement over time in response to treatment correlated with improvement both on measures of hypochondriasis and on measures of somatization, depression, anxiety, and functional status. Confirmatory factor analysis did not show adequate fit for a three-factor model. Exploratory factor analysis revealed a five-factor solution with the first two factors consistent with the separation of the H-YBOCS-M items into the subscales of illness-related avoidance and compulsions. Conclusions H-YBOCS-M appears to be valid, reliable, and appropriate as an outcome measure for treatment studies of illness anxiety. Study results highlight “avoidance” as a key feature of illness anxiety—with potentially important nosologic and treatment implications. PMID:22504935

Validation of the Self-Regulation Strategy Inventory-Parent Rating Scale

ERIC Educational Resources Information Center

Lubin, Audrey Ruth

2015-01-01

The current dissertation gathered empirical evidence of convergent and predictive validity for the Self-Regulation Strategies Inventory-Parent Rating Scale (SRSI-PRS), which measures parents' perception of their child's use of self-regulated learning (SRL) strategies during mathematics activities. The SRSI-PRS, which is part of the larger SRSI…

Exploring physician specialist response rates to web-based surveys.

PubMed

Cunningham, Ceara Tess; Quan, Hude; Hemmelgarn, Brenda; Noseworthy, Tom; Beck, Cynthia A; Dixon, Elijah; Samuel, Susan; Ghali, William A; Sykes, Lindsay L; Jetté, Nathalie

2015-04-09

Survey research in healthcare is an important tool to collect information about healthcare delivery, service use and overall issues relating to quality of care. Unfortunately, physicians are often a group with low survey response rates and little research has looked at response rates among physician specialists. For these reasons, the purpose of this project was to explore survey response rates among physician specialists in a large metropolitan Canadian city. As part of a larger project to look at physician payment plans, an online survey about medical billing practices was distributed to 904 physicians from various medical specialties. The primary method for physicians to complete the survey was via the Internet using a well-known and established survey company (www.surveymonkey.com). Multiple methods were used to encourage survey response such as individual personalized email invitations, multiple reminders, and a draw for three gift certificate prizes were used to increase response rate. Descriptive statistics were used to assess response rates and reasons for non-response. Overall survey response rate was 35.0%. Response rates varied by specialty: Neurology/neurosurgery (46.6%); internal medicine (42.9%); general surgery (29.6%); pediatrics (29.2%); and psychiatry (27.1%). Non-respondents listed lack of time/survey burden as the main reason for not responding to our survey. Our survey results provide a look into the challenges of collecting healthcare research where response rates to surveys are often low. The findings presented here should help researchers in planning future survey based studies. Findings from this study and others suggest smaller monetary incentives for each individual may be a more appropriate way to increase response rates.

Low validity of Google Trends for behavioral forecasting of national suicide rates

PubMed Central

Niederkrotenthaler, Thomas; Till, Benedikt; Ajdacic-Gross, Vladeta; Voracek, Martin

2017-01-01

Recent research suggests that search volumes of the most popular search engine worldwide, Google, provided via Google Trends, could be associated with national suicide rates in the USA, UK, and some Asian countries. However, search volumes have mostly been studied in an ad hoc fashion, without controls for spurious associations. This study evaluated the validity and utility of Google Trends search volumes for behavioral forecasting of suicide rates in the USA, Germany, Austria, and Switzerland. Suicide-related search terms were systematically collected and respective Google Trends search volumes evaluated for availability. Time spans covered 2004 to 2010 (USA, Switzerland) and 2004 to 2012 (Germany, Austria). Temporal associations of search volumes and suicide rates were investigated with time-series analyses that rigorously controlled for spurious associations. The number and reliability of analyzable search volume data increased with country size. Search volumes showed various temporal associations with suicide rates. However, associations differed both across and within countries and mostly followed no discernable patterns. The total number of significant associations roughly matched the number of expected Type I errors. These results suggest that the validity of Google Trends search volumes for behavioral forecasting of national suicide rates is low. The utility and validity of search volumes for the forecasting of suicide rates depend on two key assumptions (“the population that conducts searches consists mostly of individuals with suicidal ideation”, “suicide-related search behavior is strongly linked with suicidal behavior”). We discuss strands of evidence that these two assumptions are likely not met. Implications for future research with Google Trends in the context of suicide research are also discussed. PMID:28813490

Low validity of Google Trends for behavioral forecasting of national suicide rates.

PubMed

Tran, Ulrich S; Andel, Rita; Niederkrotenthaler, Thomas; Till, Benedikt; Ajdacic-Gross, Vladeta; Voracek, Martin

2017-01-01

Recent research suggests that search volumes of the most popular search engine worldwide, Google, provided via Google Trends, could be associated with national suicide rates in the USA, UK, and some Asian countries. However, search volumes have mostly been studied in an ad hoc fashion, without controls for spurious associations. This study evaluated the validity and utility of Google Trends search volumes for behavioral forecasting of suicide rates in the USA, Germany, Austria, and Switzerland. Suicide-related search terms were systematically collected and respective Google Trends search volumes evaluated for availability. Time spans covered 2004 to 2010 (USA, Switzerland) and 2004 to 2012 (Germany, Austria). Temporal associations of search volumes and suicide rates were investigated with time-series analyses that rigorously controlled for spurious associations. The number and reliability of analyzable search volume data increased with country size. Search volumes showed various temporal associations with suicide rates. However, associations differed both across and within countries and mostly followed no discernable patterns. The total number of significant associations roughly matched the number of expected Type I errors. These results suggest that the validity of Google Trends search volumes for behavioral forecasting of national suicide rates is low. The utility and validity of search volumes for the forecasting of suicide rates depend on two key assumptions ("the population that conducts searches consists mostly of individuals with suicidal ideation", "suicide-related search behavior is strongly linked with suicidal behavior"). We discuss strands of evidence that these two assumptions are likely not met. Implications for future research with Google Trends in the context of suicide research are also discussed.

Addressing Participant Validity in a Small Internet Health Survey (The Restore Study): Protocol and Recommendations for Survey Response Validation.

PubMed

Dewitt, James; Capistrant, Benjamin; Kohli, Nidhi; Rosser, B R Simon; Mitteldorf, Darryl; Merengwa, Enyinnaya; West, William

2018-04-24

While deduplication and cross-validation protocols have been recommended for large Web-based studies, protocols for survey response validation of smaller studies have not been published. This paper reports the challenges of survey validation inherent in a small Web-based health survey research. The subject population was North American, gay and bisexual, prostate cancer survivors, who represent an under-researched, hidden, difficult-to-recruit, minority-within-a-minority population. In 2015-2016, advertising on a large Web-based cancer survivor support network, using email and social media, yielded 478 completed surveys. Our manual deduplication and cross-validation protocol identified 289 survey submissions (289/478, 60.4%) as likely spam, most stemming from advertising on social media. The basic components of this deduplication and validation protocol are detailed. An unexpected challenge encountered was invalid survey responses evolving across the study period. This necessitated the static detection protocol be augmented with a dynamic one. Five recommendations for validation of Web-based samples, especially with smaller difficult-to-recruit populations, are detailed. ©James Dewitt, Benjamin Capistrant, Nidhi Kohli, B R Simon Rosser, Darryl Mitteldorf, Enyinnaya Merengwa, William West. Originally published in JMIR Research Protocols (http://www.researchprotocols.org), 24.04.2018.

Reliability, Validity, and Responsiveness of InFLUenza Patient-Reported Outcome (FLU-PRO©) Scores in Influenza-Positive Patients.

PubMed

Powers, John H; Bacci, Elizabeth D; Guerrero, M Lourdes; Leidy, Nancy Kline; Stringer, Sonja; Kim, Katherine; Memoli, Matthew J; Han, Alison; Fairchok, Mary P; Chen, Wei-Ju; Arnold, John C; Danaher, Patrick J; Lalani, Tahaniyat; Ridoré, Michelande; Burgess, Timothy H; Millar, Eugene V; Hernández, Andrés; Rodríguez-Zulueta, Patricia; Smolskis, Mary C; Ortega-Gallegos, Hilda; Pett, Sarah; Fischer, William; Gillor, Daniel; Macias, Laura Moreno; DuVal, Anna; Rothman, Richard; Dugas, Andrea; Ruiz-Palacios, Guillermo M

2018-02-01

To assess the reliability, validity, and responsiveness of InFLUenza Patient-Reported Outcome (FLU-PRO©) scores for quantifying the presence and severity of influenza symptoms. An observational prospective cohort study of adults (≥18 years) with influenza-like illness in the United States, the United Kingdom, Mexico, and South America was conducted. Participants completed the 37-item draft FLU-PRO daily for up to 14 days. Item-level and factor analyses were used to remove items and determine factor structure. Reliability of the final tool was estimated using Cronbach α and intraclass correlation coefficients (2-day reliability). Convergent and known-groups validity and responsiveness were assessed using global assessments of influenza severity and return to usual health. Of the 536 patients enrolled, 221 influenza-positive subjects comprised the analytical sample. The mean age of the patients was 40.7 years, 60.2% were women, and 59.7% were white. The final 32-item measure has six factors/domains (nose, throat, eyes, chest/respiratory, gastrointestinal, and body/systemic), with a higher order factor representing symptom severity overall (comparative fit index = 0.92; root mean square error of approximation = 0.06). Cronbach α was high (total = 0.92; domain range = 0.71-0.87); test-retest reliability (intraclass correlation coefficient, day 1-day 2) was 0.83 for total scores and 0.57 to 0.79 for domains. Day 1 FLU-PRO domain and total scores were moderately to highly correlated (≥0.30) with Patient Global Rating of Flu Severity (except nose and throat). Consistent with known-groups validity, scores differentiated severity groups on the basis of global rating (total: F = 57.2, P < 0.001; domains: F = 8.9-67.5, P < 0.001). Subjects reporting return to usual health showed significantly greater (P < 0.05) FLU-PRO score improvement by day 7 than did those who did not, suggesting score responsiveness. Results suggest that FLU-PRO scores are reliable, valid, and

Nomogram predicting response after chemoradiotherapy in rectal cancer using sequential PETCT imaging: a multicentric prospective study with external validation.

PubMed

van Stiphout, Ruud G P M; Valentini, Vincenzo; Buijsen, Jeroen; Lammering, Guido; Meldolesi, Elisa; van Soest, Johan; Leccisotti, Lucia; Giordano, Alessandro; Gambacorta, Maria A; Dekker, Andre; Lambin, Philippe

2014-11-01

To develop and externally validate a predictive model for pathologic complete response (pCR) for locally advanced rectal cancer (LARC) based on clinical features and early sequential (18)F-FDG PETCT imaging. Prospective data (i.a. THUNDER trial) were used to train (N=112, MAASTRO Clinic) and validate (N=78, Università Cattolica del S. Cuore) the model for pCR (ypT0N0). All patients received long-course chemoradiotherapy (CRT) and surgery. Clinical parameters were age, gender, clinical tumour (cT) stage and clinical nodal (cN) stage. PET parameters were SUVmax, SUVmean, metabolic tumour volume (MTV) and maximal tumour diameter, for which response indices between pre-treatment and intermediate scan were calculated. Using multivariate logistic regression, three probability groups for pCR were defined. The pCR rates were 21.4% (training) and 23.1% (validation). The selected predictive features for pCR were cT-stage, cN-stage, response index of SUVmean and maximal tumour diameter during treatment. The models' performances (AUC) were 0.78 (training) and 0.70 (validation). The high probability group for pCR resulted in 100% correct predictions for training and 67% for validation. The model is available on the website www.predictcancer.org. The developed predictive model for pCR is accurate and externally validated. This model may assist in treatment decisions during CRT to select complete responders for a wait-and-see policy, good responders for extra RT boost and bad responders for additional chemotherapy. Copyright © 2014 The Authors. Published by Elsevier Ireland Ltd.. All rights reserved.

Rating Scales for Dystonia in Cerebral Palsy: Reliability and Validity

ERIC Educational Resources Information Center

Monbaliu, E.; Ortibus, E.; Roelens, F.; Desloovere, K.; Deklerck, J.; Prinzie, P.; De Cock, P.; Feys, H.

2010-01-01

Aim: This study investigated the reliability and validity of the Barry-Albright Dystonia Scale (BADS), the Burke-Fahn-Marsden Movement Scale (BFMMS), and the Unified Dystonia Rating Scale (UDRS) in patients with bilateral dystonic cerebral palsy (CP). Method: Three raters independently scored videotapes of 10 patients (five males, five females;…

Validity, Responsibility, and Aporia

ERIC Educational Resources Information Center

Koro-Ljungberg, Mirka

2010-01-01

In this article, the author problematizes external, objectified, oversimplified, and mechanical approaches to validity in qualitative research, which endorse simplistic and reductionist views of knowledge and data. Instead of promoting one generalizable definition or operational criteria for validity, the author's "deconstructive validity work"…

Validation of the German version of the Ford Insomnia Response to Stress Test.

PubMed

Dieck, Arne; Helbig, Susanne; Drake, Christopher L; Backhaus, Jutta

2018-06-01

The purpose of this study was to assess the psychometric properties of a German version of the Ford Insomnia Response to Stress Test with groups with and without sleep problems. Three studies were analysed. Data set 1 was based on an initial screening for a sleep training program (n = 393), data set 2 was based on a study to test the test-retest reliability of the Ford Insomnia Response to Stress Test (n = 284) and data set 3 was based on a study to examine the influence of competitive sport on sleep (n = 37). Data sets 1 and 2 were used to test internal consistency, factor structure, convergent validity, discriminant validity and test-retest reliability of the Ford Insomnia Response to Stress Test. Content validity was tested using data set 3. Cronbach's alpha of the Ford Insomnia Response to Stress Test was good (α = 0.80) and test-retest reliability was satisfactory (r = 0.72). Overall, the one-factor model showed the best fit. Furthermore, significant positive correlations between the Ford Insomnia Response to Stress Test and impaired sleep quality, depression and stress reactivity were in line with the expectations regarding the convergent validity. Subjects with sleep problems had significantly higher scores in the Ford Insomnia Response to Stress Test than subjects without sleep problems (P < 0.01). Competitive athletes with higher scores in the Ford Insomnia Response to Stress Test had significantly lower sleep quality (P = 0.01), demonstrating that vulnerability for stress-induced sleep disturbances accompanies poorer sleep quality in stressful episodes. The findings show that the German version of the Ford Insomnia Response to Stress Test is a reliable and valid questionnaire to assess the vulnerability to stress-induced sleep disturbances. © 2017 European Sleep Research Society.

The Koukopoulos Mixed Depression Rating Scale (KMDRS): An International Mood Network (IMN) validation study of a new mixed mood rating scale.

PubMed

Sani, Gabriele; Vöhringer, Paul A; Barroilhet, Sergio A; Koukopoulos, Alexia E; Ghaemi, S Nassir

2018-05-01

It has been proposed that the broad major depressive disorder (MDD) construct is heterogenous. Koukopoulos has provided diagnostic criteria for an important subtype within that construct, "mixed depression" (MxD), which encompasses clinical pictures characterized by marked psychomotor or inner excitation and rage/anger, along with severe depression. This study provides psychometric validation for the first rating scale specifically designed to assess MxD symptoms cross-sectionally, the Koukopoulos Mixed Depression Rating Scale (KMDRS). 350 patients from the international mood network (IMN) completed three rating scales: the KMDRS, Montgomery-Asberg Depression Rating Scale (MADRS) and Young Mania Rating Scale (YMRS). KMDRS' psychometric properties assessed included Cronbach's alpha, inter-rater reliability, factor analysis, predictive validity, and Receiver Operator Curve analysis. Internal consistency (Cronbach's alpha = 0.76; 95% CI 0.57, 0.94) and interrater reliability (kappa = 0.73) were adequate. Confirmatory factor analysis identified 2 components: anger and psychomotor excitation (80% of total variance). Good predictive validity was seen (C-statistic = 0.82 95% CI 0.68, 0.93). Severity cut-off scores identified were as follows: none (0-4), possible (5-9), mild (10-15), moderate (16-20) and severe (> 21) MxD. Non DSM-based diagnosis of MxD may pose some difficulties in the initial use and interpretation of the scoring of the scale. Moreover, the cross-sectional nature of the evaluation does not verify the long-term stability of the scale. KMDRS was a reliable and valid instrument to assess MxD symptoms. Copyright © 2018 Elsevier B.V. All rights reserved.

Rediscovery rate estimation for assessing the validation of significant findings in high-throughput studies.

PubMed

Ganna, Andrea; Lee, Donghwan; Ingelsson, Erik; Pawitan, Yudi

2015-07-01

It is common and advised practice in biomedical research to validate experimental or observational findings in a population different from the one where the findings were initially assessed. This practice increases the generalizability of the results and decreases the likelihood of reporting false-positive findings. Validation becomes critical when dealing with high-throughput experiments, where the large number of tests increases the chance to observe false-positive results. In this article, we review common approaches to determine statistical thresholds for validation and describe the factors influencing the proportion of significant findings from a 'training' sample that are replicated in a 'validation' sample. We refer to this proportion as rediscovery rate (RDR). In high-throughput studies, the RDR is a function of false-positive rate and power in both the training and validation samples. We illustrate the application of the RDR using simulated data and real data examples from metabolomics experiments. We further describe an online tool to calculate the RDR using t-statistics. We foresee two main applications. First, if the validation study has not yet been collected, the RDR can be used to decide the optimal combination between the proportion of findings taken to validation and the size of the validation study. Secondly, if a validation study has already been done, the RDR estimated using the training data can be compared with the observed RDR from the validation data; hence, the success of the validation study can be assessed. © The Author 2014. Published by Oxford University Press. For Permissions, please email: journals.permissions@oup.com.

[VALIDATION OF THE HUNGARIAN UNIFIED DYSKINESIA RATING SCALE].

PubMed

Horváth, Krisztina; Aschermann, Zsuzsanna; Ács, Péter; Bosnyák, Edit; Deli, Gabriella; Pál, Endre; Késmárki, Ildiko; Horvath, Réka; Takacs, Katalin; Balázs, Eva; Komoly, Sámuel; Bokor, Magdolna; Rigó, Eszter; Lajtos, Júlia; Takáts, Annamária; Tóth, Adrián; Klivényi, Péter; Dibó, György; Vecsei, László; Hidasi, Eszter; Nagy, Ferenc; Herceg, Mihály; Imre, Piroska; Kovács, Norbert

2015-05-30

The Unified Dyskinesia Rating Scale (UDysRS) was published in 2008. It was designed to be simultaneous valid, reliable and sensitive to therapeutic changes. The Movement Disorder Society organizing team developed guidelines for the development of official non-English translations consisting of four steps: translation/back-translation, cognitive pretesting, large field testing, and clinimetric analysis. The aim of this paper was to introduce the new UDysRS and its validation process into Hungarian. After the translation of UDysRS into Hungarian and back-translated into English, it was reviewed by the UDysRS translation administration team. Subsequent cognitive pretesting was conducted with ten patients. For the large field testing phase, the Hungarian official working draft version of UDysRS was tested with 256 patients with Parkinson's disease having dyskinesia. Confirmatory factor analyses (CFA) determined whether the factor structure for the valid Spanish UDysRS could be confirmed in data collected using the Hungarian Official Draft Version. To become an official translation, the Comparative Fit Index (CFI) had to be ≥ 0.90 compared to the Spanish-language version. For the Hungarian UDysRS the CFI was 0.98. The overall factor structure of the Hungarian version was consistent with that of the Spanish version based on the high CFIs for the UDysRS in the CFA; therefore, this version was designated as the Official Hungarian Version Of The UDysRS.

Using Chinese Version of MYMOP in Chinese Medicine Evaluation: Validity, Responsiveness and Minimally Important Change

PubMed Central

2010-01-01

Background Measure Yourself Medical Outcome Profile (MYMOP) is a patient generated outcome instrument applicable in the evaluation of both allopathic and complementary medicine treatment. This study aims to adapt MYMOP into Chinese, and to assess its validity, responsiveness and minimally important change values in a sample of patients using Chinese medicine (CM) services. Methods A Chinese version of MYMOP (CMYMOP) is developed by forward-backward-forward translation strategy, expert panel assessment and pilot testing amongst patients. 272 patients aged 18 or above with subjective symptoms in the past 2 weeks were recruited at a CM clinic, and were invited to complete a set of questionnaire containing CMYMOP and SF-36. Follow ups were performed at 2nd and 4th week after consultation, using the same set of questionnaire plus a global rating of change question. Criterion validity of CMYMOP was assessed by its correlation with SF-36 at baseline, and responsiveness was evaluated by calculating the Cohen effect size (ES) of change at two follow ups. Minimally important difference (MID) values were estimated via anchor based method, while minimally detectable difference (MDC) figures were calculated by distribution based method. Results Criterion validity of CMYMOP was demonstrated by negative correlation between CMYMOP Profile scores and all SF-36 domain and summary scores at baseline. For responsiveness between baseline and 4th week follow up, ES of CMYMOP Symptom 1, Activity and Profile reached the moderate change threshold (ES>0.5), while Symptom 2 and Wellbeing reached the weak change threshold (ES>0.2). None of the SF-36 scores reached the moderate change threshold, implying CMYMOP's stronger responsiveness in CM setting. At 2nd week follow up, MID values for Symptom 1, Symptom 2, Wellbeing and Profile items were 0.894, 0.580, 0.263 and 0.516 respectively. For Activity item, MDC figure of 0.808 was adopted to estimate MID. Conclusions The findings support the

Utilizing the Total Design Method in medicine: maximizing response rates in long, non-incentivized, personal questionnaire postal surveys.

PubMed

Kazzazi, Fawz; Haggie, Rebecca; Forouhi, Parto; Kazzazi, Nazar; Malata, Charles M

2018-01-01

Maximizing response rates in questionnaires can improve their validity and quality by reducing non-response bias. A comprehensive analysis is essential for producing reasonable conclusions in patient-reported outcome research particularly for topics of a sensitive nature. This often makes long (≥7 pages) questionnaires necessary but these have been shown to reduce response rates in mail surveys. Our work adapted the "Total Design Method," initially produced for commercial markets, to raise response rates in a long (total: 11 pages, 116 questions), non-incentivized, very personal postal survey sent to almost 350 women. A total of 346 women who had undergone mastectomy and immediate breast reconstruction from 2008-2014 (inclusive) at Addenbrooke's University Hospital were sent our study pack (Breast-Q satisfaction questionnaire and support documents) using our modified "Total Design Method." Participants were sent packs and reminders according to our designed schedule. Of the 346 participants, we received 258 responses, an overall response rate of 74.5% with a useable response rate of 72.3%. One hundred and six responses were received before the week 1 reminder (30.6%), 120 before week 3 (34.6%), 225 before the week 7 reminder (64.6%) and the remainder within 3 weeks of the final pack being sent. The median age of patients that the survey was sent to, and the median age of the respondents, was 54 years. In this study, we have demonstrated the successful implementation of a novel approach to postal surveys. Despite the length of the questionnaire (nine pages, 116 questions) and limitations of expenses to mail a survey to ~350 women, we were able to attain a response rate of 74.6%.

Validity of Multiprocess IRT Models for Separating Content and Response Styles

ERIC Educational Resources Information Center

Plieninger, Hansjörg; Meiser, Thorsten

2014-01-01

Response styles, the tendency to respond to Likert-type items irrespective of content, are a widely known threat to the reliability and validity of self-report measures. However, it is still debated how to measure and control for response styles such as extreme responding. Recently, multiprocess item response theory models have been proposed that…

Construct Validation of Analytic Rating Scales in a Speaking Assessment: Reporting a Score Profile and a Composite

ERIC Educational Resources Information Center

Sawaki, Yasuyo

2007-01-01

This is a construct validation study of a second language speaking assessment that reported a language profile based on analytic rating scales and a composite score. The study addressed three key issues: score dependability, convergent/discriminant validity of analytic rating scales and the weighting of analytic ratings in the composite score.…

Item Response Models for Local Dependence among Multiple Ratings

ERIC Educational Resources Information Center

Wang, Wen-Chung; Su, Chi-Ming; Qiu, Xue-Lan

2014-01-01

Ratings given to the same item response may have a stronger correlation than those given to different item responses, especially when raters interact with one another before giving ratings. The rater bundle model was developed to account for such local dependence by forming multiple ratings given to an item response as a bundle and assigning…

A Comparison of Validity Rates between Paper-and-Pencil and Computerized Testing with the MMPI-2

ERIC Educational Resources Information Center

Blazek, Nicole L.; Forbey, Johnathan D.

2011-01-01

Although the use of computerized testing in psychopathology assessment has increased in recent years, limited research has examined the impact of this format in terms of potential differences in test validity rates. The current study explores potential differences in the rates of valid and invalid Minnesota Multiphasic Personality Inventory--2…

On the validity of the Arrhenius equation for electron attachment rate coefficients.

PubMed

Fabrikant, Ilya I; Hotop, Hartmut

2008-03-28

The validity of the Arrhenius equation for dissociative electron attachment rate coefficients is investigated. A general analysis allows us to obtain estimates of the upper temperature bound for the range of validity of the Arrhenius equation in the endothermic case and both lower and upper bounds in the exothermic case with a reaction barrier. The results of the general discussion are illustrated by numerical examples whereby the rate coefficient, as a function of temperature for dissociative electron attachment, is calculated using the resonance R-matrix theory. In the endothermic case, the activation energy in the Arrhenius equation is close to the threshold energy, whereas in the case of exothermic reactions with an intermediate barrier, the activation energy is found to be substantially lower than the barrier height.

Reliability, validity and responsiveness of the Arabic version of the Disability of Arm, Shoulder and Hand (DASH-Arabic).

PubMed

Alotaibi, Naser M; Aljadi, Sameera H; Alrowayeh, Hesham N

2016-12-01

To investigate the psychometric properties (reliability, validity and responsiveness) of the DASH-Arabic in a cohort of Arabic patients presenting with various upper extremity conditions. Participants were 139 patients with various upper extremity conditions, who completed the DASH-Arabic at the baseline, 2-5 days later and 30-36 days later. Participants completed demographic data forms, the SF-36 and VAS at baseline, and a Global Rating of Change scale at first and second follow-ups. Cronbach's alpha of the DASH-Arabic was 0.94. Test-retest reliability was excellent with an ICC of 0.97. The SEM was 3.50 and the MDC95 was 9.28. Construct validity of the DASH-Arabic with the SF-36 subscales and VAS scores ranged from r -0.32 to -0.57, all statistically significant (p < 0.001). The effect size (ES) for the DASH-Arabic was 1.39 and its standard response mean was 1.51. The area under the curve was 0.82 (95% CI = 0.72-0.92, p < 0.001). The optimally efficient cutoff for an improvement was found to be a difference of 15 DASH points. The DASH-Arabic is a reliable, valid and responsive upper extremity outcome measure for patients whose primary language is Arabic; it can be used to document patient status and outcomes and support evidence-based practice. Implications for Rehabilitation The DASH-Arabic demonstrated sound psychometric properties of reliability, validity and responsiveness. It is an effective patient status and outcome tool that will support evidence-based practice. This tool is recommended for evaluating upper extremity work-related injuries and tracking therapeutic outcomes.

The Brighton musculoskeletal Patient-Reported Outcome Measure (BmPROM): An assessment of validity, reliability, and responsiveness.

PubMed

Bryant, Elizabeth; Murtagh, Shemane; Finucane, Laura; McCrum, Carol; Mercer, Christopher; Smith, Toby; Canby, Guy; Rowe, David A; Moore, Ann P

2018-05-11

In response for the need of a freely available, stand-alone, validated outcome measure for use within musculoskeletal (MSK) physiotherapy practice, sensitive enough to measure clinical effectiveness, we developed an MSK patient reported outcome measure. This study examined the validity and reliability of the newly developed Brighton musculoskeletal Patient-Reported Outcome Measure (BmPROM) within physiotherapy outpatient settings. Two hundred twenty-four patients attending physiotherapy outpatient departments in South East England with an MSK condition participated in this study. The BmPROM was assessed for user friendliness (rated feedback, N = 224), reliability (internal consistency and test-retest reliability, n = 42), validity (internal and external construct validity, N = 224), and responsiveness (internal, n = 25). Exploratory factor analysis indicated that a two-factor model provides a good fit to the data. Factors were representative of "Functionality" and "Wellbeing". Correlations observed between the BmPROM and SF-36 domains provided evidence of convergent validity. Reliability results indicated that both subscales were internally consistent with alphas above the acceptable limits for both "Functionality" (α = .85, 95% CI [.81, .88]) and 'Wellbeing' (α = .80, 95% CI [.75, .84]). Test-retest analyses (n = 42) demonstrated a high degree of reliability between "Functionality" (ICC = .84; 95% CI [.72, .91]) and "Wellbeing" scores (ICC = .84; 95% CI [.72, .91]). Further examination of test-retest reliability through the Bland-Altman analysis demonstrated that the difference between "Functionality" and "Wellbeing" test scores did not vary as a function of absolute test score. Large treatment effect sizes were found for both subscales (Functionality d = 1.10; Wellbeing 1.03). The BmPROM is a reliable and valid outcome measure for use in evaluating physiotherapy treatment of MSK conditions. Copyright © 2018 John Wiley & Sons, Ltd.

The shoulder pain and disability index: the construct validity and responsiveness of a region-specific disability measure.

PubMed

Heald, S L; Riddle, D L; Lamb, R L

1997-10-01

The purposes of this study were (1) to assess the construct validity of the Shoulder Pain and Disability Index (SPADI) and (2) to determine whether the SPADI is more responsive than the Sickness Impact Profile (SIP), a generic health status measure. The sample consisted of 94 patients who were diagnosed with a shoulder problem and referred to six outpatient physical therapy clinics. Clinically meaningful change was determined by use of an ordinal rating scale designed to determine whether the patient's shoulder function was improved, the same, or worse following treatment. Spearman rho correlations were calculated for the initial visit SPADI and SIP scores. The standardized response mean (SRM) was used to measure responsiveness for the patients who were judged to be improved. One-tailed paired t tests (alpha = .01) were used to determine whether differences existed among SRM values. Correlations between the SPADI and SIP scores ranged from r = .01 to r = .57. The SRM value was higher for the SPADI total score (SRM = 1.38) than for the SIP total score (SRM = 0.79). Most correlations between SPADI and SIP scores provided support for the construct validity of the SPADI. The SPADI does not appear to strongly reflect occupational and recreational disability and is more responsive than the SIP.

Development and validation of a Response Bias Scale (RBS) for the MMPI-2.

PubMed

Gervais, Roger O; Ben-Porath, Yossef S; Wygant, Dustin B; Green, Paul

2007-06-01

This study describes the development of a Minnesota Multiphasic Personality Inventory (MMPI-2) scale designed to detect negative response bias in forensic neuropsychological or disability assessment settings. The Response Bias Scale (RBS) consists of 28 MMPI-2 items that discriminated between persons who passed or failed the Word Memory Test (WMT), Computerized Assessment of Response Bias (CARB), and/or Test of Memory Malingering (TOMM) in a sample of 1,212 nonhead-injury disability claimants. Incremental validity of the RBS was evaluated by comparing its ability to detect poor performance on four separate symptom validity tests with that of the F and F(P) scales and the Fake Bad Scale (FBS). The RBS consistently outperformed F, F(P), and FBS. Study results suggest that the RBS may be a useful addition to existing MMPI-2 validity scales and indices in detecting symptom complaints predominantly associated with cognitive response bias and overreporting in forensic neuropsychological and disability assessment settings.

Specificity rates for non-clinical, bilingual, Mexican Americans on three popular performance validity measures.

PubMed

Gasquoine, Philip G; Weimer, Amy A; Amador, Arnoldo

2017-04-01

To measure specificity as failure rates for non-clinical, bilingual, Mexican Americans on three popular performance validity measures: (a) the language format Reliable Digit Span; (b) visual-perceptual format Test of Memory Malingering; and (c) visual-perceptual format Dot Counting, using optimal/suboptimal effort cut scores developed for monolingual, English-speakers. Participants were 61 consecutive referrals, aged between 18 and 65 years, with <16 years of education who were subjectively bilingual (confirmed via formal assessment) and chose the language of assessment, Spanish or English, for the performance validity tests. Failure rates were 38% for Reliable Digit Span, 3% for the Test of Memory Malingering, and 7% for Dot Counting. For Reliable Digit Span, the failure rates for Spanish (46%) and English (31%) languages of administration did not differ significantly. Optimal/suboptimal effort cut scores derived for monolingual English-speakers can be used with Spanish/English bilinguals when using the visual-perceptual format Test of Memory Malingering and Dot Counting. The high failure rate for Reliable Digit Span suggests it should not be used as a performance validity measure with Spanish/English bilinguals, irrespective of the language of test administration, Spanish or English.

The intelligibility in Context Scale: validity and reliability of a subjective rating measure.

PubMed

McLeod, Sharynne; Harrison, Linda J; McCormack, Jane

2012-04-01

To describe a new measure of functional intelligibility, the Intelligibility in Context Scale (ICS), and evaluate its validity, reliability, and sensitivity using 3 clinical measures of severity of speech sound disorder: (a) percentage of phonemes correct (PPC), (b) percentage of consonants correct (PCC), and (c) percentage of vowels correct (PVC). Speech skills of 120 preschool children (109 with parent-/teacher-identified concern about how they talked and made speech sounds and 11 with no identified concern) were assessed with the Diagnostic Evaluation of Articulation and Phonology (Dodd, Hua, Crosbie, Holm, & Ozanne, 2002). Parents completed the 7-item ICS, which rates the degree to which children's speech is understood by different communication partners (parents, immediate family, extended family, friends, acquaintances, teachers, and strangers) on a 5-point scale. Parents' ratings showed that most children were always (5) or usually (4) understood by parents, immediate family, and teachers, but only sometimes (3) by strangers. Factor analysis confirmed the internal consistency of the ICS items; therefore, ratings were averaged to form an overall intelligibility score. The ICS had high internal reliability (α = .93), sensitivity, and construct validity. Criterion validity was established through significant correlations between the ICS and PPC (r = .54), PCC (r = .54), and PVC (r = .36). The ICS is a promising new measure of functional intelligibility. These data provide initial support for the ICS as an easily administered, valid, and reliable estimate of preschool children's intelligibility when speaking with people of varying levels of familiarity and authority.

Validating the Interpretations of PISA and TIMSS Tasks: A Rating Study

ERIC Educational Resources Information Center

Rindermann, Heiner; Baumeister, Antonia E. E.

2015-01-01

Scholastic tests regard cognitive abilities to be domain-specific competences. However, high correlations between competences indicate either high task similarity or a dependence on common factors. The present rating study examined the validity of 12 Programme for International Student Assessment (PISA) and Third or Trends in International…

Diet History Questionnaire: Response Rates/Length of Questionnaire

Cancer.gov

Based on pilot study research from about 400 individuals in one study and about 1000 in another, the response rates for the DHQ varied from 70-85%. In both these studies, the DHQ response rates were not statistically different than those from shorter FFQs.

Evaluation of written medicine information: validation of the Consumer Information Rating Form.

PubMed

Koo, Michelle M; Krass, Ines; Aslani, Parisa

2007-06-01

The Consumer Information Rating Form (CIRF) was developed as a direct method for measuring consumers' perceptions of the comprehensibility, utility, and design quality of written medicine information. The validity and reliability of the CIRF were evaluated in a small convenience consumer sample in the US. Its validity and reliability have yet to be established in a larger sample of consumers who are on chronic therapy in different settings. To determine the validity and reliability of the CIRF in Australian consumers on chronic therapy. Consumers read and subsequently evaluated a Consumer Medicine Information (CMI) leaflet for one of their own medications, using an adapted version of the CIRF. The construct validity and internal reliability of the adapted version of the CIRF were tested using principal components analysis (PCA) and Cronbach's alpha, respectively. The adapted CIRF was completed by 282 consumers (aged 19-90 y; median 66; interquartile range 53-75 y; 60.3% females). Most respondents spoke primarily English at home (85.5%), had attained at least secondary education (84%), and had adequate health literacy levels (88.2%). Consumers rated CMI easy to read, understand, and navigate, but less easy to remember and keep. Most also found it to be useful and to contain the right amount of information. The design aspects also scored favorably, although CMI did score relatively poorly in terms of its attractiveness and tone (whether alarming or not). PCA yielded 3 factors (explaining 59.3% of the total variance) identical to those in the original CIRF: comprehensibility, utility, and design quality. All factors demonstrated good reliability (Cronbach's alpha 0.74, 0.92, and 0.75, respectively). The CIRF appears to be a robust instrument for assessing consumers' perceptions of written medicine information. However, validity always needs to be reestablished when using a previously validated measure in a different population.

Validation of the Implementation Leadership Scale (ILS) with Supervisors' Self-Ratings.

PubMed

Torres, Elisa M; Ehrhart, Mark G; Beidas, Rinad S; Farahnak, Lauren R; Finn, Natalie K; Aarons, Gregory A

2018-01-01

Although often discussed, there is a lack of empirical research on the role of leadership in the management and delivery of health services. The implementation leadership scale (ILS) assesses the degree to which leaders are knowledgeable, proactive, perseverant, and supportive during evidence-based practice (EBP) implementation. The purpose of this study was to examine the psychometric properties of the ILS for leaders' self-ratings using a sample of mental health clinic supervisors (N = 119). Supervisors (i.e., leaders) completed surveys including self-ratings of their implementation leadership. Confirmatory factor analysis, reliability, and validity of the ILS were evaluated. The ILS factor structure was supported in the sample of supervisors. Results demonstrated internal consistency reliability and validity. Cronbach alpha's ranged from 0.92 to 0.96 for the ILS subscales and 0.95 for the ILS overall scale. The factor structure replication and reliability of the ILS in a sample of supervisors demonstrates its applicability with employees across organizational levels.

Narcissism and response validity: Do individuals with narcissistic features underreport psychopathology?

PubMed

Sleep, Chelsea E; Sellbom, Martin; Campbell, W Keith; Miller, Joshua D

2017-08-01

Narcissism is broadly described as a grandiose sense of self, feelings of entitlement, and a need for attention and admiration. Theorists have long suggested that to maintain an overly positive self-image, individuals with narcissistic features often self-enhance (Leary, 2007) and exhibit distorted (John & Robins, 1994) self-perceptions. Despite this theoretical link, little is known about its relationship to response style, particularly in regard to underreporting or defensiveness. Nevertheless, response style has been extensively studied in psychopathy, narcissism's closest neighbor, due to concerns that psychopathic individuals may lack insight into their traits and/or may be unwilling to admit to perceived faults or difficulties. Given the limited research on this topic, we examined narcissism's relation to response style in multiple samples (i.e., two undergraduate samples; one incarcerated sample) with several well-validated measures of response validity and narcissism. Across samples, the findings indicate that narcissism is not characterized by response invalidity, at least not in low-stakes research settings; in fact, vulnerable features of narcissism were found to be negatively associated with underreporting and a defensive response style. Implications for the present findings are discussed. (PsycINFO Database Record (c) 2017 APA, all rights reserved).

Validation of a Deterministic Vibroacoustic Response Prediction Model

NASA Technical Reports Server (NTRS)

Caimi, Raoul E.; Margasahayam, Ravi

1997-01-01

This report documents the recently completed effort involving validation of a deterministic theory for the random vibration problem of predicting the response of launch pad structures in the low-frequency range (0 to 50 hertz). Use of the Statistical Energy Analysis (SEA) methods is not suitable in this range. Measurements of launch-induced acoustic loads and subsequent structural response were made on a cantilever beam structure placed in close proximity (200 feet) to the launch pad. Innovative ways of characterizing random, nonstationary, non-Gaussian acoustics are used for the development of a structure's excitation model. Extremely good correlation was obtained between analytically computed responses and those measured on the cantilever beam. Additional tests are recommended to bound the problem to account for variations in launch trajectory and inclination.

Validity of Teacher Ratings in Selecting Influential Aggressive Adolescents for a Targeted Preventive Intervention

PubMed Central

Henry, David B.; Miller-Johnson, Shari; Simon, Thomas R.; Schoeny, Michael E.

2009-01-01

This study describes a method for using teacher nominations and ratings to identify socially influential, aggressive middle school students for participation in a targeted violence prevention intervention. The teacher nomination method is compared with peer nominations of aggression and influence to obtain validity evidence. Participants were urban, predominantly African American and Latino sixth-grade students who were involved in a pilot study for a large multi-site violence prevention project. Convergent validity was suggested by the high correlation of teacher ratings of peer influence and peer nominations of social influence. The teacher ratings of influence demonstrated acceptable sensitivity and specificity when predicting peer nominations of influence among the most aggressive children. Results are discussed m terms of the application of teacher nominations and ratings in large trials and full implementation of targeted prevention programs. PMID:16378226

The Achilles tendon total rupture score: a study of responsiveness, internal consistency and convergent validity on patients with acute Achilles tendon ruptures

PubMed Central

2012-01-01

Background The Achilles tendon Total Rupture Score was developed by a research group in 2007 in response to the need for a patient reported outcome measure for this patient population. Beyond this original development paper, no further validation studies have been published. Consequently the purpose of this study was to evaluate internal consistency, convergent validity and responsiveness of this newly developed patient reported outcome measure within patients who have sustained an isolated acute Achilles tendon rupture. Methods Sixty-four eligible patients with an acute rupture of their Achilles tendon completed the Achilles tendon Total Rupture Score alongside two further patient reported outcome measures (Disability Rating Index and EQ 5D). These were completed at baseline, six weeks, three months, six months and nine months post injury. The Achilles tendon Total Rupture Score was evaluated for internal consistency, using Cronbach's alpha, convergent validity, through correlation analysis and responsiveness, by analysing floor and ceiling effects and calculating its relative efficiency in comparison to the Disability Rating Index and EQ 5D scores. Results The Achilles tendon Total Rupture Score demonstrated high internal consistency (Cronbachs alpha > 0.8) and correlated significantly (p < 0.001) with the Disability Rating Index at five time points (pre-injury, six weeks, three, six and nine months) with correlation coefficients between -0.5 and -0.9. However, the confidence intervals were wide. Furthermore, the ability of the new score to detect clinically important changes over time (responsiveness) was shown to be greater than the Disability Rating Index and EQ 5D. Conclusions A universally accepted outcome measure is imperative to allow comparisons to be made across practice. This is the first study to evaluate aspects of validity of this newly developed outcome measure, outside of the developing centre. The ATRS demonstrated high internal consistency and

A Valid and Reliable Instrument for Cognitive Complexity Rating Assignment of Chemistry Exam Items

ERIC Educational Resources Information Center

Knaus, Karen; Murphy, Kristen; Blecking, Anja; Holme, Thomas

2011-01-01

The design and use of a valid and reliable instrument for the assignment of cognitive complexity ratings to chemistry exam items is described in this paper. Use of such an instrument provides a simple method to quantify the cognitive demands of chemistry exam items. Instrument validity was established in two different ways: statistically…

The Reliability and Validity of Self- and Investigator Ratings of ADHD in Adults

ERIC Educational Resources Information Center

Adler, Lenard A.; Faraone, Stephen V.; Spencer, Thomas J.; Michelson, David; Reimherr, Frederick W.; Glatt, Stephen J.; Marchant, Barrie K.; Biederman, Joseph

2008-01-01

Objective: Little information is available comparing self- versus investigator ratings of symptoms in adult ADHD. The authors compared the reliability, validity, and utility in a sample of adults with ADHD and also as an index of clinical improvement during treatment of self- and investigator ratings of ADHD symptoms via the Conners Adult ADHD…

Validation of standard ASTM F2732 and comparison with ISO 11079 with respect to comfort temperature ratings for cold protective clothing.

PubMed

Gao, Chuansi; Lin, Li-Yen; Halder, Amitava; Kuklane, Kalev; Holmér, Ingvar

2015-01-01

American standard ASTM F2732 estimates the lowest environmental temperature for thermal comfort for cold weather protective clothing. International standard ISO 11079 serves the same purpose but expresses cold stress in terms of required clothing insulation for a given cold climate. The objective of this study was to validate and compare the temperature ratings using human subject tests at two levels of metabolic rates (2 and 4 MET corresponding to 116.4 and 232.8 W/m(2)). Nine young and healthy male subjects participated in the cold exposure at 3.4 and -30.6 °C. The results showed that both standards predict similar temperature ratings for an intrinsic clothing insulation of 1.89 clo and for 2 MET activity. The predicted temperature rating for 2 MET activity is consistent with test subjects' thermophysiological responses, perceived thermal sensation and thermal comfort. For 4 MET activity, however, the whole body responses were on the cold side, particularly the responses of the extremities. ASTM F2732 is also limited due to its omission and simplification of three climatic variables (air velocity, radiant temperature and relative humidity) and exposure time in the cold which are of practical importance. Copyright © 2014 Elsevier Ltd and The Ergonomics Society. All rights reserved.

Validation of auditory detection response task method for assessing the attentional effects of cognitive load.

PubMed

Stojmenova, Kristina; Sodnik, Jaka

2018-07-04

There are 3 standardized versions of the Detection Response Task (DRT), 2 using visual stimuli (remote DRT and head-mounted DRT) and one using tactile stimuli. In this article, we present a study that proposes and validates a type of auditory signal to be used as DRT stimulus and evaluate the proposed auditory version of this method by comparing it with the standardized visual and tactile version. This was a within-subject design study performed in a driving simulator with 24 participants. Each participant performed 8 2-min-long driving sessions in which they had to perform 3 different tasks: driving, answering to DRT stimuli, and performing a cognitive task (n-back task). Presence of additional cognitive load and type of DRT stimuli were defined as independent variables. DRT response times and hit rates, n-back task performance, and pupil size were observed as dependent variables. Significant changes in pupil size for trials with a cognitive task compared to trials without showed that cognitive load was induced properly. Each DRT version showed a significant increase in response times and a decrease in hit rates for trials with a secondary cognitive task compared to trials without. Similar and significantly better results in differences in response times and hit rates were obtained for the auditory and tactile version compared to the visual version. There were no significant differences in performance rate between the trials without DRT stimuli compared to trials with and among the trials with different DRT stimuli modalities. The results from this study show that the auditory DRT version, using the signal implementation suggested in this article, is sensitive to the effects of cognitive load on driver's attention and is significantly better than the remote visual and tactile version for auditory-vocal cognitive (n-back) secondary tasks.

The dual impact of "appeal" and "researcher credibility" on mail survey response rate in the context of preventive health care.

PubMed

Angur, M G; Nataraajan, R; Chawla, S K

1994-01-01

Health and fitness centers are becoming increasingly aware of their importance in the realm of preventive health care. Many hospitals have begun to open and run fitness centers, a trend that seems very likely to continue. In a competitive environment, every center would desire to obtain maximum valid customer information at minimum cost, and this paper addresses this issue. The authors investigate the confluence of both appeal and researcher credibility on mail questionnaire response rates from a metropolitan membership of a large fitness center. Personal appeal with high researcher credibility was found to generate significantly higher response rate followed by the hybrid appeal with low researcher credibility.

Cultural and ethnic differences in content validation responses.

PubMed

Evans, Bronwynne C

2004-04-01

Eight instruments to evaluate grant interventions aimed at increasing recruitment and retention of Hispanic/Latino and American Indian nurses were developed for a Nursing Workforce Diversity Grant. This article compares expert reviewer responses during content validation of these instruments with (a) current literature and (b) seven filmed intervals of Hispanic/Latino and American Indian nurses speaking about their educational experiences. White reviewers responded differently to certain items than did Hispanic/Latino and American Indian reviewers (or reviewers closely affiliated with such persons). Responses of Hispanic/Latino and American Indian experts were aligned with one another but not aligned with the responses of White experts, who also agreed with one another, prompting literature and film comparisons with their responses. Faculty development may be needed to help teachers uncover their assumptions about students of color, acquire knowledge about cultural perspectives, recognize institutional racism, and attain the skills necessary to develop and implement a curriculum of inclusion.

SNPs in stress-responsive rice genes: validation, genotyping, functional relevance and population structure

PubMed Central

2012-01-01

Background Single nucleotide polymorphism (SNP) validation and large-scale genotyping are required to maximize the use of DNA sequence variation and determine the functional relevance of candidate genes for complex stress tolerance traits through genetic association in rice. We used the bead array platform-based Illumina GoldenGate assay to validate and genotype SNPs in a select set of stress-responsive genes to understand their functional relevance and study the population structure in rice. Results Of the 384 putative SNPs assayed, we successfully validated and genotyped 362 (94.3%). Of these 325 (84.6%) showed polymorphism among the 91 rice genotypes examined. Physical distribution, degree of allele sharing, admixtures and introgression, and amino acid replacement of SNPs in 263 abiotic and 62 biotic stress-responsive genes provided clues for identification and targeted mapping of trait-associated genomic regions. We assessed the functional and adaptive significance of validated SNPs in a set of contrasting drought tolerant upland and sensitive lowland rice genotypes by correlating their allelic variation with amino acid sequence alterations in catalytic domains and three-dimensional secondary protein structure encoded by stress-responsive genes. We found a strong genetic association among SNPs in the nine stress-responsive genes with upland and lowland ecological adaptation. Higher nucleotide diversity was observed in indica accessions compared with other rice sub-populations based on different population genetic parameters. The inferred ancestry of 16% among rice genotypes was derived from admixed populations with the maximum between upland aus and wild Oryza species. Conclusions SNPs validated in biotic and abiotic stress-responsive rice genes can be used in association analyses to identify candidate genes and develop functional markers for stress tolerance in rice. PMID:22921105

Rating scales for dystonia in cerebral palsy: reliability and validity.

PubMed

Monbaliu, E; Ortibus, E; Roelens, F; Desloovere, K; Deklerck, J; Prinzie, P; de Cock, P; Feys, H

2010-06-01

This study investigated the reliability and validity of the Barry-Albright Dystonia Scale (BADS), the Burke-Fahn-Marsden Movement Scale (BFMMS), and the Unified Dystonia Rating Scale (UDRS) in patients with bilateral dystonic cerebral palsy (CP). Three raters independently scored videotapes of 10 patients (five males, five females; mean age 13 y 3 mo, SD 5 y 2 mo, range 5-22 y). One patient each was classified at levels I-IV in the Gross Motor Function Classification System and six patients were classified at level V. Reliability was measured by (1) intraclass correlation coefficient (ICC) for interrater reliability, (2) standard error of measurement (SEM) and smallest detectable difference (SDD), and (3) Cronbach's alpha for internal consistency. Validity was assessed by Pearson's correlations among the three scales used and by content analysis. Moderate to good interrater reliability was found for total scores of the three scales (ICC: BADS=0.87; BFMMS=0.86; UDRS=0.79). However, many subitems showed low reliability, in particular for the UDRS. SEM and SDD were respectively 6.36% and 17.72% for the BADS, 9.88% and 27.39% for the BFMMS, and 8.89% and 24.63% for the UDRS. High internal consistency was found. Pearson's correlations were high. Content validity showed insufficient accordance with the new CP definition and classification. Our results support the internal consistency and concurrent validity of the scales; however, taking into consideration the limitations in reliability, including the large SDD values and the content validity, further research on methods of assessment of dystonia is warranted.

Wenckebach upper rate response in single chamber pacemaker.

PubMed

Barold, S S

2000-07-01

The Medtronic Minix pacemaker during normal function in the VVT mode was found to exhibit a Wenckenbach upper rate response similar to that of dual chamber devices. This behavior occurred only when the upper rate interval was longer than the pacemaker refractory period. In a single chamber device this response may simulate pacemaker malfunction.

Fecal glucocorticoid metabolites and assay validation: Stress response evaluation in captive brown howler monkeys (Alouatta clamitans).

PubMed

Eleonora Madeira Buti, Thais; Kugelmeier, Tatiana; Sobral, Gisela; Viau Furtado, Priscila; do Valle Dutra de Andrade Neves, Dafne; Alvarenga de Oliveira, Claudio

2018-04-25

The advent of non-invasive methods provides a powerful alternative to stress studies as the use of stressful handling techniques is no longer needed. However, many factors influence hormone metabolism such as sex, diet, and metabolic rate. Thus, validation should be species- and matrix-specific. To assess stress response in brown howler monkeys Alouatta clamitans, we adopted an ACTH challenge test and parallelism to provide physiological and laboratorial validation. Radioimmunoassay was used to measure fecal levels of corticosterone. All challenged animals presented a peak in fecal glucocorticoids levels the day after the treatment, while control animals did not. There were no significant sex differences, but females with infants had higher levels of corticosterone. Corticosterone levels showed parallelism to the standard curve of the diagnostics kit. Collectively, the data suggest that the method was validated and is useful for monitoring stress, thereby helping in conservation programs both in captivity and in the wild. Transit time information may be coupled with travel distance in seed dispersal studies. © 2018 John Wiley & Sons A/S. Published by John Wiley & Sons Ltd.

The Role of Psychometric Modeling in Test Validation: An Application of Multidimensional Item Response Theory

ERIC Educational Resources Information Center

Schilling, Stephen G.

2007-01-01

In this paper the author examines the role of item response theory (IRT), particularly multidimensional item response theory (MIRT) in test validation from a validity argument perspective. The author provides justification for several structural assumptions and interpretations, taking care to describe the role he believes they should play in any…

Modeling rate sensitivity of exercise transient responses to limb motion.

PubMed

Yamashiro, Stanley M; Kato, Takahide

2014-10-01

Transient responses of ventilation (V̇e) to limb motion can exhibit predictive characteristics. In response to a change in limb motion, a rapid change in V̇e is commonly observed with characteristics different than during a change in workload. This rapid change has been attributed to a feed-forward or adaptive response. Rate sensitivity was explored as a specific hypothesis to explain predictive V̇e responses to limb motion. A simple model assuming an additive feed-forward summation of V̇e proportional to the rate of change of limb motion was studied. This model was able to successfully account for the adaptive phase correction observed during human sinusoidal changes in limb motion. Adaptation of rate sensitivity might also explain the reduction of the fast component of V̇e responses previously reported following sudden exercise termination. Adaptation of the fast component of V̇e response could occur by reduction of rate sensitivity. Rate sensitivity of limb motion was predicted by the model to reduce the phase delay between limb motion and V̇e response without changing the steady-state response to exercise load. In this way, V̇e can respond more quickly to an exercise change without interfering with overall feedback control. The asymmetry between responses to an incremental and decremental ramp change in exercise can also be accounted for by the proposed model. Rate sensitivity leads to predicted behavior, which resembles responses observed in exercise tied to expiratory reserve volume. Copyright © 2014 the American Physiological Society.

The development and validation of the Memory Support Rating Scale.

PubMed

Lee, Jason Y; Worrell, Frank C; Harvey, Allison G

2016-06-01

Patient memory for treatment information is poor, and worse memory for treatment information is associated with poorer clinical outcomes. Memory support techniques have been harnessed to improve patient memory for treatment. However, a measure of memory support used by treatment providers during sessions has yet to be established. The present study reports on the development and psychometric properties of the Memory Support Rating Scale (MSRS)-an observer-rated scale designed to measure memory support. Adults with major depressive disorder (MDD; N = 42) were randomized to either cognitive therapy plus memory support (CT + MS; n = 22) or cognitive therapy as-usual (CT-as-usual; n = 20). At posttreatment, patients freely recalled treatment points via the patient recall task. Sessions (n = 171) were coded for memory support using the MSRS, 65% of which were also assessed for the quality of cognitive therapy via the Cognitive Therapy Rating Scale (CTRS). A unidimensional scale composed of 8 items was developed using exploratory factor analysis, though a larger sample is needed to further assess the factor structure of MSRS scores. High interrater and test-retest reliabilities of MSRS scores were observed across 7 MSRS coders. MSRS scores were higher in the CT + MS condition compared with CT-as-usual, demonstrating group differentiation ability. MSRS scores were positively associated with patient recall task scores but not associated with CTRS scores, demonstrating convergent and discriminant validity, respectively. Results indicate that the MSRS yields reliable and valid scores for measuring treatment providers' use of memory support while delivering cognitive therapy. (PsycINFO Database Record (c) 2016 APA, all rights reserved).

The Development and Initial Validation of the Student Measure of Culturally Responsive Teaching

ERIC Educational Resources Information Center

Dickson, Ginger L.; Chun, Heejung; Fernandez, Ivelisse Torres

2016-01-01

This article describes the development and initial validation of a measure of middle school students' perspectives of culturally responsive teaching practices. The Student Measure of Culturally Responsive Teaching (SMCRT) was developed by modifying items on the Culturally Responsive Teaching Self-Efficacy (CRTSE), which measures teachers'…

The Sensitivity of Response Rate to the Rate of Variable-Interval Reinforcement for Pigeons and Rats: A Review

ERIC Educational Resources Information Center

Shull, Richard L.

2005-01-01

The relation between the rate of a response ("B") and the rate of its reinforcement ("R") is well known to be approximately hyperbolic: B = kR/(R + R[subscript o]), where k represents the maximum response rate, and R[subscript o] indicates the rate of reinforcers that will engender a response rate equal to half its maximum value. A review of data…

Development and validation of the Dimensional Anhedonia Rating Scale (DARS) in a community sample and individuals with major depression.

PubMed

Rizvi, Sakina J; Quilty, Lena C; Sproule, Beth A; Cyriac, Anna; Michael Bagby, R; Kennedy, Sidney H

2015-09-30

Anhedonia, a core symptom of Major Depressive Disorder (MDD), is predictive of antidepressant non-response. In contrast to the definition of anhedonia as a "loss of pleasure", neuropsychological studies provide evidence for multiple facets of hedonic function. The aim of the current study was to develop and validate the Dimensional Anhedonia Rating Scale (DARS), a dynamic scale that measures desire, motivation, effort and consummatory pleasure across hedonic domains. Following item selection procedures and reliability testing using data from community participants (N=229) (Study 1), the 17-item scale was validated in an online study with community participants (N=150) (Study 2). The DARS was also validated in unipolar or bipolar depressed patients (n=52) and controls (n=50) (Study 3). Principal components analysis of the 17-item DARS revealed a 4-component structure mapping onto the domains of anhedonia: hobbies, food/drink, social activities, and sensory experience. Reliability of the DARS subscales was high across studies (Cronbach's α=0.75-0.92). The DARS also demonstrated good convergent and divergent validity. Hierarchical regression analysis revealed the DARS showed additional utility over the Snaith-Hamilton Pleasure Scale (SHAPS) in predicting reward function and distinguishing MDD subgroups. These studies provide support for the reliability and validity of the DARS. Copyright © 2015 Elsevier Ireland Ltd. All rights reserved.

Ground validation of DPR precipitation rate over Italy using H-SAF validation methodology

NASA Astrophysics Data System (ADS)

Puca, Silvia; Petracca, Marco; Sebastianelli, Stefano; Vulpiani, Gianfranco

2017-04-01

The H-SAF project (Satellite Application Facility on support to Operational Hydrology and Water Management, funded by EUMETSAT) is aimed at retrieving key hydrological parameters such as precipitation, soil moisture and snow cover. Within the H-SAF consortium, the Product Precipitation Validation Group (PPVG) evaluate the accuracy of instantaneous and accumulated precipitation products with respect to ground radar and rain gauge data adopting the same methodology (using a Unique Common Code) throughout Europe. The adopted validation methodology can be summarized by the following few steps: (1) ground data (radar and rain gauge) quality control; (2) spatial interpolation of rain gauge measurements; (3) up-scaling of radar data to satellite native grid; (4) temporal comparison of satellite and ground-based precipitation products; and (5) production and evaluation of continuous and multi-categorical statistical scores for long time series and case studies. The statistical scores are evaluated taking into account the satellite product native grid. With the recent advent of the GPM era starting in march 2014, more new global precipitation products are available. The validation methodology developed in H-SAF can be easily applicable to different precipitation products. In this work, we have validated instantaneous precipitation data estimated from DPR (Dual-frequency Precipitation Radar) instrument onboard of the GPM-CO (Global Precipitation Measurement Core Observatory) satellite. In particular, we have analyzed the near surface and estimated precipitation fields collected in the 2A-Level for 3 different scans (NS, MS and HS). The Italian radar mosaic managed by the National Department of Civil Protection available operationally every 10 minutes is used as ground reference data. The results obtained highlight the capability of the DPR to identify properly the precipitation areas with higher accuracy in estimating the stratiform precipitation (especially for the HS). An

[Validation of the Montgomery-Åsberg Depression Rating Scale (MADRS) in Colombia].

PubMed

Cano, Juan Fernando; Gomez Restrepo, Carlos; Rondón, Martín

2016-01-01

To adapt and to validate the Montgomery-Åsberg Depression Rating Scale (MADRS) in Colombia. Observational study for scale validation. Validity criteria were used to determine the severity cut-off points of the tool. Taking into account sensitivity and specificity values, those cut points were contrasted with ICD-10 criteria for depression severity. A a factor analysis was performed. The internal consistencY was determined with the same sample of patients used for the validity criteria. Inter-rater reliability was assessed by evaluating the 22 records of the patients that consented to a video interview. Sensitivity to change was established through a second application of the scale in 28 subjects after a lapse of 14 to 28 days. The study was performed in Bogotá, the tool was applied in 150 patients suffering from major depressive disorder. The cut-off point for moderate depression was 20 (sensitivity, 98%; specificity, 96%), and the cut-off point for severe depression was 34 (sensitivity, 98%; specificity, 92%). The tool appears as a unidimensional scale, which possesses a good internal consistency with (α=.9168). The findings of inter-rater reliability evaluation showed the scale as highly reliable (intraclass correlation coefficient=.9833). The instrument has a good sensitivity to change. The Colombian version of the Montgomery-Åsberg Depression Rating Scale has good psychometric properties and can be used in clinical practice and in clinical research in the field of depressive disorder. Copyright © 2015 Asociación Colombiana de Psiquiatría. Publicado por Elsevier España. All rights reserved.

Lower Response Rates on Alumni Surveys Might Not Mean Lower Response Representativeness

ERIC Educational Resources Information Center

Lambert, Amber D.; Miller, Angie L.

2014-01-01

The purpose of this research is to explore some possible issues with response representativeness in alumni surveys. While alumni surveys can provide important information, they often have lower response rates due to bad contact information and other reasons. In this study we investigate potential differences between responses on the National…

FIELD VALIDATION OF A SHEEPSHEAD MINNOW ESTROGEN-RESPONSIVE CDNA MACROARRAY

EPA Science Inventory

Hemmer, Michael J., Iris Knoebl, Becky L. Hemmer, Patrick Larkin, Peggy S. Harris and Nancy D. Denslow. In press. Field Validation of a Sheepshead Minnow Estrogen-Responsive cDNA Macroarray (Abstract). To be presented at the SETAC Fourth World Congress, 14-18 November 2004, Portl...

Procedural Pain Heart Rate Responses in Massaged Preterm Infants

PubMed Central

Diego, Miguel A.; Field, Tiffany; Hernandez-Reif, Maria

2009-01-01

Heart rate (HR) responses to the removal of a monitoring lead were assessed in 56 preterm infants who received moderate pressure, light pressure or no massage therapy. The infants who received moderate pressure massage therapy exhibited lower increases in HR suggesting an attenuated pain response. The heart rate of infants who received moderate pressure massage also returned to baseline faster than the heart rate of the other two groups, suggesting a faster recovery rate. PMID:19185352

Detecting symptom exaggeration in combat veterans using the MMPI-2 symptom validity scales: a mixed group validation.

PubMed

Tolin, David F; Steenkamp, Maria M; Marx, Brian P; Litz, Brett T

2010-12-01

Although validity scales of the Minnesota Multiphasic Personality Inventory-2 (MMPI-2; J. N. Butcher, W. G. Dahlstrom, J. R. Graham, A. Tellegen, & B. Kaemmer, 1989) have proven useful in the detection of symptom exaggeration in criterion-group validation (CGV) studies, usually comparing instructed feigners with known patient groups, the application of these scales has been problematic when assessing combat veterans undergoing posttraumatic stress disorder (PTSD) examinations. Mixed group validation (MGV) was employed to determine the efficacy of MMPI-2 exaggeration scales in compensation-seeking (CS) and noncompensation-seeking (NCS) veterans. Unlike CGV, MGV allows for a mix of exaggerating and nonexaggerating individuals in each group, does not require that the exaggeration versus nonexaggerating status of any individual be known, and can be adjusted for different base-rate estimates. MMPI-2 responses of 377 male veterans were examined according to CS versus NCS status. MGV was calculated using 4 sets of base-rate estimates drawn from the literature. The validity scales generally performed well (adequate sensitivity, specificity, and efficiency) under most base-rate estimations, and most produced cutoff scores that showed adequate detection of symptom exaggeration, regardless of base-rate assumptions. These results support the use of MMPI-2 validity scales for PTSD evaluations in veteran populations, even under varying base rates of symptom exaggeration.

A valid model for predicting responsible nerve roots in lumbar degenerative disease with diagnostic doubt.

PubMed

Li, Xiaochuan; Bai, Xuedong; Wu, Yaohong; Ruan, Dike

2016-03-15

To construct and validate a model to predict responsible nerve roots in lumbar degenerative disease with diagnostic doubt (DD). From January 2009-January 2013, 163 patients with DD were assigned to the construction (n = 106) or validation sample (n = 57) according to different admission times to hospital. Outcome was assessed according to the Japanese Orthopedic Association (JOA) recovery rate as excellent, good, fair, and poor. The first two results were considered as effective clinical outcome (ECO). Baseline patient and clinical characteristics were considered as secondary variables. A multivariate logistic regression model was used to construct a model with the ECO as a dependent variable and other factors as explanatory variables. The odds ratios (ORs) of each risk factor were adjusted and transformed into a scoring system. Area under the curve (AUC) was calculated and validated in both internal and external samples. Moreover, calibration plot and predictive ability of this scoring system were also tested for further validation. Patients with DD with ECOs in both construction and validation models were around 76 % (76.4 and 75.5 % respectively). more preoperative visual analog pain scale (VAS) score (OR = 1.56, p < 0.01), stenosis levels of L4/5 or L5/S1 (OR = 1.44, p = 0.04), stenosis locations with neuroforamen (OR = 1.95, p = 0.01), neurological deficit (OR = 1.62, p = 0.01), and more VAS improvement of selective nerve route block (SNRB) (OR = 3.42, p = 0.02). the internal area under the curve (AUC) was 0.85, and the external AUC was 0.72, with a good calibration plot of prediction accuracy. Besides, the predictive ability of ECOs was not different from the actual results (p = 0.532). We have constructed and validated a predictive model for confirming responsible nerve roots in patients with DD. The associated risk factors were preoperative VAS score, stenosis levels of L4/5 or L5/S1, stenosis locations

Online Course Evaluations Response Rates

ERIC Educational Resources Information Center

Guder, Faruk; Malliaris, Mary

2013-01-01

This paper studies the reasons for low response rates in online evaluations. Survey data are collected from the students to understand factors that might affect student participation in the course evaluation process. When course evaluations were opened to the student body, an email announcement was sent to all students, and a reminder email was…

Adults' past-day recall of sedentary time: reliability, validity, and responsiveness.

PubMed

Clark, Bronwyn K; Winkler, Elisabeth; Healy, Genevieve N; Gardiner, Paul G; Dunstan, David W; Owen, Neville; Reeves, Marina M

2013-06-01

Past-day recall rather than recall of past week or a usual/typical day may improve the validity of self-reported sedentary time measures. This study examined the test-retest reliability, criterion validity, and responsiveness of the seven-item questionnaire, Past-day Adults' Sedentary Time (PAST). Participants (breast cancer survivors, n = 90, age = 33-75 yr, body mass index = 25-40 kg·m) in a 6-month randomized controlled trial of a lifestyle-based weight loss intervention completed the interviewer-administered PAST questionnaire about time spent sitting/lying on the previous day for work, transport, television viewing, nonwork computer use, reading, hobbies, and other purposes (summed for total sedentary time). The instrument was administered at baseline, 7 d later for test-retest reliability (n = 86), and at follow-up. ActivPAL3-assessed sit/lie time in bouts of ≥5 min during waking hours on the recall day was used as the validity criterion measure at both baseline (n = 72) and follow-up (n = 68). Analyses included intraclass correlation coefficients, Pearson's correlations (r), and Bland-Altman plots and responsiveness index. The PAST had fair to good test-retest reliability (intraclass correlation coefficient = 0.50, 95% confidence interval [CI] = 0.32-0.64). At baseline, the correlation between PAST and activPAL sit/lie time was r = 0.57 (95% CI = 0.39-0.71). The mean difference between PAST at baseline and retest was -25 min (5.2%), 95% limits of agreement = -5.9 to 5.0 h, and the activPAL sit/lie time was -9 min (1.8%), 95% limits of agreement = -4.9 to 4.6 h. The PAST showed small but significant responsiveness (-0.44, 95% CI = -0.92 to -0.04); responsiveness of activPAL sit/lie time was not significant. The PAST questionnaire provided an easy-to-administer measure of sedentary time in this sample. Validity and reliability findings compare favorably with other sedentary time questionnaires. Past-day recall of sedentary time shows promise for use in

Do Differential Response Rates to Patient Surveys Between Organizations Lead to Unfair Performance Comparisons?: Evidence From the English Cancer Patient Experience Survey.

PubMed

Saunders, Catherine L; Elliott, Marc N; Lyratzopoulos, Georgios; Abel, Gary A

2016-01-01

Patient surveys typically have variable response rates between organizations, leading to concerns that such differences may affect the validity of performance comparisons. To explore the size and likely sources of associations between hospital-level survey response rates and patient experience. Cross-sectional mail survey including 60 patient experience items sent to 101,771 cancer survivors recently treated by 158 English NHS hospitals. Age, sex, race/ethnicity, socioeconomic status, clinical diagnosis, hospital type, and region were available for respondents and nonrespondents. The overall response rate was 67% (range, 39% to 77% between hospitals). Hospitals with higher response rates had higher scores for all items (Spearman correlation range, 0.03-0.44), particularly questions regarding hospital-level administrative processes, for example, procedure cancellations or medical note availability.From multivariable analysis, associations between individual patient experience and hospital-level response rates were statistically significant (P<0.05) for 53/59 analyzed questions, decreasing to 37/59 after adjusting for case-mix, and 25/59 after further adjusting for hospital-level characteristics.Predicting responses of nonrespondents, and re-estimating hypothetical hospital scores assuming a 100% response rate, we found that currently low performing hospitals would have attained even lower scores. Overall nationwide attainment would have decreased slightly to that currently observed. Higher response rate hospitals have more positive experience scores, and this is only partly explained by patient case-mix. High response rates may be a marker of efficient hospital administration, and higher quality that should not, therefore, be adjusted away in public reporting. Although nonresponse may result in slightly overestimating overall national levels of performance, it does not appear to meaningfully bias comparisons of case-mix-adjusted hospital results.

German validation of the Conners Adult ADHD Rating Scales (CAARS) II: reliability, validity, diagnostic sensitivity and specificity.

PubMed

Christiansen, H; Kis, B; Hirsch, O; Matthies, S; Hebebrand, J; Uekermann, J; Abdel-Hamid, M; Kraemer, M; Wiltfang, J; Graf, E; Colla, M; Sobanski, E; Alm, B; Rösler, M; Jacob, C; Jans, T; Huss, M; Schimmelmann, B G; Philipsen, A

2012-07-01

The German version of the Conners Adult ADHD Rating Scales (CAARS) has proven to show very high model fit in confirmative factor analyses with the established factors inattention/memory problems, hyperactivity/restlessness, impulsivity/emotional lability, and problems with self-concept in both large healthy control and ADHD patient samples. This study now presents data on the psychometric properties of the German CAARS-self-report (CAARS-S) and observer-report (CAARS-O) questionnaires. CAARS-S/O and questions on sociodemographic variables were filled out by 466 patients with ADHD, 847 healthy control subjects that already participated in two prior studies, and a total of 896 observer data sets were available. Cronbach's-alpha was calculated to obtain internal reliability coefficients. Pearson correlations were performed to assess test-retest reliability, and concurrent, criterion, and discriminant validity. Receiver Operating Characteristics (ROC-analyses) were used to establish sensitivity and specificity for all subscales. Coefficient alphas ranged from .74 to .95, and test-retest reliability from .85 to .92 for the CAARS-S, and from .65 to .85 for the CAARS-O. All CAARS subscales, except problems with self-concept correlated significantly with the Barrett Impulsiveness Scale (BIS), but not with the Wender Utah Rating Scale (WURS). Criterion validity was established with ADHD subtype and diagnosis based on DSM-IV criteria. Sensitivity and specificity were high for all four subscales. The reported results confirm our previous study and show that the German CAARS-S/O do indeed represent a reliable and cross-culturally valid measure of current ADHD symptoms in adults. Copyright © 2011 Elsevier Masson SAS. All rights reserved.

Validity of parent's self-reported responses to home safety questions.

PubMed

Osborne, Jodie M; Shibl, Rania; Cameron, Cate M; Kendrick, Denise; Lyons, Ronan A; Spinks, Anneliese B; Sipe, Neil; McClure, Roderick J

2016-09-01

The aim of the study was to describe the validity of parent's self-reported responses to questions on home safety practices for children of 2-4 years. A cross-sectional validation study compared parent's self-administered responses to items in the Home Injury Prevention Survey with home observations undertaken by trained researchers. The relationship between the questionnaire and observation results was assessed using percentage agreement, sensitivity, specificity, positive predictive value, negative predictive value and intraclass correlation coefficients. Percentage agreements ranged from 44% to 100% with 40 of the total 45 items scoring higher than 70%. Sensitivities ranged from 0% to 100%, with 27 items scoring at least 70%. Specificities also ranged from 0% to 100%, with 33 items scoring at least 70%. As such, the study identified a series of self-administered home safety questions that have sensitivities, specificities and predictive values sufficiently high to allow the information to be useful in research and injury prevention practice.

Factorial Validity and Reliability of the Devereux Elementary School Behavior Rating Scale.

ERIC Educational Resources Information Center

Reynolds, William M.; Bernstein, Sydna M.

1982-01-01

The factorial validity and internal consistency reliability of the Devereux Elementary School Behavior Rating Scale were examined with a random sample of elementary school children. Given the problem of multicollinearity that was shown to exist among subscales, the authors suggest caution in the interpretation of Devereux subscales as discrete…

Validation analysis of informant's ratings of cognitive function in African Americans and Nigerians

PubMed Central

Shen, Jianzhao; Gao, Sujuan; Unverzagt, Frederick W.; Ogunniyi, Adesola; Baiyewu, Olusegun; Gureje, Oye; Hendrie, Hugh C.; Hall, Kathleen S.

2011-01-01

SUMMARY Objectives To examine informant validity using the Community Screening Interview for Dementia (CSI ‘D’) both cross-sectionally and longitudinally in two very different cultures and to explore the effects of informants and study participants’ characteristics on the validity of informants’ reports. Methods Elderly African Americans age 65 years and older residing in Indianapolis, USA and elderly Yoruba Nigerians age 65 years and older residing in Ibadan, Nigeria were assessed on cognitive functioning using the CSI ‘D’ at baseline (1992–1993) and five-year follow-up (1997–1998). At baseline, the informant validity in both samples was evaluated against participants’ cognitive tests using Pearson correlation and regular regression models. At follow-up, informants ratings on cognitive decline were assessed against participants’ cognitive decline scores from baseline to follow-up using biserial correlation and logistic regressions. Results At baseline, informants’ reports on cognitive functioning significantly correlated with cognitive scores in both samples (Indianapolis:r = –0.43, p < 0.001; Ibadan:r = –0.47, p < 0.001). The participant–informant relationships significantly affected the informants’ reports in the two samples with different patterns (p = 0.005 for Indianapolis and p < 0.001 for Ibadan) at a given level of cognitive functioning. African Americans spouses reported more cognitive problems, while siblings reported more problems for the Yoruba Nigerians. At follow-up, informants’ ratings on cognitive decline significantly correlated with the cognitive decline scores (Indianapolis r = 0.38, p < 0.001; Ibadan r = 0.32, p < 0.001). The characteristics of study participants and informants had little impact on the informants’ ratings on cognitive decline. Conclusions Informant reports are valid in assessing the cognitive functioning of study participants both cross-sectionally and longitudinally in two very different

Development of Interviewer Response Rate Standards for National Surveys

ERIC Educational Resources Information Center

Erdman, Chandra; Adams, Tamara; O'Hare, Barbara C.

2016-01-01

Realistic response rate expectations are important for successfully allocating and managing data collection efforts under limited resources. Interviewer performance is often evaluated against response rate standards, and face-to-face interviewer performance can vary due to, in part, the socioeconomic characteristics of the neighborhoods in which…

Validation of Universal Scale in Oral Surgery (USOS) for Patient's Psycho-emotional Status Rating.

PubMed

Astramskaite, Inesa; Pinchasov, Ginnady; Gervickas, Albinas; Sakavicius, Dalius; Juodzbalys, Gintaras

2017-01-01

There aren't any objective methods that may help in standard evaluation of oral surgery patient's psycho-emotional status. Without any standardized evaluation, two main problems appear: heterogeneity between studies and ineffective patient's evaluation. Therefore, Universal Scale in Oral Surgery (USOS) for patient's psycho-emotional status rating has previously been proposed by authors. The aim of present study is to assess the clinical effectivity and validate the Universal Scale in Oral Surgery in case of outpatient tooth extraction for adult healthy patients. Clinical trial to validate the USOS for patient's psycho-emotional status rating was performed. In total 90 patients, that came for outpatient dental extraction to Lithuanian University of Health Sciences Oral and Maxillofacial Surgery Department ambulatory, were enrolled in clinical trial. Patients filled self-reported questionnaires before the procedure. Operating surgeon rated USOS for patient's psycho-emotional status rating doctor's part questionnaire after the procedure. 4 - 6 weeks later all patients were asked to fill USOS for patient's psycho-emotional status rating questionnaire retrospectively. According to the statistical analysis, the final composition of USOS for patient's psycho-emotional status rating that would fit to reliability coefficient should be composed from 6 patient part questions and 3 general doctor part questions. Universal Scale in Oral Surgery for patient's psycho-emotional status rating is a novel, doctor and patient rated scale which is suitable for clinical and scientific usage.

Response to "Rating Teachers Cheaper, Faster, and Better: Not so Fast": It's About Evidence

ERIC Educational Resources Information Center

Gargani, John; Strong, Michael

2015-01-01

In Gargani and Strong (2014), we describe The Rapid Assessment of Teacher Effectiveness (RATE), a new teacher evaluation instrument. Our account of the validation research associated with RATE inspired a review by Good and Lavigne (2015). Here, we reply to the main points of their review. We elaborate on the validity, reliability, theoretical…

Convergence among Data Sources, Response Bias, and Reliability and Validity of a Structured Job Analysis Questionnaire.

ERIC Educational Resources Information Center

Smith, Jack E.; Hakel, Milton D.

1979-01-01

Examined are questions pertinent to the use of the Position Analysis Questionnaire: Who can use the PAQ reliably and validly? Must one rely on trained job analysts? Can people having no direct contact with the job use the PAQ reliably and validly? Do response biases influence PAQ responses? (Author/KC)

Differential sensitivity of the Response Bias Scale (RBS) and MMPI-2 validity scales to memory complaints.

PubMed

Gervais, Roger O; Ben-Porath, Yossef S; Wygant, Dustin B; Green, Paul

2008-12-01

The MMPI-2 Response Bias Scale (RBS) is designed to detect response bias in forensic neuropsychological and disability assessment settings. Validation studies have demonstrated that the scale is sensitive to cognitive response bias as determined by failure on the Word Memory Test (WMT) and other symptom validity tests. Exaggerated memory complaints are a common feature of cognitive response bias. The present study was undertaken to determine the extent to which the RBS is sensitive to memory complaints and how it compares in this regard to other MMPI-2 validity scales and indices. This archival study used MMPI-2 and Memory Complaints Inventory (MCI) data from 1550 consecutive non-head-injury disability-related referrals to the first author's private practice. ANOVA results indicated significant increases in memory complaints across increasing RBS score ranges with large effect sizes. Regression analyses indicated that the RBS was a better predictor of the mean memory complaints score than the F, F(B), and F(P) validity scales and the FBS. There was no correlation between the RBS and the CVLT, an objective measure of verbal memory. These findings suggest that elevated scores on the RBS are associated with over-reporting of memory problems, which provides further external validation of the RBS as a sensitive measure of cognitive response bias. Interpretive guidelines for the RBS are provided.

Development and Validation of a Rating Scale for Wind Jazz Improvisation Performance

ERIC Educational Resources Information Center

Smith, Derek T.

2009-01-01

The purpose of this study was to construct and validate a rating scale for collegiate wind jazz improvisation performance. The 14-item Wind Jazz Improvisation Evaluation Scale (WJIES) was constructed and refined through a facet-rational approach to scale development. Five wind jazz students and one professional jazz educator were asked to record…

Effect of Mailing Address Style on Survey Response Rate.

ERIC Educational Resources Information Center

Cookingham, Frank G.

This study determined the effect of using mailing labels prepared by a letter-quality computer printer on survey response rate. D. A. Dillman's personalization approach to conducting mail surveys suggests that envelopes with addresses typed directly on them may produce a higher response rate than envelopes with addresses typed on self-adhesive…

The modified gait abnormality rating scale in patients with a conversion disorder: a reliability and responsiveness study.

PubMed

Vandenberg, Justin M; George, Deanna R; O'Leary, Andrea J; Olson, Lindsay C; Strassburg, Kaitlyn R; Hollman, John H

2015-01-01

Individuals with conversion disorder have neurologic symptoms that are not identified by an underlying organic cause. Often the symptoms manifest as gait disturbances. The modified gait abnormality rating scale (GARS-M) may be useful for quantifying gait abnormalities in these individuals. The purpose of this study was to examine the reliability, responsiveness and concurrent validity of GARS-M scores in individuals with conversion disorder. Data from 27 individuals who completed a rehabilitation program were included in this study. Pre- and post-intervention videos were obtained and walking speed was measured. Five examiners independently evaluated gait performance according to the GARS-M criteria. Inter- and intrarater reliability of GARS-M scores were estimated with intraclass correlation coefficients (ICCs). Responsiveness was estimated with the minimum detectable change (MDC). Pre- to post-treatment changes in GARS-M scores were analyzed with a dependent t-test. The correlation between GARS-M scores and walking speed was analyzed to assess concurrent validity. GARS-M scores were quantified with good-to-excellent inter- (ICC = 0.878) and intrarater reliability (ICC = 0.989). The MDC was 2 points. Mean GARS-M scores decreased from 7 ± 5 at baseline to 1 ± 2 at discharge (t26 = 7.411, p < 0.001) and 85% of patients improved beyond the MDC. Furthermore, GARS-M scores and walking speed measurements were moderately correlated (r = -0.582, p = 0.004), indicating that the GARS-M has acceptable concurrent validity. Our findings provide evidence that the GARS-M scores are reliable, valid and responsive for quantifying gait abnormalities in patients with conversion disorder. GARS-M scores provide objective measures upon which treatment effects can be assessed. Copyright © 2014 Elsevier B.V. All rights reserved.

Evaluation of the Validity and Response Burden of Patient Self-Report Measures of the Pain Assessment Screening Tool and Outcomes Registry (PASTOR).

PubMed

Cook, Karon F; Kallen, Michael A; Buckenmaier, Chester; Flynn, Diane M; Hanling, Steven R; Collins, Teresa S; Joltes, Kristin; Kwon, Kyung; Medina-Torne, Sheila; Nahavandi, Parisa; Suen, Joshua; Gershon, Richard

2017-07-01

In 2009, the Army Pain Management Task Force was chartered. On the basis of their findings, the Department of Defense recommended a comprehensive pain management strategy that included development of a standardized pain assessment system that would collect patient-reported outcomes data to inform the patient-provider clinical encounter. The result was the Pain Assessment Screening Tool and Outcomes Registry (PASTOR). The purpose of this study was to assess the validity and response burden of the patient-reported outcome measures in PASTOR. Data for analyses were collected from 681 individuals who completed PASTOR at baseline and follow-up as part of their routine clinical care. The survey tool included self-report measures of pain severity and pain interference (measured using the National Institutes of Health Patient-Reported Outcome Measurement Information System [PROMIS] and the Defense and Veterans Pain Rating scale). PROMIS measures of pain correlates also were administered. Validation analyses included estimation of score associations among measures, comparison of scores of known groups, responsiveness, ceiling and floor effects, and response burden. Results of psychometric testing provided substantial evidence for the validity of PASTOR self-report measures in this population. Expected associations among scores largely supported the concurrent validity of the measures. Scores effectively distinguished among respondents on the basis of their self-reported impressions of general health. PROMIS measures were administered using computer adaptive testing and each, on average, required less than 1 minute to administer. Statistical and graphical analyses demonstrated the responsiveness of PASTOR measures over time. Reprint & Copyright © 2017 Association of Military Surgeons of the U.S.

Adult Attachment Ratings (AAR): an item response theory analysis.

PubMed

Pilkonis, Paul A; Kim, Yookyung; Yu, Lan; Morse, Jennifer Q

2014-01-01

The Adult Attachment Ratings (AAR) include 3 scales for anxious, ambivalent attachment (excessive dependency, interpersonal ambivalence, and compulsive care-giving), 3 for avoidant attachment (rigid self-control, defensive separation, and emotional detachment), and 1 for secure attachment. The scales include items (ranging from 6-16 in their original form) scored by raters using a 3-point format (0 = absent, 1 = present, and 2 = strongly present) and summed to produce a total score. Item response theory (IRT) analyses were conducted with data from 414 participants recruited from psychiatric outpatient, medical, and community settings to identify the most informative items from each scale. The IRT results allowed us to shorten the scales to 5-item versions that are more precise and easier to rate because of their brevity. In general, the effective range of measurement for the scales was 0 to +2 SDs for each of the attachment constructs; that is, from average to high levels of attachment problems. Evidence for convergent and discriminant validity of the scales was investigated by comparing them with the Experiences of Close Relationships-Revised (ECR-R) scale and the Kobak Attachment Q-sort. The best consensus among self-reports on the ECR-R, informant ratings on the ECR-R, and expert judgments on the Q-sort and the AAR emerged for anxious, ambivalent attachment. Given the good psychometric characteristics of the scale for secure attachment, however, this measure alone might provide a simple alternative to more elaborate procedures for some measurement purposes. Conversion tables are provided for the 7 scales to facilitate transformation from raw scores to IRT-calibrated (theta) scores.

Growth and development rates have different thermal responses.

PubMed

Forster, Jack; Hirst, Andrew G; Woodward, Guy

2011-11-01

Growth and development rates are fundamental to all living organisms. In a warming world, it is important to determine how these rates will respond to increasing temperatures. It is often assumed that the thermal responses of physiological rates are coupled to metabolic rate and thus have the same temperature dependence. However, the existence of the temperature-size rule suggests that intraspecific growth and development are decoupled. Decoupling of these rates would have important consequences for individual species and ecosystems, yet this has not been tested systematically across a range of species. We conducted an analysis on growth and development rate data compiled from the literature for a well-studied group, marine pelagic copepods, and use an information-theoretic approach to test which equations best describe these rates. Growth and development rates were best characterized by models with significantly different parameters: development has stronger temperature dependence than does growth across all life stages. As such, it is incorrect to assume that these rates have the same temperature dependence. We used the best-fit models for these rates to predict changes in organism mass in response to temperature. These predictions follow a concave relationship, which complicates attempts to model the impacts of increasing global temperatures on species body size.

Construct and Predictive Validity of Social Acceptability: Scores From High School Teacher Ratings on the School Intervention Rating Form

ERIC Educational Resources Information Center

Harrison, Judith R.; State, Talida M.; Evans, Steven W.; Schamberg, Terah

2016-01-01

The purpose of this study was to evaluate the construct and predictive validity of scores on a measure of social acceptability of class-wide and individual student intervention, the School Intervention Rating Form (SIRF), with high school teachers. Utilizing scores from 158 teachers, exploratory factor analysis revealed a three-factor (i.e.,…

Development and validation of the Bush-Francis Catatonia Rating Scale - Brazilian version.

PubMed

Nunes, Ana Letícia Santos; Filgueiras, Alberto; Nicolato, Rodrigo; Alvarenga, Jussara Mendonça; Silveira, Luciana Angélica Silva; Silva, Rafael Assis da; Cheniaux, Elie

2017-01-01

This article aims to describe the adaptation and translation process of the Bush-Francis Catatonia Rating Scale (BFCRS) and its reduced version, the Bush-Francis Catatonia Screening Instrument (BFCSI) for Brazilian Portuguese, as well as its validation. Semantic equivalence processes included four steps: translation, back translation, evaluation of semantic equivalence and a pilot-study. Validation consisted of simultaneous applications of the instrument in Portuguese by two examiners in 30 catatonic and 30 non-catatonic patients. Total scores averaged 20.07 for the complete scale and 7.80 for its reduced version among catatonic patients, compared with 0.47 and 0.20 among non-catatonic patients, respectively. Overall values of inter-rater reliability of the instruments were 0.97 for the BFCSI and 0.96 for the BFCRS. The scale's version in Portuguese proved to be valid and was able to distinguish between catatonic and non-catatonic patients. It was also reliable, with inter-evaluator reliability indexes as high as those of the original instrument.

The Anaclitic-Introjective Depression Assessment: Development and preliminary validity of an observer-rated measure.

PubMed

Rost, Felicitas; Luyten, Patrick; Fonagy, Peter

2018-03-01

The two-configurations model developed by Blatt and colleagues offers a comprehensive conceptual and empirical framework for understanding depression. This model suggests that depressed patients struggle, at different developmental levels, with issues related to dependency (anaclitic issues) or self-definition (introjective issues), or a combination of both. This paper reports three studies on the development and preliminary validation of the Anaclitic-Introjective Depression Assessment, an observer-rated assessment tool of impairments in relatedness and self-definition in clinical depression based on the item pool of the Shedler-Westen Assessment Procedure. Study 1 describes the development of the measure using expert consensus rating and Q-methodology. Studies 2 and 3 report the assessment of its psychometric properties, preliminary reliability, and validity in a sample of 128 patients diagnosed with treatment-resistant depression. Four naturally occurring clusters of depressed patients were identified using Q-factor analysis, which, overall, showed meaningful and theoretically expected relationships with anaclitic/introjective prototypes as formulated by experts, as well as with clinical, social, occupational, global, and relational functioning. Taken together, findings reported in this paper provide preliminary evidence for the reliability and validity of the Anaclitic-Introjective Depression Assessment, an observer-rated measure that allows the detection of important nuanced differentiations between and within anaclitic and introjective depression. Copyright © 2017 John Wiley & Sons, Ltd.

Validating a visual version of the metronome response task.

PubMed

Laflamme, Patrick; Seli, Paul; Smilek, Daniel

2018-02-12

The metronome response task (MRT)-a sustained-attention task that requires participants to produce a response in synchrony with an audible metronome-was recently developed to index response variability in the context of studies on mind wandering. In the present studies, we report on the development and validation of a visual version of the MRT (the visual metronome response task; vMRT), which uses the rhythmic presentation of visual, rather than auditory, stimuli. Participants completed the vMRT (Studies 1 and 2) and the original (auditory-based) MRT (Study 2) while also responding to intermittent thought probes asking them to report the depth of their mind wandering. The results showed that (1) individual differences in response variability during the vMRT are highly reliable; (2) prior to thought probes, response variability increases with increasing depth of mind wandering; (3) response variability is highly consistent between the vMRT and the original MRT; and (4) both response variability and depth of mind wandering increase with increasing time on task. Our results indicate that the original MRT findings are consistent across the visual and auditory modalities, and that the response variability measured in both tasks indexes a non-modality-specific tendency toward behavioral variability. The vMRT will be useful in the place of the MRT in experimental contexts in which researchers' designs require a visual-based primary task.

The Development and Validation of the Memory Support Rating Scale (MSRS)

PubMed Central

Lee, Jason Y.; Worrell, Frank C.; Harvey, Allison G.

2015-01-01

Patient memory for treatment information is poor, and worse memory for treatment information is associated with poorer clinical outcomes. Memory support techniques have been harnessed to improve patient memory for treatment. However, a measure of memory support used by treatment providers during sessions has yet to be established. The present study reports on the development and psychometric properties of the Memory Support Rating Scale (MSRS) – an observer-rated scale designed to measure memory support. Forty-two adults with major depressive disorder (MDD) were randomized to either cognitive therapy plus memory support (CS+MS; n = 22) or cognitive therapy as-usual (CT-as-usual; n = 20). At post-treatment, patients freely recalled treatment points via the Patient Recall Task. Sessions (n = 171) were coded for memory support using the MSRS, 65% of which were also assessed for the quality of cognitive therapy via the Cognitive Therapy Rating Scale (CTRS). A unidimensional scale composed of 8 items was developed using exploratory factor analysis, though a larger sample is needed to further assess the factor structure of MSRS scores. High inter-rater and test-retest reliabilities of MSRS scores were observed across seven MSRS coders. MSRS scores were higher in the CT+MS condition compared to CT-as-usual, demonstrating group differentiation ability. MSRS scores were positively associated with Patient Recall Task scores but not associated with CTRS scores, demonstrating convergent and discriminant validity, respectively. Results indicate that the MSRS yields reliable and valid scores for measuring treatment providers’ use of memory support while delivering cognitive therapy. PMID:26389597

Construct validity of ADHD/ODD rating scales: recommendations for the evaluation of forthcoming DSM-V ADHD/ODD scales.

PubMed

Burns, G Leonard; Walsh, James A; Servera, Mateu; Lorenzo-Seva, Urbano; Cardo, Esther; Rodríguez-Fornells, Antoni

2013-01-01

Exploratory structural equation modeling (SEM) was applied to a multiple indicator (26 individual symptom ratings) by multitrait (ADHD-IN, ADHD-HI and ODD factors) by multiple source (mothers, fathers and teachers) model to test the invariance, convergent and discriminant validity of the Child and Adolescent Disruptive Behavior Inventory with 872 Thai adolescents and the ADHD Rating Scale-IV and ODD scale of the Disruptive Behavior Inventory with 1,749 Spanish children. Most of the individual ADHD/ODD symptoms showed convergent and discriminant validity with the loadings and thresholds being invariant over mothers, fathers and teachers in both samples (the three latent factor means were higher for parents than teachers). The ADHD-IN, ADHD-HI and ODD latent factors demonstrated convergent and discriminant validity between mothers and fathers within the two samples. Convergent and discriminant validity between parents and teachers for the three factors was either absent (Thai sample) or only partial (Spanish sample). The application of exploratory SEM to a multiple indicator by multitrait by multisource model should prove useful for the evaluation of the construct validity of the forthcoming DSM-V ADHD/ODD rating scales.

Are validated outcome measures used in distal radial fractures truly valid?

PubMed Central

Nienhuis, R. W.; Bhandari, M.; Goslings, J. C.; Poolman, R. W.; Scholtes, V. A. B.

2016-01-01

Objectives Patient-reported outcome measures (PROMs) are often used to evaluate the outcome of treatment in patients with distal radial fractures. Which PROM to select is often based on assessment of measurement properties, such as validity and reliability. Measurement properties are assessed in clinimetric studies, and results are often reviewed without considering the methodological quality of these studies. Our aim was to systematically review the methodological quality of clinimetric studies that evaluated measurement properties of PROMs used in patients with distal radial fractures, and to make recommendations for the selection of PROMs based on the level of evidence of each individual measurement property. Methods A systematic literature search was performed in PubMed, EMbase, CINAHL and PsycINFO databases to identify relevant clinimetric studies. Two reviewers independently assessed the methodological quality of the studies on measurement properties, using the COnsensus-based Standards for the selection of health Measurement INstruments (COSMIN) checklist. Level of evidence (strong / moderate / limited / lacking) for each measurement property per PROM was determined by combining the methodological quality and the results of the different clinimetric studies. Results In all, 19 out of 1508 identified unique studies were included, in which 12 PROMs were rated. The Patient-rated wrist evaluation (PRWE) and the Disabilities of Arm, Shoulder and Hand questionnaire (DASH) were evaluated on most measurement properties. The evidence for the PRWE is moderate that its reliability, validity (content and hypothesis testing), and responsiveness are good. The evidence is limited that its internal consistency and cross-cultural validity are good, and its measurement error is acceptable. There is no evidence for its structural and criterion validity. The evidence for the DASH is moderate that its responsiveness is good. The evidence is limited that its reliability and the

Reliability and Validity of the Borg and OMNI Rating of Perceived Exertion Scales in Adolescent Girls.

ERIC Educational Resources Information Center

Pfeiffer, Karin A.; Pivarnik, James M.; Womack, Christopher J.; Reeves, Mathew J.; Malina, Robert M.

2002-01-01

Investigated the reliability and validity of the Borg and OMNI rating of perceived exertion (RPE) scales in adolescent girls during treadmill exercise. Girls were randomly assigned to one of the RPE scales during various treadmill exercise conditions. Results indicated that the OMNI cycle pictorial scale was reliable and valid for use with…

Subjective Responses to Oral Tobacco Products: Scale Validation

PubMed Central

2013-01-01

Introduction: Several noncombusted oral tobacco products have been introduced that are primarily marketed to cigarette smokers. An important component of evaluating these products involves assessment of subjective responses to the product. To date, few studies have been undertaken to examine the validity of subjective response questionnaires for oral tobacco products. The goal of this study is to examine the extent subjective responses to a product are related to product preference and extent of product use. Methods: Data from a study examining oral tobacco product preference were used. Smokers were asked to sample a variety of oral tobacco products that differed in formulation (snus versus dissolvables) and dose of nicotine. At the end of the sampling period, subjects were asked to choose the product that they would use to completely substitute for cigarettes for the next 2 weeks. During the sampling period, subjects completed a Product Evaluation Scale (PES) that describes subjective responses to the product. During the treatment phase, they kept record of amount of product use. Results: Subjective responses to the product on the PES were related to product choice and to some extent, the amount of product use. Product choice was associated with different characteristics of the product and smoker needs. Conclusion: The PES may be a useful tool for the evaluation or oral tobacco products. PMID:23239843

Ablation and Thermal Response Property Model Validation for Phenolic Impregnated Carbon Ablator

NASA Technical Reports Server (NTRS)

Milos, F. S.; Chen, Y.-K.

2009-01-01

Phenolic Impregnated Carbon Ablator was the heatshield material for the Stardust probe and is also a candidate heatshield material for the Orion Crew Module. As part of the heatshield qualification for Orion, physical and thermal properties were measured for newly manufactured material, included emissivity, heat capacity, thermal conductivity, elemental composition, and thermal decomposition rates. Based on these properties, an ablation and thermal-response model was developed for temperatures up to 3500 K and pressures up to 100 kPa. The model includes orthotropic and pressure-dependent thermal conductivity. In this work, model validation is accomplished by comparison of predictions with data from many arcjet tests conducted over a range of stagnation heat flux and pressure from 107 Watts per square centimeter at 2.3 kPa to 1100 Watts per square centimeter at 84 kPa. Over the entire range of test conditions, model predictions compare well with measured recession, maximum surface temperatures, and in depth temperatures.

Validating a new device for measuring tear evaporation rates.

PubMed

Rohit, Athira; Ehrmann, Klaus; Naduvilath, Thomas; Willcox, Mark; Stapleton, Fiona

2014-01-01

To calibrate and validate a commercially available dermatology instrument to measure tear evaporation rate of contact lens wearers. A dermatology instrument was modified by attaching a swim goggle cup such that the cup sealed around the eye socket. Results for the unmodified instrument are dependent on probe area and enclosed volume. Calibration curves were established using a model eye, to account for individual variations in chamber volume and exposed area. Fifteen participants were recruited and the study included a contact lens wear and a no contact lens wear stage. Day and diurnal variation of the measurements were assessed by taking the measurement three times a day over 2 days. The coefficient of repeatability of the measurement was calculated and a linear mixed model assessed the influence of humidity, temperature, contact lens wear, day and diurnal variations on tear evaporation rate. The associations between variables were assessed using Pearson correlation coefficient. Absolute evaporation rates with and without contact lens wear were calculated based on the new calibration. The measurements were most repeatable during the evening with no lens wear (COR = 49 g m⁻² h) and least repeatable during the evening with contact lens wear (COR = 93 g m⁻² h). Humidity (p = 0.007), and contact lens wear (p < 0.01), significantly affected the tear evaporation rate. However, temperature (p = 0.54) diurnal variation (p = 0.85) and different days (p = 0.65) had no significant effect after controlling for humidity. Tear evaporation rates can be measured using a modified dermatology instrument. Measurements were higher and more variable with lens wear consistent with previous literature. Control of environmental conditions is important as a higher humidity results in a reduced evaporation rate. © 2013 The Authors Ophthalmic & Physiological Optics © 2013 The College of Optometrists.

Gravitropic responses of the Avena coleoptile in space and on clinostats. II. Is reciprocity valid?

NASA Technical Reports Server (NTRS)

Johnsson, A.; Brown, A. H.; Chapman, D. K.; Heathcote, D.; Karlsson, C.

1995-01-01

Experiments were undertaken to determine if the reciprocity rule is valid for gravitropic responses of oat coleoptiles in the acceleration region below 1 g. The rule predicts that the gravitropic response should be proportional to the product of the applied acceleration and the stimulation time. Seedlings were cultivated on 1 g centrifuges and transferred to test centrifuges to apply a transverse g-stimulation. Since responses occurred in microgravity, the uncertainties about the validity of clinostat simulation of weightlessness was avoided. Plants at two stages of coleoptile development were tested. Plant responses were obtained using time-lapse video recordings that were analyzed after the flight. Stimulus intensities and durations were varied and ranged from 0.1 to 1.0 g and from 2 to 130 min, respectively. For threshold g-doses the reciprocity rule was obeyed. The threshold dose was of the order of 55 g s and 120 g s, respectively, for two groups of plants investigated. Reciprocity was studied also at bending responses which are from just above the detectable level to about 10 degrees. The validity of the rule could not be confirmed for higher g-doses, chiefly because the data were more variable. It was investigated whether the uniformity of the overall response data increased when the gravitropic dose was defined as (gm x t) with m-values different from unity. This was not the case and the reciprocity concept is, therefore, valid also in the hypogravity region. The concept of gravitropic dose, the product of the transverse acceleration and the stimulation time, is also well-defined in the acceleration region studied. With the same hardware, tests were done on earth where responses occurred on clinostats. The results did not contradict the reciprocity rule but scatter in the data was large.

Development, validity and responsiveness of the Clinical COPD Questionnaire.

PubMed

van der Molen, Thys; Willemse, Brigitte W M; Schokker, Siebrig; ten Hacken, Nick H T; Postma, Dirkje S; Juniper, Elizabeth F

2003-04-28

The new Global Obstructive Lung Disease (GOLD) guidelines advice to focus treatment in Chronic Obstructive Pulmonary Disease (COPD) on improvement of functional state, prevention of disease progression and minimization of symptoms. So far no validated questionnaires are available to measure symptom and functional state in daily clinical practice. The aim of this study was to develop and validate the Clinical COPD Questionnaire (CCQ). Qualitative research with patients and clinicians was performed to generate possible items to evaluate clinical COPD control. Thereafter, an item reduction questionnaire was sent to 77 international experts. Sixty-seven experts responded and the 10 most important items, divided into 3 domains (symptoms, functional and mental state) were included in the CCQ (scale: 0 = best, 6 = worst). Cross-sectional data were collected from 119 subjects (57 COPD, GOLD stage I-III; 18 GOLD stage 0 and 44 (ex)smokers). Cronbach's alpha was high (0.91). The CCQ scores in patients (GOLD 0-III) were significantly higher than in healthy (ex)smokers. Furthermore, significant correlations were found between the CCQ total score and domains of the SF-36 (rho = 0.48 to rho = 0.69) and the SGRQ (rho = 0.67 to rho = 0.72). In patients with COPD, the correlation between the CCQ and FEV1%pred was rho =-0.49. Test-retest reliability was determined in 20 subjects in a 2-week interval (Intra Class Coefficient = 0.94). Thirty-six smokers with and without COPD showed significant improvement in the CCQ after 2 months smoking cessation, indicating the responsiveness of the CCQ. The CCQ is a self-administered questionnaire specially developed to measure clinical control in patients with COPD. Data support the validity, reliability and responsiveness of this short and easy to administer questionnaire.

Development, validity and responsiveness of the Clinical COPD Questionnaire

PubMed Central

van der Molen, Thys; Willemse, Brigitte WM; Schokker, Siebrig; ten Hacken, Nick HT; Postma, Dirkje S; Juniper, Elizabeth F

2003-01-01

Background The new Global Obstructive Lung Disease (GOLD) guidelines advice to focus treatment in Chronic Obstructive Pulmonary Disease (COPD) on improvement of functional state, prevention of disease progression and minimization of symptoms. So far no validated questionnaires are available to measure symptom and functional state in daily clinical practice. The aim of this study was to develop and validate the Clinical COPD Questionnaire (CCQ). Methods Qualitative research with patients and clinicians was performed to generate possible items to evaluate clinical COPD control. Thereafter, an item reduction questionnaire was sent to 77 international experts. Sixty-seven experts responded and the 10 most important items, divided into 3 domains (symptoms, functional and mental state) were included in the CCQ (scale: 0 = best, 6 = worst). Results Cross-sectional data were collected from 119 subjects (57 COPD, GOLD stage I-III; 18 GOLD stage 0 and 44 (ex)smokers). Cronbach's α was high (0.91). The CCQ scores in patients (GOLD 0-III) were significantly higher than in healthy (ex)smokers. Furthermore, significant correlations were found between the CCQ total score and domains of the SF-36 (ρ = 0.48 to ρ = 0.69) and the SGRQ (ρ = 0.67 to ρ = 0.72). In patients with COPD, the correlation between the CCQ and FEV1%pred was ρ =-0.49. Test-retest reliability was determined in 20 subjects in a 2-week interval (Intra Class Coefficient = 0.94). Thirty-six smokers with and without COPD showed significant improvement in the CCQ after 2 months smoking cessation, indicating the responsiveness of the CCQ. Conclusion The CCQ is a self-administered questionnaire specially developed to measure clinical control in patients with COPD. Data support the validity, reliability and responsiveness of this short and easy to administer questionnaire. PMID:12773199

The validated hypoallergenic cosmetics rating system: its 30-year evolution and effect on the prevalence of cosmetic reactions.

PubMed

Verallo-Rowell, Vermén M

2011-01-01

The validated hypoallergenic (vh) rating system was initiated in 1988 to try to objectively validate the "hypoallergenic" claim in cosmetics. To show how the system rates cosmetic hypoallergenicity and to compare the prevalence of cosmetic contact dermatitis (CCD) among users of regular cosmetics versus cosmetics with high VH numbers. (1) Made a VH list based on top allergens from patch-test results published by the North American Contact Dermatitis Group (NACDG) and the European Surveillance System on Contact Allergies (ESSCA); (2) reviewed global regulatory, cosmetic, drug, packaging, and manufacturing practices to show how allergens may contaminate products; (3) compared cosmetic ingredients lists against the VH list to obtain the VH rating (the more allergens absent, the higher the VH rating); and (4) obtained CCD prevalence among users of regular cosmetics versus users of cosmetics with high VH ratings. (1) Two VH lists (1988, 2003) included only cosmetic allergens in the NACDG surveys, the third (2007) included cosmetic and potential contaminant noncosmetic allergens, and the fourth (2010) adds ESSCA patch-test surveys. (2) CCD prevalence is 0.05 to 0.12% (average, 0.08%) among users of cosmetics with high VH ratings versus 2.4 to 36.3% among users of regular cosmetics. The VH rating system is shown to objectively validate the hypoallergenic cosmetics claim.

Multivariate Brain Prediction of Heart Rate and Skin Conductance Responses to Social Threat.

PubMed

Eisenbarth, Hedwig; Chang, Luke J; Wager, Tor D

2016-11-23

Psychosocial stressors induce autonomic nervous system (ANS) responses in multiple body systems that are linked to health risks. Much work has focused on the common effects of stress, but ANS responses in different body systems are dissociable and may result from distinct patterns of cortical-subcortical interactions. Here, we used machine learning to develop multivariate patterns of fMRI activity predictive of heart rate (HR) and skin conductance level (SCL) responses during social threat in humans (N = 18). Overall, brain patterns predicted both HR and SCL in cross-validated analyses successfully (r HR = 0.54, r SCL = 0.58, both p < 0.0001). These patterns partly reflected central stress mechanisms common to both responses because each pattern predicted the other signal to some degree (r HR→SCL = 0.21 and r SCL→HR = 0.22, both p < 0.01), but they were largely physiological response specific. Both patterns included positive predictive weights in dorsal anterior cingulate and cerebellum and negative weights in ventromedial PFC and local pattern similarity analyses within these regions suggested that they encode common central stress mechanisms. However, the predictive maps and searchlight analysis suggested that the patterns predictive of HR and SCL were substantially different across most of the brain, including significant differences in ventromedial PFC, insula, lateral PFC, pre-SMA, and dmPFC. Overall, the results indicate that specific patterns of cerebral activity track threat-induced autonomic responses in specific body systems. Physiological measures of threat are not interchangeable, but rather reflect specific interactions among brain systems. We show that threat-induced increases in heart rate and skin conductance share some common representations in the brain, located mainly in the vmPFC, temporal and parahippocampal cortices, thalamus, and brainstem. However, despite these similarities, the brain patterns that predict these two autonomic responses

Reliability and Validity of the Turkish Version of the Gastrointestinal Symptom Rating Scale.

PubMed

Turan, Nuray; Aşt, Türkinaz Atabek; Kaya, Nurten

The purpose of this methodological study is to investigate the validity and reliability of the Turkish version of the Gastrointestinal Symptom Rating Scale (GSRS). The scale was adapted to the Turkish language via backward translation. Content validity was examined by referring to experts. Reliability was examined via test-retest reliability and internal consistency, and validity was examined with divergent and convergent validity. The Epworth Sleepiness Scale (ESS) and the Marlowe-Crowne Social Desirability Scale (MCSDS) were used for divergent validity. As for convergent validity, the Constipation Severity Instrument (CSI) and the Patient Assessment of Constipation Quality of Life Scale (PAC-QOLQ) were utilized. The relationship between the GSRS and the health-related quality of life (36-item short-form health survey [SF-36]) was also analyzed. The study population consisted of patients in orthopedic clinic who volunteered to participate. Test-retest reliability was examined with the participation of 30 patients; internal consistency and validity were examined with 150 patients. Test-retest reliability correlation coefficients of the GSRS varied from 0.39 to 0.87 for all items. For internal consistency, the GSRS's item total correlation was found to be 0.17-0.67, and Cronbach α was 0.82 for all items. There was a positive linear significant correlation between the GSRS, CSI, and PAC-QOLQ. There was no significant correlation between the GSRS, MCSDS, and ESS. Higher GSRS scores inversely correlated with general quality of life (SF-36). The Turkish version of the GSRS has been found to be a reliable and valid instrument for assessing patients' gastrointestinal symptoms. Therefore, this instrument can be confidently used with Turkish individuals.

Recent Research on Mailed Questionnaire Response Rates.

ERIC Educational Resources Information Center

Baumgartner, Robert M.; Heberlein, Thomas A.

1984-01-01

Forty studies of mailed surveys are reviewed in terms of 11 variables which affect response rates: sponsorship, respondents, salience, follow-up contacts, incentives, length, anonymity, personalization, deadline, types of appeals, and postage. (BW)

Validity Inferences under High-Stakes Conditions: A Response from Language Testing

ERIC Educational Resources Information Center

Hill, Kathryn; McNamara, Tim

2015-01-01

Those who work in second- and foreign-language testing often find Koretz's concern for validity inferences under high-stakes (VIHS) conditions both welcome and familiar. While the focus of the article is more narrowly on the potential for two instructional responses to test-based accountability, "reallocation" and "coaching,"…

Comparative Analysis of the Relative Validity for Subjective Time Rating Scales. Final Report.

ERIC Educational Resources Information Center

Carpenter, James B.; And Others

Since the accuracy and validity of occupational data may vary according to the rating scale format employed, the first phase of the research described in the report employed hypothetical job descriptions from which accurate criterion data could be generated. The second phase of the research required developing an occupational survey instrument…

Validation of the Spanish version of Mackey childbirth satisfaction rating scale.

PubMed

Caballero, Pablo; Delgado-García, Beatriz E; Orts-Cortes, Isabel; Moncho, Joaquin; Pereyra-Zamora, Pamela; Nolasco, Andreu

2016-04-16

The "Mackey Childbirth Satisfaction Rating Scale" (MCSRS) is a complete non-validated scale which includes the most important factors associated with maternal satisfaction. Our primary purpose was to describe the internal structure of the scale and validate the reliability and validity of concept of its Spanish version MCSRS-E. The MCSRS was translated into Spanish, back-translated and adapted to the Spanish population. It was then administered following a pilot test with women who met the study participant requirements. The scale structure was obtained by performing an exploratory factorial analysis using a sample of 304 women. The structures obtained were tested by conducting a confirmatory factorial analysis using a sample of 159 women. To test the validity of concept, the structure factors were correlated with expectations prior to childbirth experiences. McDonald's omegas were calculated for each model to establish the reliability of each factor. The study was carried out at four University Hospitals; Alicante, Elche, Torrevieja and Vinalopo Salud of Elche. The inclusion criteria were women aged 18-45 years old who had just delivered a singleton live baby at 38-42 weeks through vaginal delivery. Women who had difficulty speaking and understanding Spanish were excluded. The process generated 5 different possible internal structures in a nested model more consistent with the theory than other internal structures of the MCSRS applied hitherto. All of them had good levels of validation and reliability. This nested model to explain internal structure of MCSRS-E can accommodate different clinical practice scenarios better than the other structures applied to date, and it is a flexible tool which can be used to identify the aspects that should be changed to improve maternal satisfaction and hence maternal health.

Building Fluent Performance: Measuring Response Rate and Multiplying Response Opportunities

ERIC Educational Resources Information Center

Binder, Carl

2010-01-01

Precision teaching emerged from O.R. Lindsley's pristine application of Skinner's natural science of behavior, with a focus on response rate measurement and free operant procedures. When applied with human learners in instructional settings, these first principles led to a series of developments framed in this paper as four kinds of ceilings that…

Predictive validity of curriculum-based measurement and teacher ratings of academic achievement.

PubMed

Kettler, Ryan J; Albers, Craig A

2013-08-01

Two alternative universal screening approaches to identify students with early learning difficulties were examined, along with a combination of these approaches. These approaches, consisting of (a) curriculum-based measurement (CBM) and (b) teacher ratings using Performance Screening Guides (PSGs), served as predictors of achievement tests in reading and mathematics. Participants included 413 students in grades 1, 2, and 3 in Tennessee (n=118) and Wisconsin (n=295) who were divided into six subsamples defined by grade and state. Reading and mathematics achievement tests with established psychometric properties were used as criteria within a concurrent and predictive validity framework. Across both achievement areas, CBM probes shared more variance with criterion measures than did teacher ratings, although teacher ratings added incremental validity among most subsamples. PSGs tended to be more accurate for identifying students in need of assistance at a 1-month interval, whereas CBM probes were more accurate at a 6-month interval. Teachers indicated that (a) false negatives are more problematic than are false positives, (b) both screening methods are useful for identifying early learning difficulties, and (c) both screening methods are useful for identifying students in need of interventions. Collectively, these findings suggest that the two types of measures, when used together, yield valuable information about students who need assistance in reading and mathematics. Copyright © 2013 Society for the Study of School Psychology. Published by Elsevier Ltd. All rights reserved.

Sensors for rate responsive pacing

PubMed Central

Dell'Orto, Simonetta; Valli, Paolo; Greco, Enrico Maria

2004-01-01

Advances in pacemaker technology in the 1980s have generated a wide variety of complex multiprogrammable pacemakers and pacing modes. The aim of the present review is to address the different rate responsive pacing modalities presently available in respect to physiological situations and pathological conditions. Rate adaptive pacing has been shown to improve exercise capacity in patients with chronotropic incompetence. A number of activity and metabolic sensors have been proposed and used for rate control. However, all sensors used to optimize pacing rate metabolic demands show typical limitations. To overcome these weaknesses the use of two sensors has been proposed. Indeed an unspecific but fast reacting sensor is combined with a more specific but slower metabolic one. Clinical studies have demonstrated that this methodology is suitable to reproduce normal sinus behavior during different types and loads of exercise. Sensor combinations require adequate sensor blending and cross checking possibly controlled by automatic algorithms for sensors optimization and simplicity of programming. Assessment and possibly deactivation of some automatic functions should be also possible to maximize benefits from the dual sensor system in particular conditions. This is of special relevance in patient whose myocardial contractility is limited such as in subjects with implantable defibrillators and biventricular pacemakers. The concept of closed loop pacing, implementing a negative feedback relating pacing rate and the control signal, will provide new opportunities to optimize dual-sensors system and deserves further investigation. The integration of rate adaptive pacing into defibrillators is the natural consequence of technical evolution. PMID:16943981

Responsiveness and predictive validity of the tablet-based symbol digit modalities test in patients with stroke.

PubMed

Hsiao, Pei-Chi; Yu, Wan-Hui; Lee, Shih-Chieh; Chen, Mei-Hsiang; Hsieh, Ching-Lin

2018-06-14

The responsiveness and predictive validity of the Tablet-based Symbol Digit Modalities Test (T-SDMT) are unknown, which limits the utility of the T-SDMT in both clinical and research settings. The purpose of this study was to examine the responsiveness and predictive validity of the T-SDMT in inpatients with stroke. A follow-up, repeated-assessments design. One rehabilitation unit at a local medical center. A total of 50 inpatients receiving rehabilitation completed T-SDMT assessments at admission to and discharge from a rehabilitation ward. The median follow-up period was 14 days. The Barthel index (BI) was assessed at discharge and was used as the criterion of the predictive validity. The mean changes in the T-SDMT scores between admission and discharge were statistically significant (paired t-test = 3.46, p = 0.001). The T-SDMT scores showed a nearly moderate standardized response mean (0.49). A moderate association (Pearson's r = 0.47) was found between the scores of the T-SDMT at admission and those of the BI at discharge, indicating good predictive validity of the T-SDMT. Our results support the responsiveness and predictive validity of the T-SDMT in patients with stroke receiving rehabilitation in hospitals. This study provides empirical evidence supporting the use of the T-SDMT as an outcome measure for assessing processingspeed in inpatients with stroke. The scores of the T-SDMT could be used to predict basic activities of daily living function in inpatients with stroke.

Prospective validation of pathologic complete response models in rectal cancer: Transferability and reproducibility.

PubMed

van Soest, Johan; Meldolesi, Elisa; van Stiphout, Ruud; Gatta, Roberto; Damiani, Andrea; Valentini, Vincenzo; Lambin, Philippe; Dekker, Andre

2017-09-01

Multiple models have been developed to predict pathologic complete response (pCR) in locally advanced rectal cancer patients. Unfortunately, validation of these models normally omit the implications of cohort differences on prediction model performance. In this work, we will perform a prospective validation of three pCR models, including information whether this validation will target transferability or reproducibility (cohort differences) of the given models. We applied a novel methodology, the cohort differences model, to predict whether a patient belongs to the training or to the validation cohort. If the cohort differences model performs well, it would suggest a large difference in cohort characteristics meaning we would validate the transferability of the model rather than reproducibility. We tested our method in a prospective validation of three existing models for pCR prediction in 154 patients. Our results showed a large difference between training and validation cohort for one of the three tested models [Area under the Receiver Operating Curve (AUC) cohort differences model: 0.85], signaling the validation leans towards transferability. Two out of three models had a lower AUC for validation (0.66 and 0.58), one model showed a higher AUC in the validation cohort (0.70). We have successfully applied a new methodology in the validation of three prediction models, which allows us to indicate if a validation targeted transferability (large differences between training/validation cohort) or reproducibility (small cohort differences). © 2017 American Association of Physicists in Medicine.

Reliability and validity of two self-rating scales in the assessment of childhood depression.

PubMed

Fundudis, T; Berney, T P; Kolvin, I; Famuyiwa, O O; Barrett, L; Bhate, S; Tyrer, S P

1991-07-01

A comparison was made of the reliability and validity of two self-rating scales, the Children's Depression Inventory (CDI) and Depression Self-Rating Scale (DSRS), in the diagnosis of depression in 93 children (aged 8-16 years) attending a university child psychiatry department. The two scales were of comparable merit but had only moderate discrimination between depressed and non-depressed children, with each scale having a misclassification rate of 25%. Better agreement was obtained in more verbally intelligent children, irrespective of age. Girls scored higher on the instruments than boys. No significant relationship was found between teacher assessment of classroom behaviour and the two self-rating depression instruments.

Clinical utility and validity of minoxidil response testing in androgenetic alopecia.

PubMed

Goren, Andy; Shapiro, Jerry; Roberts, Janet; McCoy, John; Desai, Nisha; Zarrab, Zoulikha; Pietrzak, Aldona; Lotti, Torello

2015-01-01

Clinical response to 5% topical minoxidil for the treatment of androgenetic alopecia (AGA) is typically observed after 3-6 months. Approximately 40% of patients will regrow hair. Given the prolonged treatment time required to elicit a response, a diagnostic test for ruling out nonresponders would have significant clinical utility. Two studies have previously reported that sulfotransferase enzyme activity in plucked hair follicles predicts a patient's response to topical minoxidil therapy. The aim of this study was to assess the clinical utility and validity of minoxidil response testing. In this communication, the present authors conducted an analysis of completed and ongoing studies of minoxidil response testing. The analysis confirmed the clinical utility of a sulfotransferase enzyme test in successfully ruling out 95.9% of nonresponders to topical minoxidil for the treatment of AGA. © 2014 Wiley Periodicals, Inc.

Prospective validation of immunological infiltrate for prediction of response to neoadjuvant chemotherapy in HER2-negative breast cancer--a substudy of the neoadjuvant GeparQuinto trial.

PubMed

Issa-Nummer, Yasmin; Darb-Esfahani, Silvia; Loibl, Sibylle; Kunz, Georg; Nekljudova, Valentina; Schrader, Iris; Sinn, Bruno Valentin; Ulmer, Hans-Ullrich; Kronenwett, Ralf; Just, Marianne; Kühn, Thorsten; Diebold, Kurt; Untch, Michael; Holms, Frank; Blohmer, Jens-Uwe; Habeck, Jörg-Olaf; Dietel, Manfred; Overkamp, Friedrich; Krabisch, Petra; von Minckwitz, Gunter; Denkert, Carsten

2013-01-01

We have recently described an increased lymphocytic infiltration rate in breast carcinoma tissue is a significant response predictor for anthracycline/taxane-based neoadjuvant chemotherapy (NACT). The aim of this study was to prospectively validate the tumor-associated lymphocyte infiltrate as predictive marker for response to anthracycline/taxane-based NACT. The immunological infiltrate was prospectively evaluated in a total of 313 core biopsies from HER2 negative patients of the multicenter PREDICT study, a substudy of the neoadjuvant GeparQuinto study. Intratumoral lymphocytes (iTuLy), stromal lymphocytes (strLy) as well as lymphocyte-predominant breast cancer (LPBC) were evaluated by histopathological assessment. Pathological complete response (pCR) rates were analyzed and compared between the defined subgroups using the exact test of Fisher. Patients with lymphocyte-predominant breast cancer (LPBC) had a significantly increased pCR rate of 36.6%, compared to non-LPBC patients (14.3%, p<0.001). LPBC and stromal lymphocytes were significantly independent predictors for pCR in multivariate analysis (LPBC: OR 2.7, p = 0.003, strLy: OR 1.2, p = 0.01). The amount of intratumoral lymphocytes was significantly predictive for pCR in univariate (OR 1.2, p = 0.01) but not in multivariate logistic regression analysis (OR 1.2, p = 0.11). Confirming previous investigations of our group, we have prospectively validated in an independent cohort that an increased immunological infiltrate in breast tumor tissue is predictive for response to anthracycline/taxane-based NACT. Patients with LPBC and increased stromal lymphocyte infiltration have significantly increased pCR rates. The lymphocytic infiltrate is a promising additional parameter for histopathological evaluation of breast cancer core biopsies.

The Development and Validation of the Student Response System Benefit Scale

ERIC Educational Resources Information Center

Hooker, J. F.; Denker, K. J.; Summers, M. E.; Parker, M.

2016-01-01

Previous research into the benefits student response systems (SRS) that have been brought into the classroom revealed that SRS can contribute positively to student experiences. However, while the benefits of SRS have been conceptualized and operationalized into a widely cited scale, the validity of this scale had not been tested. Furthermore,…

Validity, responsiveness, and minimal clinically important difference of EQ-5D-5L in stroke patients undergoing rehabilitation.

PubMed

Chen, Poyu; Lin, Keh-Chung; Liing, Rong-Jiuan; Wu, Ching-Yi; Chen, Chia-Ling; Chang, Ku-Chou

2016-06-01

To examine the criterion validity, responsiveness, and minimal clinically important difference (MCID) of the EuroQoL 5-Dimensions Questionnaire (EQ-5D-5L) and visual analog scale (EQ-VAS) in people receiving rehabilitation after stroke. The EQ-5D-5L, along with four criterion measures-the Medical Research Council scales for muscle strength, the Fugl-Meyer assessment, the functional independence measure, and the Stroke Impact Scale-was administered to 65 patients with stroke before and after 3- to 4-week therapy. Criterion validity was estimated using the Spearman correlation coefficient. Responsiveness was analyzed by the effect size, standardized response mean (SRM), and criterion responsiveness. The MCID was determined by anchor-based and distribution-based approaches. The percentage of patients exceeding the MCID was also reported. Concurrent validity of the EQ-Index was better compared with the EQ-VAS. The EQ-Index has better power for predicting the rehabilitation outcome in the activities of daily living than other motor-related outcome measures. The EQ-Index was moderately responsive to change (SRM = 0.63), whereas the EQ-VAS was only mildly responsive to change. The MCID estimation of the EQ-Index (the percentage of patients exceeding the MCID) was 0.10 (33.8 %) and 0.10 (33.8 %) based on the anchor-based and distribution-based approaches, respectively, and the estimation of EQ-VAS was 8.61 (41.5 %) and 10.82 (32.3 %). The EQ-Index has shown reasonable concurrent validity, limited predictive validity, and acceptable responsiveness for detecting the health-related quality of life in stroke patients undergoing rehabilitation, but not for EQ-VAS. Future research considering different recovery stages after stroke is warranted to validate these estimations.

Comparing Response Rates in E-Mail and Paper Surveys: A Meta-Analysis

ERIC Educational Resources Information Center

Shih, Tse-Hua; Fan, Xitao

2009-01-01

This meta-analysis examined 35 study results within last 10 years that directly compared the response rates of e-mail versus mail surveys. Individual studies reported inconsistent findings concerning the response rate difference between e-mail and mail surveys, but e-mail surveys generally have lower response rate (about 20% lower on the average)…

A randomised trial and economic evaluation of the effect of response mode on response rate, response bias, and item non-response in a survey of doctors.

PubMed

Scott, Anthony; Jeon, Sung-Hee; Joyce, Catherine M; Humphreys, John S; Kalb, Guyonne; Witt, Julia; Leahy, Anne

2011-09-05

Surveys of doctors are an important data collection method in health services research. Ways to improve response rates, minimise survey response bias and item non-response, within a given budget, have not previously been addressed in the same study. The aim of this paper is to compare the effects and costs of three different modes of survey administration in a national survey of doctors. A stratified random sample of 4.9% (2,702/54,160) of doctors undertaking clinical practice was drawn from a national directory of all doctors in Australia. Stratification was by four doctor types: general practitioners, specialists, specialists-in-training, and hospital non-specialists, and by six rural/remote categories. A three-arm parallel trial design with equal randomisation across arms was used. Doctors were randomly allocated to: online questionnaire (902); simultaneous mixed mode (a paper questionnaire and login details sent together) (900); or, sequential mixed mode (online followed by a paper questionnaire with the reminder) (900). Analysis was by intention to treat, as within each primary mode, doctors could choose either paper or online. Primary outcome measures were response rate, survey response bias, item non-response, and cost. The online mode had a response rate 12.95%, followed by the simultaneous mixed mode with 19.7%, and the sequential mixed mode with 20.7%. After adjusting for observed differences between the groups, the online mode had a 7 percentage point lower response rate compared to the simultaneous mixed mode, and a 7.7 percentage point lower response rate compared to sequential mixed mode. The difference in response rate between the sequential and simultaneous modes was not statistically significant. Both mixed modes showed evidence of response bias, whilst the characteristics of online respondents were similar to the population. However, the online mode had a higher rate of item non-response compared to both mixed modes. The total cost of the online

A randomised trial and economic evaluation of the effect of response mode on response rate, response bias, and item non-response in a survey of doctors

PubMed Central

2011-01-01

Background Surveys of doctors are an important data collection method in health services research. Ways to improve response rates, minimise survey response bias and item non-response, within a given budget, have not previously been addressed in the same study. The aim of this paper is to compare the effects and costs of three different modes of survey administration in a national survey of doctors. Methods A stratified random sample of 4.9% (2,702/54,160) of doctors undertaking clinical practice was drawn from a national directory of all doctors in Australia. Stratification was by four doctor types: general practitioners, specialists, specialists-in-training, and hospital non-specialists, and by six rural/remote categories. A three-arm parallel trial design with equal randomisation across arms was used. Doctors were randomly allocated to: online questionnaire (902); simultaneous mixed mode (a paper questionnaire and login details sent together) (900); or, sequential mixed mode (online followed by a paper questionnaire with the reminder) (900). Analysis was by intention to treat, as within each primary mode, doctors could choose either paper or online. Primary outcome measures were response rate, survey response bias, item non-response, and cost. Results The online mode had a response rate 12.95%, followed by the simultaneous mixed mode with 19.7%, and the sequential mixed mode with 20.7%. After adjusting for observed differences between the groups, the online mode had a 7 percentage point lower response rate compared to the simultaneous mixed mode, and a 7.7 percentage point lower response rate compared to sequential mixed mode. The difference in response rate between the sequential and simultaneous modes was not statistically significant. Both mixed modes showed evidence of response bias, whilst the characteristics of online respondents were similar to the population. However, the online mode had a higher rate of item non-response compared to both mixed modes. The

Increasing response rates to lifestyle surveys: a pragmatic evidence review.

PubMed

McCluskey, S; Topping, A E

2011-03-01

Lifestyle surveys are often a key component of a local Joint Strategic Needs Assessment (JSNA), undertaken to inform public health planning. They are usually administered to a large number of people in order to provide a comprehensive profile of population health. However, declining response rates coupled with the under-representation of certain population groups in lifestyle survey data has led to doubts concerning the reliability of findings. In order to inform the design of their own lifestyle survey, NHS Calderdale commissioned an evidence-based review of the methodological literature relating to the administration of lifestyle surveys, with the specific aim of identifying practical and resource-efficient strategies shown to be effective for maximizing whole-population response rates. A pragmatic review of the published literature was undertaken, specifically to explore the most practical and resource-efficient ways to maximize lifestyle survey response rates to the most commonly used methods (postal surveys, face-to-face interviews, telephone interviews and electronic surveys). Electronic databases including MEDLINE, CINAHL, DARE, EMBASE and PsychINFO were searched. Empirical evidence published in the last 10 years was identified and citation tracking performed on all retrieved articles. An internet search for 'grey literature' was also conducted. The postal questionnaire remains an important lifestyle survey tool, but reported response rates have decreased rapidly in recent years. Interviews and telephone surveys are recommended in order to supplement data from postal questionnaires and increase response rates in some population groups, but costs may be prohibitive. Electronic surveys are a cheaper alternative, but the empirical evidence on effectiveness is inconclusive. Careful planning and tailoring of survey design to the characteristics of target populations can increase response rates and representativeness of lifestyle survey data. The results of this

Validation of Rain Rate Retrievals for the Airborne Hurricane Imaging Radiometer (HIRAD)

NASA Technical Reports Server (NTRS)

Jacob, Maria; Salemirad, Matin; Jones, W. Linwood; Biswas, Sayak; Cecil, Daniel

2015-01-01

On board of the NASA's Global Hawk (AV1) aircraft there are two microwave, namely: the passive microwave Hurricane Imaging Radiometer (HIRAD), and the active microwave High-altitude Imaging Wind and Rain Airborne Profiler (HIWRAP). This paper presents results from an unplanned rain rate measurement validation opportunity that occurred in 2013, when the Global Hawk aircraft flew over an intense tropical squall-line that was simultaneously observed, by the Tampa NEXRAD meteorological radar. During this experiment, Global Hawk flying at an altitude of 18 km made 3 passes over the rapidly propagating thunderstorm, while the TAMPA NEXRAD perform volume scans on a 5-minute interval. NEXRAD 2D images of rain rate (mm/hr) were obtained at two altitudes (3 km & 6 km), which serve as surface truth for the HIRAD rain rate retrievals. In this paper, results are presented of the three-way inter-comparison of HIRAD Tb, HIWRAP dbZ and NEXRAD rain rate imagery.

Numerical modelling of landscape and sediment flux response to precipitation rate change

NASA Astrophysics Data System (ADS)

Armitage, John J.; Whittaker, Alexander C.; Zakari, Mustapha; Campforts, Benjamin

2018-02-01

Laboratory-scale experiments of erosion have demonstrated that landscapes have a natural (or intrinsic) response time to a change in precipitation rate. In the last few decades there has been growth in the development of numerical models that attempt to capture landscape evolution over long timescales. However, there is still an uncertainty regarding the validity of the basic assumptions of mass transport that are made in deriving these models. In this contribution we therefore return to a principal assumption of sediment transport within the mass balance for surface processes; we explore the sensitivity of the classic end-member landscape evolution models and the sediment fluxes they produce to a change in precipitation rates. One end-member model takes the mathematical form of a kinetic wave equation and is known as the stream power model, in which sediment is assumed to be transported immediately out of the model domain. The second end-member model is the transport model and it takes the form of a diffusion equation, assuming that the sediment flux is a function of the water flux and slope. We find that both of these end-member models have a response time that has a proportionality to the precipitation rate that follows a negative power law. However, for the stream power model the exponent on the water flux term must be less than one, and for the transport model the exponent must be greater than one, in order to match the observed concavity of natural systems. This difference in exponent means that the transport model generally responds more rapidly to an increase in precipitation rates, on the order of 105 years for post-perturbation sediment fluxes to return to within 50 % of their initial values, for theoretical landscapes with a scale of 100×100 km. Additionally from the same starting conditions, the amplitude of the sediment flux perturbation in the transport model is greater, with much larger sensitivity to catchment size. An important finding is that

Tumor shrinkage and objective response rates: gold standard for oncology efficacy screening trials, or an outdated end point?

PubMed

Bradbury, Penelope; Seymour, Lesley

2009-01-01

Phase II clinical trials have long been used to screen new cancer therapeutics for antitumor activity ("efficacy") worthy of further evaluation. Traditionally, the primary end point used in these screening trials has been objective response rate (RR), with the desired rate being arbitrarily set by the researchers before initiation of the trial. For cytotoxic agents, especially in common tumor types, response has been a reasonably robust and validated surrogate of benefit. Phase II trials with response as an end point have a modest sample size (15-40 patients) and are completed rapidly allowing early decisions regarding future development of a given agent. More recently, a number of new agents have proven successful in pivotal phase III studies, despite a low or very modest RR demonstrated in early clinical trials. Researchers have postulated that these novel agents, as a class, may not induce significant regression of tumors, and that the use of RR as an end point for phase II studies will result in false negative results, and point out that not all available data is used in making the decision. Others have pointed out that even novel agents have proven unsuccessful in pivotal trials if objective responses are not demonstrated in early clinical trials. We review here the historical and current information regarding objective tumor response.

Reliability and Validity of the Early Childhood Environment Rating Scale, Revised Edition, ECERS-R in Arabic

ERIC Educational Resources Information Center

Hadeed, Julie

2014-01-01

The aim of this study was to test reliabilities and validations for the Arabic translation of the Early Childhood Environment Rating Scale, Revised (ECERS-R) scale [Harms, T., Clifford, R. M., & Cryer, D. (1998). "Early childhood environment rating scale, revised edition." New York: Teachers College Press]. ECERS-R mean scores were…

Ratings of perceived exertion in braille: validity and reliability in production mode.

PubMed

Buckley, J P; Eston, R G; Sim, J

2000-08-01

(a) To assess the validity and reliability of producing and reproducing a given exercise intensity during cycle ergometry using a braille version of Borg's standard 6-20 rating of perceived exertion (RPE) scale, and (b) to determine whether the exercise responses of blind participants, at a given produced RPE, were similar to those reported in recognised guidelines for sighted subjects. Ten healthy registered blind volunteer participants (four women, six men; mean (SD) age 23.2 (9.0) years) performed an initial graded exercise cycle test to determine maximal heart rate (HRMAx) and maximal oxygen uptake (VO2MAX). Three trials of three exercise bouts at RPEs 9, 11, and 13 were then performed in random order on three separate days of the same week, with expired air and heart rate measured continuously. Each exercise bout was followed by 10 minutes of rest. The validity of the scale as a means of producing different exercise intensities was assessed using a two factor (RPE x trial) repeated measures analysis of variance. Intertrial reliability was assessed using intraclass correlation coefficients (ICC) and the bias +/-95% limits of agreement (95%LoA) procedure. Participants reported no difficulty in using the braille RPE scale. When asked to produce exercise intensities equating to RPE 9, 11, and 13, they elicited mean %VO2MAX values of 47%, 53%, and 63% respectively. Analysis of variance showed no significant differences in either %HRMAx or %VO2MAX between trials at each of the three RPEs, but there was a significant difference (p<0.001) in both %HRMAx and %VO2MAX between the three RPE levels. All pairwise comparisons of the three different RPEs were significantly different (p<0.016). The ICC between the second and third trial for %HRMAx was significant (p <0.05) for all three RPEs. Similarly for %VO2MAX, the ICC was significant for RPE 9 and 11 but not 13. The 95%LoA decreased for both %HRMAx and %VO2MAX with each successive trial. Blind participants were successful

[Ventricular tachycardia in a patient with rate-responsive cardiac pacemaker].

PubMed

Himbert, C; Lascault, G; Tonet, J; Coutte, R; Busquet, P; Frank, R; Grosgogeat, Y

1992-11-01

The authors report a case of syncopal ventricular tachycardia in a patient with a respiratory-dependent rate responsive pacemaker, followed-up for valvular heart disease with severe left ventricular dysfunction and sustained atrial and ventricular arrhythmias. The introduction of low dose betablocker therapy with reinforcement of the treatment of cardiac failure controlled the ventricular arrhythmia, after suppression of the data responsive function had been shown to be ineffective. The authors discuss the role of the rate responsive function in the triggering of the ventricular tachycardias.

Item Response Theory Analyses of the Parent and Teacher Ratings of the DSM-IV ADHD Rating Scale

ERIC Educational Resources Information Center

Gomez, Rapson

2008-01-01

The graded response model (GRM), which is based on item response theory (IRT), was used to evaluate the psychometric properties of the inattention and hyperactivity/impulsivity symptoms in an ADHD rating scale. To accomplish this, parents and teachers completed the DSM-IV ADHD Rating Scale (DARS; Gomez et al., "Journal of Child Psychology and…

Understanding mail survey response rates among male reserve component Gulf War era veterans.

PubMed

Schumm, W R; Bollman, S R; Jurich, A P; Castelo, C; Sanders, D; Webb, F J

2000-12-01

In this study of current and former male Reserve and National Guard members from the State of Ohio, it was expected that veterans who were older, had more years of military service, who had participated in the Persian Gulf War, who were Euro-Americans, who were higher in rank, who had higher residential stability in Ohio, who belonged to the Air Force, who had higher formal education, and who belonged to the National Guard would have a greater investment in U.S. society as defined by 11 demographic variables. It was assumed that those with greater investment in society would more often have valid addresses and would be more likely to respond to a survey on military issues, thereby biasing sample outcomes in those directions. Results for male veterans were consistent with the hypothesis that investment in the society system would predict validity of addresses and response rates. In other words, results supported the idea that those veterans who might be expected to have a greater investment in U.S. society were more likely to be located and to respond (once located) to a survey concerning Desert Storm-era military service and its aftermath. Implications for future Desert Storm research are discussed.

Comparison and validation of acoustic response models for wind noise reduction pipe arrays

DOE Office of Scientific and Technical Information (OSTI.GOV)

Marty, Julien; Denis, Stéphane; Gabrielson, Thomas

The detection capability of the infrasound component of the International Monitoring System (IMS) is tightly linked to the performance of its wind noise reduction systems. The wind noise reduction solution implemented at all IMS infrasound measurement systems consists of a spatial distribution of air inlets connected to the infrasound sensor through a network of pipes. This system, usually referred to as “pipe array,” has proven its efficiency in operational conditions. The objective of this paper is to present the results of the comparison and validation of three distinct acoustic response models for pipe arrays. The characteristics of the models andmore » the results obtained for a defined set of pipe array configurations are described. A field experiment using a newly developed infrasound generator, dedicated to the validation of these models, is then presented. The comparison between the modeled and empirical acoustic responses shows that two of the three models can be confidently used to estimate pipe array acoustic responses. Lastly, this study paves the way to the deconvolution of IMS infrasound data from pipe array responses and to the optimization of pipe array design to IMS applications.« less

Comparison and validation of acoustic response models for wind noise reduction pipe arrays

DOE PAGES

Marty, Julien; Denis, Stéphane; Gabrielson, Thomas; ...

2017-02-13

The detection capability of the infrasound component of the International Monitoring System (IMS) is tightly linked to the performance of its wind noise reduction systems. The wind noise reduction solution implemented at all IMS infrasound measurement systems consists of a spatial distribution of air inlets connected to the infrasound sensor through a network of pipes. This system, usually referred to as “pipe array,” has proven its efficiency in operational conditions. The objective of this paper is to present the results of the comparison and validation of three distinct acoustic response models for pipe arrays. The characteristics of the models andmore » the results obtained for a defined set of pipe array configurations are described. A field experiment using a newly developed infrasound generator, dedicated to the validation of these models, is then presented. The comparison between the modeled and empirical acoustic responses shows that two of the three models can be confidently used to estimate pipe array acoustic responses. Lastly, this study paves the way to the deconvolution of IMS infrasound data from pipe array responses and to the optimization of pipe array design to IMS applications.« less

Reliability and Validity of the Devereux Early Childhood Assessment (DECA) as a Function of Parent and Teacher Ratings

ERIC Educational Resources Information Center

Barbu, Otilia C.; Levine-Donnerstein, Deborah; Marx, Ronald W.; Yaden, David B., Jr.

2013-01-01

This study examined reliability and validity of the Devereux Early Childhood Assessment (DECA), based on samples of parents and teachers' ratings of 1,145 entering kindergartners in the Southwest. Confirmatory factor analysis showed that DECA presented good reliability and validity for manifest variables, corroborating previous findings. Three…

The effect of single engine fixed wing air transport on rate-responsive pacemakers.

PubMed

De Rotte, A A; Van Der Kemp, P

1999-09-01

Insufficient information exists about the safety of patients with accelerometer-based rate-responsive pacemakers in air transport by general aviation aircraft. The response in pacing rate of two types of accelerometer-based rate-responsive pacemakers with data logging capabilities was studied during test flights with single engine fixed wing aircraft. Results were compared with the rate-response of these pacemakers during transportation by car and were also interpreted in respect to physiological heart rate response of aircrew during flights in single engine fixed wing aircraft. In addition, a continuous accelerometer readout was recorded during a turbulent phase of flight. This recording was used for a pacemaker-simulator experiment with maximal sensitive motion-sensor settings. Only a minor increase in pacing rate due to aircraft motion could be demonstrated during all phases of flight at all altitudes with the pacemakers programmed in the normal mode. This increase was of the same magnitude as induced during transport by car and would be of negligible influence on the performance of the individual pacemaker patient equipped with such a pacemaker. Moreover, simultaneous Holter monitoring of the pilots during these flights showed a similar rate-response in natural heart rate compared with the increase in pacing rate induced by aircraft motion in accelerometer-based rate-responsive pacemakers. No sensor-mediated pacemaker tachycardia was seen during any of these recordings. However, a 15% increase in pacing rate was induced by severe air turbulence. Programming the maximal sensitivity of the motion sensor into the pacemaker could, on the other hand, induce a significant increase in pacing rate as was demonstrated by the simulation experiments. These results seem to rule out potentially dangerous or adverse effects from motional or vibrational influences during transport in single engine fixed wing aircraft on accelerometer-based rate-responsive pacemakers with

Validity of the Smarthealth Watch to Measure Heart Rate during Rest and Exercise

ERIC Educational Resources Information Center

Lee, C. Matthew; Gorelick, Mark

2011-01-01

The purpose of this study was to examine the validity of the Smarthealth watch (Salutron, Inc., Fremont, California, USA), a heart rate monitor that includes a wristwatch without an accompanying chest strap. Twenty-five individuals participated in 3-min periods of standing, 2.0 mph walking, 3.5 mph walking, 4.5 mph jogging, and 6.0 mph running.…

Response audit of an Internet survey of health care providers and administrators: implications for determination of response rates.

PubMed

Dobrow, Mark J; Orchard, Margo C; Golden, Brian; Holowaty, Eric; Paszat, Lawrence; Brown, Adalsteinn D; Sullivan, Terrence

2008-10-16

Internet survey modalities often compare unfavorably with traditional survey modalities, particularly with respect to response rates. Response to Internet surveys can be affected by the distribution options and response/collection features employed as well as the existence of automated (out-of-office) replies, automated forwarding, server rejection, and organizational or personal spam filters. However, Internet surveys also provide unparalleled opportunities to track study subjects and examine many of the factors influencing the determination of response rates. Tracking data available for Internet surveys provide detailed information and immediate feedback on a significant component of response that other survey modalities cannot match. This paper presents a response audit of a large Internet survey of more than 5000 cancer care providers and administrators in Ontario, Canada. Building upon the CHEcklist for Reporting Results of Internet E-Surveys (CHERRIES), the main objectives of the paper are to (a) assess the impact of a range of factors on the determination of response rates for Internet surveys and (b) recommend steps for improving published descriptions of Internet survey methods. We audited the survey response data, analyzing the factors that affected the numerator and denominator in the ultimate determination of response. We also conducted a sensitivity analysis to account for the inherent uncertainty associated with the impact of some of the factors on the response rates. The survey was initially sent out to 5636 health care providers and administrators. The determination of the numerator was influenced by duplicate/unattached responses and response completeness. The numerator varied from a maximum of 2031 crude (unadjusted) responses to 1849 unique views, 1769 participants, and 1616 complete responses. The determination of the denominator was influenced by forwarding of the invitation email to unknown individuals, server rejections, automated replies

The level crossing rates and associated statistical properties of a random frequency response function

NASA Astrophysics Data System (ADS)

Langley, Robin S.

2018-03-01

This work is concerned with the statistical properties of the frequency response function of the energy of a random system. Earlier studies have considered the statistical distribution of the function at a single frequency, or alternatively the statistics of a band-average of the function. In contrast the present analysis considers the statistical fluctuations over a frequency band, and results are obtained for the mean rate at which the function crosses a specified level (or equivalently, the average number of times the level is crossed within the band). Results are also obtained for the probability of crossing a specified level at least once, the mean rate of occurrence of peaks, and the mean trough-to-peak height. The analysis is based on the assumption that the natural frequencies and mode shapes of the system have statistical properties that are governed by the Gaussian Orthogonal Ensemble (GOE), and the validity of this assumption is demonstrated by comparison with numerical simulations for a random plate. The work has application to the assessment of the performance of dynamic systems that are sensitive to random imperfections.

Adapting CEF-Descriptors for Rating Purposes: Validation by a Combined Rater Training and Scale Revision Approach

ERIC Educational Resources Information Center

Harsch, Claudia; Martin, Guido

2012-01-01

We explore how a local rating scale can be based on the Common European Framework CEF-proficiency scales. As part of the scale validation (Alderson, 1991; Lumley, 2002), we examine which adaptations are needed to turn CEF-proficiency descriptors into a rating scale for a local context, and to establish a practicable method to revise the initial…

Increasing response rates to follow-up questionnaires in health intervention research: Randomized controlled trial of a gift card prize incentive.

PubMed

Morgan, Amy J; Rapee, Ronald M; Bayer, Jordana K

2017-08-01

Background/aims Achieving a high response rate to follow-up questionnaires in randomized controlled trials of interventions is important for study validity. Few studies have tested the value of incentives in increasing response rates to online questionnaires in clinical trials of health interventions. This study evaluated the effect of a gift card prize-draw incentive on response rates to follow-up questionnaires within a trial of an online health intervention. Method The study was embedded in a host randomized controlled trial of an online parenting program for child anxiety. A total of 433 participants were randomly allocated to one of two groups: (1) being informed that they would enter a gift card prize-draw if they completed the final study questionnaire (24-week follow-up) and (2) not informed about the prize-draw. All participants had a 1 in 20 chance of winning an AUD50 gift card after they completed the online questionnaire. Results The odds of the informed group completing the follow-up questionnaire were significantly higher than the uninformed group, (79.6% vs 68.5%, odds ratio = 1.79, 95% confidence interval = 1.15-2.79). This response rate increase of 11.1% (95% confidence interval = 2.8-19.1) occurred in both intervention and control groups in the host randomized controlled trial. The incentive was also effective in increasing questionnaire commencement (84.6% vs 75.9%, odds ratio = 1.74, 95% confidence interval = 1.07-2.84) and reducing the delay in completing the questionnaire (19.9 vs 22.6 days, hazard ratio = 1.34, 95% confidence interval = 1.07-1.67). Conclusion This study adds to evidence for the effectiveness of incentives to increase response rates to follow-up questionnaires in health intervention trials.

Clinical Validation of Heart Rate Apps: Mixed-Methods Evaluation Study

PubMed Central

Stans, Jelle; Mortelmans, Christophe; Van Haelst, Ruth; Van Schelvergem, Gertjan; Pelckmans, Caroline; Smeets, Christophe JP; Lanssens, Dorien; De Cannière, Hélène; Storms, Valerie; Thijs, Inge M; Vaes, Bert; Vandervoort, Pieter M

2017-01-01

Background Photoplethysmography (PPG) is a proven way to measure heart rate (HR). This technology is already available in smartphones, which allows measuring HR only by using the smartphone. Given the widespread availability of smartphones, this creates a scalable way to enable mobile HR monitoring. An essential precondition is that these technologies are as reliable and accurate as the current clinical (gold) standards. At this moment, there is no consensus on a gold standard method for the validation of HR apps. This results in different validation processes that do not always reflect the veracious outcome of comparison. Objective The aim of this paper was to investigate and describe the necessary elements in validating and comparing HR apps versus standard technology. Methods The FibriCheck (Qompium) app was used in two separate prospective nonrandomized studies. In the first study, the HR of the FibriCheck app was consecutively compared with 2 different Food and Drug Administration (FDA)-cleared HR devices: the Nonin oximeter and the AliveCor Mobile ECG. In the second study, a next step in validation was performed by comparing the beat-to-beat intervals of the FibriCheck app to a synchronized ECG recording. Results In the first study, the HR (BPM, beats per minute) of 88 random subjects consecutively measured with the 3 devices showed a correlation coefficient of .834 between FibriCheck and Nonin, .88 between FibriCheck and AliveCor, and .897 between Nonin and AliveCor. A single way analysis of variance (ANOVA; P=.61 was executed to test the hypothesis that there were no significant differences between the HRs as measured by the 3 devices. In the second study, 20,298 (ms) R-R intervals (RRI)–peak-to-peak intervals (PPI) from 229 subjects were analyzed. This resulted in a positive correlation (rs=.993, root mean square deviation [RMSE]=23.04 ms, and normalized root mean square error [NRMSE]=0.012) between the PPI from FibriCheck and the RRI from the wearable

INFLUENCES OF RESPONSE RATE AND DISTRIBUTION ON THE CALCULATION OF INTEROBSERVER RELIABILITY SCORES

PubMed Central

Rolider, Natalie U.; Iwata, Brian A.; Bullock, Christopher E.

2012-01-01

We examined the effects of several variations in response rate on the calculation of total, interval, exact-agreement, and proportional reliability indices. Trained observers recorded computer-generated data that appeared on a computer screen. In Study 1, target responses occurred at low, moderate, and high rates during separate sessions so that reliability results based on the four calculations could be compared across a range of values. Total reliability was uniformly high, interval reliability was spuriously high for high-rate responding, proportional reliability was somewhat lower for high-rate responding, and exact-agreement reliability was the lowest of the measures, especially for high-rate responding. In Study 2, we examined the separate effects of response rate per se, bursting, and end-of-interval responding. Response rate and bursting had little effect on reliability scores; however, the distribution of some responses at the end of intervals decreased interval reliability somewhat, proportional reliability noticeably, and exact-agreement reliability markedly. PMID:23322930

Validation of Rain Rate Retrievals for the Airborne Hurricane Imaging Radiometer (HIRAD)

NASA Technical Reports Server (NTRS)

Jacob, Maria; Salemirad, Matin; Jones, Linwood; Biswas, Sayak; Cecil, Daniel

2015-01-01

NASA's Global Hawk aircraft (AV1)has two microwave sensors: the passive Hurricane Imaging Radiometer (HIRAD), and the active High-altitude Imaging Wind and Rain Airborne Profiler(HIWRAP). Results are presented for a rain measurement validation opportunity that occurred in 2013, when the AV1 flew over a tropical squall-line that was simultaneously observed by the Tampa NEXRAD radar. During this experiment, Global Hawk made 3 passes over the rapidly propagating thunderstorm, while the TAMPA NEXRAD performed volume scans every 5 minutes. In this poster, the three-way inter-comparison of HIRAD Tb (base temperature), HIWRAP dbZ (decibels relative to equivalent reflectivity) and NEXRAD rain rate imagery are presented. Also, observed HIRAD Tbs are compared with theoretical radiative transfer model results using HIWRAP Rain Rates.

Crop yield response to increasing biochar rates

USDA-ARS?s Scientific Manuscript database

The benefit or detriment to crop yield from biochar application varies with biochar type/rate, soil, crop, or climate. The objective of this research was to identify yield response of cotton (Gossypium hirsutum L.), corn (Zea mayes L.), and peanut (Arachis hypogaea L.) to hardwood biochar applied at...

Effects of Personalization and Invitation Email Length on Web-Based Survey Response Rates

ERIC Educational Resources Information Center

Trespalacios, Jesús H.; Perkins, Ross A.

2016-01-01

Individual strategies to increase response rate and survey completion have been extensively researched. Recently, efforts have been made to investigate a combination of interventions to yield better response rates for web-based surveys. This study examined the effects of four different survey invitation conditions on response rate. From a large…

Reducing questionnaire length did not improve physician response rate: a randomized trial.

PubMed

Bolt, Eva E; van der Heide, Agnes; Onwuteaka-Philipsen, Bregje D

2014-04-01

To examine the effect of reducing questionnaire length on the response rate in a physician survey. A postal four double-page questionnaire on end-of-life decision making was sent to a random sample of 1,100 general practitioners, 400 elderly care physicians, and 500 medical specialists. Another random sample of 500 medical specialists received a shorter questionnaire of two double pages. After 3 months and one reminder, all nonresponding physicians received an even shorter questionnaire of one double page. Total response was 64% (1,456 of 2,269 eligible respondents). Response rate of medical specialists for the four double-page questionnaire was equal to that of the two double-page questionnaire (190 and 191 questionnaires were returned, respectively). The total response rate increased from 53% to 64% after sending a short one double-page questionnaire (1,203-1,456 respondents). The results of our study suggest that reducing the length of a long questionnaire in a physician survey does not necessarily improve response rate. To improve response rate and gather more information, researchers could decide to send a drastically shortened version of the questionnaire to nonresponders. Copyright © 2014 Elsevier Inc. All rights reserved.

Construction and Validation of a Professional Suitability Scale for Social Work Practice

ERIC Educational Resources Information Center

Tam, Dora M. Y.; Coleman, Heather

2009-01-01

This article reports on the construction and validation of a professional suitability scale, designed for assessing students' suitability for social work practice. Data were collected from 188 field supervisors who provided usable questionnaires, representing a response rate of 74%. Construct validation by exploratory factor analysis identified a…

The Culturally Responsive Classroom Management Self-Efficacy Scale: Development and Initial Validation

ERIC Educational Resources Information Center

Siwatu, Kamau Oginga; Putman, S. Michael; Starker-Glass, Tehia V.; Lewis, Chance W.

2017-01-01

This article reports on the development and initial validation of the Culturally Responsive Classroom Management Self-Efficacy Scale. Data from 380 preservice and inservice teachers were used to examine the psychometric properties of the instrument. Exploratory factor analysis results suggested a one-factor structure consisting of 35 items and the…

Participation rates, response bias and response behaviours in the community survey of the Swiss Spinal Cord Injury Cohort Study (SwiSCI).

PubMed

Fekete, Christine; Segerer, Wolfgang; Gemperli, Armin; Brinkhof, Martin W G

2015-10-08

Surveying persons with disabilities is challenging, as targeted subjects may experience specific barriers to survey participation. Here we report on participation rates and response behaviour in a community survey of people with spinal cord injury (SCI) in Switzerland. The cross-sectional survey was implemented as part of the Swiss Spinal Cord Injury Cohort Study (SwiSCI) and represents the largest population-based SCI survey in Europe including nearly 2000 persons. Design features to enhance participation rates included the division of the questionnaire volume over three successive modules; recurrent and mixed-mode reminding of non-responders; and mixed-mode options for response. We describe participation rates of the SwiSCI community survey (absolute and cumulative cooperation, contact, response, and attrition rates) and report on response rates in relation to recruitment efforts. Potential non-response bias and the association between responders' characteristics and response behaviour (response speed: reminding until participation; response mode: paper-pencil vs. online completion) were assessed using regression modelling. Over the successive modules, absolute response rates were 61.1, 80.6 and 87.3% which resulted in cumulative response rates of 49.3 and 42.6% for the second and third modules. Written reminders effectively increased response rates, with the first reminder showing the largest impact. Telephone reminders, partly with direct telephone interviewing, enhanced response rate to the first module, but were essentially redundant in subsequent modules. Non-response to the main module was related to current age, membership of Swiss Paraplegic Association (SPA) and time since injury, but not to gender, lesion level and preferred language of response. Response speed increased with household income, but was not associated to other sociodemographic factors, lesion characteristics or health indicators. We found significant associations between online completion

Factor Structure, Factorial Invariance, and Validity of the Multidimensional Shame-Related Response Inventory-21 (MSRI-21)

PubMed Central

Garcia, Antonio F.; Acosta, Melina; Pirani, Saifa; Edwards, Daniel; Osman, Augustine

2017-01-01

We describe 2 studies designed to evaluate scores on the Multidimensional Shame-related Response Inventory-21 (MSRI-21), a recently developed instrument that measures affective and behavioral responses to shame. The inventory assesses shame-related responses in 3 categories: negative self-evaluation, fear of social consequences, and maladaptive behavior tendency. For Study 1, (N = 743) undergraduates completed the MSRI-21. Confirmatory factor analysis supported the validity of the MSRI-21 3-factor structure. Latent variable modeling of coefficient-α provided strong evidence for the internal consistency of scores on each scale. In Study 2, (N = 540) undergraduates completed the instrument along with 5 concurrent measures chosen for clinical significance. Achievement of factorial invariance supported the use of MSRI-21 scale scores to make valid mean comparisons across gender. In addition, MSRI-21 scale scores were associated as expected with scores on measures of self-harm, suicide, and other risk factors. Taken together, results of 2 studies support the internal consistency reliability, factorial validity, factorial invariance, and convergent validity of scores on the MSRI-21. Further work is needed to assess the temporal stability of the MSRI-21 scale scores, invariance across clinical status and other groupings, item-level measurement properties, and viability in highly symptomatic samples. PMID:28182490

Validation of Rain Rate Retrievals for the Airborne Hurricane Imaging Radiometer (HIRAD)

NASA Technical Reports Server (NTRS)

Jacob, Maria Marta; Salemirad, Matin; Jones, W. Linwood; Biswas, Sayak; Cecil, Daniel

2015-01-01

The NASA Hurricane and Severe Storm Sentinel (HS3) mission is an aircraft field measurements program using NASA's unmanned Global Hawk aircraft system for remote sensing and in situ observations of Atlantic and Caribbean Sea hurricanes. One of the principal microwave instruments is the Hurricane Imaging Radiometer (HIRAD), which measures surface wind speeds and rain rates. For validation of the HIRAD wind speed measurement in hurricanes, there exists a comprehensive set of comparisons with the Stepped Frequency Microwave Radiometer (SFMR) with in situ GPS dropwindsondes [1]. However, for rain rate measurements, there are only indirect correlations with rain imagery from other HS3 remote sensors (e.g., the dual-frequency Ka- & Ku-band doppler radar, HIWRAP), which is only qualitative in nature. However, this paper presents results from an unplanned rain rate measurement validation opportunity that occurred in 2013, when HIRAD flew over an intense tropical squall line that was simultaneously observed by the Tampa NEXRAD meteorological radar (Fig. 1). During this experiment, Global Hawk flying at an altitude of 18 km made 3 passes over the rapidly propagating thunderstorm, while the TAMPA NEXRAD perform volume scans on a 5-minute interval. Using the well-documented NEXRAD Z-R relationship, 2D images of rain rate (mm/hr) were obtained at two altitudes (3 km & 6 km), which serve as surface truth for the HIRAD rain rate retrievals. A preliminary comparison of HIRAD rain rate retrievals (image) for the first pass and the corresponding closest NEXRAD rain image is presented in Fig. 2 & 3. This paper describes the HIRAD instrument, which 1D synthetic-aperture thinned array radiometer (STAR) developed by NASA Marshall Space Flight Center [2]. The rain rate retrieval algorithm, developed by Amarin et al. [3], is based on the maximum likelihood estimation (MLE) technique, which compares the observed Tb's at the HIRAD operating frequencies of 4, 5, 6 and 6.6 GHz with

Surveys of Health Professions Trainees: Prevalence, Response Rates, and Predictive Factors to Guide Researchers.

PubMed

Phillips, Andrew W; Friedman, Benjamin T; Utrankar, Amol; Ta, Andrew Q; Reddy, Shalini T; Durning, Steven J

2017-02-01

To establish a baseline overall response rate for surveys of health professions trainees, determine strategies associated with improved response rates, and evaluate for the presence of nonresponse bias. The authors performed a comprehensive analysis of all articles published in Academic Medicine, Medical Education, and Advances in Health Sciences Education in 2013, recording response rates. Additionally, they reviewed nonresponse bias analyses and factors suggested in other fields to affect response rate including survey delivery method, prenotification, and incentives. The search yielded 732 total articles; of these, 356 were research articles, and of these, 185 (52.0%) used at least one survey. Of these, 66 articles (35.6%) met inclusion criteria and yielded 73 unique surveys. Of the 73 surveys used, investigators reported a response rate for 63.0% of them; response rates ranged from 26.6% to 100%, mean (standard deviation) 71.3% (19.5%). Investigators reported using incentives for only 16.4% of the 73 surveys. The only survey methodology factor significantly associated with response rate was single- vs. multi-institutional surveys (respectively, 74.6% [21.2%] vs. 62.0% [12.8%], P = .022). Notably, statistical power for all analyses was limited. No articles evaluated for nonresponse bias. Approximately half of the articles evaluated used a survey as part of their methods. Limited data are available to establish a baseline response rate among health professions trainees and inform researchers which strategies are associated with higher response rates. Journals publishing survey-based health professions education research should improve reporting of response rate, nonresponse bias, and other survey factors.

Response rate and reinforcement rate in Pavlovian conditioning.

PubMed

Harris, Justin A; Carpenter, Joanne S

2011-10-01

Four experiments used delay conditioning of magazine approach in rats to investigate the relationship between the rate of responding, R, to a conditioned stimulus (CS) and the rate, r, at which the CS is reinforced with the unconditioned stimulus (US). Rats were concurrently trained with four variable-duration CSs with different rs, either as a result of differences in the mean CS-US interval or in the proportion of CS presentations that ended with the US. In each case, R was systematically related to r, and the relationship was very accurately characterized by a hyperbolic function, R = Ar/(r +c). Accordingly, the reciprocal of these two variables-response interval, I (= 1/R), and CS-US interval, i (= 1/r) - were related by a simple affine (straight line) transformation, I = mi+b. This latter relationship shows that each increment in the time that the rats had to wait for food produced a linear increment in the time they waited between magazine entries. We discuss the close agreement between our findings and the Matching Law (Herrnstein, 1970) and consider their implications for both associative theories (e.g., Rescorla & Wagner, 1972) and nonassociative theories (Gallistel & Gibbon, 2000) of conditioning. (PsycINFO Database Record (c) 2011 APA, all rights reserved).

Improving Completion Rates in Adult Education through Social Responsibility

ERIC Educational Resources Information Center

Wahlgren, Bjarne; Mariager-Anderson, Kristina

2017-01-01

Dropout is a serious problem within education. This article reports on an intervention project, titled "New Roles for the Teacher--Increased Completion Rates Through Social Responsibility," which sought to reduce nonattendance and drop-out rates in the Danish adult educational system by improving teachers' competences. This goal was…

POVERTY, INFANT MORTALITY, AND HOMICIDE RATES IN CROSS-NATIONAL PERPSECTIVE: ASSESSMENTS OF CRITERION AND CONSTRUCT VALIDITY*

PubMed Central

Messner, Steven F.; Raffalovich, Lawrence E.; Sutton, Gretchen M.

2011-01-01

This paper assesses the extent to which the infant mortality rate might be treated as a “proxy” for poverty in research on cross-national variation in homicide rates. We have assembled a pooled, cross-sectional time-series dataset for 16 advanced nations over the 1993–2000 period that includes standard measures of infant mortality and homicide and also contains information on two commonly used “income-based” poverty measures: a measure intended to reflect “absolute” deprivation and a measure intended to reflect “relative” deprivation. With these data, we are able to assess the criterion validity of the infant mortality rate with reference to the two income-based poverty measures. We are also able to estimate the effects of the various indicators of disadvantage on homicide rates in regression models, thereby assessing construct validity. The results reveal that the infant mortality rate is more strongly correlated with “relative poverty” than with “absolute poverty,” although much unexplained variance remains. In the regression models, the measure of infant mortality and the relative poverty measure yield significant positive effects on homicide rates, while the absolute poverty measure does not exhibit any significant effects. Our analyses suggest that it would be premature to dismiss relative deprivation in cross-national research on homicide, and that disadvantage is best conceptualized and measured as a multidimensional construct. PMID:21643432

Heart Rate Response in Spectators of the Montreal Canadiens Hockey Team.

PubMed

Khairy, Leia T; Barin, Roxana; Demonière, Fabrice; Villemaire, Christine; Billo, Marie-Josée; Tardif, Jean-Claude; Macle, Laurent; Khairy, Paul

2017-12-01

To our knowledge, heart rate responses have not previously been assessed in hockey fans. We quantified heart rate increases in spectators of the Montreal Canadiens, compared televised with live games, explored features associated with peak heart rates, and assessed whether increases correlate with a fan passion score. Healthy adults were enrolled, with half attending live games and half viewing televised games. All subjects completed questionnaires and had continuous Holter monitoring. Intensity of the physical stress response was defined according to previously published heart rate index thresholds as mild (< 1.33), moderate (1.33-1.83), or vigorous (> 1.83). In 20 participants, 35% women, age 46 ± 10 years, the heart rate increased by a median of 92% during the hockey game, from 60 (interquartile range, 54-65) beats per minute at rest to 114 (interquartile range, 103-129) beats per minute (P < 0.001). The heart rate increased by 110% vs 75% during live vs televised games (P < 0.001). Heart rate index (2.16 ± 0.27 vs 1.73 ± 0.15; P < 0.001) and percent maximum predicted heart rate attained (75% ± 8% vs 58% ± 7%; P < 0.001) were significantly higher during live vs televised games. Number of premature beats was nonsignificantly higher during live games (5 vs 1; P = 0.181). The fan passion score was not predictive of the heart rate response (P = 0.753). Peak heart rates most commonly occurred during overtime (40%) and scoring opportunities for (25%) and against (15%). It is exciting to watch the Montreal Canadiens! Viewing a live hockey game is associated with a heart rate response equivalent to vigorous physical stress and a televised game to moderate physical stress. Copyright © 2017 Canadian Cardiovascular Society. Published by Elsevier Inc. All rights reserved.

Validity of a questionnaire measuring the world health organization concept of health system responsiveness with respect to perinatal services in the Dutch obstetric care system.

PubMed

van der Kooy, Jacoba; Valentine, Nicole B; Birnie, Erwin; Vujkovic, Marijana; de Graaf, Johanna P; Denktaş, Semiha; Steegers, Eric A P; Bonsel, Gouke J

2014-12-03

The concept of responsiveness, introduced by the World Health Organization (WHO), addresses non-clinical aspects of health service quality that are relevant regardless of provider, country, health system or health condition. Responsiveness refers to "aspects related to the way individuals are treated and the environment in which they are treated" during health system interactions. This paper assesses the psychometric properties of a newly developed responsiveness questionnaire dedicated to evaluating maternal experiences of perinatal care services, called the Responsiveness in Perinatal and Obstetric Health Care Questionnaire (ReproQ), using the eight-domain WHO concept. The ReproQ was developed between October 2009 and February 2010 by adapting the WHO Responsiveness Questionnaire items to the perinatal care context. The psychometric properties of feasibility, construct validity, and discriminative validity were empirically assessed in a sample of Dutch women two weeks post partum. A total of 171 women consented to participation. Feasibility: the interviews lasted between 20 and 40 minutes and the overall missing rate was 8%. Construct validity: mean Cronbach's alphas for the antenatal, birth and postpartum phase were: 0.73 (range 0.57-0.82), 0.84 (range 0.66-0.92), and 0.87 (range 0.62-0.95) respectively. The item-own scale correlations within all phases were considerably higher than most of the item-other scale correlations. Within the antenatal care, birth care and post partum phases, the eight factors explained 69%, 69%, and 76% of variance respectively. Discriminative validity: overall responsiveness mean sum scores were higher for women whose children were not admitted. This confirmed the hypothesis that dissatisfaction with health outcomes is transferred to their judgement on responsiveness of the perinatal services. The ReproQ interview-based questionnaire demonstrated satisfactory psychometric properties to describe the quality of perinatal care in the

Cross-cultural reliability and validity of ADHD assessed by the ADHD Rating Scale in a pan-European study.

PubMed

Döpfner, Manfred; Steinhausen, Hans-Christoph; Coghill, David; Dalsgaard, Søren; Poole, Lynne; Ralston, Stephen J; Rothenberger, Aribert

2006-12-01

To provide psychometric information on the Attention-Deficit/Hyperactivity Disorder (ADHD) Rating Scale-IV (ADHD-RS-IV) in a large population of children with ADHD. Patients aged 6-18 years (n=1,478 in baseline analysis) were rated by 244 physicians on the ADHD-RS-IV based on a semi-structured interview with the patient's parent. Physicians additionally rated functional impairment (CGAS) and health status (CGI-S), and parents rated their child's behavioural and emotional problems (SDQ) and quality of life (CHIP-CE). Inattention and hyperactivity-impulsivity as dimensions of ADHD were replicated. 3-factor solutions reflecting the ICD-10 definition, with hyperactivity, impulsivity and inattention as separate dimensions were extracted in some national sub-samples and in separate analyses for boys and younger children.Good internal consistencies, strong country effects and small effects of age were found. Based on ADHD-RS-IV, 88.5% of patients met the criteria for any ADHD diagnosis. Correlations between ADHD-RS-IV and measures of functional impairment were low but statistically significant. The correlations with SDQ and CHIP-CE scales confirm the convergent and divergent validity of ADHD-RS-IV. Impressive evidence for the cross-cultural factorial validity, internal consistency as well as convergent and divergent validity of ADHD-RS-IV was found. ADHD can be assessed reliably and validly in routine care across Europe. The ICD-10 3-factor model seems to be less robust than the DSM-IV 2-factor model, but may be a good description for special populations (boys, younger children).

Adaptation and validation of a Spanish-language version of the Frontotemporal Dementia Rating Scale (FTD-FRS).

PubMed

Turró-Garriga, O; Hermoso Contreras, C; Olives Cladera, J; Mioshi, E; Pelegrín Valero, C; Olivera Pueyo, J; Garre-Olmo, J; Sánchez-Valle, R

2017-06-01

The Frontotemporal Dementia Rating Scale (FTD-FRS) is a tool designed to aid with clinical staging and assessment of the progression of frontotemporal dementia (FTD-FRS). Present a multicentre adaptation and validation study of a Spanish version of the FRS. The adapted version was created using 2 translation-back translation processes (English to Spanish, Spanish to English) and verified by the scale's original authors. We validated the adapted version in a sample of consecutive patients diagnosed with FTD. The procedure included evaluating internal consistency, testing unidimensionality with the Rasch model, analysing construct validity and discriminant validity, and calculating the degree of agreement between the Clinical Dementia Rating scale (CDR) and FTD-FRS for FTD cases. The study included 60 patients with DFT. The mean score on the FRS was 12.1 points (SD=6.5; range, 2-25) with inter-group differences (F=120.3; df=3; P<.001). Cronbach's alpha was 0.897 and principal component analysis of residuals delivered an acceptable eigenvalue for 5 contrasts (1.6-2.7) and 36.1% raw variance. FRS was correlated with the Mini-mental State Examination (r=0.572; P<.001) and functional capacity (DAD; r=0.790; P<.001). FTD-FRS also showed a significant correlation with CDR (r=-0.641; P<.001), but we did observe variability in the severity levels; cases appeared to be less severe according to the CDR than when measured with the FTD-FRS (kappa=0.055). This process of validating the Spanish translation of the FTD-FRS yielded satisfactory results for validity and unidimensionality (severity) in the assessment of patients with FTD. Copyright © 2016 Sociedad Española de Neurología. Publicado por Elsevier España, S.L.U. All rights reserved.

The impact of vaccine failure rate on epidemic dynamics in responsive networks.

PubMed

Liang, Yu-Hao; Juang, Jonq

2015-04-01

An SIS model based on the microscopic Markov-chain approximation is considered in this paper. It is assumed that the individual vaccination behavior depends on the contact awareness, local and global information of an epidemic. To better simulate the real situation, the vaccine failure rate is also taken into consideration. Our main conclusions are given in the following. First, we show that if the vaccine failure rate α is zero, then the epidemic eventually dies out regardless of what the network structure is or how large the effective spreading rate and the immunization response rates of an epidemic are. Second, we show that for any positive α, there exists a positive epidemic threshold depending on an adjusted network structure, which is only determined by the structure of the original network, the positive vaccine failure rate and the immunization response rate for contact awareness. Moreover, the epidemic threshold increases with respect to the strength of the immunization response rate for contact awareness. Finally, if the vaccine failure rate and the immunization response rate for contact awareness are positive, then there exists a critical vaccine failure rate αc > 0 so that the disease free equilibrium (DFE) is stable (resp., unstable) if α < αc (resp., α > αc). Numerical simulations to see the effectiveness of our theoretical results are also provided.

Convergent Validity with the BERS-2 Teacher Rating Scale and the Achenbach Teacher's Report Form: A Replication and Extension

ERIC Educational Resources Information Center

Benner, Gregory J.; Beaudoin, Kathleen; Mooney, Paul; Uhing, Brad M.; Pierce, Corey D.

2008-01-01

In the present study, we sought to extend instrument validation research for a strength-based emotional and behavior rating scale, the "Teacher Rating Scale of the Behavior and Emotional Rating Scale-Second Edition" (BERS-2; Epstein, M. H. (2004). "Behavioral and emotional rating scale" (2nd ed.). Austin, TX: PRO-ED) through…

The German Version of the Gaze Anxiety Rating Scale (GARS): Reliability and Validity

PubMed Central

Domes, Gregor; Marx, Lisa; Spenthof, Ines; Heinrichs, Markus

2016-01-01

Objective Fear of eye gaze and avoidance of eye contact are core features of social anxiety disorders (SAD). To measure self-reported fear and avoidance of eye gaze, the Gaze Anxiety Rating Scale (GARS) has been developed and validated in recent years in its English version. The main objectives of the present study were to psychometrically evaluate the German translation of the GARS concerning its reliability, factorial structure, and validity. Methods Three samples of participants were enrolled in the study. (1) A non-patient sample (n = 353) completed the GARS and a set of trait questionnaires to assess internal consistency, test-retest reliability, factorial structure, and concurrent and divergent validity. (2) A sample of patients with SAD (n = 33) was compared to a healthy control group (n = 30) regarding their scores on the GARS and the trait measures. Results The German GARS fear and avoidance scales exhibited excellent internal consistency and high stability over 2 and 4 months, as did the original version. The English version’s factorial structure was replicated, yielding two categories of situations: (1) everyday situations and (2) situations involving high evaluative threat. GARS fear and avoidance displayed convergent validity with trait measures of social anxiety and were markedly higher in patients with GSAD than in healthy controls. Fear and avoidance of eye contact in situations involving high levels of evaluative threat related more closely to social anxiety than to gaze anxiety in everyday situations. Conclusions The German version of the GARS has demonstrated reliability and validity similar to the original version, and is thus well suited to capture fear and avoidance of eye contact in different social situations as a valid self-report measure of social anxiety and related disorders in the social domain for use in both clinical practice and research. PMID:26937638

The German Version of the Gaze Anxiety Rating Scale (GARS): Reliability and Validity.

PubMed

Domes, Gregor; Marx, Lisa; Spenthof, Ines; Heinrichs, Markus

2016-01-01

Fear of eye gaze and avoidance of eye contact are core features of social anxiety disorders (SAD). To measure self-reported fear and avoidance of eye gaze, the Gaze Anxiety Rating Scale (GARS) has been developed and validated in recent years in its English version. The main objectives of the present study were to psychometrically evaluate the German translation of the GARS concerning its reliability, factorial structure, and validity. Three samples of participants were enrolled in the study. (1) A non-patient sample (n = 353) completed the GARS and a set of trait questionnaires to assess internal consistency, test-retest reliability, factorial structure, and concurrent and divergent validity. (2) A sample of patients with SAD (n = 33) was compared to a healthy control group (n = 30) regarding their scores on the GARS and the trait measures. The German GARS fear and avoidance scales exhibited excellent internal consistency and high stability over 2 and 4 months, as did the original version. The English version's factorial structure was replicated, yielding two categories of situations: (1) everyday situations and (2) situations involving high evaluative threat. GARS fear and avoidance displayed convergent validity with trait measures of social anxiety and were markedly higher in patients with GSAD than in healthy controls. Fear and avoidance of eye contact in situations involving high levels of evaluative threat related more closely to social anxiety than to gaze anxiety in everyday situations. The German version of the GARS has demonstrated reliability and validity similar to the original version, and is thus well suited to capture fear and avoidance of eye contact in different social situations as a valid self-report measure of social anxiety and related disorders in the social domain for use in both clinical practice and research.

Tactics to Increase Course Evaluation Response Rates: A Comparison of Effectiveness

ERIC Educational Resources Information Center

Jacek, Laura

2015-01-01

When an institution decides to move to online teaching evaluations, they often face concerns that their response rates will fall with the change. This fear need never come to pass, however. There are many interventions that can raise response rates. Good communication strategies, improved student and faculty engagement, and grade hold are just a…

VALIDATION OF ADULT OMNI PERCEIVED EXERTION SCALES FOR ELLIPTICAL ERGOMETRY12

PubMed Central

MAYS, RYAN J.; GOSS, FREDRIC L.; SCHAFER, MARK A.; KIM, KEVIN H.; NAGLE-STILLEY, ELIZABETH F.; ROBERTSON, ROBERT J.

2012-01-01

Summary This investigation examined the validity of newly developed Adult OMNI Elliptical Ergometer Ratings of Perceived Exertion Scales. Sixty men and women performed a graded exercise test on an elliptical ergometer. Oxygen consumption (VO2), heart rate (HR) and ratings of perceived exertion were recorded each stage from the Borg 15 Category Scale and two different OMNI scales. One scale employed an elliptical ergometer format of the OMNI Picture System of Perceived Exertion. The second scale modified verbal, numerical, and pictorial descriptors at the low end of the response range. Concurrent and construct validity were established by the positive relation between ratings of perceived exertion from each OMNI scale with VO2, HR and Borg Scale ratings of perceived exertion (men, r = .94–.97; women, r = .93–.98). Validity was established for both OMNI scales, indicating either metric can be used to estimate ratings of perceived exertion during partial weight bearing exercise. PMID:21319623

Validation of biomarkers to predict response to immunotherapy in cancer: Volume II - clinical validation and regulatory considerations.

PubMed

Dobbin, Kevin K; Cesano, Alessandra; Alvarez, John; Hawtin, Rachael; Janetzki, Sylvia; Kirsch, Ilan; Masucci, Giuseppe V; Robbins, Paul B; Selvan, Senthamil R; Streicher, Howard Z; Zhang, Jenny; Butterfield, Lisa H; Thurin, Magdalena

2016-01-01

There is growing recognition that immunotherapy is likely to significantly improve health outcomes for cancer patients in the coming years. Currently, while a subset of patients experience substantial clinical benefit in response to different immunotherapeutic approaches, the majority of patients do not but are still exposed to the significant drug toxicities. Therefore, a growing need for the development and clinical use of predictive biomarkers exists in the field of cancer immunotherapy. Predictive cancer biomarkers can be used to identify the patients who are or who are not likely to derive benefit from specific therapeutic approaches. In order to be applicable in a clinical setting, predictive biomarkers must be carefully shepherded through a step-wise, highly regulated developmental process. Volume I of this two-volume document focused on the pre-analytical and analytical phases of the biomarker development process, by providing background, examples and "good practice" recommendations. In the current Volume II, the focus is on the clinical validation, validation of clinical utility and regulatory considerations for biomarker development. Together, this two volume series is meant to provide guidance on the entire biomarker development process, with a particular focus on the unique aspects of developing immune-based biomarkers. Specifically, knowledge about the challenges to clinical validation of predictive biomarkers, which has been gained from numerous successes and failures in other contexts, will be reviewed together with statistical methodological issues related to bias and overfitting. The different trial designs used for the clinical validation of biomarkers will also be discussed, as the selection of clinical metrics and endpoints becomes critical to establish the clinical utility of the biomarker during the clinical validation phase of the biomarker development. Finally, the regulatory aspects of submission of biomarker assays to the U.S. Food and

Evaluating symptom outcomes in gastroparesis clinical trials: validity and responsiveness of the Gastroparesis Cardinal Symptom Index-Daily Diary (GCSI-DD).

PubMed

Revicki, D A; Camilleri, M; Kuo, B; Szarka, L A; McCormack, J; Parkman, H P

2012-05-01

Patient-reported symptom scales are needed to evaluate treatments for gastroparesis. The Gastroparesis Cardinal Symptom Index-Daily Diary (GCSI-DD) was developed to assess daily symptoms of gastroparesis. This study evaluated the validity and responsiveness of the GCSI-DD in patients with gastroparesis. Symptomatic patients were started with a new treatment for gastroparesis. Patients completed the GCSI-DD each evening during a baseline week and for 8 weeks of treatment. Responders were defined based on patient and clinician global rating of change. Minimal important differences (MID) were estimated based on baseline to 4 week changes in symptoms scores for small improvements. Of 69 patients participating, 46 had idiopathic, 19 diabetic, and four postfundoplication gastroparesis. Excellent test-retest reliability was seen for GCSI-DD scores, and there were significant correlations between GCSI-DD scores and clinician ratings of symptom severity. Responders to treatment reported improvements in nausea [effect size (ES) = 0.42, P < 0.001], postprandial fullness, ES = 0.83, P < 0.001), bloating (ES = 0.34, P < 0.001), early satiety (ES = 0.53, P < 0.001), but lower responses for upper abdominal pain (ES = 0.29), and vomiting (ES = 0.22; P = 0.119). MIDs were 0.55 for nausea, 0.97 for excessive fullness, 0.63 for bloating, 0.77 for postprandial fullness, and 0.30 for abdominal pain. A composite score of four symptoms (Composite-1; nausea, bloating, excessive fullness, postprandial fullness) had ES of 0.61 and MID of 0.73. Composite-2 score (nausea, early satiety, bloating, abdominal pain) had a lower ES of 0.47. Symptoms of early satiety, nausea, postprandial fullness, and bloating were responsive to treatment for gastroparesis. A composite of these symptoms also demonstrates validity and responsiveness to treatment for gastroparesis, and may represent an acceptable endpoint for evaluating the effectiveness of medical treatments in clinical trials for gastroparesis. �

Measuring hunger and satiety in primary school children. Validation of a new picture rating scale.

PubMed

Bennett, Carmel; Blissett, Jackie

2014-07-01

Measuring hunger and satiety in children is essential to many studies of childhood eating behaviour. Few validated measures currently exist that allow children to make accurate and reliable ratings of hunger/satiety. Three studies aimed to validate the use of a new categorical rating scale in the context of estimated and real eating episodes. Forty-seven 6- to 8-year-olds participated in Study 1, which used a between-participant design. Results indicated that the majority of children were able to make estimated hunger/satiety ratings for a story character using the scale. No significant differences in the ratings of hunger/satiety of children measured before and after lunch were observed and likely causes are discussed. To account for inter-individual differences in hunger/satiety perceptions Study 2 employed a within-participant design. Fifty-four 5- to 7-year-olds participated and made estimated hunger/satiety ratings for a story character and real hunger/satiety ratings before and after lunch. The results indicated that the majority of children were able to use the scale to make estimated and real hunger and satiety ratings. Children were found to be significantly hungrier before compared to after lunch. As it was not possible to establish the types and quantities of food children ate for lunch a third study was carried out in a controlled laboratory environment. Thirty-six 6- to 9-year-olds participated in Study 3 and made hunger/satiety ratings before and after ingesting an ad libitum snack of known composition and quantity. Results indicated that children felt hungrier before than after the snack and that pre-snack hunger/satiety, and changes in hunger/satiety, were associated with snack intake. Overall, the studies indicate that the scale has potential for use with primary school children. Implications of the findings are discussed. Copyright © 2014 Elsevier Ltd. All rights reserved.

Utility of the Conners' Adult ADHD Rating Scale validity scales in identifying simulated attention-deficit hyperactivity disorder and random responding.

PubMed

Walls, Brittany D; Wallace, Elizabeth R; Brothers, Stacey L; Berry, David T R

2017-12-01

Recent concern about malingered self-report of symptoms of attention-deficit hyperactivity disorder (ADHD) in college students has resulted in an urgent need for scales that can detect feigning of this disorder. The present study provided further validation data for a recently developed validity scale for the Conners' Adult ADHD Rating Scale (CAARS), the CAARS Infrequency Index (CII), as well as for the Inconsistency Index (INC). The sample included 139 undergraduate students: 21 individuals with diagnoses of ADHD, 29 individuals responding honestly, 54 individuals responding randomly (full or half), and 35 individuals instructed to feign. Overall, the INC showed moderate sensitivity to random responding (.44-.63) and fairly high specificity to ADHD (.86-.91). The CII demonstrated modest sensitivity to feigning (.31-.46) and excellent specificity to ADHD (.91-.95). Sequential application of validity scales had correct classification rates of honest (93.1%), ADHD (81.0%), feigning (57.1%), half random (42.3%), and full random (92.9%). The present study suggests that the CII is modestly sensitive (true positive rate) to feigned ADHD symptoms, and highly specific (true negative rate) to ADHD. Additionally, this study highlights the utility of applying the CAARS validity scales in a sequential manner for identifying feigning. (PsycINFO Database Record (c) 2017 APA, all rights reserved).

Selective vibration sensing: a new concept for activity-sensing rate-responsive pacing.

PubMed

Lau, C P; Stott, J R; Toff, W D; Zetlein, M B; Ward, D E; Camm, A J

1988-09-01

A clinically available model of an activity-sensing, rate-responsive pacemaker (Activitrax, Medtronic) utilizes body vibration during exercise as an indicator of the need for a rate increase. Although having the advantage of rapid onset of rate response, this system lacks specificity and the rate response does not closely correlate with the level of exertion. In addition, this pacemaker is susceptible to the effects of extraneous vibration. In this study involving 20 normal subjects fitted with an external Activitrax pacemaker, the rate responses to a variety of exercises were studied and were compared with the corresponding sinus rates. The vibration generated at the level of the pacemaker was also measured by accelerometers in three axes. Only a fair correlation (r = 0.51) was achieved between the pacemaker rate and the sinus rate. The total root mean square value of acceleration in either the anteroposterior or the vertical axes was found to have a better correlation (r = 0.8). As the main accelerations during physical activities were in the lower frequency range (0.1-4 Hz), a low-pass filter was used to reduce the influence of extraneous vibration. Selective sensing of the acceleration level may be usefully implemented in an algorithm for activity pacing.

Developing a Scale for Culturally Responsive Practice: Validation, Relationship with School Organizational Factors, and Application

ERIC Educational Resources Information Center

Han, Jae-Bum

2017-01-01

The primary goal of this dissertation is to develop and provide preliminary validation for a new measure of culturally responsive practice. This instrument, which is called the Culturally Responsive Practice Scale (CRPS), includes items that reflect ways that teachers teach multicultural students in their classrooms. To accomplish the goal, three…

A comparison of heart rate responses in racquet games.

PubMed Central

Docherty, D.

1982-01-01

The present study investigated the heart rate response to playing tennis with special reference to the skill levels and ages of the participants. Data obtained in a similar manner during earlier studies of badminton and squash players were compared with that obtained during tennis. The number of rallies, mean rally time and actual playing time in 30 minutes of play was also compared for the different skill levels and sports. Results showed that playing tennis raised the players' heart rates to 68-70% of their predicted maximum heart rate (PMHR). Playing squash and badminton could raise heart rates to 80-85% of the players' PMHR which was significantly higher than the values obtained for tennis. The actual skill level of the participants within their chosen sport did not have a significant effect in predicting the physical demands of squash or tennis but was important in predicting the heart rate response of badminton players. The more skillful the badminton player the greater the cardiac response as a result of game play. Analysis of time spent in actual play revealed that tennis players were involved in play for only five of the thirty minutes of game play, compared to 15 and 10 min respectively for squash and badminton. Skill level within each sport was only a significant factor in predicting length of play for squash players in which the medium and highly skilled groups played significantly longer than those of a lower level of skill. Images p96-a PMID:7104564

Validating the use of 137Cs and 210Pbex measurements to estimate rates of soil loss from cultivated land in southern Italy.

PubMed

Porto, Paolo; Walling, Des E

2012-04-01

Soil erosion represents an important threat to the long-term sustainability of agriculture and forestry in many areas of the world, including southern Italy. Numerous models and prediction procedures have been developed to estimate rates of soil loss and soil redistribution, based on the local topography, hydrometeorology, soil type and land management. However, there remains an important need for empirical measurements to provide a basis for validating and calibrating such models and prediction procedures as well as to support specific investigations and experiments. In this context, erosion plots provide useful information on gross rates of soil loss, but are unable to document the efficiency of the onward transfer of the eroded sediment within a field and towards the stream system, and thus net rates of soil loss from larger areas. The use of environmental radionuclides, particularly caesium-137 ((137)Cs) and excess lead-210 ((210)Pb(ex)), as a means of estimating rates of soil erosion and deposition has attracted increasing attention in recent years and the approach has now been recognised as possessing several important advantages. In order to provide further confirmation of the validity of the estimates of longer-term erosion and soil redistribution rates provided by (137)Cs and (210)Pb(ex) measurements, there is a need for studies aimed explicitly at validating the results obtained. In this context, the authors directed attention to the potential offered by a set of small erosion plots located near Reggio Calabria in southern Italy, for validating estimates of soil loss provided by (137)Cs and (210)Pb(ex) measurements. A preliminary assessment suggested that, notwithstanding the limitations and constraints involved, a worthwhile investigation aimed at validating the use of (137)Cs and (210)Pb(ex) measurements to estimate rates of soil loss from cultivated land could be undertaken. The results demonstrate a close consistency between the measured rates of soil

Reliability, Validity, and Responsiveness of the QuickDASH in Patients With Upper Limb Amputation.

PubMed

Resnik, Linda; Borgia, Matthew

2015-09-01

To examine the internal consistency, test-retest reliability, validity, and responsiveness of the shortened version of the Disabilities of the Arm, Shoulder and Hand (QuickDASH) questionnaire in persons with upper limb amputation. Cross-sectional and longitudinal. Three sites participating in the U.S. Department of Veterans Affairs Home Study of the DEKA Arm. A convenience sample of upper limb amputees (N=44). Training with a multifunction upper limb prosthesis. Multiple outcome measures including the QuickDASH were administered twice within 1 week, and for a subset of 20 persons, after completion of in-laboratory training with the DEKA Arm. Scale alphas and intraclass correlation coefficient type 3,1 (ICC3,1) were used to examine reliability. Minimum detectable change (MDC) scores were calculated. Analyses of variance, comparing QuickDASH scores by the amount of prosthetic use and amputation level, were used for known-group validity analyses with alpha set at .05. Pairwise correlations between QuickDASH and other measures were used to examine concurrent validity. Responsiveness was measured by effect size (ES) and standardized response mean (SRM). QuickDASH alpha was .83, and ICC was .87 (95% confidence interval, .77-.93). MDC at the 95% confidence level (MDC95%) was 17.4. Full- or part-time prosthesis users had better QuickDASH scores compared with nonprosthesis users (P=.021), as did those with more distal amputations at both baseline (P=.042) and with the DEKA Arm (P=.024). The QuickDASH was correlated with concurrent measures of activity limitation as expected. The ES and SRM after training with the DEKA Arm were 0.6. This study provides evidence of reliability and validity of the QuickDASH in persons with upper limb amputation. Results provide preliminary evidence of responsiveness to prosthetic device type/training. Further research with a larger sample is needed to confirm results. Copyright © 2015 American Congress of Rehabilitation Medicine. Published by

Validity of Sluggish Cognitive Tempo in South America: An Initial Examination Using Mother and Teacher Ratings of Chilean Children.

PubMed

Belmar, Marta; Servera, Mateu; Becker, Stephen P; Burns, G Leonard

2017-06-01

To examine the validity of sluggish cognitive tempo (SCT) and ADHD-inattention (ADHD-IN) symptoms in children from Chile. Mothers and teachers rated SCT, ADHD-IN, ADHD-hyperactivity/impulsivity (ADHD-HI), oppositional defiant disorder (ODD), anxiety, depression, academic impairment, social impairment, and peer rejection (teachers only) in 652 Chilean children (55% boys) aged 6 to 14 years. For both mother and teacher ratings, the eight SCT symptoms and nine ADHD-IN symptoms showed substantial loadings on their respective factors (convergent validity) along with loadings close to zero on the alternative factor (discriminant validity). ADHD-IN showed a uniquely stronger relationship than SCT with ADHD-HI and ODD whereas SCT showed a uniquely stronger relationship than ADHD-IN with anxiety and depression. Although ADHD-IN uniquely predicted academic impairment and social difficulties, SCT did not. This study provides the first evidence for the validity of SCT among children outside of North America or Western Europe.

Clinical Validation of Heart Rate Apps: Mixed-Methods Evaluation Study.

PubMed

Vandenberk, Thijs; Stans, Jelle; Mortelmans, Christophe; Van Haelst, Ruth; Van Schelvergem, Gertjan; Pelckmans, Caroline; Smeets, Christophe Jp; Lanssens, Dorien; De Cannière, Hélène; Storms, Valerie; Thijs, Inge M; Vaes, Bert; Vandervoort, Pieter M

2017-08-25

Photoplethysmography (PPG) is a proven way to measure heart rate (HR). This technology is already available in smartphones, which allows measuring HR only by using the smartphone. Given the widespread availability of smartphones, this creates a scalable way to enable mobile HR monitoring. An essential precondition is that these technologies are as reliable and accurate as the current clinical (gold) standards. At this moment, there is no consensus on a gold standard method for the validation of HR apps. This results in different validation processes that do not always reflect the veracious outcome of comparison. The aim of this paper was to investigate and describe the necessary elements in validating and comparing HR apps versus standard technology. The FibriCheck (Qompium) app was used in two separate prospective nonrandomized studies. In the first study, the HR of the FibriCheck app was consecutively compared with 2 different Food and Drug Administration (FDA)-cleared HR devices: the Nonin oximeter and the AliveCor Mobile ECG. In the second study, a next step in validation was performed by comparing the beat-to-beat intervals of the FibriCheck app to a synchronized ECG recording. In the first study, the HR (BPM, beats per minute) of 88 random subjects consecutively measured with the 3 devices showed a correlation coefficient of .834 between FibriCheck and Nonin, .88 between FibriCheck and AliveCor, and .897 between Nonin and AliveCor. A single way analysis of variance (ANOVA; P=.61 was executed to test the hypothesis that there were no significant differences between the HRs as measured by the 3 devices. In the second study, 20,298 (ms) R-R intervals (RRI)-peak-to-peak intervals (PPI) from 229 subjects were analyzed. This resulted in a positive correlation (rs=.993, root mean square deviation [RMSE]=23.04 ms, and normalized root mean square error [NRMSE]=0.012) between the PPI from FibriCheck and the RRI from the wearable ECG. There was no significant difference

Measuring Constructs in Family Science: How Can Item Response Theory Improve Precision and Validity?

PubMed Central

Gordon, Rachel A.

2014-01-01

This article provides family scientists with an understanding of contemporary measurement perspectives and the ways in which item response theory (IRT) can be used to develop measures with desired evidence of precision and validity for research uses. The article offers a nontechnical introduction to some key features of IRT, including its orientation toward locating items along an underlying dimension and toward estimating precision of measurement for persons with different levels of that same construct. It also offers a didactic example of how the approach can be used to refine conceptualization and operationalization of constructs in the family sciences, using data from the National Longitudinal Survey of Youth 1979 (n = 2,732). Three basic models are considered: (a) the Rasch and (b) two-parameter logistic models for dichotomous items and (c) the Rating Scale Model for multicategory items. Throughout, the author highlights the potential for researchers to elevate measurement to a level on par with theorizing and testing about relationships among constructs. PMID:25663714

Validation Study of a Gatekeeping Attitude Index for Social Work Education

ERIC Educational Resources Information Center

Tam, Dora M. Y.; Coleman, Heather

2011-01-01

This article reports on a study designed to validate the Gatekeeping Attitude Index, a 14-item Likert scaling index. The authors collected data from a convenience sample of social work field instructors (N = 188) with a response rate of 74.0%. Construct validation by exploratory factor analysis identified a 2-factor solution on the index after…

Further validation of the MMPI-2 and MMPI-2-RF Response Bias Scale: findings from disability and criminal forensic settings.

PubMed

Wygant, Dustin B; Sellbom, Martin; Gervais, Roger O; Ben-Porath, Yossef S; Stafford, Kathleen P; Freeman, David B; Heilbronner, Robert L

2010-12-01

The present study extends the validation of the Minnesota Multiphasic Personality Inventory-2 (MMPI-2) and the Minnesota Multiphasic Personality Inventory-2 Restructured Form (MMPI-2-RF) Response Bias Scale (RBS; R. O. Gervais, Y. S. Ben-Porath, D. B. Wygant, & P. Green, 2007) in separate forensic samples composed of disability claimants and criminal defendants. Using cognitive symptom validity tests as response bias indicators, the RBS exhibited large effect sizes (Cohen's ds = 1.24 and 1.48) in detecting cognitive response bias in the disability and criminal forensic samples, respectively. The scale also added incremental prediction to the traditional MMPI-2 and the MMPI-2-RF overreporting validity scales in the disability sample and exhibited excellent specificity with acceptable sensitivity at cutoffs ranging from 90T to 120T. The results of this study indicate that the RBS can add uniquely to the existing MMPI-2 and MMPI-2-RF validity scales in detecting symptom exaggeration associated with cognitive response bias.

Validity, Sensitivity, and Responsiveness of the 11-Face Faces Pain Scale to Postoperative Pain in Adult Orthopedic Surgery Patients.

PubMed

Van Giang, Nguyen; Chiu, Hsiao-Yean; Thai, Duong Hong; Kuo, Shu-Yu; Tsai, Pei-Shan

2015-10-01

Pain is common in patients after orthopedic surgery. The 11-face Faces Pain Scale has not been validated for use in adult patients with postoperative pain. To assess the validity of the 11-face Faces Pain Scale and its ability to detect responses to pain medications, and to determine whether the sensitivity of the 11-face Faces Pain Scale for detecting changes in pain intensity over time is associated with gender differences in adult postorthopedic surgery patients. The 11-face Faces Pain Scale was translated into Vietnamese using forward and back translation. Postoperative pain was assessed using an 11-point numerical rating scale and the 11-face Faces Pain Scale on the day of surgery, and before (Time 1) and every 30 minutes after (Times 2-5) the patients had taken pain medications on the first postoperative day. The 11-face Faces Pain Scale highly correlated with the numerical rating scale (r = 0.78, p < .001). When the scores from each follow-up test (Times 2-5) were compared with those from the baseline test (Time 1), the effect sizes were -0.70, -1.05, -1.20, and -1.31, and the standardized response means were -1.17, -1.59, -1.66, and -1.82, respectively. The mean change in pain intensity, but not gender-time interaction effect, over the five time points was significant (F = 182.03, p < .001). Our results support that the 11-face Faces Pain Scale is appropriate for measuring acute postoperative pain in adults. Copyright © 2015 American Society for Pain Management Nursing. Published by Elsevier Inc. All rights reserved.

Analyzing self-controlled case series data when case confirmation rates are estimated from an internal validation sample.

PubMed

Xu, Stanley; Clarke, Christina L; Newcomer, Sophia R; Daley, Matthew F; Glanz, Jason M

2018-05-16

Vaccine safety studies are often electronic health record (EHR)-based observational studies. These studies often face significant methodological challenges, including confounding and misclassification of adverse event. Vaccine safety researchers use self-controlled case series (SCCS) study design to handle confounding effect and employ medical chart review to ascertain cases that are identified using EHR data. However, for common adverse events, limited resources often make it impossible to adjudicate all adverse events observed in electronic data. In this paper, we considered four approaches for analyzing SCCS data with confirmation rates estimated from an internal validation sample: (1) observed cases, (2) confirmed cases only, (3) known confirmation rate, and (4) multiple imputation (MI). We conducted a simulation study to evaluate these four approaches using type I error rates, percent bias, and empirical power. Our simulation results suggest that when misclassification of adverse events is present, approaches such as observed cases, confirmed case only, and known confirmation rate may inflate the type I error, yield biased point estimates, and affect statistical power. The multiple imputation approach considers the uncertainty of estimated confirmation rates from an internal validation sample, yields a proper type I error rate, largely unbiased point estimate, proper variance estimate, and statistical power. © 2018 WILEY-VCH Verlag GmbH & Co. KGaA, Weinheim.

Construct Validity and Responsiveness of the Pediatric Quality of Life Inventory 4.0 Generic Core Scales and Infant Scales in the PICU.

PubMed

Aspesberro, François; Fesinmeyer, Megan D; Zhou, Chuan; Zimmerman, Jerry J; Mangione-Smith, Rita

2016-06-01

To assess the construct validity and the responsiveness of the Pediatric Quality of Life Inventory 4.0 Generic Core Scales and Infant Scales in the medical-surgical (PICU) and cardiac PICU. Prospective cohort study of 367 inpatients admitted either to the PICU or the cardiac ICU at Seattle Children's Hospital from January 2012 to June 2013. Parent/caregiver and child (≥ 8 yr old, developmentally appropriate, and critical illness resolved) Pediatric Quality of Life Inventory scores were obtained within 24 hours of PICU/cardiac ICU discharge and subsequently at 4-12 weeks following hospital discharge. Of the 491 eligible participants invited to participate, 367 (74.7% response rate) completed the Pediatric Quality of Life Inventory survey at ICU discharge, and of these, 263 (71.7% follow-up response rate) completed the follow-up survey 4-12 weeks after hospital discharge. Responsiveness was assessed by calculating improvement scores (difference between follow-up and ICU discharge scores, Δ Pediatric Quality of Life Inventory). Construct validity was examined by comparing mean improvement scores for known groups differing by medical complexity. At follow-up, [INCREMENT] Pediatric Quality of Life Inventory scores were as follows (mean ± SD): physical domain, 34.8 ± 32.0; and psychosocial domain, 23.1 ± 23.5. Patients with complex chronic or noncomplex chronic disease had physical functioning improvement scores that were 17.4 points (95% CI, -28.3 to -6.5; p < 0.001) and 19.5 points (95% CI, -30.4 to -8.5; p < 0.002) lower than children with no chronic illness, respectively. Patients with complex chronic disease exhibited psychosocial improvement scores that were 9.6 points (95% CI, -18.4 to -0.8; p < 0.033) lower than patients without chronic disease. Patients with noncomplex chronic disease had similar psychosocial improvement scores when compared with patients without chronic disease. As a measure of health-related quality of live, Pediatric Quality of

Construct Validation of Three Nutrition Questions Using Health and Diet Ratings in Older Canadian Males Living in the Community.

PubMed

Akhtar, Usman; Keller, Heather H; Tate, Robert B; Lengyel, Christina O

2015-12-01

Brief nutrition screening tools are desired for research and practice. Seniors in the Community: Risk Evaluation for Eating and Nutrition (SCREEN-II, 14 items) and the abbreviated version SCREEN-II-AB (8 items) are valid and reliable nutrition screening tools for older adults. This exploratory study used a retrospective cross-sectional design to determine the construct validity of a subset of 3 items (weight loss, appetite, and swallowing difficulty) currently on the SCREEN-II and SCREEN-II-AB tools. Secondary data on community-dwelling senior males (n = 522, mean ± SD age = 86.7 ± 3.0 years) in the Manitoba Follow-up Study (MFUS) study were available for analysis. Participants completed the mailed MFUS Nutrition Survey that included SCREEN-II items and questions pertaining to self-rated health, diet healthiness, and rating of the importance of nutrition towards successful aging as the constructs for comparison. Self-perceived health status (F = 14.7, P < 0.001), diet healthiness (ρ = 0.17, P = 0.002) and the rating of nutrition's importance to aging (ρ = 0.10, P = 0.03) were correlated with the 3-item score. Inferences were consistent with associations between these construct variables and the full SCREEN-II. Three items from SCREEN-II and SCREEN-II-AB demonstrate initial construct validity with self-perceived health status and diet healthiness ratings by older males; further exploration for criterion and predictive validity in more diverse samples is needed.

The Outpatient Experience Questionnaire of comprehensive public hospital in China: development, validity and reliability.

PubMed

Hu, Yinhuan; Zhang, Zixia; Xie, Jinzhu; Wang, Guanping

2017-02-01

The objective of this study is to describe the development of the Outpatient Experience Questionnaire (OPEQ) and to assess the validity and reliability of the scale. Literature review, patient interviews, Delphi method and Cross-sectional validation survey. Six comprehensive public hospitals in China. The survey was carried out on a sample of 600 outpatients. Acceptability of the questionnaire was assessed according to the overall response rate, item non-response rate and the average completion time. Correlation coefficients and confirmatory factor analysis were used to test construct validity. Delphi method was used to assess the content validity of the questionnaire. Cronbach's coefficient alpha and split-half reliability coefficient were used to estimate the internal reliability of the questionnaire. The overall response rate was 97.2% and the item non-response rate ranged from 0% to 0.3%. The mean completion time was 6 min. The Spearman correlations of item-total score ranged from 0.466 to 0.765. The results of confirmatory factor analysis showed that all items had factor loadings above 0.40 and the dimension intercorrelation ranged from 0.449 to 0.773, the goodness of fit of the questionnaire was reasonable. The overall authority grade of expert consultation was 0.80 and Kendall's coefficient of concordance W was 0.186. The Cronbach's coefficients alpha of six dimensions ranged from 0.708 to 0.895, the split-half reliability coefficient (Spearman-Brown coefficient) was 0.969. The OPEQ is a promising instrument covering the most important aspects which influence outpatient experiences of comprehensive public hospital in China. It has good evidence for acceptability, validity and reliability. © The Author 2016. Published by Oxford University Press in association with the International Society for Quality in Health Care. All rights reserved. For permissions, please e-mail: journals.permissions@oup.com

A validation study of public health knowledge, skills, social responsibility and applied learning.

PubMed

Vackova, Dana; Chen, Coco K; Lui, Juliana N M; Johnston, Janice M

2018-06-22

To design and validate a questionnaire to measure medical students' Public Health (PH) knowledge, skills, social responsibility and applied learning as indicated in the four domains recommended by the Association of Schools & Programmes of Public Health (ASPPH). A cross-sectional study was conducted to develop an evaluation tool for PH undergraduate education through item generation, reduction, refinement and validation. The 74 preliminary items derived from the existing literature were reduced to 55 items based on expert panel review which included those with expertise in PH, psychometrics and medical education, as well as medical students. Psychometric properties of the preliminary questionnaire were assessed as follows: frequency of endorsement for item variance; principal component analysis (PCA) with varimax rotation for item reduction and factor estimation; Cronbach's Alpha, item-total correlation and test-retest validity for internal consistency and reliability. PCA yielded five factors: PH Learning Experience (6 items); PH Risk Assessment and Communication (5 items); Future Use of Evidence in Practice (6 items); Recognition of PH as a Scientific Discipline (4 items); and PH Skills Development (3 items), explaining 72.05% variance. Internal consistency and reliability tests were satisfactory (Cronbach's Alpha ranged from 0.87 to 0.90; item-total correlation > 0.59). Lower paired test-retest correlations reflected instability in a social science environment. An evaluation tool for community-centred PH education has been developed and validated. The tool measures PH knowledge, skills, social responsibilities and applied learning as recommended by the internationally recognised Association of Schools & Programmes of Public Health (ASPPH).

Theoretical Evaluation of the Transient Response of Constant Head and Constant Flow-Rate Permeability Tests

USGS Publications Warehouse

Zhang, M.; Takahashi, M.; Morin, R.H.; Esaki, T.

1998-01-01

A theoretical analysis is presented that compares the response characteristics of the constant head and the constant flowrate (flow pump) laboratory techniques for quantifying the hydraulic properties of geologic materials having permeabilities less than 10-10 m/s. Rigorous analytical solutions that describe the transient distributions of hydraulic gradient within a specimen are developed, and equations are derived for each method. Expressions simulating the inflow and outflow rates across the specimen boundaries during a constant-head permeability test are also presented. These solutions illustrate the advantages and disadvantages of each method, including insights into measurement accuracy and the validity of using Darcy's law under certain conditions. The resulting observations offer practical considerations in the selection of an appropriate laboratory test method for the reliable measurement of permeability in low-permeability geologic materials.

Validation of a single-stage fixed-rate step test for the prediction of maximal oxygen uptake in healthy adults.

PubMed

Hansen, Dominique; Jacobs, Nele; Thijs, Herbert; Dendale, Paul; Claes, Neree

2016-09-01

Healthcare professionals with limited access to ergospirometry remain in need of valid and simple submaximal exercise tests to predict maximal oxygen uptake (VO2max ). Despite previous validation studies concerning fixed-rate step tests, accurate equations for the estimation of VO2max remain to be formulated from a large sample of healthy adults between age 18-75 years (n > 100). The aim of this study was to develop a valid equation to estimate VO2max from a fixed-rate step test in a larger sample of healthy adults. A maximal ergospirometry test, with assessment of cardiopulmonary parameters and VO2max , and a 5-min fixed-rate single-stage step test were executed in 112 healthy adults (age 18-75 years). During the step test and subsequent recovery, heart rate was monitored continuously. By linear regression analysis, an equation to predict VO2max from the step test was formulated. This equation was assessed for level of agreement by displaying Bland-Altman plots and calculation of intraclass correlations with measured VO2max . Validity further was assessed by employing a Jackknife procedure. The linear regression analysis generated the following equation to predict VO2max (l min(-1) ) from the step test: 0·054(BMI)+0·612(gender)+3·359(body height in m)+0·019(fitness index)-0·012(HRmax)-0·011(age)-3·475. This equation explained 78% of the variance in measured VO2max (F = 66·15, P<0·001). The level of agreement and intraclass correlation was high (ICC = 0·94, P<0·001) between measured and predicted VO2max . From this study, a valid fixed-rate single-stage step test equation has been developed to estimate VO2max in healthy adults. This tool could be employed by healthcare professionals with limited access to ergospirometry. © 2015 Scandinavian Society of Clinical Physiology and Nuclear Medicine. Published by John Wiley & Sons Ltd.

Construct Validity Evidence for Single-Response Items to Estimate Physical Activity Levels in Large Sample Studies

ERIC Educational Resources Information Center

Jackson, Allen W.; Morrow, James R., Jr.; Bowles, Heather R.; FitzGerald, Shannon J.; Blair, Steven N.

2007-01-01

Valid measurement of physical activity is important for studying the risks for morbidity and mortality. The purpose of this study was to examine evidence of construct validity of two similar single-response items assessing physical activity via self-report. Both items are based on the stages of change model. The sample was 687 participants (men =…

Expert assessment of physical ergonomics at video-display unit workstations: repeatability, validity and responsiveness to changes.

PubMed

Ketola, Ritva; Toivonen, Risto; Luukkonen, Ritva; Takala, Esa-Pekka; Viikari-Juntura, Eira

2004-08-01

Inter-observer repeatability, validity and responsiveness to change were determined for an expert assessment method for video-display unit (VDU) workstation ergonomics. The aim was to determine to what extent the expert assessment of ergonomics is related to the technical measurements, tidiness and space, work chair ergonomics and responds to changes in these characteristics. Technical measurements and video-recordings before and 2 months after an ergonomic intervention were made for 109 VDU office workstations. Two experts in ergonomics analysed and rated the ergonomics of the workstations. A researcher analysed tidiness and available space. A physiotherapist classified the work chairs used according to their ergonomic properties. The intra-class correlation coefficient between the workstation ergonomic ratings of the two experts was 0.74 at the baseline and 0.81 at the follow-up. Workstation tidiness and space, and work chair ergonomics, had a strong effect on the assessments of both experts. For both experts a change in the locations of the mouse, the screen and the keyboard and values of tidiness and space and work chair ergonomics during the intervention showed a significant association with the ratings. The assessment method studied can be utilized by an expert in a repeatable manner both in cross-sectional and in longitudinal settings.

Evaluating CollaboRATE in a clinical setting: analysis of mode effects on scores, response rates and costs of data collection.

PubMed

Barr, Paul J; Forcino, Rachel C; Thompson, Rachel; Ozanne, Elissa M; Arend, Roger; Castaldo, Molly Ganger; O'Malley, A James; Elwyn, Glyn

2017-03-24

Shared decision-making (SDM) has become a policy priority, yet its implementation is not routinely assessed. To address this gap we tested the delivery of CollaboRATE, a 3-item patient reported experience measure of SDM, via multiple survey modes. To assess CollaboRATE response rates and respondent characteristics across different modes of administration, impact of mode and patient characteristics on SDM performance and cost of administration per response in a real-world primary care practice. Observational study design, with repeated assessment of SDM performance using CollaboRATE in a primary care clinic over 15 months of data collection. Different modes of administration were introduced sequentially including paper, patient portal, interactive voice response (IVR) call, text message and tablet computer. Consecutive patients ≥18 years, or parents/guardians of patients <18 years, visiting participating primary care clinicians. CollaboRATE assesses three core SDM tasks: (1) explanation about health issues, (2) elicitation of patient preferences and (3) integration of patient preferences into decisions. Responses to each item range from 0 (no effort was made) to 9 (every effort was made). CollaboRATE scores are calculated as the proportion of participants who report a score of nine on each of the three CollaboRATE questions. Scores were sensitive to mode effects: the paper mode had the highest average score (81%) and IVR had the lowest (61%). However, relative clinician performance rankings were stable across the different data collection modes used. Tablet computers administered by research staff had the highest response rate (41%), although this approach was costly. Clinic staff giving paper surveys to patients as they left the clinic had the lowest response rate (12%). CollaboRATE can be introduced using multiple modes of survey delivery while producing consistent clinician rankings. This may allow routine assessment and benchmarking of clinician and

Convergent Validity, Concurrent Validity, and Diagnostic Accuracy of the interRAI Depression Rating Scale.

PubMed

Penny, Katherine; Barron, Alex; Higgins, Ann-Marie; Gee, Susan; Croucher, Matthew; Cheung, Gary

2016-09-19

Depression Rating Scale (DRS) is one of the clinical outcome measures of the International Resident Assessment Instrument (interRAI) assessment. The primary aim of this study is to investigate the diagnostic accuracy and concurrent validity of the 3-day assessment window version of the DRS. The performance of DRS was compared with a gold standard clinical diagnosis of depression in 92 patients (age ≥65) who had interRAI version 9.1 Home Care assessment completed within 30 days of discharge from psychogeriatric inpatient care or memory clinic assessment. The DRS had poor diagnostic accuracy for depression diagnosis with an area under the curve of 0.68 (95% confidence interval [CI] = 0.57-0.77). The DRS score had a poor to moderate correlation with the Health of the Nation Outcome Scale 65+ depression item score (r s = 0.30, 95% CI = 0.09-0.48, P = .006). This study and the existing literature raise concerns that the DRS is not an adequate measure of depression. © The Author(s) 2016.

Clinical decision making in response to performance validity test failure in a psychiatric setting.

PubMed

Marcopulos, Bernice A; Caillouet, Beth A; Bailey, Christopher M; Tussey, Chriscelyn; Kent, Julie-Ann; Frederick, Richard

2014-01-01

This study examined the clinical utility of a performance validity test (PVT) for screening consecutive referrals (N = 436) to a neuropsychology service at a state psychiatric hospital treating both civilly committed and forensic patients. We created a contingency table with Test of Memory Malingering (TOMM) pass/fail (355/81) and secondary gain present/absent (181/255) to examine pass rates associated with patient demographic, clinical and forensic status characteristics. Of the 81 failed PVTs, 48 had secondary gain defined as active criminal legal charges; 33 failed PVTs with no secondary gain. These individuals tended to be older, female, Caucasian, and civilly committed compared with the group with secondary gain who failed. From estimations of TOMM False Positive Rate and True Positive Rate we estimated base rates of neurocognitive malingering for our clinical population using the Test Validation Summary (TVS; Frederick & Bowden, 2009 ). Although PVT failure is clearly more common in a group with secondary gain (31%), there were a number of false positives (11%). Clinical ratings of patients without gain who failed suggested cognitive deficits, behavioral issues, and inattention. Low scores on PVTs in the absence of secondary gain provide useful information on test engagement and can inform clinical decisions about testing.

Effect of manipulating recombination rates on response to selection in livestock breeding programs.

PubMed

Battagin, Mara; Gorjanc, Gregor; Faux, Anne-Michelle; Johnston, Susan E; Hickey, John M

2016-06-22

In this work, we performed simulations to explore the potential of manipulating recombination rates to increase response to selection in livestock breeding programs. We carried out ten replicates of several scenarios that followed a common overall structure but differed in the average rate of recombination along the genome (expressed as the length of a chromosome in Morgan), the genetic architecture of the trait under selection, and the selection intensity under truncation selection (expressed as the proportion of males selected). Recombination rates were defined by simulating nine different chromosome lengths: 0.10, 0.25, 0.50, 1, 2, 5, 10, 15 and 20 Morgan, respectively. One Morgan was considered to be the typical chromosome length for current livestock species. The genetic architecture was defined by the number of quantitative trait variants (QTV) that affected the trait under selection. Either a large (10,000) or a small (1000 or 500) number of QTV was simulated. Finally, the proportions of males selected under truncation selection as sires for the next generation were equal to 1.2, 2.4, 5, or 10 %. Increasing recombination rate increased the overall response to selection and decreased the loss of genetic variance. The difference in cumulative response between low and high recombination rates increased over generations. At low recombination rates, cumulative response to selection tended to asymptote sooner and the genetic variance was completely eroded. If the trait under selection was affected by few QTV, differences between low and high recombination rates still existed, but the selection limit was reached at all rates of recombination. Higher recombination rates can enhance the efficiency of breeding programs to turn genetic variation into response to selection. However, to increase response to selection significantly, the recombination rate would need to be increased 10- or 20-fold. The biological feasibility and consequences of such large increases in

Thiopurine pharmacogenomics: association of SNPs with clinical response and functional validation of candidate genes

PubMed Central

Matimba, Alice; Li, Fang; Livshits, Alina; Cartwright, Cher S; Scully, Stephen; Fridley, Brooke L; Jenkins, Gregory; Batzler, Anthony; Wang, Liewei; Weinshilboum, Richard; Lennard, Lynne

2014-01-01

Aim We investigated candidate genes associated with thiopurine metabolism and clinical response in childhood acute lymphoblastic leukemia. Materials & methods We performed genome-wide SNP association studies of 6-thioguanine and 6-mercaptopurine cytotoxicity using lymphoblastoid cell lines. We then genotyped the top SNPs associated with lymphoblastoid cell line cytotoxicity, together with tagSNPs for genes in the ‘thiopurine pathway’ (686 total SNPs), in DNA from 589 Caucasian UK ALL97 patients. Functional validation studies were performed by siRNA knockdown in cancer cell lines. Results SNPs in the thiopurine pathway genes ABCC4, ABCC5, IMPDH1, ITPA, SLC28A3 and XDH, and SNPs located within or near ATP6AP2, FRMD4B, GNG2, KCNMA1 and NME1, were associated with clinical response and measures of thiopurine metabolism. Functional validation showed shifts in cytotoxicity for these genes. Conclusion The clinical response to thiopurines may be regulated by variation in known thiopurine pathway genes and additional novel genes outside of the thiopurine pathway. PMID:24624911

Individualism: a valid and important dimension of cultural differences between nations.

PubMed

Schimmack, Ulrich; Oishi, Shigehiro; Diener, Ed

2005-01-01

Oyserman, Coon, and Kemmelmeier's (2002) meta-analysis suggested problems in the measurement of individualism and collectivism. Studies using Hofstede's individualism scores show little convergent validity with more recent measures of individualism and collectivism. We propose that the lack of convergent validity is due to national differences in response styles. Whereas Hofstede statistically controlled for response styles, Oyserman et al.'s meta-analysis relied on uncorrected ratings. Data from an international student survey demonstrated convergent validity between Hofstede's individualism dimension and horizontal individualism when response styles were statistically controlled, whereas uncorrected scores correlated highly with the individualism scores in Oyserman et al.'s meta-analysis. Uncorrected horizontal individualism scores and meta-analytic individualism scores did not correlate significantly with nations' development, whereas corrected horizontal individualism scores and Hofstede's individualism dimension were significantly correlated with development. This pattern of results suggests that individualism is a valid construct for cross-cultural comparisons, but that the measurement of this construct needs improvement.

Reliability and validity of a Kannada rate of reading test.

PubMed

Srinivasan, Krithica; Krishnan, Gopee; Wilkins, Arnold; Allen, Peter

2018-05-01

Kannada, one of the Dravidian languages, is the official language of Karnataka state of India. There is a need for a test using Kannada words that can assess visual aspects of reading independently of syntactic and semantic knowledge. A test of reading rate in Kannada was developed following the design principles of the Wilkins Rate of Reading Test (RRT). Fifteen high-frequency bisyllabic Kannada words were selected. Children were recruited from state and private schools that used Kannada or English as the medium of instruction. A total of 799 children from Grade 2 to 9 participated in the study. Reading rate was measured using the English RRT and the Kannada version twice in immediate succession during the first session. In 85 children, measurements using the Kannada RRT were repeated after an interval of 15 days. Pearson product moment correlation between the two immediately successive tests was 0.95 for the Kannada RRT and 0.91 for the English RRT. The correlation for the tests separated by an interval of 15 days was 0.83. When Kannada was the medium of instruction, there was little difference between test scores for Kannada and English. When English was the medium of instruction, test scores were greater in English. Scores increased as expected with age (P < 0.0001), similarly for Kannada and English tests. The newly developed Kannada RRT is both reliable and valid and can be used as a tool for measuring the visual aspects of reading.

An Item Response Unfolding Model for Graphic Rating Scales

ERIC Educational Resources Information Center

Liu, Ying

2009-01-01

The graphic rating scale, a measurement tool used in many areas of psychology, usually takes a form of a fixed-length line segment, with both ends bounded and labeled as extreme responses. The raters mark somewhere on the line, and the length of the line segment from one endpoint to the mark is taken as the measure. An item response unfolding…

An Interlaboratory Validation of the Radiation Dose Response Relationship (DRR) for H-ARS in the Rhesus Macaque.

PubMed

Thrall, Karla D; Love, Ruschelle; OʼDonnell, Kyle C; Farese, Ann M; Manning, Ronald; MacVittie, Thomas J

2015-11-01

The Medical Countermeasures against Radiological Threats (MCART) consortium has established a dose response relationship for the hematopoietic acute radiation syndrome (HARS) in the rhesus macaque conducted under an individualized supportive care protocol, including blood transfusions. Application of this animal model as a platform for demonstrating efficacy of candidate medical countermeasures is significantly strengthened when the model is independently validated at multiple institutions. The study reported here describes implementation of standard operating procedures at an institute outside the consortium in order to evaluate the ability to establish an equivalent radiation dose response relationship in a selected species. Validation of the animal model is a significant component for consideration of the model protocol as an FDA-recommended drug development tool in the context of the "Animal Rule." In the current study, 48 male rhesus macaques (4-8 kg) were exposed to total-body irradiation (TBI) using 6 MV photon energy at a dose rate of approximately 0.8 Gy min. Results show that onset and duration of the hematological response, including anemia, neutropenia, and thrombocytopenia, following TBI ranging from 6.25 to 8.75 Gy correlate well with previously reported findings. The lethality values at 60 d following TBI were estimated to be 6.88 Gy (LD30/60), 7.43 Gy (LD50/60), and 7.98 Gy (LD70/60). These values are equivalent to those published previously of 7.06 Gy (LD30/60), 7.52 Gy (LD50/60), and 7.99 Gy (LD70/60); the DRR slope (p = 0.68) and y-intercepts show agreement along the complete dose range for HARS. The ability to replicate the previously established institutional lethality profile (PROBIT) and model outcomes through careful implementation of defined procedures is a testament to the robustness of the model and highlights the need for consistency in procedures.

Affective stress responses during leisure time: Validity evaluation of a modified version of the Stress-Energy Questionnaire.

PubMed

Hadžibajramović, Emina; Ahlborg, Gunnar; Håkansson, Carita; Lundgren-Nilsson, Åsa; Grimby-Ekman, Anna

2015-12-01

Psychosocial stress at work is one of the most important factors behind increasing sick-leave rates. In addition to work stressors, it is important to account for non-work-related stressors when assessing stress responses. In this study, a modified version of the Stress-Energy Questionnaire (SEQ), the SEQ during leisure time (SEQ-LT) was introduced for assessing the affective stress response during leisure time. The aim of this study was to investigate the internal construct validity of the SEQ-LT. A second aim was to define the cut-off points for the scales, which could indicate high and low levels of leisure-time stress and energy, respectively. Internal construct validity of the SEQ-LT was evaluated using a Rasch analysis. We examined the unidimensionality and other psychometric properties of the scale by the fit to the Rasch model. A criterion-based approach was used for classification into high and low stress/energy levels. The psychometric properties of the stress and energy scales of the SEQ-LT were satisfactory, having accommodated for local dependency. The cut-off point for low stress was proposed to be in the interval between 2.45 and 3.02 on the Rasch metric score; while for high stress, it was between 3.65 and 3.90. The suggested cut-off points for the low and high energy levels were values between 1.73-1.97 and 2.66-3.08, respectively. The stress and energy scale of the SEQ-LT satisfied the measurement criteria defined by the Rasch analysis and it provided a useful tool for non-work-related assessment of stress responses. We provide guidelines on how to interpret the scale values. © 2015 the Nordic Societies of Public Health.

The Implicit Positive and Negative Affect Test: Validity and Relationship with Cardiovascular Stress-Responses

PubMed Central

van der Ploeg, Melanie M.; Brosschot, Jos F.; Thayer, Julian F.; Verkuil, Bart

2016-01-01

Self-report, i.e., explicit, measures of affect cannot fully explain the cardiovascular (CV) responses to stressors. Measuring affect beyond self-report, i.e., using implicit measures, could add to our understanding of stress-related CV activity. The Implicit Positive and Negative Affect Test (IPANAT) was administered in two studies to test its ecological validity and relation with CV responses and self-report measures of affect. In Study 1 students (N = 34) viewed four film clips inducing anger, happiness, fear, or no emotion, and completed the IPANAT and the Positive And Negative Affect Scale at baseline and after each clip. Implicit negative affect (INA) was higher and implicit positive affect (IPA) was lower after the anger inducing clip and vice versa after the happiness inducing clip. In Study 2 students performed a stressful math task with (n = 14) or without anger harassment (n = 15) and completed the IPANAT and a Visual Analog Scale as an explicit measure afterwards. Systolic (SBP), diastolic (DBP) blood pressure, heart rate (HR), heart rate variability (HRV), and total peripheral resistance (TPR) were recorded throughout. SBP and DBP were higher and TPR was lower in the harassment condition during the task with a prolonged effect on SBP and DBP during recovery. As expected, explicit negative affect (ENA) was higher and explicit positive affect (EPA) lower after harassment, but ENA and EPA were not related to CV activity. Although neither INA nor IPA differed between the tasks, during both tasks higher INA was related to higher SBP, lower HRV and lower TPR and to slower recovery of DBP after both tasks. Low IPA was related to slower recovery of SBP and DBP after the tasks. Implicit affect was not related to recovery of HR, HRV, and TPR. In conclusion, the IPANAT seems to respond to film clip-induced negative and positive affect and was related to CV activity during and after stressful tasks. These findings support the theory that implicitly measured affect

The Implicit Positive and Negative Affect Test: Validity and Relationship with Cardiovascular Stress-Responses.

PubMed

van der Ploeg, Melanie M; Brosschot, Jos F; Thayer, Julian F; Verkuil, Bart

2016-01-01

Self-report, i.e., explicit, measures of affect cannot fully explain the cardiovascular (CV) responses to stressors. Measuring affect beyond self-report, i.e., using implicit measures, could add to our understanding of stress-related CV activity. The Implicit Positive and Negative Affect Test (IPANAT) was administered in two studies to test its ecological validity and relation with CV responses and self-report measures of affect. In Study 1 students (N = 34) viewed four film clips inducing anger, happiness, fear, or no emotion, and completed the IPANAT and the Positive And Negative Affect Scale at baseline and after each clip. Implicit negative affect (INA) was higher and implicit positive affect (IPA) was lower after the anger inducing clip and vice versa after the happiness inducing clip. In Study 2 students performed a stressful math task with (n = 14) or without anger harassment (n = 15) and completed the IPANAT and a Visual Analog Scale as an explicit measure afterwards. Systolic (SBP), diastolic (DBP) blood pressure, heart rate (HR), heart rate variability (HRV), and total peripheral resistance (TPR) were recorded throughout. SBP and DBP were higher and TPR was lower in the harassment condition during the task with a prolonged effect on SBP and DBP during recovery. As expected, explicit negative affect (ENA) was higher and explicit positive affect (EPA) lower after harassment, but ENA and EPA were not related to CV activity. Although neither INA nor IPA differed between the tasks, during both tasks higher INA was related to higher SBP, lower HRV and lower TPR and to slower recovery of DBP after both tasks. Low IPA was related to slower recovery of SBP and DBP after the tasks. Implicit affect was not related to recovery of HR, HRV, and TPR. In conclusion, the IPANAT seems to respond to film clip-induced negative and positive affect and was related to CV activity during and after stressful tasks. These findings support the theory that implicitly measured affect

Convergent and discriminant validity and reliability of the pediatric anxiety rating scale in youth with autism spectrum disorders.

PubMed

Storch, Eric A; Wood, Jeffrey J; Ehrenreich-May, Jill; Jones, Anna M; Park, Jennifer M; Lewin, Adam B; Murphy, Tanya K

2012-11-01

The psychometric properties of the Pediatric Anxiety Rating Scale (PARS), a clinician-administered measure for assessing severity of anxiety symptoms, were examined in 72 children and adolescents diagnosed with an autism spectrum disorder (ASD). The internal consistency of the PARS was 0.59, suggesting that the items were related but not repetitive. The PARS showed high 26-day test-retest (ICC = 0.83) and inter-rater reliability (ICC = 0.86). The PARS was strongly correlated with clinician-ratings of overall anxiety severity and parent-report anxiety measures, supporting convergent validity. Results for divergent validity were mixed. Although the PARS was not associated with the sum of the Social and Communication items on the Autism Diagnostic Observation System, it was moderately correlated with parent-reported inattention, aggression and externalizing behavior. Overall, these results suggest that the psychometric properties of the PARS are adequate for assessing anxiety symptoms in youth with ASD, although additional clarification of divergent validity is needed.

Construct validity of the modified numeric rating scale of patient global assessment in psoriatic arthritis.

PubMed

Leung, Ying-Ying; Ho, Kwok-Wah; Zhu, Tracy-Yanner; Tam, Lai-Shan; Kun, Emily Wailin; Li, Edmund Kwok-Ming

2012-04-01

The construct validity of the patient global health assessment (PGA) in psoriatic arthritis (PsA) has not been analyzed, despite its common use. We evaluated the construct validity of a numeric rating scale (NRS) of the PGA in PsA. Patients with PsA who fulfilled the ClASsification for Psoriatic ARthritis (CASPAR) criteria were recruited at a tertiary referral center. Demographic data were collected and PGA data were determined from administration of an 11-point NRS (0 to 10 points representing best to worst status). Convergent and discriminant validity were evaluated by correlation between PGA and clinical variables. Patients were grouped as having severe disease based on Disease Activity Score 28-joint count (DAS28) > 5.1, Health Assessment Questionnaire (HAQ) > 1.0, walking with aids, and social welfare-dependent. Patients were grouped as being in remission by DAS28 < 2.6 and the Minimal Disease Activity Criteria. Known-group validity of PGA was evaluated. A total of 125 patients (52% men) were studied. Convergent validity revealed strong correlations of PGA with pain score, HAQ, and DAS28; and weak correlations with skin severity score, physician's global assessment and morning stiffness. In multivariate analysis, PGA was associated with pain, physical function, mental function, and skin severity score. PGA distinguished different levels of severity well, as determined by comparison with different known groups with large effect sizes. Judged on an NRS, the PGA had good construct validity and satisfactorily distinguished all levels of severity in PsA.

Screening tool for oropharyngeal dysphagia in stroke - Part I: evidence of validity based on the content and response processes.

PubMed

Almeida, Tatiana Magalhães de; Cola, Paula Cristina; Pernambuco, Leandro de Araújo; Magalhães, Hipólito Virgílio; Magnoni, Carlos Daniel; Silva, Roberta Gonçalves da

2017-08-17

The aim of the present study was to identify the evidence of validity based on the content and response process of the Rastreamento de Disfagia Orofaríngea no Acidente Vascular Encefálico (RADAVE; "Screening Tool for Oropharyngeal Dysphagia in Stroke"). The criteria used to elaborate the questions were based on a literature review. A group of judges consisting of 19 different health professionals evaluated the relevance and representativeness of the questions, and the results were analyzed using the Content Validity Index. In order to evidence validity based on the response processes, 23 health professionals administered the screening tool and analyzed the questions using a structured scale and cognitive interview. The RADAVE structured to be applied in two stages. The first version consisted of 18 questions in stage I and 11 questions in stage II. Eight questions in stage I and four in stage II did not reach the minimum Content Validity Index, requiring reformulation by the authors. The cognitive interview demonstrated some misconceptions. New adjustments were made and the final version was produced with 12 questions in stage I and six questions in stage II. It was possible to develop a screening tool for dysphagia in stroke with adequate evidence of validity based on content and response processes. Both validity evidences obtained so far allowed to adjust the screening tool in relation to its construct. The next studies will analyze the other evidences of validity and the measures of accuracy.

Differential Effects of Incentives on Response Error, Response Rate, and Reliability of a Mailed Questionnaire.

ERIC Educational Resources Information Center

Brown, Darine F.; Hartman, Bruce

1980-01-01

Investigated issues associated with stimulating increased return rates to a mail questionnaire among school counselors. Results show that as the number of incentives received increased, the return rates increased in a linear fashion. The incentives did not introduce response error or affect the reliability of the Counselor Function Inventory.…

Reliability and validity of the combined heart rate and movement sensor Actiheart.

PubMed

Brage, S; Brage, N; Franks, P W; Ekelund, U; Wareham, N J

2005-04-01

Accurate quantification of physical activity energy expenditure is a key part of the effort to understand disorders of energy metabolism. The Actiheart, a combined heart rate (HR) and movement sensor, is designed to assess physical activity in populations. To examine aspects of Actiheart reliability and validity in mechanical settings and during walking and running. In eight Actiheart units, technical reliability (coefficients of variation, CV) and validity for movement were assessed with sinusoid accelerations (0.1-20 m/s(2)) and for HR by simulated R-wave impulses (25-250 bpm). Agreement between Actiheart and ECG was determined during rest and treadmill locomotion (3.2-12.1 km/h). Walking and running intensity (in J/min/kg) was assessed with indirect calorimetry in 11 men and nine women (26-50 y, 20-29 kg/m(2)) and modelled from movement, HR, and movement + HR by multiple linear regression, adjusting for sex. Median intrainstrument CV was 0.5 and 0.03% for movement and HR, respectively. Corresponding interinstrument CV values were 5.7 and 0.03% with some evidence of heteroscedasticity for movement. The linear relationship between movement and acceleration was strong (R(2) = 0.99, P < 0.001). Simulated R-waves were detected within 1 bpm from 30 to 250 bpm. The 95% limits of agreement between Actiheart and ECG were -4.2 to 4.3 bpm. Correlations with intensity were generally high (R(2) > 0.84, P < 0.001) but significantly highest when combining HR and movement (SEE < 1 MET). The Actiheart is technically reliable and valid. Walking and running intensity may be estimated accurately but further studies are needed to assess validity in other activities and during free-living. The study received financial support from the Wellcome Trust and SB was supported by a scholarship from Unilever, UK.

Validity of the patient-reported Clinical Global Impression of Change as a measure of treatment response in men with premature ejaculation.

PubMed

Althof, Stanley E; Brock, Gerald B; Rosen, Raymond C; Rowland, David L; Aquilina, Joseph W; Rothman, Margaret; Tesfaye, Fisseha; Bull, Scott

2010-06-01

The Clinical Global Impression of Change (CGIC) measures have high utility in clinical practice. However, it is unknown whether the CGIC is valued for assessing premature ejaculation (PE) symptoms and/or the relationship between CGIC and other validated PE patient-reported measures. The study aims to assess the validity of the patient-reported CGIC measure in men with PE and to examine the relationship between CGIC ratings and assessments of control, satisfaction, personal distress, and interpersonal difficulty. Data from a randomized, double-blind, 24-week phase 3 trial in 1,162 men with PE who received dapoxetine (30 mg or 60 mg) or placebo on demand provided the basis for the analysis. Patients were ≥18 years, in a stable monogamous relationship for ≥6 months, met the Diagnostic and Statistical Manual of Mental Disorders-Fourth Edition-Text Revision criteria for PE for ≥6 months, and had an intravaginal ejaculatory latency time (IELT) ≤2 minutes in ≥75% of intercourse episodes. The CGIC asked patients to rate improvement or worsening of their PE compared with the start of the study using a 7-point response scale; other patient-reported measures were control over ejaculation, satisfaction with sexual intercourse, interpersonal difficulty, and personal distress related to ejaculation. Stopwatch-measured IELT was recorded. Associations between CGIC and change in other measures at study end point were assessed. The magnitude of IELT increased for each category of improvement on the CGIC: 1.63, 4.03, and 7.15 minutes for slightly better, better, and much better, respectively. Higher CGIC ratings were correlated with greater improvement in control (r = 0.73), satisfaction (r = 0.62), greater reduction in distress (r = -0.52), and interpersonal difficulty (r = -0.39). Total variance accounted for was 57.4%: control (48.7%), satisfaction (4.5%), IELT (2.8%), and distress (1.15%). The analyses support the validity of the CGIC measure in men with PE. The CGIC

High-rate operant behavior in two mouse strains: a response-bout analysis.

PubMed

Johnson, Joshua E; Pesek, Erin F; Newland, M Christopher

2009-06-01

Operant behavior sometimes occurs in bouts characterized by an initiation rate, within-bout response rate, and bout length. The generality of this structure was tested using high-rate nose-poking in mice. Reinforcement of short interresponse times produced high response rates while a random-interval schedule held reinforcement rates constant. BALB/c mice produced bouts that were more frequent, longer, and contained a higher within-bout rate of responding (nine nose-pokes/s) than did the C57BL/6 mice (five nose-pokes/s). Adding a running wheel decreased total nose-pokes and bout length, and increased bout-initiation rate. Free-feeding reduced nose-poking by decreasing bout-initiation rate. Photoperiod reversal decreased bout-initiation rate but not total nose-poke rate. Despite strain differences in bout structure, both strains responded similarly to the interventions. The three bout measures were correlated with overall rate but not with each other. Log-survival analyses provided independent descriptors of the structure of high-rate responding in these two strains.

A Teacher-Report Measure of Children's Task-Avoidant Behavior: A Validation Study of the Behavioral Strategy Rating Scale

ERIC Educational Resources Information Center

Zhang, Xiao; Nurmi, Jari-Erik; Kiuru, Noona; Lerkkanen, Marja-Kristiina; Aunola, Kaisa

2011-01-01

This study aims to validate a teacher-report measure of children's task-avoidant behavior, namely the Behavioral Strategy Rating Scale (BSRS), in a sample of 352 Finnish children. In each of the four waves from Kindergarten to Grade 2, teachers rated children's task-avoidant behavior using the BSRS, children completed reading and mathematics…

Responsiveness and validity of the SCORFAD, an extent and severity scale for feline hypersensitivity dermatitis.

PubMed

Steffan, Jean; Olivry, Thierry; Forster, Sophie L; Seewald, Wolfgang

2012-10-01

Hypersensitivity (allergic) dermatitis (HD) is commonly seen in cats, causing pruritus and various patterns of skin lesions, including at least one of the following: head and neck excoriations, self-induced alopecia, eosinophilic plaques and miliary dermatitis. Few studies have evaluated the efficacy of therapeutic interventions for feline HD, and although various scales have been considered, none has been formally validated for the assessment of disease severity and its response to therapy. To design and validate a novel scale (SCORing Feline Allergic Dermatitis; SCORFAD) to assess the value of different criteria used as outcome measures for the treatment of feline HD and to set minimal thresholds for defining the clinical success of tested interventions. One hundred client-owned cats. The SCORFAD scale was designed to include the four most frequently identified lesion types in feline HD (eosinophilic plaque, head and neck excoriations, self-induced alopecia and miliary dermatitis) across 10 body regions. The extent and severity of each lesion type were graded prior to inclusion and after 3 and 6 weeks in a clinical study to compare the efficacy of two doses of ciclosporin with placebo. The SCORFAD scale was found to exhibit satisfactory content, construct, criterion and sensitivity to change. The percentage reduction in SCORFAD from baseline was determined to be the most valid assessment of clinical response. Inter- and intra-observer reliability was not assessed. The SCORFAD scale is proposed for use as a validated tool for the assessment of disease severity and response to therapeutic interventions in clinical trials for feline HD. © 2012 The Authors. Veterinary Dermatology © 2012 ESVD and ACVD.

The Accuracy and Validity of iOS-Based Heart Rate Apps During Moderate to High Intensity Exercise.

PubMed

Bouts, Alexa M; Brackman, Lauren; Martin, Elizabeth; Subasic, Adam M; Potkanowicz, Edward S

2018-01-01

People use their smartphones for everything from web browsing to tracking fitness metrics. However, it is unclear whether smartphone-based apps that use photoplethysmography to measure heart rate are an accurate or valid measure of exercise intensity. Purpose was to determine the accuracy and validity of two iOS-based heart rate monitors, Runtastic Heart Rate Monitor and Pulse Tracker PRO by Runtastic (Runtastic) and Instant Heart Rate+: Heart Rate and Pulse Monitor by Azumio (Instant Heart Rate), when compared to the electrocardiogram (ECG) and Polar® T31 uncoded heart rate monitor from moderate to vigorous intensity exercise. Participants were 15 male and female regularly active college students. Pre-exercise heart rate and blood pressure were recorded and then participants exercised on a stationary bike at a pedal rate of between 50-60 rpms. After completing a warm-up stage at 40% of age estimated maximum heart rate (AEMHR), exercise intensity progressed from 50% of AEMHR through to 85% of AEMHR in eight, 5-minute stages. At the end of each stage, and having achieved steady-state, heart rates were recorded from each apparatus. After completing the final stage, participants completed a cooldown at 40% of their AEMHR. Post-exercise heart rate and blood pressure were also recorded to ensure full recovery to baseline. There was a strong positive correlation between the Polar® monitor and the ECG during all stages. However, there were not strong correlations for either of the smartphone-based apps at any time point. Although there were weak correlations between the smartphone-based apps and ECG and Polar®, further studies need to be conducted to determine if inaccuracy is due to user error (finger placement, finger temperature, etc.) or the technology behind the apps.

The Accuracy and Validity of iOS-Based Heart Rate Apps During Moderate to High Intensity Exercise

PubMed Central

BOUTS, ALEXA M.; BRACKMAN, LAUREN; MARTIN, ELIZABETH; SUBASIC, ADAM M.; POTKANOWICZ, EDWARD S.

2018-01-01

People use their smartphones for everything from web browsing to tracking fitness metrics. However, it is unclear whether smartphone-based apps that use photoplethysmography to measure heart rate are an accurate or valid measure of exercise intensity. Purpose was to determine the accuracy and validity of two iOS-based heart rate monitors, Runtastic Heart Rate Monitor and Pulse Tracker PRO by Runtastic (Runtastic) and Instant Heart Rate+: Heart Rate and Pulse Monitor by Azumio (Instant Heart Rate), when compared to the electrocardiogram (ECG) and Polar® T31 uncoded heart rate monitor from moderate to vigorous intensity exercise. Participants were 15 male and female regularly active college students. Pre-exercise heart rate and blood pressure were recorded and then participants exercised on a stationary bike at a pedal rate of between 50–60 rpms. After completing a warm-up stage at 40% of age estimated maximum heart rate (AEMHR), exercise intensity progressed from 50% of AEMHR through to 85% of AEMHR in eight, 5-minute stages. At the end of each stage, and having achieved steady-state, heart rates were recorded from each apparatus. After completing the final stage, participants completed a cooldown at 40% of their AEMHR. Post-exercise heart rate and blood pressure were also recorded to ensure full recovery to baseline. There was a strong positive correlation between the Polar® monitor and the ECG during all stages. However, there were not strong correlations for either of the smartphone-based apps at any time point. Although there were weak correlations between the smartphone-based apps and ECG and Polar®, further studies need to be conducted to determine if inaccuracy is due to user error (finger placement, finger temperature, etc.) or the technology behind the apps. PMID:29541341

Validity and reliability of a novel measure of activity performance and participation.

PubMed

Murgatroyd, Phil; Karimi, Leila

2016-01-01

To develop and evaluate an innovative clinician-rated measure, which produces global numerical ratings of activity performance and participation. Repeated measures study with 48 community-dwelling participants investigating clinical sensibility, comprehensiveness, practicality, inter-rater reliability, responsiveness, sensitivity and concurrent validity with Barthel Index. Important clinimetric characteristics including comprehensiveness and ease of use were rated >8/10 by clinicians. Inter-rater reliability was excellent on the summary scores (intraclass correlation of 0.95-0.98). There was good evidence that the new outcome measure distinguished between known high and low functional scoring groups, including both responsiveness to change and sensitivity at the same time point in numerous tests. Concurrent validity with the Barthel Index was fair to high (Spearman Rank Order Correlation 0.32-0.85, p > 0.05). The new measure's summary scores were nearly twice as responsive to change compared with the Barthel Index. Other more detailed data could also be generated by the new measure. The Activity Performance Measure is an innovative outcome instrument that showed good clinimetric qualities in this initial study. Some of the results were strong, given the sample size, and further trial and evaluation is appropriate. Implications for Rehabilitation The Activity Performance Measure is an innovative outcome measure covering activity performance and participation. In an initial evaluation, it showed good clinimetric qualities including responsiveness to change, sensitivity, practicality, clinical sensibility, item coverage, inter-rater reliability and concurrent validity with the Barthel Index. Further trial and evaluation is appropriate.

Improving Survey Response Rates of School Counselors: Comparing the Use of Incentives

ERIC Educational Resources Information Center

Bauman, Sheri

2007-01-01

This article examines the effectiveness of incentives in improving survey response rates of school counselors and compares the findings with those of previously researched populations. A $1 cash incentive increased response rates for a one-wave mailing of a questionnaire, while a raffle opportunity did not. The number and length of optional…

The effectiveness of a monetary incentive offer on survey response rates and response completeness in a longitudinal study.

PubMed

Yu, Shengchao; Alper, Howard E; Nguyen, Angela-Maithy; Brackbill, Robert M; Turner, Lennon; Walker, Deborah J; Maslow, Carey B; Zweig, Kimberly C

2017-04-26

Achieving adequate response rates is an ongoing challenge for longitudinal studies. The World Trade Center Health Registry is a longitudinal health study that periodically surveys a cohort of ~71,000 people exposed to the 9/11 terrorist attacks in New York City. Since Wave 1, the Registry has conducted three follow-up surveys (Waves 2-4) every 3-4 years and utilized various strategies to increase survey participation. A promised monetary incentive was offered for the first time to survey non-respondents in the recent Wave 4 survey, conducted 13-14 years after 9/11. We evaluated the effectiveness of a monetary incentive in improving the response rate five months after survey launch, and assessed whether or not response completeness was compromised due to incentive use. The study compared the likelihood of returning a survey for those who received an incentive offer to those who did not, using logistic regression models. Among those who returned surveys, we also examined whether those receiving an incentive notification had higher rate of response completeness than those who did not, using negative binomial regression models and logistic regression models. We found that a $10 monetary incentive offer was effective in increasing Wave 4 response rates. Specifically, the $10 incentive offer was useful in encouraging initially reluctant participants to respond to the survey. The likelihood of returning a survey increased by 30% for those who received an incentive offer (AOR = 1.3, 95% CI: 1.1, 1.4), and the incentive increased the number of returned surveys by 18%. Moreover, our results did not reveal any significant differences on response completeness between those who received an incentive offer and those who did not. In the face of the growing challenge of maintaining a high response rate for the World Trade Center Health Registry follow-up surveys, this study showed the value of offering a monetary incentive as an additional refusal conversion strategy. Our

Survey response rates in the forest products literature from 2000 to 2015

Treesearch

Matt Bumgardner; Iris Montague; Jan Wiedenbeck

2017-01-01

A literature analysis was conducted to synthesize typical response rates from forest-productsindustry- based survey studies published from 2000 to mid-2015. One hundred and ninety-five surveys published in several forest products and forestry journals and proceedings (mostly North American based) were analyzed. Overall, the typical response rate was found to be about...

Emotional Responses to Suicidal Patients: Factor Structure, Construct, and Predictive Validity of the Therapist Response Questionnaire-Suicide Form.

PubMed

Barzilay, Shira; Yaseen, Zimri S; Hawes, Mariah; Gorman, Bernard; Altman, Rachel; Foster, Adriana; Apter, Alan; Rosenfield, Paul; Galynker, Igor

2018-01-01

Mental health professionals have a pivotal role in suicide prevention. However, they also often have intense emotional responses, or countertransference, during encounters with suicidal patients. Previous studies of the Therapist Response Questionnaire-Suicide Form (TRQ-SF), a brief novel measure aimed at probing a distinct set of suicide-related emotional responses to patients found it to be predictive of near-term suicidal behavior among high suicide-risk inpatients. The purpose of this study was to validate the TRQ-SF in a general outpatient clinic setting. Adult psychiatric outpatients ( N  = 346) and their treating mental health professionals ( N  = 48) completed self-report assessments following their first clinic meeting. Clinician measures included the TRQ-SF, general emotional states and traits, therapeutic alliance, and assessment of patient suicide risk. Patient suicidal outcomes and symptom severity were assessed at intake and one-month follow-up. Following confirmatory factor analysis of the TRQ-SF, factor scores were examined for relationships with clinician and patient measures and suicidal outcomes. Factor analysis of the TRQ-SF confirmed three dimensions: (1) affiliation, (2) distress, and (3) hope. The three factors also loaded onto a single general factor of negative emotional response toward the patient that demonstrated good internal reliability. The TRQ-SF scores were associated with measures of clinician state anger and anxiety and therapeutic alliance, independently of clinician personality traits after controlling for the state- and patient-specific measures. The total score and three subscales were associated in both concurrent and predictive ways with patient suicidal outcomes, depression severity, and clinicians' judgment of patient suicide risk, but not with global symptom severity, thus indicating specifically suicide-related responses. The TRQ-SF is a brief and reliable measure with a 3-factor structure. It demonstrates

Assessing Women's Responses to Sexual Threat: Validity of a Virtual Role-Play Procedure

ERIC Educational Resources Information Center

Jouriles, Ernest N.; Rowe, Lorelei Simpson; McDonald, Renee; Platt, Cora G.; Gomez, Gabriella S.

2011-01-01

This study evaluated the validity of a role-play procedure that uses virtual reality technology to assess women's responses to sexual threat. Forty-eight female undergraduate students were randomly assigned to either a standard, face-to-face role-play (RP) or a virtual role-play (VRP) of a sexually coercive situation. A multimethod assessment…

Effects of various methodologic strategies: survey response rates among Canadian physicians and physicians-in-training.

PubMed

Grava-Gubins, Inese; Scott, Sarah

2008-10-01

To increase the overall 2007 response rate of the National Physician Survey (NPS) from the survey's 2004 rate of response with the implementation of various methodologic strategies. Physicians were stratified to receive either a long version (12 pages) or a short version (6 pages) of the survey (38% and 62%, respectively). Mixed modes of contact were used-58% were contacted by e-mail and 42% by regular mail-with multiple modes of contact attempted for nonrespondents. The self-administered, confidential surveys were distributed in either English or French. Medical residents and students received e-mail surveys only and were offered a substantial monetary lottery incentive for completing their surveys. A professional communications firm assisted in marketing the survey and delivered advance notification of its impending distribution. Canada. A total of 62 441 practising physicians, 2627 second-year medical residents, and 9162 medical students in Canada. Of the practising physicians group, 60 811 participants were eligible and 19 239 replied, for an overall 2007 study response rate of 31.64% (compared with 35.85% in 2004). No difference in rate of response was found between the longer and shorter versions of the survey. If contacted by regular mail, the response rate was 34.1%; the e-mail group had a response rate of 29.9%. Medical student and resident response rates were 30.8% and 27.9%, respectively (compared with 31.2% and 35.6% in 2004). Despite shortening the questionnaires, contacting more physicians by e-mail, and enhancing marketing and follow-up, the 2007 NPS response rate for practising physicians did not surpass the 2004 NPS response rate. Offering a monetary lottery incentive to medical residents and students was also unsuccessful in increasing their response rates. The role of surveys in gathering information from physicians and physicians-in-training remains problematic. Researchers need to investigate alternative strategies for achieving higher rates of

Predictors of Response Rates to a Long Term Follow-Up Mail out Survey

PubMed Central

Koloski, Natasha A.; Jones, Michael; Eslick, Guy; Talley, Nicholas J.

2013-01-01

Objective Very little is known about predictors of response rates to long-term follow-up mail-out surveys, including whether the timing of an incentive affects response rates. We aimed to determine whether the timing of the incentive affects response rates and what baseline demographic and psychological factors predict response rates to a 12 year follow-up survey. Study design and setting: Participants were 450 randomly selected people from the Penrith population, Australia who had previously participated in a mail-out survey 12 years earlier. By random allocation, 150 people received no incentive, 150 received a lottery ticket inducement with the follow-up survey and 150 received a lottery ticket inducement on the return of a completed survey. Results The overall response rate for the study was 63%. There were no significant differences in terms of response rates between the no incentive (58.8%;95%CI 49.8%,67.3%), incentive with survey (65.1%;95%CI 56.2%,73.3%) and promised incentive (65.3%;95%CI 56.1%,73.7%) groups. Independent predictors of responding to the 12 year survey were being older (OR=1.02, 95%CI 1.01,1.05,P=0.001) and being less neurotic as reported on the first survey 12 years earlier (OR=0.92, 95%CI 0.86,0.98, P=0.010). Conclusions Psychological factors may play a role in determining who responds to long-term follow-up surveys although timing of incentives does not. PMID:24223902

The Oxford Ankle Foot Questionnaire for children: responsiveness and longitudinal validity.

PubMed

Morris, Christopher; Doll, Helen; Davies, Neville; Wainwright, Andrew; Theologis, Tim; Willett, Keith; Fitzpatrick, Ray

2009-12-01

To evaluate how scores from the Oxford Ankle Foot Questionnaire change over time and with treatment using both distribution-based and anchor-based approaches. Eighty children aged 5-16 and their parent or career completed questionnaires at orthopaedic or trauma outpatient clinics. They were asked to complete and return a second set of questionnaires again within 2 weeks (retest), and then mailed a third set of questionnaires to complete again after 2 months (follow-up). The follow-up questionnaires included a global rating of change 'transition' item. Child- and parent-reported mean domain scores (Physical, School & Play, and Emotional) were all stable at retest, whereas positive mean changes were observed at follow-up. As we hypothesised, trauma patients had poorer scores than elective patients at baseline, and showed greater improvement at follow-up. For trauma patients, mean changes in per cent scores were large (scores improved between 40 and 56 for the Physical and School & Play domains, and 17 and 21 for Emotional); all effect sizes (ES) were large (>0.8). For elective patients, the mean improvement in per cent scores were more moderate (Physical: child 10, ES = 0.4, parent 11, ES = 0.5; School & Play child 0, ES = 0, parent 9 ES = 0.4; Emotional: child 6, ES = 0.2; parents 8, ES > 0.3). Minimal detectable change (MDC(90)), an indication of measurement error, ranged from 6 to 8. Half the standard deviation of baseline scores ranged from 11 to 18. Minimal important difference could only be calculated for elective patients (9 child and 13 parent ratings), these ranged from 7 to 17. The findings support the responsiveness and longitudinal validity of the scales. Changes in domain scores of, or exceeding, the MDC(90) (6-8) are likely to be beyond measurement error; further work is required to refine the estimate of change that can be considered important.

On Validity Theory and Test Validation

ERIC Educational Resources Information Center

Sireci, Stephen G.

2007-01-01

Lissitz and Samuelsen (2007) propose a new framework for conceptualizing test validity that separates analysis of test properties from analysis of the construct measured. In response, the author of this article reviews fundamental characteristics of test validity, drawing largely from seminal writings as well as from the accepted standards. He…

The heart rate response to nintendo wii boxing in young adults.

PubMed

Bosch, Pamela R; Poloni, Joseph; Thornton, Andrew; Lynskey, James V

2012-06-01

To determine if 30 minutes of Nintendo Wii Sports boxing provides cardiorespiratory benefits and contributes to the daily exercise recommendations for healthy young adults. Twenty healthy 23- to 27-year-olds participated in two sessions to measure maximum heart rate (HR(max)) via a treadmill test and heart rate (HR) response to 30 minutes of Wii Sports boxing. Heart rate in beats per minute (bpm) was measured continuously, and exercise intensity during each minute of play was stratified as a percentage of HR(max). Mixed designs analysis of variance (ANOVA) and Pearson product moment correlations were used to analyze the data. Mean (SD) HR response to boxing was 143 (15) bpm or 77.5% (10.0%) of HR(max). The mean HR response for experienced participants was significantly lower than inexperienced participants, P = .007. The ANOVA revealed a significant interaction between experience and time spent at various intensities, P = .009. Experienced participants spent more time in light to vigorous intensities, inexperienced participants in moderate to very hard intensities. Fitness was not correlated with mean HR response to boxing, P = .49. Thirty minutes of Nintendo Wii Sports boxing provides a moderate to vigorous aerobic response in healthy young adults and can contribute to daily recommendations for physical activity.

The Heart Rate Response to Nintendo Wii Boxing in Young Adults

PubMed Central

Bosch, Pamela R.; Poloni, Joseph; Thornton, Andrew; Lynskey, James V.

2012-01-01

Purpose To determine if 30 minutes of Nintendo Wii Sports boxing provides cardiorespiratory benefits and contributes to the daily exercise recommendations for healthy young adults. Methods Twenty healthy 23- to 27-year-olds participated in two sessions to measure maximum heart rate (HRmax) via a treadmill test and heart rate (HR) response to 30 minutes of Wii Sports boxing. Heart rate in beats per minute (bpm) was measured continuously, and exercise intensity during each minute of play was stratified as a percentage of HRmax. Mixed designs analysis of variance (ANOVA) and Pearson product moment correlations were used to analyze the data. Results Mean (SD) HR response to boxing was 143 (15) bpm or 77.5% (10.0%) of HRmax. The mean HR response for experienced participants was significantly lower than inexperienced participants, P = .007. The ANOVA revealed a significant interaction between experience and time spent at various intensities, P = .009. Experienced participants spent more time in light to vigorous intensities, inexperienced participants in moderate to very hard intensities. Fitness was not correlated with mean HR response to boxing, P = .49. Conclusion Thirty minutes of Nintendo Wii Sports boxing provides a moderate to vigorous aerobic response in healthy young adults and can contribute to daily recommendations for physical activity. PMID:22833705

How many mailouts? Could attempts to increase the response rate in the Iraq war cohort study be counterproductive?

PubMed Central

Tate, A Rosemary; Jones, Margaret; Hull, Lisa; Fear, Nicola T; Rona, Roberto; Wessely, Simon; Hotopf, Matthew

2007-01-01

misclassification is difficult to assess, the results suggest that bias due to reporting errors could be greater than bias caused by nonresponse. Resources might be better spent on improving and validating the data, rather than on increasing the response rate. PMID:18045472

Validation of a pictorial rating scale for grip strength evaluation in 3- to 6-year-old children.

PubMed

Defrasne Ait-Said, Elise; Groslambert, Alain; Courty, Daniel

2007-06-13

The present study aimed to validate a pictorial rating scale to evaluate the child's ability to produce grip forces. Thirty-seven children aged 3 to 6 years participated as subjects in this investigation. We used a tailor-made pictorial scale and a hand grip strength meter, as well as a Piaget's clinical interview aimed to gather information on the child's understanding of the rating scale. The sensitivity of the rating scale was measured by testing a 4-intensity-level hand grip effort with 3- to 6-year-old children. In addition, the reproducibility of this pictorial rating scale was investigated by a test and randomised re-test procedure. Statistical analysis revealed that no significant main effect (P>0.05) for test was observed in any child. In addition, no significant main effect (P>0.05) for intensity was found in 3-year-old children. However, in the 4-year-old children and over, a significant main effect (P<0.05) was found for intensity. The results also showed that 5- and 6-year-old children were able to produce four differentiated intensities of grip forces. These findings suggest that the pictorial rating scale for grip strength evaluation showed acceptable reproducibility and was sensitive to the age of the children tested. To conclude, this pictorial rating scale appears to be a valid tool to investigate accurately the child's ability to produce grip forces in young children from 5-year-old and over.

Oligodendroglial response to ionizing radiation: Dose and dose-rate response

DOE Office of Scientific and Technical Information (OSTI.GOV)

Levy, R.P.

1991-01-01

An in vitro system using neuroglia from neonatal rat brain was developed to examining the morphologic, immunocytochemical and biochemical response of oligodendroglia to ionizing radiation. Following acute [gamma]-radiation at day-in-culture (DIC) 8, oligodendrocyte counts at DIC 14 were 55% to 65% of control values after 2 Gy, and 29% to 36% after 5 Gy. Counts increased to near-normal levels at DIC 21 in the 2 Gy group and to 75% of normal in the 5 Gy group. Myelin basic protein levels (MBP) at DIC 14 were 60% of control values after 2 Gy, and 40% after 5 Gy. At DICmore » 21, MBP after 2 Gy was 45% greater than that observed at DIC 14, but MBP, as a fraction of age-matched control values, dropped from 60% to 50%. Following 5 Gy, absolute MBP changed little between DIC 14 and DIC 21, but decreased from 40% to 25% of control cultures. It was concluded that oligodendrocytes in irradiated cultures had significantly lower functional capacity than did unirradiated controls. The response to split-dose irradiation indicated that nearly all sublethal damage in the oligodendrocyte population (and its precursors) was repaired within 3 h to 4 h. At DIC 14, the group irradiated in a single fraction had significantly lower oligodendrocyte counts than any group given split doses; all irradiated cultures had marked depression of MBP synthesis, but to significant differences referable to time interval between doses. At DIC 21, cultures irradiated at intervals of 0 h to 2 h had similar oligodendrocyte counts to one another, but these counts were significantly lower than in cultures irradiated at intervals of 4 h to 6 h; MBP levels remained depressed at DIC 21 for all irradiated cultures. The oligodendrocyte response to dose rate (0.03 to 1.97 Gy/min) was evaluated at DIC 14 and DIC 21. Exposure at 0.03 Gy/min suppressed oligodendrocyte counts at DIC 21 less than did higher dose rates in 5-Gy irradiated cultures.« less

The SIST-M: Predictive validity of a brief structured Clinical Dementia Rating interview

PubMed Central

Okereke, Olivia I.; Pantoja-Galicia, Norberto; Copeland, Maura; Hyman, Bradley T.; Wanggaard, Taylor; Albert, Marilyn S.; Betensky, Rebecca A.; Blacker, Deborah

2011-01-01

Background We previously established reliability and cross-sectional validity of the SIST-M (Structured Interview and Scoring Tool–Massachusetts Alzheimer's Disease Research Center), a shortened version of an instrument shown to predict progression to Alzheimer disease (AD), even among persons with very mild cognitive impairment (vMCI). Objective To test predictive validity of the SIST-M. Methods Participants were 342 community-dwelling, non-demented older adults in a longitudinal study. Baseline Clinical Dementia Rating (CDR) ratings were determined by either: 1) clinician interviews or 2) a previously developed computer algorithm based on 60 questions (of a possible 131) extracted from clinician interviews. We developed age+gender+education-adjusted Cox proportional hazards models using CDR-sum-of-boxes (CDR-SB) as the predictor, where CDR-SB was determined by either clinician interview or algorithm; models were run for the full sample (n=342) and among those jointly classified as vMCI using clinician- and algorithm-based CDR ratings (n=156). We directly compared predictive accuracy using time-dependent Receiver Operating Characteristic (ROC) curves. Results AD hazard ratios (HRs) were similar for clinician-based and algorithm-based CDR-SB: for a 1-point increment in CDR-SB, respective HRs (95% CI)=3.1 (2.5,3.9) and 2.8 (2.2,3.5); among those with vMCI, respective HRs (95% CI) were 2.2 (1.6,3.2) and 2.1 (1.5,3.0). Similarly high predictive accuracy was achieved: the concordance probability (weighted average of the area-under-the-ROC curves) over follow-up was 0.78 vs. 0.76 using clinician-based vs. algorithm-based CDR-SB. Conclusion CDR scores based on items from this shortened interview had high predictive ability for AD – comparable to that using a lengthy clinical interview. PMID:21986342

In Situ Rates of Sulfate Reduction in Response to Geochemical Perturbations

USGS Publications Warehouse

Kneeshaw, T.A.; McGuire, J.T.; Cozzarelli, I.M.; Smith, E.W.

2011-01-01

Rates of in situ microbial sulfate reduction in response to geochemical perturbations were determined using Native Organism Geochemical Experimentation Enclosures (NOGEEs), a new in situ technique developed to facilitate evaluation of controls on microbial reaction rates. NOGEEs function by first trapping a native microbial community in situ and then subjecting it to geochemical perturbations through the introduction of various test solutions. On three occasions, NOGEEs were used at the Norman Landfill research site in Norman, Oklahoma, to evaluate sulfate-reduction rates in wetland sediments impacted by landfill leachate. The initial experiment, in May 2007, consisted of five introductions of a sulfate test solution over 11 d. Each test stimulated sulfate reduction with rates increasing until an apparent maximum was achieved. Two subsequent experiments, conducted in October 2007 and February 2008, evaluated the effects of concentration on sulfate-reduction rates. Results from these experiments showed that faster sulfate-reduction rates were associated with increased sulfate concentrations. Understanding variability in sulfate-reduction rates in response to perturbations may be an important factor in predicting rates of natural attenuation and bioremediation of contaminants in systems not at biogeochemical equilibrium. Copyright ?? 2011 The Author(s). Journal compilation ?? 2011 National Ground Water Association.

[Response rates in three opinion surveys performed through online questionnaires in the health setting].

PubMed

Aerny Perreten, Nicole; Domínguez-Berjón, Ma Felicitas; Astray Mochales, Jenaro; Esteban-Vasallo, María D; Blanco Ancos, Luis Miguel; Lópaz Pérez, Ma Ángeles

2012-01-01

The main advantages of online questionnaires are the speed of data collection and cost savings, but response rates are usually low. This study analyzed response rates and associated factors among health professionals in three opinion surveys in the autonomous region of Madrid. The participants, length of the questionnaire and topic differed among the three surveys. The surveys were conducted by using paid Internet software. The institutional e-mail addresses of distinct groups of health professionals were used. Response rates were highest in hospitals (up to 63%) and administrative services and were lowest in primary care (less than 33%). The differences in response rates were analyzed in primary care professionals according to age, sex and professional category and only the association with age was statistically significant. None of the surveys achieved a response rate of 60%. Differences were observed according to workplace, patterns of Internet usage, and interest in the subject. Copyright © 2011 SESPAS. Published by Elsevier Espana. All rights reserved.

Cross-cultural adaptation, evaluation and validation of the Spouse Response Inventory: a study protocol.

PubMed

Kaiser, Ulrike; Steinmetz, Dorit; Scharnagel, Rüdiger; Jensen, Mark P; Balck, Friedrich; Sabatowski, Rainer

2014-10-14

Since the response of spouses has been proven to be an important reinforcement of pain behaviour and disability it has been addressed in research and therapy. Fordyce suggested pain behaviour and well behaviour be considered in explaining suffering in chronic pain patients. Among existing instruments concerning spouse's responses the aspect of well behaviour has not been examined so far. The SRI (Spouse Response Inventory) tries to consider pain behaviour and well behaviour and appears to be acceptable because of its brevity and close proximity to daily language. The aim of the study is the translation into German, followed by evaluation and validation, of the SRI on a German sample of patients with chronic pain. The study is comprehensively designed: initially, the focus will lie on the translation of the instrument following the guidelines for cross-cultural translation and adaptation and evaluation of the German version according to the source study. Subsequently, a validation referring to predictive, incremental and construct validation will be conducted using instruments based on similar or close but different constructs. Evaluation of the resulting SRI-G (SRI-German) will be conducted on a sample of at least 30 patients with chronic pain attending a comprehensive pain centre. For validation at least 120 patients with chronic headache, back pain, cancer related pain and somatoform pain disorder shall be included, for a total of 480 patients. Separate analyses according to specific pain diagnoses will be performed to ensure psychometric property, interpretability and control of diagnosis of specific limitations. Analyses will include comprehensive investigation of psychometric property of the scale by hierarchical regression analyses, correlation analyses, multivariate analysis of variance and exploratory factor analyses (SPSS). The study protocol was approved by the Ethics Committee of the University of Dresden (EK 335 122008) based on the Helsinki declaration

Development and validation of a two-dimensional fast-response flood estimation model

DOE Office of Scientific and Technical Information (OSTI.GOV)

Judi, David R; Mcpherson, Timothy N; Burian, Steven J

2009-01-01

A finite difference formulation of the shallow water equations using an upwind differencing method was developed maintaining computational efficiency and accuracy such that it can be used as a fast-response flood estimation tool. The model was validated using both laboratory controlled experiments and an actual dam breach. Through the laboratory experiments, the model was shown to give good estimations of depth and velocity when compared to the measured data, as well as when compared to a more complex two-dimensional model. Additionally, the model was compared to high water mark data obtained from the failure of the Taum Sauk dam. Themore » simulated inundation extent agreed well with the observed extent, with the most notable differences resulting from the inability to model sediment transport. The results of these validation studies complex two-dimensional model. Additionally, the model was compared to high water mark data obtained from the failure of the Taum Sauk dam. The simulated inundation extent agreed well with the observed extent, with the most notable differences resulting from the inability to model sediment transport. The results of these validation studies show that a relatively numerical scheme used to solve the complete shallow water equations can be used to accurately estimate flood inundation. Future work will focus on further reducing the computation time needed to provide flood inundation estimates for fast-response analyses. This will be accomplished through the efficient use of multi-core, multi-processor computers coupled with an efficient domain-tracking algorithm, as well as an understanding of the impacts of grid resolution on model results.« less

Cross-cultural adaptation, validation, and responsiveness of the Korean version of the AUSCAN Osteoarthritis Index.

PubMed

Moon, Ki Won; Lee, Shin-Seok; Kim, Jin Hyun; Song, Ran; Lee, Eun Young; Song, Yeong Wook; Bellamy, Nicholas; Lee, Eun Bong

2012-11-01

The Australian/Canadian Osteoarthritis Hand Index (AUSCAN) is a patient self-reported 15-item questionnaire measuring the severity of hand osteoarthritis symptoms in the respect of pain, stiffness, and function. In this study, we developed a Korean version of the AUSCAN Index (K-AUSCAN) and confirmed its reliability, validity, and responsiveness. The AUSCAN Index was translated into Korean by 3 translators and translated back into English by 3 different translators. In a group of 53 patients with clinical hand osteoarthritis (mean age 58.3 ± 7.6 years), validity was evaluated against other outcome measures, including the Functional Index for Hand Osteoarthritis (FIHOA) and Multidimensional Health Assessment Questionnaire (MDHAQ). Test-retest reliability was assessed at a 2-weeks interval in 51 patients. Internal consistency of K-AUSCAN was evaluated by Cronbach's α. Responsiveness was measured by standardized response mean (SRM). The test-retest reliability of K-AUSCAN yielded intraclass correlation coefficient of 0.46 for pain, 0.58 for stiffness, and 0.67 for function. The internal consistency of K-AUSCAN was satisfactory with Cronbach's α of 0.89 for pain and 0.93 for function. The K-AUSCAN index showed good correlation with other measures (r (2) was 0.67 for K-AUSCAN pain and MDHAQ pain; r (2) was 0.72 for K-AUSCAN function and FIHOA). The pain and function of K-AUSCAN correlated substantially with each other and moderately with stiffness subscale. The average SRM for K-AUSCAN pain, stiffness, and function was -0.92, -0.48, and -0.84, respectively. The Korean version of the AUSCAN Index is a valid, reliable, and responsive tool for the assessment of hand osteoarthritis symptoms.

Construct validation of an interactive digital algorithm for ostomy care.

PubMed

Beitz, Janice M; Gerlach, Mary A; Schafer, Vickie

2014-01-01

The purpose of this study was to evaluate construct validity for a previously face and content validated Ostomy Algorithm using digital real-life clinical scenarios. A cross-sectional, mixed-methods Web-based survey design study was conducted. Two hundred ninety-seven English-speaking RNs completed the study; participants practiced in both acute care and postacute settings, with 1 expert ostomy nurse (WOC nurse) and 2 nonexpert nurses. Following written consent, respondents answered demographic questions and completed a brief algorithm tutorial. Participants were then presented with 7 ostomy-related digital scenarios consisting of real-life photos and pertinent clinical information. Respondents used the 11 assessment components of the digital algorithm to choose management options. Participant written comments about the scenarios and the research process were collected. The mean overall percentage of correct responses was 84.23%. Mean percentage of correct responses for respondents with a self-reported basic ostomy knowledge was 87.7%; for those with a self-reported intermediate ostomy knowledge was 85.88% and those who were self-reported experts in ostomy care achieved 82.77% correct response rate. Five respondents reported having no prior ostomy care knowledge at screening and achieved an overall 45.71% correct response rate. No negative comments regarding the algorithm were recorded by participants. The new standardized Ostomy Algorithm remains the only face, content, and construct validated digital clinical decision instrument currently available. Further research on application at the bedside while tracking patient outcomes is warranted.

Validation of an iPad visual analogue rating system for assessing appetite and satiety.

PubMed

Brunger, Louise; Smith, Adam; Re, Roberta; Wickham, Martin; Philippides, Andrew; Watten, Phil; Yeomans, Martin R

2015-01-01

The study aimed to validate appetite ratings made on a new electronic device, the Apple iPad Mini, against an existing but now obsolete electronic device (Hewlett Packard iPAQ). Healthy volunteers (9 men and 9 women) rated their appetite before and 0, 30, 60, 90 and 120 minutes after consuming both a low energy (LE: 77 kcal) and high energy (HE: 274 kcal) beverage at breakfast on 2 non-consecutive days in counter-balanced order. Rated hunger, desire to eat and how much participants could consume was significantly lower after HE than LE on both devices, although there was better overall differentiation between HE and LE for ratings on iPad. Rated satiation and fullness, and a composite measure combining all five ratings, was significantly higher after HE than LE on both devices. There was also evidence that differences between conditions were more significant when analysed at each time point than using an overall area under the curve (AUC) measure. Overall, these data confirm that appetite ratings made using iPad are at least as sensitive as those on iPAQ, and offer a new platform for researchers to collect appetite data. Copyright © 2014 Elsevier Ltd. All rights reserved.

Importance of heart rate during exercise for response to cardiac resynchronization therapy.

PubMed

Maass, Alexander H; Buck, Sandra; Nieuwland, Wybe; Brügemann, Johan; van Veldhuisen, Dirk J; Van Gelder, Isabelle C

2009-07-01

Cardiac resynchronization therapy (CRT) is an established therapy for patients with severe heart failure and mechanical dyssynchrony. Response is only achieved in 60-70% of patients. To study exercise-related factors predicting response to CRT. We retrospectively examined consecutive patients in whom a CRT device was implanted. All underwent cardiopulmonary exercise testing prior to implantation and after 6 months. The occurrence of chronotropic incompetence and heart rates exceeding the upper rate of the device, thereby compromising biventricular stimulation, was studied. Response was defined as a decrease in LVESV of 10% or more after 6 months. We included 144 patients. After 6 months 86 (60%) patients were responders. Peak VO2 significantly increased in responders. Chronotropic incompetence was more frequently seen in nonresponders (21 [36%] vs 9 [10%], P = 0.03), mostly in patients in SR. At moderate exercise, defined as 25% of the maximal exercise tolerance, that is, comparable to daily life exercise, nonresponders more frequently went above the upper rate of the device (13 [22%] vs 2 [3%], P < 0.0001), most of whom were patients in permanent AF. Multivariate analysis revealed heart rates not exceeding the upper rate of the device during moderate exercise (OR 15.8 [3.3-76.5], P = 0.001) and nonischemic cardiomyopathy (OR 2.4 [1.0-5.7], P = 0.04) as predictive for response. Heart rate exceeding the upper rate during moderate exercise is an independent predictor for nonresponse to CRT in patients with AF, whereas chronotropic incompetence is a predictor for patients in SR.

Validity and reliability of exposure assessors' ratings of exposure intensity by type of occupational questionnaire and type of rater.

PubMed

Friesen, Melissa C; Coble, Joseph B; Katki, Hormuzd A; Ji, Bu-Tian; Xue, Shouzheng; Lu, Wei; Stewart, Patricia A

2011-07-01

In epidemiologic studies that rely on professional judgment to assess occupational exposures, the raters' accurate assessment is vital to detect associations. We examined the influence of the type of questionnaire, type of industry, and type of rater on the raters' ability to reliably and validly assess within-industry differences in exposure. Our aim was to identify areas where improvements in exposure assessment may be possible. Subjects from three foundries (n = 72) and three textile plants (n = 74) in Shanghai, China, completed an occupational history (OH) and an industry-specific questionnaire (IQ). Six total dust measurements were collected per subject and were used to calculate a subject-specific measurement mean, which was used as the gold standard. Six raters independently ranked the intensity of each subject's current job on an ordinal scale (1-4) based on the OH alone and on the OH and IQ together. Aggregate ratings were calculated for the group, for industrial hygienists, and for occupational physicians. We calculated intra-class correlation coefficients (ICCs) to evaluate the reliability of the raters. We calculated the correlation between the subject-specific measurement means and the ratings to evaluate the raters' validity. Analyses were stratified by industry, type of questionnaire, and type of rater. We also examined the agreement between the ratings by exposure category, where the subject-specific measurement means were categorized into two and four categories. The reliability and validity measures were higher for the aggregate ratings than for the ratings from the individual raters. The group's performance was maximized with three raters. Both the reliability and validity measures were higher for the foundry industry than for the textile industry. The ICCs were consistently lower in the OH/IQ round than in the OH round in both industries. In contrast, the correlations with the measurement means were higher in the OH/IQ round than in the OH round

Live birth rates in the different combinations of the Bologna criteria poor ovarian responders: a validation study.

PubMed

La Marca, Antonio; Grisendi, Valentina; Giulini, Simone; Sighinolfi, Giovanna; Tirelli, Alessandra; Argento, Cindy; Re, Claudia; Tagliasacchi, Daniela; Marsella, Tiziana; Sunkara, Sesh Kamal

2015-06-01

to compare the baseline characteristics and chance of live birth in the different categories of poor responders identified by the combinations of the Bologna criteria and establish whether these groups comprise a homogenous population. database containing clinical and laboratory information on IVF treatment cycles carried out at the Mother-Infant Department of the University Hospital of Modena between year 2007 and 2011 was analysed. This data was collected prospectively and recorded in the registered database of the fertility centre. Eight hundred and thirty women fulfilled the inclusion/ exclusion criteria of the study and 210 women fulfilled the Bologna criteria definition for poor ovarian response (POR). Five categories of poor responders were identified by different combinations of the Bologna criteria. There were no significant differences in female age, AFC, AMH, cycle cancellation rate and number of retrieved oocytes between the five groups. The live birth rate ranged between 5.5 and 7.4 % and was not statistically different in the five different categories of women defined as poor responders according to the Bologna criteria. The study demonstrates that the different groups of poor responders based on the Bologna criteria have similar IVF outcomes. This information validates the Bologna criteria definition as women having a uniform poor prognosis and also demonstrates that the Bologna criteria poor responders in the various subgroups represent a homogenous population with similar pre-clinical and clinical outcomes.

Reliability and Validity of "Parents' Evaluation of Responsible Behaviors of 5-6 Year Old Children" Scale

ERIC Educational Resources Information Center

Polat, Ozgul; Dagal, Asude B.

2013-01-01

This study is aimed at developing a scale (Parents' Evaluation of Responsible Behaviors of 5-6 Year Old Children) for measuring parents' evaluation of their 5-6 year-old children's responsible behaviors. The construct validity of the scale was tested by Factor Analysis. Factor analysis determined that the scale can be clustered under 10 factors.…

Validation Relaxation: A Quality Assurance Strategy for Electronic Data Collection

PubMed Central

Gordon, Nicholas; Griffiths, Thomas; Kraemer, John D; Siedner, Mark J

2017-01-01

Background The use of mobile devices for data collection in developing world settings is becoming increasingly common and may offer advantages in data collection quality and efficiency relative to paper-based methods. However, mobile data collection systems can hamper many standard quality assurance techniques due to the lack of a hardcopy backup of data. Consequently, mobile health data collection platforms have the potential to generate datasets that appear valid, but are susceptible to unidentified database design flaws, areas of miscomprehension by enumerators, and data recording errors. Objective We describe the design and evaluation of a strategy for estimating data error rates and assessing enumerator performance during electronic data collection, which we term “validation relaxation.” Validation relaxation involves the intentional omission of data validation features for select questions to allow for data recording errors to be committed, detected, and monitored. Methods We analyzed data collected during a cluster sample population survey in rural Liberia using an electronic data collection system (Open Data Kit). We first developed a classification scheme for types of detectable errors and validation alterations required to detect them. We then implemented the following validation relaxation techniques to enable data error conduct and detection: intentional redundancy, removal of “required” constraint, and illogical response combinations. This allowed for up to 11 identifiable errors to be made per survey. The error rate was defined as the total number of errors committed divided by the number of potential errors. We summarized crude error rates and estimated changes in error rates over time for both individuals and the entire program using logistic regression. Results The aggregate error rate was 1.60% (125/7817). Error rates did not differ significantly between enumerators (P=.51), but decreased for the cohort with increasing days of application

Validation Relaxation: A Quality Assurance Strategy for Electronic Data Collection.

PubMed

Kenny, Avi; Gordon, Nicholas; Griffiths, Thomas; Kraemer, John D; Siedner, Mark J

2017-08-18

The use of mobile devices for data collection in developing world settings is becoming increasingly common and may offer advantages in data collection quality and efficiency relative to paper-based methods. However, mobile data collection systems can hamper many standard quality assurance techniques due to the lack of a hardcopy backup of data. Consequently, mobile health data collection platforms have the potential to generate datasets that appear valid, but are susceptible to unidentified database design flaws, areas of miscomprehension by enumerators, and data recording errors. We describe the design and evaluation of a strategy for estimating data error rates and assessing enumerator performance during electronic data collection, which we term "validation relaxation." Validation relaxation involves the intentional omission of data validation features for select questions to allow for data recording errors to be committed, detected, and monitored. We analyzed data collected during a cluster sample population survey in rural Liberia using an electronic data collection system (Open Data Kit). We first developed a classification scheme for types of detectable errors and validation alterations required to detect them. We then implemented the following validation relaxation techniques to enable data error conduct and detection: intentional redundancy, removal of "required" constraint, and illogical response combinations. This allowed for up to 11 identifiable errors to be made per survey. The error rate was defined as the total number of errors committed divided by the number of potential errors. We summarized crude error rates and estimated changes in error rates over time for both individuals and the entire program using logistic regression. The aggregate error rate was 1.60% (125/7817). Error rates did not differ significantly between enumerators (P=.51), but decreased for the cohort with increasing days of application use, from 2.3% at survey start (95% CI 1

Bridge condition assessment and load rating using dynamic response.

DOT National Transportation Integrated Search

2014-07-01

This report describes a method for the overall condition assessment and load rating of prestressed box beam : (PSBB) bridges based on their dynamic response collected through wireless sensor networks (WSNs). Due to a : large inventory of deficient an...

Construct Validity and Reliability of College Students' Responses to the Reasons for Smoking Scale

ERIC Educational Resources Information Center

Fiala, Kelly Ann; D'Abundo, Michelle Lee; Marinaro, Laura Marie

2010-01-01

When utilizing self-assessments to determine motives for health behaviors, it is essential that the resulting data demonstrate sound psychometric properties. The purpose of this research was to assess the reliability and construct validity of college students' responses to the Reasons for Smoking Scale (RFS). Confirmatory factor analyses and…

Phenobarbital for Neonatal Seizures: Response Rate and Predictors of Refractoriness.

PubMed

Spagnoli, Carlotta; Seri, Stefano; Pavlidis, Elena; Mazzotta, Silvia; Pelosi, Annalisa; Pisani, Francesco

2016-10-01

Background Phenobarbital is the first-line choice for neonatal seizures treatment, despite a response rate of approximately 45%. Failure to respond to acute anticonvulsants is associated with poor neurodevelopmental outcome, but knowledge on predictors of refractoriness is limited. Objective To quantify response rate to phenobarbital and to establish variables predictive of its lack of efficacy. Methods We retrospectively evaluated newborns with electrographically confirmed neonatal seizures admitted between January 1999 and December 2012 to the neonatal intensive care unit of Parma University Hospital (Italy), excluding neonates with status epilepticus. Response was categorized as complete (cessation of clinical and electrographic seizures after phenobarbital administration), partial (reduction but not cessation of electrographic seizures with the first bolus, response to the second bolus), or absent (no response after the second bolus). Multivariate analysis was used to identify independent predictors of refractoriness. Results Out of 91 newborns receiving phenobarbital, 57 (62.6%) responded completely, 15 (16.5%) partially, and 19 (20.9%) did not respond. Seizure type (p = 0.02), background electroencephalogram (EEG; p ≤ 0.005), and neurologic examination (p  ≤  0.005) correlated with response to phenobarbital. However, EEG (p  ≤  0.02) and seizure type (p  ≤  0.001) were the only independent predictors. Conclusion Our results suggest a prominent role of neurophysiological variables (background EEG and electrographic-only seizure type) in predicting the absence of response to phenobarbital in high-risk newborns. Georg Thieme Verlag KG Stuttgart · New York.

The Childhood Cancer Survivor Study-Neurocognitive Questionnaire (CCSS-NCQ) Revised: Item Response Analysis and Concurrent Validity

PubMed Central

Kenzik, Kelly M.; Huang, I-Chan; Brinkman, Tara M.; Baughman, Brandon; Ness, Kirsten K.; Shenkman, Elizabeth A.; Hudson, Melissa M.; Robison, Leslie L.; Krull, Kevin R.

2014-01-01

Objective Childhood cancer survivors are at risk for neurocognitive impairment related to cancer diagnosis or treatment. This study refined and further validated the Childhood Cancer Survivor Study Neurocognitive Questionnaire (CCSS-NCQ), a scale developed to screen for impairment in long-term survivors of childhood cancer. Method Items related to task efficiency, memory, organization and emotional regulation domains were examined using item response theory (IRT). Data were collected from 833 adult survivors of childhood cancer in the St. Jude Lifetime Cohort Study who completed self-report and direct neurocognitive testing. The revision process included: 1) content validity mapping of items to domains, 2) constructing a revised CCSS-NCQ, 3) selecting items within specific domains using IRT, and 4) evaluating concordance between the revised CCSS-NCQ and direct neurocognitive assessment. Results Using content and measurement properties, 32 items were retained (8 items in 4 domains). Items captured low to middle levels of neurocognitive concerns. The latent domain scores demonstrated poor convergent/divergent validity with the direct assessments. Adjusted effect sizes (Cohen's d) for agreement between self-reported memory and direct memory assessment were moderate for total recall (ES=0.66), long-term memory (ES=0.63), and short-term memory (ES=0.55). Effect sizes between self-rated task efficiency and direct assessment of attention were moderate for focused attention (ES=0.70) and attention span (ES=0.50), but small for sustained attention (ES=0.36). Cranial radiation therapy and female gender were associated with lower self-reported neurocognitive function. Conclusion The revised CCSS-NCQ demonstrates adequate measurement properties for assessing day-to-day neurocognitive concerns in childhood cancer survivors, and adds useful information to direct assessment. PMID:24933482

What Response Rates Are Needed to Make Reliable Inferences from Student Evaluations of Teaching?

ERIC Educational Resources Information Center

Zumrawi, Abdel Azim; Bates, Simon P.; Schroeder, Marianne

2014-01-01

This paper addresses the determination of statistically desirable response rates in students' surveys, with emphasis on assessing the effect of underlying variability in the student evaluation of teaching (SET). We discuss factors affecting the determination of adequate response rates and highlight challenges caused by non-response and lack of…

Improving response rate and quality of survey data with a scratch lottery ticket incentive

PubMed Central

2012-01-01

Background The quality of data collected in survey research is usually indicated by the response rate; the representativeness of the sample, and; the rate of completed questions (item-response). In attempting to improve a generally declining response rate in surveys considerable efforts are being made through follow-up mailings and various types of incentives. This study examines effects of including a scratch lottery ticket in the invitation letter to a survey. Method Questionnaires concerning oral health were mailed to a random sample of 2,400 adults. A systematically selected half of the sample (1,200 adults) received a questionnaire including a scratch lottery ticket. One reminder without the incentive was sent. Results The incentive increased the response rate and improved representativeness by reaching more respondents with lower education. Furthermore, it reduced item nonresponse. The initial incentive had no effect on the propensity to respond after the reminder. Conclusion When attempting to improve survey data, three issues become important: response rate, representativeness, and item-response. This study shows that including a scratch lottery ticket in the invitation letter performs well on all the three. PMID:22515335

Identifying Gifted Students in Puerto Rico: Validation of a Spanish Translation of the Gifted Rating Scales

ERIC Educational Resources Information Center

Rosado, Javier I.; Pfeiffer, Steven; Petscher, Yaacov

2015-01-01

The challenge of correctly identifying gifted students is a critical issue. Gifted education in Puerto Rico is marked by insufficient support and a lack of appropriate identification methods. This study examined the reliability and validity of a Spanish translation of the "Gifted Rating Scales-School Form" (GRS) with a sample of 618…

Validation of RNAi Silencing Efficiency Using Gene Array Data shows 18.5% Failure Rate across 429 Independent Experiments.

PubMed

Munkácsy, Gyöngyi; Sztupinszki, Zsófia; Herman, Péter; Bán, Bence; Pénzváltó, Zsófia; Szarvas, Nóra; Győrffy, Balázs

2016-09-27

No independent cross-validation of success rate for studies utilizing small interfering RNA (siRNA) for gene silencing has been completed before. To assess the influence of experimental parameters like cell line, transfection technique, validation method, and type of control, we have to validate these in a large set of studies. We utilized gene chip data published for siRNA experiments to assess success rate and to compare methods used in these experiments. We searched NCBI GEO for samples with whole transcriptome analysis before and after gene silencing and evaluated the efficiency for the target and off-target genes using the array-based expression data. Wilcoxon signed-rank test was used to assess silencing efficacy and Kruskal-Wallis tests and Spearman rank correlation were used to evaluate study parameters. All together 1,643 samples representing 429 experiments published in 207 studies were evaluated. The fold change (FC) of down-regulation of the target gene was above 0.7 in 18.5% and was above 0.5 in 38.7% of experiments. Silencing efficiency was lowest in MCF7 and highest in SW480 cells (FC = 0.59 and FC = 0.30, respectively, P = 9.3E-06). Studies utilizing Western blot for validation performed better than those with quantitative polymerase chain reaction (qPCR) or microarray (FC = 0.43, FC = 0.47, and FC = 0.55, respectively, P = 2.8E-04). There was no correlation between type of control, transfection method, publication year, and silencing efficiency. Although gene silencing is a robust feature successfully cross-validated in the majority of experiments, efficiency remained insufficient in a significant proportion of studies. Selection of cell line model and validation method had the highest influence on silencing proficiency.

Validation of Social Cognition Rating Tools in Indian Setting (SOCRATIS): A new test-battery to assess social cognition.

PubMed

Mehta, Urvakhsh M; Thirthalli, Jagadisha; Naveen Kumar, C; Mahadevaiah, Mahesh; Rao, Kiran; Subbakrishna, Doddaballapura K; Gangadhar, Bangalore N; Keshavan, Matcheri S

2011-09-01

Social cognition is a cognitive domain that is under substantial cultural influence. There are no culturally appropriate standardized tools in India to comprehensively test social cognition. This study describes validation of tools for three social cognition constructs: theory of mind, social perception and attributional bias. Theory of mind tests included adaptations of, (a) two first order tasks [Sally-Anne and Smarties task], (b) two second order tasks [Ice cream van and Missing cookies story], (c) two metaphor-irony tasks and (d) the faux pas recognition test. Internal, Personal, and Situational Attributions Questionnaire (IPSAQ) and Social Cue Recognition Test were adapted to assess attributional bias and social perception, respectively. These tests were first modified to suit the Indian cultural context without changing the constructs to be tested. A panel of experts then rated the tests on likert scales as to (1) whether the modified tasks tested the same construct as in the original and (2) whether they were culturally appropriate. The modified tests were then administered to groups of actively symptomatic and remitted schizophrenia patients as well as healthy comparison subjects. All tests of the Social Cognition Rating Tools in Indian Setting had good content validity and known groups validity. In addition, the social cure recognition test in Indian setting had good internal consistency and concurrent validity. Copyright © 2011 Elsevier B.V. All rights reserved.

Effect of response format on cognitive reflection: Validating a two- and four-option multiple choice question version of the Cognitive Reflection Test.

PubMed

Sirota, Miroslav; Juanchich, Marie

2018-03-27

The Cognitive Reflection Test, measuring intuition inhibition and cognitive reflection, has become extremely popular because it reliably predicts reasoning performance, decision-making, and beliefs. Across studies, the response format of CRT items sometimes differs, based on the assumed construct equivalence of tests with open-ended versus multiple-choice items (the equivalence hypothesis). Evidence and theoretical reasons, however, suggest that the cognitive processes measured by these response formats and their associated performances might differ (the nonequivalence hypothesis). We tested the two hypotheses experimentally by assessing the performance in tests with different response formats and by comparing their predictive and construct validity. In a between-subjects experiment (n = 452), participants answered stem-equivalent CRT items in an open-ended, a two-option, or a four-option response format and then completed tasks on belief bias, denominator neglect, and paranormal beliefs (benchmark indicators of predictive validity), as well as on actively open-minded thinking and numeracy (benchmark indicators of construct validity). We found no significant differences between the three response formats in the numbers of correct responses, the numbers of intuitive responses (with the exception of the two-option version, which had a higher number than the other tests), and the correlational patterns of the indicators of predictive and construct validity. All three test versions were similarly reliable, but the multiple-choice formats were completed more quickly. We speculate that the specific nature of the CRT items helps build construct equivalence among the different response formats. We recommend using the validated multiple-choice version of the CRT presented here, particularly the four-option CRT, for practical and methodological reasons. Supplementary materials and data are available at https://osf.io/mzhyc/ .

Measuring Constructs in Family Science: How Can Item Response Theory Improve Precision and Validity?

ERIC Educational Resources Information Center

Gordon, Rachel A.

2015-01-01

This article provides family scientists with an understanding of contemporary measurement perspectives and the ways in which item response theory (IRT) can be used to develop measures with desired evidence of precision and validity for research uses. The article offers a nontechnical introduction to some key features of IRT, including its…

Neural responses to sounds presented on and off the beat of ecologically valid music

PubMed Central

Tierney, Adam; Kraus, Nina

2013-01-01

The tracking of rhythmic structure is a vital component of speech and music perception. It is known that sequences of identical sounds can give rise to the percept of alternating strong and weak sounds, and that this percept is linked to enhanced cortical and oscillatory responses. The neural correlates of the perception of rhythm elicited by ecologically valid, complex stimuli, however, remain unexplored. Here we report the effects of a stimulus' alignment with the beat on the brain's processing of sound. Human subjects listened to short popular music pieces while simultaneously hearing a target sound. Cortical and brainstem electrophysiological onset responses to the sound were enhanced when it was presented on the beat of the music, as opposed to shifted away from it. Moreover, the size of the effect of alignment with the beat on the cortical response correlated strongly with the ability to tap to a beat, suggesting that the ability to synchronize to the beat of simple isochronous stimuli and the ability to track the beat of complex, ecologically valid stimuli may rely on overlapping neural resources. These results suggest that the perception of musical rhythm may have robust effects on processing throughout the auditory system. PMID:23717268

High Strain-Rate and Temperature Effects on the Response of Composites

NASA Technical Reports Server (NTRS)

Gilat, Amos

2004-01-01

The objective of the research is to expand the experimental study of the effect of strain rate on mechanical response (deformation and failure) of epoxy resins and carbon fibers/epoxy matrix composites, to include elevated temperature tests. The experimental data provide the information needed for NASA scientists for the development of a nonlinear, strain rate and temperature dependent deformation and strength models for composites that can subsequently be used in design. This year effort was directed into the development and testing of the epoxy resin at elevated temperatures. Two types of epoxy resins were tested in shear at high strain rates of about 700 per second and elevated temperatures of 50 and 80 C. The results show that the temperature significantly affects the response of epoxy.

Utility of the response bias scale (RBS) and other MMPI-2 validity scales in predicting TOMM performance.

PubMed

Whitney, Kriscinda A; Davis, Jeremy J; Shepard, Polly H; Herman, Steven M

2008-01-01

The present study represents a replication and extension of the original Response Bias Scale (RBS) validation study. In addition to examining the relationship between the Test of Memory Malingering (TOMM), RBS, and several other well-researched Minnesota Multiphasic Personality Inventory 2 (MMPI-2) validity scales (i.e., F, Fb, Fp, and the Fake Bad Scale), the present study also included the recently developed Infrequency Post-Traumatic Stress Disorder Scale and the Henry-Heilbronner Index (HHI) of the MMPI-2. Findings from this retrospective data analysis (N=46) demonstrated the superiority of the RBS, and to a certain extent the HHI, over other MMPI-2 validity scales in predicting TOMM failure within the outpatient Veterans Affairs population. Results of the current study confirm the clinical utility of the RBS and suggest that, particularly if the MMPI-2 is an existing part of the neuropsychological assessment, examination of RBS scores is an efficient means of detecting negative response bias.

The effectiveness of recruitment strategies on general practitioner's survey response rates - a systematic review.

PubMed

Pit, Sabrina Winona; Vo, Tham; Pyakurel, Sagun

2014-06-06

Low survey response rates in general practice are common and lead to loss of power, selection bias, unexpected budgetary constraints and time delays in research projects. To assess the effectiveness of recruitment strategies aimed at increasing survey response rates among GPs. Systematic review. MEDLINE (OVIDSP, 1948-2012), EMBASE (OVIDSP, 1980-2012), Evidence Based Medicine Reviews (OVIDSP, 2012) and references of included papers were searched. Major search terms included GPs, recruitment strategies, response rates, and randomised controlled trials (RCT). Cluster RCTs, RCTs and factorial trial designs that evaluate recruitment strategies aimed at increasing GP survey response rates. Abstracts identified by the search strategy were reviewed and relevant articles were retrieved. Each full-text publication was examined to determine whether it met the predetermined inclusion criteria. Data extraction and study quality was assessed by using predetermined checklists. Monetary and nonmonetary incentives were more effective than no incentive with monetary incentives having a slightly bigger effect than nonmonetary incentives. Large incentives were more effective than small incentives, as were upfront monetary incentives compared to promised monetary incentives. Postal surveys were more effective than telephone or email surveys. One study demonstrated that sequentially mixed mode (online survey followed by a paper survey with a reminder) was more effective than an online survey or the combination of an online and paper survey sent similtaneously in the first mail out. Pre-contact with a phonecall from a peer, personalised packages, sending mail on Friday, and using registered mail also increased response rates in single studies. Pre-contact by letter or postcard almost reached statistical signficance. GP survey response rates may improve by using the following strategies: monetary and nonmonetary incentives, larger incentives, upfront monetary incentives, postal surveys

Design and Validation of High Date Rate Ka-Band Software Defined Radio for Small Satellite

NASA Technical Reports Server (NTRS)

Xia, Tian

2016-01-01

The Design and Validation of High Date Rate Ka- Band Software Defined Radio for Small Satellite project will develop a novel Ka-band software defined radio (SDR) that is capable of establishing high data rate inter-satellite links with a throughput of 500 megabits per second (Mb/s) and providing millimeter ranging precision. The system will be designed to operate with high performance and reliability that is robust against various interference effects and network anomalies. The Ka-band radio resulting from this work will improve upon state of the art Ka-band radios in terms of dimensional size, mass and power dissipation, which limit their use in small satellites.

Content validation of behaviours and autonomic responses for the assessment of pain in critically ill adults with a brain injury.

PubMed

Gélinas, Céline; Puntillo, Kathleen A; Boitor, Madalina; Bérubé, Mélanie; Topolovec-Vranic, Jane; Ramelet, Anne-Sylvie; Joffe, Aaron M; Richard-Lalonde, Melissa; Bernard, Francis; Streiner, David L

2018-05-01

The evidence shows that brain-injured patients express behaviours that are related to their level of consciousness (LOC), and different from other patients in the intensive care unit (ICU). Therefore, existing behavioural scales should be revised to enhance their content and validity for use in these patients. The aim was to evaluate the content relevance of behaviours and autonomic responses for pain assessment of brain-injured ICU patients from the perspective of critical care clinicians. A total of 77 clinicians from four adult neuroscience ICUs (three from Canada and one from the United States) participated in this descriptive study. A physician/nurse ratio of 21% (13/61) was reached in this quota sample, and three physiotherapists also participated. They completed a content validation questionnaire of 19 items rated on clarity and relevance based on the patient's LOC. Item Content Validity Index (I-CVI), and modified kappa (κ*) were calculated. Values higher than 0.78 and 0.75 respectively were considered excellent. Regardless of the patient's LOC, brow lowering, grimacing, and trying to reach the pain site were rated as the most relevant behaviours by clinicians, with excellent values of I-CVI>0.78 and κ*>0.75. Eyes tightly closed, moaning and verbal complaints of pain also obtained excellent values in altered LOC and conscious patients. Eye weeping obtained excellent values only in conscious patients. Other items showed fair (0.40-0.59) to good (0.60-0.74) values, while blinking and coughing showed poor values (<0.40) at various LOC. Facial expressions, movements towards the pain site, and vocalisation of pain were the most relevant pain-related behaviours rated by critical care clinicians. The relevance of some behaviours (e.g., moaning and verbal complaints of pain) varied across LOCs, thereby calling forth adaptations of behavioural pain scales to allow for interpretation in the context of a patient's LOC and ability to express specific behaviours

Influences of Response Rate and Distribution on the Calculation of Interobserver Reliability Scores

ERIC Educational Resources Information Center

Rolider, Natalie U.; Iwata, Brian A.; Bullock, Christopher E.

2012-01-01

We examined the effects of several variations in response rate on the calculation of total, interval, exact-agreement, and proportional reliability indices. Trained observers recorded computer-generated data that appeared on a computer screen. In Study 1, target responses occurred at low, moderate, and high rates during separate sessions so that…

Reproducibility, validity, and responsiveness of the hip outcome score in patients with end-stage hip osteoarthritis.

PubMed

Naal, Florian D; Impellizzeri, Franco M; von Eisenhart-Rothe, Rüdiger; Mannion, Anne F; Leunig, Michael

2012-11-01

To evaluate reproducibility, validity, and responsiveness of the Hip Outcome Score (HOS) in patients with end-stage hip osteoarthritis. In a cohort of 157 consecutive patients (mean age 66 years; 79 women) undergoing total hip replacement, the HOS was tested for the following measurement properties: feasibility (percentage of evaluable questionnaires), reproducibility (intraclass correlation coefficient [ICC] and standard error of measurement [SEM]), construct validity (correlation with the Western Ontario and McMaster Universities Osteoarthritis Index [WOMAC], Oxford Hip Score [OHS], Short Form 12 health survey, and University of California, Los Angeles activity scale), internal consistency (Cronbach's alpha), factorial validity (factor analysis), floor and ceiling effects, and internal and external responsiveness at 6 months after surgery (standardized response mean and change score correlations). Missing items occurred frequently. Five percent to 6% of the HOS activities of daily living (ADL) subscales and 20-32% of the sport subscales could not be scored. ICCs were 0.92 for both subscales. SEMs were 1.8 points (ADL subscale) and 2.3 points (sport subscale). Highest correlations were found with the OHS (r = 0.81 for ADL subscale and r = 0.58 for sport subscale) and the WOMAC physical function subscale (r = 0.83 for ADL subscale and r = 0.56 for sport subscale). Cronbach's alpha was 0.93 and 0.88 for the ADL and sport subscales, respectively. Neither unidimensionality of the subscales nor the 2-factor structure was supported by factor analysis. Both subscales showed good internal and external responsiveness. The HOS is reproducible and responsive when assessing patients with end-stage hip osteoarthritis in whom the items are relevant. However, based on the large proportion of missing data and the findings of the factor analysis, we cannot recommend this questionnaire for routine use in this target group. Copyright © 2012 by the American College of Rheumatology.

Exploring how to increase response rates to surveys of older people.

PubMed

Palonen, Mira; Kaunonen, Marja; Åstedt-Kurki, Päivi

2016-05-01

To address the special considerations that need to be taken into account when collecting data from older people in healthcare research. An objective of all research studies is to ensure there is an adequate sample size. The final sample size will be influenced by methods of recruitment and data collection, among other factors. There are some special considerations that need to be addressed when collecting data among older people. Quantitative surveys of people aged 60 or over in 2009-2014 were analysed using statistical methods. A quantitative study of patients aged 75 or over in an emergency department was used as an example. A methodological approach to analysing quantitative studies concerned with older people. The best way to ensure high response rates in surveys involving people aged 60 or over is to collect data in the presence of the researcher; response rates are lowest in posted surveys and settings where the researcher is not present when data are collected. Response rates do not seem to vary according to the database from which information about the study participants is obtained or according to who is responsible for recruitment to the survey. Implications for research/practice To conduct coherent studies with older people, the data collection process should be carefully considered.

An Investigation of the Validity and Reliability of the Adapted Mathematics Anxiety Rating Scale-Short Version (MARS-SV) among Turkish Students

ERIC Educational Resources Information Center

Baloglu, Mustafa

2010-01-01

This study adapted the Mathematics Anxiety Rating Scale-Short Version (MARS-SV) into Turkish and investigated the validity and reliability of the adapted instrument. Twenty-five bilingual experts agreed on the language validity, and 49 Turkish language experts agreed on the conformity and understandability of the scale's items. Thirty-two subject…

Development and validation of a brief general and sports nutrition knowledge questionnaire and assessment of athletes' nutrition knowledge.

PubMed

Trakman, Gina Louise; Forsyth, Adrienne; Hoye, Russell; Belski, Regina

2018-01-01

The Nutrition for Sport Knowledge Questionnaire (NSKQ) is an 89-item, valid and reliable measure of sports nutrition knowledge (SNK). It takes 25 min to complete and has been subject to low completion and response rates. The aim of this study was to develop an abridged version of the NSKQ (A-NSKQ) and compare response rates, completion rates and NK scores of the NSKQ and A-NSKQ. Rasch analysis was used for the questionnaire validation. The sample ( n  = 181) was the same sample that was used in the validation of the full-length NSKQ. Construct validity was assessed using the known-group comparisons method. Temporal stability was assessed using the test-retest reliability method. NK assessment was cross-sectional; responses were collected electronically from members of one non-elite Australian football (AF) and netball club, using Qualtrics Software (Qualtrics, Provo, UT). Validation - The A-NSKQ has 37 items that assess general ( n  = 17) and sports ( n  = 20) nutrition knowledge (NK). Both sections are unidimensional (Perc5% = 2.84% [general] and 3.41% [sport]). Both sections fit the Rasch Model (overall-interaction statistic mean (SD) = - 0.15 ± 0.96 [general] and 0.22 ± 1.11 [sport]; overall-person interaction statistic mean (SD) = - 0.11 ± 0.61 [general] and 0.08 ± 0.73 [sport]; Chi-Square probability = 0.308 [general] and 0.283 [sport]). Test-retest reliability was confirmed ( r  = 0.8, P  < 0.001 [general] and r  = 0.7, P < 0.001 [sport]). Construct validity was demonstrated (nutrition students = 77% versus non-nutrition students = 60%, P < 0.001 [general] and nutrition students = 60% versus non-nutrition students = 40%, P < 0.001 [sport]. Assessment of NK - 177 usable survey responses from were returned. Response rates were low (7%) but completion rates were high (85%). NK scores on the A-NSKQ (46%) are comparable to results obtained in similar cohorts on the NSKQ

The relation between auditory-nerve temporal responses and perceptual rate integration in cochlear implants

PubMed Central

Hughes, Michelle L.; Baudhuin, Jacquelyn L.; Goehring, Jenny L.

2014-01-01

The purpose of this study was to examine auditory-nerve temporal response properties and their relation to psychophysical threshold for electrical pulse trains of varying rates (“rate integration”). The primary hypothesis was that better rate integration (steeper slope) would be correlated with smaller decrements in ECAP amplitude as a function of stimulation rate (shallower slope of the amplitude-rate function), reflecting a larger percentage of the neural population contributing more synchronously to each pulse in the train. Data were obtained for 26 ears in 23 cochlear-implant recipients. Electrically evoked compound action potential (ECAP) amplitudes were measured in response to each of 21 pulses in a pulse train for the following rates: 900, 1200, 1800, 2400, and 3500 pps. Psychophysical thresholds were obtained using a 3-interval, forced-choice adaptive procedure for 300-ms pulse trains of the same rates as used for the ECAP measures, which formed the rate-integration function. For each electrode, the slope of the psychophysical rate-integration function was compared to the following ECAP measures: (1) slope of the function comparing average normalized ECAP amplitude across pulses versus stimulation rate (“adaptation”), (2) the rate that produced the maximum alternation depth across the pulse train, and (3) rate at which the alternating pattern ceased (stochastic rate). Results showed no significant relations between the slope of the rate-integration function and any of the ECAP measures when data were collapsed across subjects. However, group data showed that both threshold and average ECAP amplitude decreased with increased stimulus rate, and within-subject analyses showed significant positive correlations between psychophysical thresholds and mean ECAP response amplitudes across the pulse train. These data suggest that ECAP temporal response patterns are complex and further study is required to better understand the relative contributions of

Validating genetic markers of response to recombinant human growth hormone in children with growth hormone deficiency and Turner syndrome: the PREDICT validation study

PubMed Central

Stevens, Adam; Murray, Philip; Wojcik, Jerome; Raelson, John; Koledova, Ekaterina; Chatelain, Pierre

2016-01-01

Objective Single-nucleotide polymorphisms (SNPs) associated with the response to recombinant human growth hormone (r-hGH) have previously been identified in growth hormone deficiency (GHD) and Turner syndrome (TS) children in the PREDICT long-term follow-up (LTFU) study (Nbib699855). Here, we describe the PREDICT validation (VAL) study (Nbib1419249), which aimed to confirm these genetic associations. Design and methods Children with GHD (n = 293) or TS (n = 132) were recruited retrospectively from 29 sites in nine countries. All children had completed 1 year of r-hGH therapy. 48 SNPs previously identified as associated with first year growth response to r-hGH were genotyped. Regression analysis was used to assess the association between genotype and growth response using clinical/auxological variables as covariates. Further analysis was undertaken using random forest classification. Results The children were younger, and the growth response was higher in VAL study. Direct genotype analysis did not replicate what was found in the LTFU study. However, using exploratory regression models with covariates, a consistent relationship with growth response in both VAL and LTFU was shown for four genes – SOS1 and INPPL1 in GHD and ESR1 and PTPN1 in TS. The random forest analysis demonstrated that only clinical covariates were important in the prediction of growth response in mild GHD (>4 to <10 μg/L on GH stimulation test), however, in severe GHD (≤4 μg/L) several SNPs contributed (in IGF2, GRB10, FOS, IGFBP3 and GHRHR). Conclusions The PREDICT validation study supports, in an independent cohort, the association of four of 48 genetic markers with growth response to r-hGH treatment in both pre-pubertal GHD and TS children after controlling for clinical/auxological covariates. However, the contribution of these SNPs in a prediction model of first-year response is not sufficient for routine clinical use. PMID:27651465

Validating genetic markers of response to recombinant human growth hormone in children with growth hormone deficiency and Turner syndrome: the PREDICT validation study.

PubMed

Stevens, Adam; Murray, Philip; Wojcik, Jerome; Raelson, John; Koledova, Ekaterina; Chatelain, Pierre; Clayton, Peter

2016-12-01

Single-nucleotide polymorphisms (SNPs) associated with the response to recombinant human growth hormone (r-hGH) have previously been identified in growth hormone deficiency (GHD) and Turner syndrome (TS) children in the PREDICT long-term follow-up (LTFU) study (Nbib699855). Here, we describe the PREDICT validation (VAL) study (Nbib1419249), which aimed to confirm these genetic associations. Children with GHD (n = 293) or TS (n = 132) were recruited retrospectively from 29 sites in nine countries. All children had completed 1 year of r-hGH therapy. 48 SNPs previously identified as associated with first year growth response to r-hGH were genotyped. Regression analysis was used to assess the association between genotype and growth response using clinical/auxological variables as covariates. Further analysis was undertaken using random forest classification. The children were younger, and the growth response was higher in VAL study. Direct genotype analysis did not replicate what was found in the LTFU study. However, using exploratory regression models with covariates, a consistent relationship with growth response in both VAL and LTFU was shown for four genes - SOS1 and INPPL1 in GHD and ESR1 and PTPN1 in TS. The random forest analysis demonstrated that only clinical covariates were important in the prediction of growth response in mild GHD (>4 to <10 μg/L on GH stimulation test), however, in severe GHD (≤4 μg/L) several SNPs contributed (in IGF2, GRB10, FOS, IGFBP3 and GHRHR). The PREDICT validation study supports, in an independent cohort, the association of four of 48 genetic markers with growth response to r-hGH treatment in both pre-pubertal GHD and TS children after controlling for clinical/auxological covariates. However, the contribution of these SNPs in a prediction model of first-year response is not sufficient for routine clinical use. © 2016 European Society of Endocrinology.

Self-reported eating rate is associated with weight status in a Dutch population: a validation study and a cross-sectional study.

PubMed

van den Boer, Janet H W; Kranendonk, Jentina; van de Wiel, Anne; Feskens, Edith J M; Geelen, Anouk; Mars, Monica

2017-09-08

Observational studies performed in Asian populations suggest that eating rate is related to BMI. This paper investigates the association between self-reported eating rate (SRER) and body mass index (BMI) in a Dutch population, after having validated SRER against actual eating rate. Two studies were performed; a validation and a cross-sectional study. In the validation study SRER (i.e., 'slow', 'average', or 'fast') was obtained from 57 participants (men/women = 16/41, age: mean ± SD = 22.6 ± 2.8 yrs., BMI: mean ± SD = 22.1 ± 2.8 kg/m 2 ) and in these participants actual eating rate was measured for three food products. Using analysis of variance the association between SRER and actual eating rate was studied. The association between SRER and BMI was investigated in cross-sectional data from the NQplus cohort (i.e., 1473 Dutch adults; men/women = 741/732, age: mean ± SD = 54.6 ± 11.7 yrs., BMI: mean ± SD = 25.9 ± 4.0 kg/m 2 ) using (multiple) linear regression analysis. In the validation study actual eating rate increased proportionally with SRER (for all three food products P < 0.01). In the cross-sectional study SRER was positively associated with BMI in both men and women (P = 0.03 and P < 0.001, respectively). Self-reported fast-eating women had a 1.13 kg/m 2 (95% CI 0.43, 1.84) higher BMI compared to average-speed-eating women, after adjusting for confounders. This was not the case in men; self-reported fast-eating men had a 0.29 kg/m 2 (95% CI -0.22, 0.80) higher BMI compared to average-speed-eating men, after adjusting for confounders. These studies show that self-reported eating rate reflects actual eating rate on a group-level, and that a high self-reported eating rate is associated with a higher BMI in this Dutch population.

The rate dependent response of a bistable chain at finite temperature

NASA Astrophysics Data System (ADS)

Benichou, Itamar; Zhang, Yaojun; Dudko, Olga K.; Givli, Sefi

2016-10-01

We study the rate dependent response of a bistable chain subjected to thermal fluctuations. The study is motivated by the fact that the behavior of this model system is prototypical to a wide range of nonlinear processes in materials physics, biology and chemistry. To account for the stochastic nature of the system response, we formulate a set of governing equations for the evolution of the probability density of meta-stable configurations. Based on this approach, we calculate the behavior for a wide range of parametric values, such as rate, temperature, overall stiffness, and number of elements in the chain. Our results suggest that fundamental characteristics of the response, such as average transition stress and hysteresis, can be captured by a simple law which folds the influence of all these factors into a single non-dimensional quantity. We also show that the applicability of analytical results previously obtained for single-well systems can be extended to systems having multiple wells by proper definition of rate and of the transition stress.

Invited commentary: Evaluating epidemiologic research methods--the importance of response rate calculation.

PubMed

Harris, M Anne

2010-09-15

Epidemiologic research that uses administrative records (rather than registries or clinical surveys) to identify cases for study has been increasingly restricted because of concerns about privacy, making unbiased population-based research less practicable. In their article, Nattinger et al. (Am J Epidemiol. 2010;172(6):637-644) present a method for using administrative data to contact participants that has been well received. However, the methods employed for calculating and reporting response rates require further consideration, particularly the classification of untraceable cases as ineligible. Depending on whether response rates are used to evaluate the potential for bias to influence study results or to evaluate the acceptability of the method of contact, different fractions may be considered. To improve the future study of epidemiologic research methods, a consensus on the calculation and reporting of study response rates should be sought.

Measuring Depression at the End of Life: Is the Hamilton Depression Rating Scale a Valid Instrument?

ERIC Educational Resources Information Center

Olden, Megan; Rosenfeld, Barry; Pessin, Hayley; Breitbart, William

2009-01-01

Depression at the end of life is a common mental health issue with serious implications for quality of life and decision making. This study investigated the reliability and validity of one of the most frequently used measures of depression, the Hamilton Depression Rating Scale (HAM-D) in 422 patients with terminal cancer admitted to a palliative…

Validity and Reliability of Turkish Version of Gilliam Autism Rating Scale-2: Results of Preliminary Study

ERIC Educational Resources Information Center

Diken, Ibrahim H.; Diken, Ozlem; Gilliam, James E.; Ardic, Avsar; Sweeney, Dwight

2012-01-01

The purpose of this preliminary study was to explore the validity and reliability of Turkish Version of the Gilliam Autism Rating Scale-2 (TV-GARS-2). Participants included 436 children diagnosed with autism (331 male and 105 female, mean of ages was 8.01 with SD = 3.77). Data were also collected from individuals diagnosed with intellectual…

Slew-rate dependence of tracer magnetization response in magnetic particle imaging.

PubMed

Shah, Saqlain A; Ferguson, R M; Krishnan, K M

2014-10-28

Magnetic Particle Imaging (MPI) is a new biomedical imaging technique that produces real-time, high-resolution tomographic images of superparamagnetic iron oxide nanoparticle tracers. Currently, 25 kHz and 20 mT/μ 0 excitation fields are common in MPI, but lower field amplitudes may be necessary for patient safety in future designs. Here, we address fundamental questions about MPI tracer magnetization dynamics and predict tracer performance in future scanners that employ new combinations of excitation field amplitude ( H o ) and frequency ( ω ). Using an optimized, monodisperse MPI tracer, we studied how several combinations of drive field frequencies and amplitudes affect the tracer's response, using Magnetic Particle Spectrometry and AC hysteresis, for drive field conditions at 15.5, 26, and 40.2 kHz, with field amplitudes ranging from 7 to 52 mT/μ 0 . For both fluid and immobilized nanoparticle samples, we determined that magnetic response was dominated by Néel reversal. Furthermore, we observed that the peak slew-rate ( ωH o ) determined the tracer magnetic response. Smaller amplitudes provided correspondingly smaller field of view, sometimes resulting in excitation of minor hysteresis loops. Changing the drive field conditions but keeping the peak slew-rate constant kept the tracer response almost the same. Higher peak slew-rates led to reduced maximum signal intensity and greater coercivity in the tracer response. Our experimental results were in reasonable agreement with Stoner-Wohlfarth model based theories.

Reliability, validity, and responsiveness of the Persian version of Shoulder Activity Scale in a group of patients with shoulder disorders.

PubMed

Negahban, Hossein; Mohtasebi, Elham; Goharpey, Shahin

2015-01-01

The aim of this methodological study was to cross-culturally translate the Shoulder Activity Scale (SAS) into the Persian and determine its clinimetric properties including reliability, validity, and responsiveness in patients with shoulder disorders. Persian version of the SAS was obtained after standard forward-backward translation. Three questionnaires were completed by the respondents: SAS, shoulder pain and disability index (SPADI), and Short-Form 36 Health Survey (SF-36). The patients completed the SAS, 1 week after the first visit to evaluate the test-retest reliability. Construct validity was evaluated by examining the associations between the scores on the SAS and the scores obtained from the SPADI, SF-36, and age of the patients. To assess responsiveness, data were collected in the first visit and then again after 4 weeks physiotherapy intervention. Test-retest reliability and internal consistency were assessed using Intra-class Correlation Coefficient (ICC) and Cronbach's alpha, respectively. To evaluate construct validity, Spearman's rank correlation was used. The ability of the SAS to detect changes was evaluated by the receiver-operating characteristics method. No problem or language difficulties were reported during translation process. Test-retest reliability of the SAS was excellent with an ICC of 0.98. Also, the marginal Cronbach's alpha level of 0.64 was obtained. The correlation between the SAS and the SPADI was low, proving divergent validity, whereas the correlations between the SAS and the SF-36/age were moderate proving convergent validity. A marginally acceptable responsiveness was achieved for the Persian SAS. The study provides some evidences to support the test-retest reliability, internal consistency, construct validity, and responsiveness of the Persian version of the SAS in patients with shoulder disorders. Therefore, it seems that this instrument is a useful measure of shoulder activity level in research setting and clinical practice

Urdu translation of the Hamilton Rating Scale for Depression: Results of a validation study

PubMed Central

Hashmi, Ali M.; Naz, Shahana; Asif, Aftab; Khawaja, Imran S.

2016-01-01

Objective: To develop a standardized validated version of the Hamilton Rating Scale for Depression (HAM-D) in Urdu. Methods: After translation of the HAM-D into the Urdu language following standard guidelines, the final Urdu version (HAM-D-U) was administered to 160 depressed outpatients. Inter-item correlation was assessed by calculating Cronbach alpha. Correlation between HAM-D-U scores at baseline and after a 2-week interval was evaluated for test-retest reliability. Moreover, scores of two clinicians on HAM-D-U were compared for inter-rater reliability. For establishing concurrent validity, scores of HAM-D-U and BDI-U were compared by using Spearman correlation coefficient. The study was conducted at Mayo Hospital, Lahore, from May to December 2014. Results: The Cronbach alpha for HAM-D-U was 0.71. Composite scores for HAM-D-U at baseline and after a 2-week interval were also highly correlated with each other (Spearman correlation coefficient 0.83, p-value < 0.01) indicating good test-retest reliability. Composite scores for HAM-D-U and BDI-U were positively correlated with each other (Spearman correlation coefficient 0.85, p < 0.01) indicating good concurrent validity. Scores of two clinicians for HAM-D-U were also positively correlated (Spearman correlation coefficient 0.82, p-value < 0.01) indicated good inter-rater reliability. Conclusion: The HAM-D-U is a valid and reliable instrument for the assessment of Depression. It shows good inter-rater and test-retest reliability. The HAM-D-U can be a tool either for clinical management or research. PMID:28083049

Urdu translation of the Hamilton Rating Scale for Depression: Results of a validation study.

PubMed

Hashmi, Ali M; Naz, Shahana; Asif, Aftab; Khawaja, Imran S

2016-01-01

To develop a standardized validated version of the Hamilton Rating Scale for Depression (HAM-D) in Urdu. After translation of the HAM-D into the Urdu language following standard guidelines, the final Urdu version (HAM-D-U) was administered to 160 depressed outpatients. Inter-item correlation was assessed by calculating Cronbach alpha. Correlation between HAM-D-U scores at baseline and after a 2-week interval was evaluated for test-retest reliability. Moreover, scores of two clinicians on HAM-D-U were compared for inter-rater reliability. For establishing concurrent validity, scores of HAM-D-U and BDI-U were compared by using Spearman correlation coefficient. The study was conducted at Mayo Hospital, Lahore, from May to December 2014. The Cronbach alpha for HAM-D-U was 0.71. Composite scores for HAM-D-U at baseline and after a 2-week interval were also highly correlated with each other (Spearman correlation coefficient 0.83, p-value < 0.01) indicating good test-retest reliability. Composite scores for HAM-D-U and BDI-U were positively correlated with each other (Spearman correlation coefficient 0.85, p < 0.01) indicating good concurrent validity. Scores of two clinicians for HAM-D-U were also positively correlated (Spearman correlation coefficient 0.82, p-value < 0.01) indicated good inter-rater reliability. The HAM-D-U is a valid and reliable instrument for the assessment of Depression. It shows good inter-rater and test-retest reliability. The HAM-D-U can be a tool either for clinical management or research.

Test–retest reliability, validity, and minimum detectable change of visual analog, numerical rating, and verbal rating scales for measurement of osteoarthritic knee pain

PubMed Central

Alghadir, Ahmad H; Anwer, Shahnawaz; Iqbal, Amir; Iqbal, Zaheen Ahmed

2018-01-01

Objective Several scales are commonly used for assessing pain intensity. Among them, the numerical rating scale (NRS), visual analog scale (VAS), and verbal rating scale (VRS) are often used in clinical practice. However, no study has performed psychometric analyses of their reliability and validity in the measurement of osteoarthritic (OA) pain. Therefore, the present study examined the test–retest reliability, validity, and minimum detectable change (MDC) of the VAS, NRS, and VRS for the measurement of OA knee pain. In addition, the correlations of VAS, NRS, and VRS with demographic variables were evaluated. Methods The study included 121 subjects (65 women, 56 men; aged 40–80 years) with OA of the knee. Test–retest reliability of the VAS, NRS, and VRS was assessed during two consecutive visits in a 24 h interval. The validity was tested using Pearson’s correlation coefficients between the baseline scores of VAS, NRS, and VRS and the demographic variables (age, body mass index [BMI], sex, and OA grade). The standard error of measurement (SEM) and the MDC were calculated to assess statistically meaningful changes. Results The intraclass correlation coefficients of the VAS, NRS, and VRS were 0.97, 0.95, and 0.93, respectively. VAS, NRS, and VRS were significantly related to demographic variables (age, BMI, sex, and OA grade). The SEM of VAS, NRS, and VRS was 0.03, 0.48, and 0.21, respectively. The MDC of VAS, NRS, and VRS was 0.08, 1.33, and 0.58, respectively. Conclusion All the three scales had excellent test–retest reliability. However, the VAS was the most reliable, with the smallest errors in the measurement of OA knee pain. PMID:29731662

Using Rasch Analysis to Inform Rating Scale Development

ERIC Educational Resources Information Center

Van Zile-Tamsen, Carol

2017-01-01

The use of surveys, questionnaires, and rating scales to measure important outcomes in higher education is pervasive, but reliability and validity information is often based on problematic Classical Test Theory approaches. Rasch Analysis, based on Item Response Theory, provides a better alternative for examining the psychometric quality of rating…

Influence of strain rate on indentation response of porcine brain.

PubMed

Qian, Long; Zhao, Hongwei; Guo, Yue; Li, Yuanshang; Zhou, Mingxing; Yang, Liguo; Wang, Zhiwei; Sun, Yifan

2018-06-01

Knowledge of brain tissue mechanical properties may be critical for formulating hypotheses about some specific diseases mechanisms and its accurate simulations such as traumatic brain injury (TBI) and tumor growth. Compared to traditional tests (e.g. tensile and compression), indentation shows superiority by virtue of its pinpoint and nondestructive/quasi-nondestructive. As a viscoelastic material, the properties of brain tissue depend on the strain rate by definition. However most efforts focus on the aspect of velocity in the field of brain indentation, rather than strain rate. The influence of strain rate on indentation response of brain tissue is taken little attention. Further, by comparing different results from literatures, it is also obvious that strain rate rather than velocity is more appropriate to characterize mechanical properties of brain. In this paper, to systematically characterize the influence of strain rate, a series of indentation-relaxation tests n = 210) are performed on the cortex of porcine brain using a custom-designed indentation device. The mechanical response that correlates with indenter diameters, depths of indentation and velocities, is revealed for the indentation portion, and elastic behavior of brain tissue is analyzed as the function of strain rate. Similarly, a linear viscoelastic model with a Prony series is employed for the indentation-relaxation portion, wherein the brain tissue shows more viscous and responds more quickly with increasing strain rate. Understanding the effect of strain rate on mechanical properties of brain indentation may be far-reaching for brain injury biomechanics and accurate simulations, but be important for bridging between indentation results of different literatures. Copyright © 2018 Elsevier Ltd. All rights reserved.

[Design and validation of the CSR-Hospital-SP scale to measure corporate social responsibility].

PubMed

Mira, José Joaquín; Lorenzo, Susana; Navarro, Isabel; Pérez-Jover, Virtudes; Vitaller, Julián

2013-01-01

To design and validate a scale (CSR-Hospital-SP) to determine health professionals' views on the approach of management to corporate social responsibility (CSR) in their hospital. The literature was reviewed to identify the main CSR scales and select the dimensions to be evaluated. The initial version of the scale consisted of 25 items. A convenience sample of a minimum of 224 health professionals working in five public hospitals in five autonomous regions were invited to respond. Floor and ceiling effects, internal consistency, reliability, and construct validity were analyzed. A total of 233 health professionals responded. The CSR-Hospital-SP scale had 20 items grouped into four factors. The item-total correlation was higher than 0.30; all factor loadings were greater than 0.50; 59.57% of the variance was explained; Cronbach's alpha was 0.90; Spearman-Brown's coefficient was 0.82. The CSR-Hospital-SP scale is a tool designed for hospitals that implement accountability mechanisms and promote socially responsible management approaches. Copyright © 2012 SESPAS. Published by Elsevier Espana. All rights reserved.

Transcriptional responses to glucose at different glycolytic rates in Saccharomyces cerevisiae.

PubMed

Elbing, Karin; Ståhlberg, Anders; Hohmann, Stefan; Gustafsson, Lena

2004-12-01

The addition of glucose to Saccharomyces cerevisiae cells causes reprogramming of gene expression. Glucose is sensed by membrane receptors as well as (so far elusive) intracellular sensing mechanisms. The availability of four yeast strains that display different hexose uptake capacities allowed us to study glucose-induced effects at different glycolytic rates. Rapid glucose responses were observed in all strains able to take up glucose, consistent with intracellular sensing. The degree of long-term responses, however, clearly correlated with the glycolytic rate: glucose-stimulated expression of genes encoding enzymes of the lower part of glycolysis showed an almost linear correlation with the glycolytic rate, while expression levels of genes encoding gluconeogenic enzymes and invertase (SUC2) showed an inverse correlation. Glucose control of SUC2 expression is mediated by the Snf1-Mig1 pathway. Mig1 dephosphorylation upon glucose addition is known to lead to repression of target genes. Mig1 was initially dephosphorylated upon glucose addition in all strains able to take up glucose, but remained dephosphorylated only at high glycolytic rates. Remarkably, transient Mig1-dephosphorylation was accompanied by the repression of SUC2 expression at high glycolytic rates, but stimulated SUC2 expression at low glycolytic rates. This suggests that Mig1-mediated repression can be overruled by factors mediating induction via a low glucose signal. At low and moderate glycolytic rates, Mig1 was partly dephosphorylated both in the presence of phosphorylated, active Snf1, and unphosphorylated, inactive Snf1, indicating that Mig1 was actively phosphorylated and dephosphorylated simultaneously, suggesting independent control of both processes. Taken together, it appears that glucose addition affects the expression of SUC2 as well as Mig1 activity by both Snf1-dependent and -independent mechanisms that can now be dissected and resolved as early and late/sustained responses.

Short forms of the Schedule for Nonadaptive and Adaptive Personality (SNAP) for self- and collateral ratings: development, reliability, and validity.

PubMed

Harlan, E; Clark, L A

1999-06-01

Researchers and clinicians alike increasingly seek brief, reliable, and valid measures to obtain personality trait ratings from both selves and peers. We report the development of a paragraph-descriptor short form of a full-length personality assessment instrument, the Schedule for Nonadaptive and Adaptive Personality (SNAP) with both self- and other versions. Reliability and validity data were collected on a sample of 294 college students, from 90 of whom we also obtained parental ratings of their personality. Internal consistency reliability was good in both self- and parent data. The factorial structures of the self-report short and long forms were very similar. Convergence between parental ratings was moderately high. Self-parent convergence was variable, with lower agreement on scales assessing subjective distress than those assessing more observable behaviors; it also was stronger for higher order factors than for scales.

Validity of the Inbody 520™ to predict metabolic rate in apparently healthy adults.

PubMed

Salacinski, Amanda J; Howell, Steven M; Hill, Danielle L

2017-05-30

The present study seeks to assess the validity of the InBody 520™ device to predict RMR in apparently healthy adults relative to a metabolic cart (the standard, yet time intensive, method for determining resting metabolic rate). Twenty-six apparently healthy adults participated in the study. Predicted RMR (pRMR) was calculated by the InBody 520™ and measured RMR (mRMR) was determined by 30-minute gas analysis and ventilated hood system. Of the 78 measurement trials conducted, 64 yielded acceptable measurement trials. A Pearson product-moment correlation was used to determine the relationship between pRMR and mRMR (r = .87, P < .001). No significant difference existed between the pRMR (1650.89 ± 295.96 kcal) and mRMR (1675.36 ± 278.69 kcal) values (P =.19). Study findings suggest that the InBody520™ provides valid measurements of RMR in apparently healthy adults and can be an effective and efficient method for collecting data in a clinical setting.

Reliability, Validity, and Responsiveness of the Incremental Shuttle Walk Test in Patients With Interstitial Lung Disease.

PubMed

Singh, Sumedha; Moiz, Jamal Ali; Ali, Mir Shad; Talwar, Deepak

2018-05-11

To determine the reliability, validity, and responsiveness of the incremental shuttle walk test (ISWT) in patients with interstitial lung disease (ILD). This was a cross-sectional longitudinal study. Patients (n = 27, 10 males; mean age ± SD, 61 ± 9.8 y) with ILD of any etiology, who participated in an outpatient pulmonary rehabilitation (PR) program, were recruited. Reliability was determined by comparing the distance covered in meters between the ISWT-1 and the ISWT-2. Validity was assessed by correlating the distance covered in the ISWT-1, with the maximum oxygen consumption (VO2max) obtained through cardiopulmonary exercise testing and distance covered during the 6-min walk test (6MWT). Responsiveness was assessed by comparing the distance covered in the ISWT-3, undertaken after the completion of PR, to the ISWT-1. The distance covered was equivalent between the ISWT-1 (216.7 ± 64.9 m) and the ISWT-2 (220.7 ± 67.3 m), with an excellent intraclass correlation coefficient (ICC2,1 = 0.91; 95% CI, 0.81-0.95). The standard error of measurement and minimal detectable change at the 95% CI (MDC95) values for the ISWT were 19.5 m and 53.9m, respectively. There were significant correlations between the distance covered on the ISWT and VO2max (r = 0.79, P < .0001) and the distance covered on the 6MWT (r = 0.76, P < .0001). Following PR, the change in the ISWT distance showed large effect size (ES = 0.85) and standardized response mean (SRM = 1.58). The ISWT is a reliable, valid, and responsive measure of estimated functional capacity in patients with ILD.

Validity of using a work habits scale for the daily evaluation of nurse anesthetists' clinical performance while controlling for the leniencies of the rating anesthesiologists.

PubMed

Dexter, Franklin; Ledolter, Johannes; Hindman, Bradley J

2017-11-01

Anesthesiologists can provide psychometrically reliable daily evaluations of certified registered nurse anesthetist (CRNA) work habits for purposes of the mandatory ongoing professional practice evaluation (OPPE). Our goal was to evaluate the validity of assessing CRNA work habits. Observational study. Large teaching hospital. N=77 anesthesiologists evaluated work habits of N=67 CRNAs. The non-technical attribute of work habits was measured on a 6-item scale (e.g., 1="Only assumed responsibility when forced to, and failed to follow through consistently" versus 5="Consistently identified tasks and completed them efficiently and thoroughly"). One year of scores were used to assess validity. Each daily evaluation could also be accompanied by a written comment. Content analysis of comments was performed using two years of data. Statistical analyses were performed using mixed effects logistic regression, treating each anesthesiologist as a fixed effect to compensate for the leniency of their ratings. The N=77 anesthesiologists' response rate was 97.3%, obtained at a mean 2.93days after the request. The internal consistency of the scale was large: Cronbach's alpha 0.952. Controlling the false discovery rate at 5.0%, among the 67 CRNAs, 8 were significantly below average (each P≤0.0048) and 6 were above average (each P≤0.0018). During the 6months after CRNAs knew that their work habits scores would be used for OPPE, there were significant increases in the scores compared with the preceding 6months (odds ratio 1.93, P<0.0001). Greater CRNA's qualitative annual evaluation scores made by the chief CRNA, without knowledge of the work habit scores or comments, were associated with greater odds of the CRNA's leniency-adjusted work habit scores equaling 5.00 (odds ratio 1.53, P=0.0004). Comments of negative sentiment made by the anesthesiologists were associated with greater odds of the leniency-adjusted work habit scores being <5.00 (odds ratio 54.5, P<0.0001). Even though

Validation of cross-cultural child mental health and psychosocial research instruments: adapting the Depression Self-Rating Scale and Child PTSD Symptom Scale in Nepal

PubMed Central

2011-01-01

Background The lack of culturally adapted and validated instruments for child mental health and psychosocial support in low and middle-income countries is a barrier to assessing prevalence of mental health problems, evaluating interventions, and determining program cost-effectiveness. Alternative procedures are needed to validate instruments in these settings. Methods Six criteria are proposed to evaluate cross-cultural validity of child mental health instruments: (i) purpose of instrument, (ii) construct measured, (iii) contents of construct, (iv) local idioms employed, (v) structure of response sets, and (vi) comparison with other measurable phenomena. These criteria are applied to transcultural translation and alternative validation for the Depression Self-Rating Scale (DSRS) and Child PTSD Symptom Scale (CPSS) in Nepal, which recently suffered a decade of war including conscription of child soldiers and widespread displacement of youth. Transcultural translation was conducted with Nepali mental health professionals and six focus groups with children (n = 64) aged 11-15 years old. Because of the lack of child mental health professionals in Nepal, a psychosocial counselor performed an alternative validation procedure using psychosocial functioning as a criterion for intervention. The validation sample was 162 children (11-14 years old). The Kiddie-Schedule for Affective Disorders and Schizophrenia (K-SADS) and Global Assessment of Psychosocial Disability (GAPD) were used to derive indication for treatment as the external criterion. Results The instruments displayed moderate to good psychometric properties: DSRS (area under the curve (AUC) = 0.82, sensitivity = 0.71, specificity = 0.81, cutoff score ≥ 14); CPSS (AUC = 0.77, sensitivity = 0.68, specificity = 0.73, cutoff score ≥ 20). The DSRS items with significant discriminant validity were "having energy to complete daily activities" (DSRS.7), "feeling that life is not worth living" (DSRS.10), and "feeling

Modeling of Mitochondria Bioenergetics Using a Composable Chemiosmotic Energy Transduction Rate Law: Theory and Experimental Validation

PubMed Central

Chang, Ivan; Heiske, Margit; Letellier, Thierry; Wallace, Douglas; Baldi, Pierre

2011-01-01

Mitochondrial bioenergetic processes are central to the production of cellular energy, and a decrease in the expression or activity of enzyme complexes responsible for these processes can result in energetic deficit that correlates with many metabolic diseases and aging. Unfortunately, existing computational models of mitochondrial bioenergetics either lack relevant kinetic descriptions of the enzyme complexes, or incorporate mechanisms too specific to a particular mitochondrial system and are thus incapable of capturing the heterogeneity associated with these complexes across different systems and system states. Here we introduce a new composable rate equation, the chemiosmotic rate law, that expresses the flux of a prototypical energy transduction complex as a function of: the saturation kinetics of the electron donor and acceptor substrates; the redox transfer potential between the complex and the substrates; and the steady-state thermodynamic force-to-flux relationship of the overall electro-chemical reaction. Modeling of bioenergetics with this rate law has several advantages: (1) it minimizes the use of arbitrary free parameters while featuring biochemically relevant parameters that can be obtained through progress curves of common enzyme kinetics protocols; (2) it is modular and can adapt to various enzyme complex arrangements for both in vivo and in vitro systems via transformation of its rate and equilibrium constants; (3) it provides a clear association between the sensitivity of the parameters of the individual complexes and the sensitivity of the system's steady-state. To validate our approach, we conduct in vitro measurements of ETC complex I, III, and IV activities using rat heart homogenates, and construct an estimation procedure for the parameter values directly from these measurements. In addition, we show the theoretical connections of our approach to the existing models, and compare the predictive accuracy of the rate law with our experimentally

Modeling of mitochondria bioenergetics using a composable chemiosmotic energy transduction rate law: theory and experimental validation.

PubMed

Chang, Ivan; Heiske, Margit; Letellier, Thierry; Wallace, Douglas; Baldi, Pierre

2011-01-01

Mitochondrial bioenergetic processes are central to the production of cellular energy, and a decrease in the expression or activity of enzyme complexes responsible for these processes can result in energetic deficit that correlates with many metabolic diseases and aging. Unfortunately, existing computational models of mitochondrial bioenergetics either lack relevant kinetic descriptions of the enzyme complexes, or incorporate mechanisms too specific to a particular mitochondrial system and are thus incapable of capturing the heterogeneity associated with these complexes across different systems and system states. Here we introduce a new composable rate equation, the chemiosmotic rate law, that expresses the flux of a prototypical energy transduction complex as a function of: the saturation kinetics of the electron donor and acceptor substrates; the redox transfer potential between the complex and the substrates; and the steady-state thermodynamic force-to-flux relationship of the overall electro-chemical reaction. Modeling of bioenergetics with this rate law has several advantages: (1) it minimizes the use of arbitrary free parameters while featuring biochemically relevant parameters that can be obtained through progress curves of common enzyme kinetics protocols; (2) it is modular and can adapt to various enzyme complex arrangements for both in vivo and in vitro systems via transformation of its rate and equilibrium constants; (3) it provides a clear association between the sensitivity of the parameters of the individual complexes and the sensitivity of the system's steady-state. To validate our approach, we conduct in vitro measurements of ETC complex I, III, and IV activities using rat heart homogenates, and construct an estimation procedure for the parameter values directly from these measurements. In addition, we show the theoretical connections of our approach to the existing models, and compare the predictive accuracy of the rate law with our experimentally

Dependence of the phototropic response of Arabidopsis thaliana on fluence rate and wavelength

DOE Office of Scientific and Technical Information (OSTI.GOV)

Konjevic, R.; Steinitz, B.; Poff, K.L.

1989-12-01

In the phototropic response of Arabidopsis thaliana seedlings, the shape of the fluence-response relation depends on fluence rate and wavelength. At low fluence rates, the response to 450-nm light is characterized by a single maximum at about 0.3 {mu}mol{center dot}m{sup {minus}2}. At higher fluence rates, the response shows two distinct maxima, I and II, at 0.3 and 3.5 {mu}mol{center dot}m{sup {minus}2}, respectively. The response to 500-nm light shows a single maximum at 2 {mu}mol{center dot}m{sup {minus}2}, and the response to 510-nm light shows a single maximum at 4.5 {mu}mol{center dot}m{sup {minus}2}, independent of fluence rate. The response to 490-nm lightmore » shows a maximal at 4.5 {mu}mol{center dot}m{sup {minus}2} and a shoulder at about 0.6 {mu}mol{center dot}m{sup {minus}2}. Preirradiation with high-fluence 510-nm light from above, immediately followed by unilateral 450-nm light, eliminates maximum II but not maximum I. Preirradiation with high-fluence 450-nm light from above eliminates the response to subsequent unilateral irradiation with either 450-nm or 510-nm light. The recovery of the response following high-fluence 450-nm light is considerably slower than the recovery following high-fluence 510-nm light. Unilateral irradiation with low-fluence 510-nm light followed by 450-nm light results in curvature that is approximately the sum of those produced by either irradiation alone. Based on these results, it is proposed that phototropism in A. thaliana seedlings is mediated by at least two blue-light photoreceptor pigments.« less

Validity and extension of the SCS-CN method for computing infiltration and rainfall-excess rates

NASA Astrophysics Data System (ADS)

Mishra, Surendra Kumar; Singh, Vijay P.

2004-12-01

A criterion is developed for determining the validity of the Soil Conservation Service curve number (SCS-CN) method. According to this criterion, the existing SCS-CN method is found to be applicable when the potential maximum retention, S, is less than or equal to twice the total rainfall amount. The criterion is tested using published data of two watersheds. Separating the steady infiltration from capillary infiltration, the method is extended for predicting infiltration and rainfall-excess rates. The extended SCS-CN method is tested using 55 sets of laboratory infiltration data on soils varying from Plainfield sand to Yolo light clay, and the computed and observed infiltration and rainfall-excess rates are found to be in good agreement.

Heart Rate Response and Lactic Acid Concentration in Squash Players.

ERIC Educational Resources Information Center

Beaudin, Paula; And Others

1978-01-01

It was concluded that playing squash is an activity that results in heart rate responses of sufficient intensity to elicit aerobic training effects without producing high lactic acid concentration in the blood. (MM)

Slew-rate dependence of tracer magnetization response in magnetic particle imaging

DOE Office of Scientific and Technical Information (OSTI.GOV)

Shah, Saqlain A.; Krishnan, K. M., E-mail: kannanmk@uw.edu; Ferguson, R. M.

2014-10-28

Magnetic Particle Imaging (MPI) is a new biomedical imaging technique that produces real-time, high-resolution tomographic images of superparamagnetic iron oxide nanoparticle tracers. Currently, 25 kHz and 20 mT/μ{sub 0} excitation fields are common in MPI, but lower field amplitudes may be necessary for patient safety in future designs. Here, we address fundamental questions about MPI tracer magnetization dynamics and predict tracer performance in future scanners that employ new combinations of excitation field amplitude (H{sub o}) and frequency (ω). Using an optimized, monodisperse MPI tracer, we studied how several combinations of drive field frequencies and amplitudes affect the tracer's response, using Magnetic Particlemore » Spectrometry and AC hysteresis, for drive field conditions at 15.5, 26, and 40.2 kHz, with field amplitudes ranging from 7 to 52 mT/μ{sub 0}. For both fluid and immobilized nanoparticle samples, we determined that magnetic response was dominated by Néel reversal. Furthermore, we observed that the peak slew-rate (ωH{sub o}) determined the tracer magnetic response. Smaller amplitudes provided correspondingly smaller field of view, sometimes resulting in excitation of minor hysteresis loops. Changing the drive field conditions but keeping the peak slew-rate constant kept the tracer response almost the same. Higher peak slew-rates led to reduced maximum signal intensity and greater coercivity in the tracer response. Our experimental results were in reasonable agreement with Stoner-Wohlfarth model based theories.« less

Anger responses to psychosocial stress predict heart rate and cortisol stress responses in men but not women.

PubMed

Lupis, Sarah B; Lerman, Michelle; Wolf, Jutta M

2014-11-01

While previous research has suggested that anger and fear responses to stress are linked to distinct sympathetic nervous system (SNS) stress responses, little is known about how these emotions predict hypothalamus-pituitary-adrenal (HPA) axis reactivity. Further, earlier research primarily relied on retrospective self-report of emotion. The current study aimed at addressing both issues in male and female individuals by assessing the role of anger and fear in predicting heart rate and cortisol stress responses using both self-report and facial coding analysis to assess emotion responses. We exposed 32 healthy students (18 female; 19.6±1.7 yr) to an acute psychosocial stress paradigm (TSST) and measured heart rate and salivary cortisol levels throughout the protocol. Anger and fear before and after stress exposure was assessed by self-report, and video recordings of the TSST were assessed by a certified facial coder to determine emotion expression (FACS). Self-reported emotions and emotion expressions did not correlate (all p>.23). Increases in self-reported fear predicted blunted cortisol responses in men (β=0.41, p=.04). Also for men, longer durations of anger expression predicted exaggerated cortisol responses (β=0.67 p=.004), and more anger incidences predicted exaggerated cortisol and heart rate responses (β=0.51, p=.033; β=0.46, p=.066, resp.). Anger and fear did not predict SNS or HPA activity for females (all p>.23). The current differential self-report and facial coding findings support the use of multiple modes of emotion assessment. Particularly, FACS but not self-report revealed a robust anger-stress association that could have important downstream health effects for men. For women, future research may clarify the role of other emotions, such as self-conscious expressions of shame, for physiological stress responses. A better understanding of the emotion-stress link may contribute to behavioral interventions targeting health-promoting ways of

Anger responses to psychosocial stress predict heart rate and cortisol stress responses in men but not women

PubMed Central

Lupis, Sarah B.; Lerman, Michelle; Wolf, Jutta M.

2014-01-01

While previous research has suggested that anger and fear responses to stress are linked to distinct sympathetic nervous system (SNS) stress responses, little is known about how these emotions predict hypothalamus-pituitary-adrenal (HPA) axis reactivity. Further, earlier research primarily relied on retrospective self-report of emotion. The current study aimed at addressing both issues in male and female individuals by assessing the role of anger and fear in predicting heart rate and cortisol stress responses using both self-report and facial coding analysis to assess emotion responses. We exposed 32 healthy students (18 female; 19.6+/−1.7 yrs.) to an acute psychosocial stress paradigm (TSST) and measured heart rate and salivary cortisol levels throughout the protocol. Anger and fear before and after stress exposure was assessed by self-report, and video recordings of the TSST were assessed by a certified facial coder to determine emotion expression (FACS). Self-reported emotions and emotion expressions did not correlate (all p > .23). Increases in self-reported fear predicted blunted cortisol responses in men (β = 0.41, p = .04). Also for men, longer durations of anger expression predicted exaggerated cortisol responses (β = 0.67 p = .004), and more anger incidences predicted exaggerated cortisol and heart rate responses (β = 0.51, p = .033; β = 0.46, p = .066, resp.). Anger and fear did not predict SNS or HPA activity for females (all p > .23). The current differential self-report and facial coding findings support the use of multiple modes of emotion assessment. Particularly, FACS but not self-report revealed a robust anger-stress association that could have important downstream health effects for men. For women, future research may clarify the role of other emotions, such as self-conscious expressions of shame, for physiological stress responses. A better understanding of the emotion-stress link may contribute to behavioral interventions targeting health

Validation of Arabic and English versions of the ARSMA-II Acculturation Rating Scale.

PubMed

Jadalla, Ahlam; Lee, Jerry

2015-02-01

To translate and adapt the Acculturation Rating Scale of Mexican-Americans II (ARSMA-II) for Arab Americans. A multistage translation process followed by a pilot and a large study. The translated and adapted versions, Acculturation Rating Scale for Arabic Americans-II Arabic and English (ARSAA-IIA, ARSAA-IIE), were validated in a sample of 297 Arab Americans. Factor analyses with principal axis factoring extractions and direct oblimin rotations were used to identify the underlying structure of ARSAA-II. Factor analysis confirmed the underlying structure of ARSAA-II and produced two interpretable factors labeled as 'Attraction to American Culture' (AAmC) and 'Attraction to Arabic Culture' (AArC). The Cronbach's alphas of AAmC and AArC were .89 and .85 respectively. Findings support ARSAA-II A & E to assess acculturation among Arab Americans. The emergent factors of ARSAA-II support the theoretical structure of the original ARSMA-II tool and show high internal consistency.

Quantifying rates of evolutionary adaptation in response to ocean acidification.

PubMed

Sunday, Jennifer M; Crim, Ryan N; Harley, Christopher D G; Hart, Michael W

2011-01-01

The global acidification of the earth's oceans is predicted to impact biodiversity via physiological effects impacting growth, survival, reproduction, and immunology, leading to changes in species abundances and global distributions. However, the degree to which these changes will play out critically depends on the evolutionary rate at which populations will respond to natural selection imposed by ocean acidification, which remains largely unquantified. Here we measure the potential for an evolutionary response to ocean acidification in larval development rate in two coastal invertebrates using a full-factorial breeding design. We show that the sea urchin species Strongylocentrotus franciscanus has vastly greater levels of phenotypic and genetic variation for larval size in future CO(2) conditions compared to the mussel species Mytilus trossulus. Using these measures we demonstrate that S. franciscanus may have faster evolutionary responses within 50 years of the onset of predicted year-2100 CO(2) conditions despite having lower population turnover rates. Our comparisons suggest that information on genetic variation, phenotypic variation, and key demographic parameters, may lend valuable insight into relative evolutionary potentials across a large number of species.

Assessing the blood volume and heart rate responses during haemodialysis in fluid overloaded patients using support vector regression.

PubMed

Javed, Faizan; Savkin, Andrey V; Chan, Gregory S H; Middleton, Paul M; Malouf, Philip; Steel, Elizabeth; Mackie, James; Lovell, Nigel H

2009-11-01

This study aims to assess the blood volume and heart rate (HR) responses during haemodialysis in fluid overloaded patients by a nonparametric nonlinear regression approach based on a support vector machine (SVM). Relative blood volume (RBV) and electrocardiogram (ECG) was recorded from 23 haemodynamically stable renal failure patients during regular haemodialysis. Modelling was performed on 18 fluid overloaded patients (fluid removal of >2 L). SVM-based regression was used to obtain the models of RBV change with time as well as the percentage change in HR with respect to RBV. Mean squared error (MSE) and goodness of fit (R(2)) were used for comparison among different kernel functions. The design parameters were estimated using a grid search approach and the selected models were validated by a k-fold cross-validation technique. For the model of HR versus RBV change, a radial basis function (RBF) kernel (MSE = 17.37 and R(2) = 0.932) gave the least MSE compared to linear (MSE = 25.97 and R(2) = 0.898) and polynomial (MSE = 18.18 and R(2)= 0.929). The MSE was significantly lower for training data set when using RBF kernel compared to other kernels (p < 0.01). The RBF kernel also provided a slightly better fit of RBV change with time (MSE = 1.12 and R(2) = 0.91) compared to a linear kernel (MSE = 1.46 and R(2) = 0.88). The modelled HR response was characterized by an initial drop and a subsequent rise during progressive reduction in RBV, which may be interpreted as the reflex response to a transition from central hypervolaemia to hypovolaemia. These modelled curves can be used as references to a controller that can be designed to regulate the haemodynamic variables to ensure the stability of patients undergoing haemodialysis.

The yo-yo intermittent recovery test: physiological response, reliability, and validity.

PubMed

Krustrup, Peter; Mohr, Magni; Amstrup, Tommas; Rysgaard, Torben; Johansen, Johnny; Steensberg, Aadam; Pedersen, Preben K; Bangsbo, Jens

2003-04-01

To examine the physiological response and reproducibility of the Yo-Yo intermittent recovery test and its application to elite soccer. Heart rate was measured, and metabolites were determined in blood and muscle biopsies obtained before, during, and after the Yo-Yo test in 17 males. Physiological measurements were also performed during a Yo-Yo retest and an exhaustive incremental treadmill test (ITT). Additionally, 37 male elite soccer players performed two to four seasonal tests, and the results were related to physical performance in matches. The test-retest CV for the Yo-Yo test was 4.9%. Peak heart rate was similar in ITT and Yo-Yo test (189 +/- 2 vs 187 +/- 2 bpm), whereas peak blood lactate was higher (P < 0.05) in the Yo-Yo test. During the Yo-Yo test, muscle lactate increased eightfold (P < 0.05) and muscle creatine phosphate (CP) and glycogen decreased (P < 0.05) by 51% and 23%, respectively. No significant differences were observed in muscle CP, lactate, pH, or glycogen between 90 and 100% of exhaustion time. During the precompetition period, elite soccer players improved (P < 0.05) Yo-Yo test performance and maximum oxygen uptake ([OV0312]O(2max)) by 25 +/- 6 and 7 +/- 1%, respectively. High-intensity running covered by the players during games was correlated to Yo-Yo test performance (r = 0.71, P < 0.05) but not to [OV0312]O(2max) and ITT performance. The test had a high reproducibility and sensitivity, allowing for detailed analysis of the physical capacity of athletes in intermittent sports. Specifically, the Yo-Yo intermittent recovery test was a valid measure of fitness performance in soccer. During the test, the aerobic loading approached maximal values, and the anaerobic energy system was highly taxed. Additionally, the study suggests that fatigue during intense intermittent short-term exercise was unrelated to muscle CP, lactate, pH, and glycogen.

Examining Evidence for the Validity of PISA Learning Strategy Scales Based on Student Response Processes

ERIC Educational Resources Information Center

Hopfenbeck, Therese N.; Maul, Andrew

2011-01-01

The aim of this study was to investigate response-process based evidence for the validity of the Programme for International Student Assessment's (PISA) self-report questionnaire scales as measures of specific psychological constructs, with a focus on scales meant to measure inclination toward specific learning strategies. Cognitive interviews (N…

Development and validation of an item response theory-based Social Responsiveness Scale short form.

PubMed

Sturm, Alexandra; Kuhfeld, Megan; Kasari, Connie; McCracken, James T

2017-09-01

Research and practice in autism spectrum disorder (ASD) rely on quantitative measures, such as the Social Responsiveness Scale (SRS), for characterization and diagnosis. Like many ASD diagnostic measures, SRS scores are influenced by factors unrelated to ASD core features. This study further interrogates the psychometric properties of the SRS using item response theory (IRT), and demonstrates a strategy to create a psychometrically sound short form by applying IRT results. Social Responsiveness Scale analyses were conducted on a large sample (N = 21,426) of youth from four ASD databases. Items were subjected to item factor analyses and evaluation of item bias by gender, age, expressive language level, behavior problems, and nonverbal IQ. Item selection based on item psychometric properties, DIF analyses, and substantive validity produced a reduced item SRS short form that was unidimensional in structure, highly reliable (α = .96), and free of gender, age, expressive language, behavior problems, and nonverbal IQ influence. The short form also showed strong relationships with established measures of autism symptom severity (ADOS, ADI-R, Vineland). Degree of association between all measures varied as a function of expressive language. Results identified specific SRS items that are more vulnerable to non-ASD-related traits. The resultant 16-item SRS short form may possess superior psychometric properties compared to the original scale and emerge as a more precise measure of ASD core symptom severity, facilitating research and practice. Future research using IRT is needed to further refine existing measures of autism symptomatology. © 2017 Association for Child and Adolescent Mental Health.

Validation of new psychosocial factors questionnaires: a Colombian national study.

PubMed

Villalobos, Gloria H; Vargas, Angélica M; Rondón, Martin A; Felknor, Sarah A

2013-01-01

The study of workers' health problems possibly associated with stressful conditions requires valid and reliable tools for monitoring risk factors. The present study validates two questionnaires to assess psychosocial risk factors for stress-related illnesses within a sample of Colombian workers. The validation process was based on a representative sample survey of 2,360 Colombian employees, aged 18-70 years. Worker response rate was 90%; 46% of the responders were women. Internal consistency was calculated, construct validity was tested with factor analysis and concurrent validity was tested with Spearman correlations. The questionnaires demonstrated adequate reliability (0.88-0.95). Factor analysis confirmed the dimensions proposed in the measurement model. Concurrent validity resulted in significant correlations with stress and health symptoms. "Work and Non-work Psychosocial Factors Questionnaires" were found to be valid and reliable for the assessment of workers' psychosocial factors, and they provide information for research and intervention. Copyright © 2012 Wiley Periodicals, Inc.

Psychometric properties including reliability, validity and responsiveness of the Majeed pelvic score in patients with chronic sacroiliac joint pain.

PubMed

Bajada, Stefan; Mohanty, Khitish

2016-06-01

The Majeed scoring system is a disease-specific outcome measure that was originally designed to assess pelvic injuries. The aim of this study was to determine the psychometric properties of the Majeed scoring system for chronic sacroiliac joint pain. Internal consistency, content validity, criterion validity, construct validity and responsiveness to change was assessed prospectively for the Majeed scoring system in a cohort of 60 patients diagnosed with sacroiliac joint pain. This diagnosis was confirmed with CT-guided sacroiliac joint anaesthetic block. The overall Majeed score showed acceptable internal consistency (Cronbach alpha = 0.63). Similarly, it showed acceptable floor (0 %) and ceiling (0 %) effects. On the other hand, the domains of pain, work, sitting and sexual intercourse had high (>30 %) floor effects. Significant correlation with the physical component of the Short Form-36 (p = 0.005) and Oswestry disability index (p ≤ 0.001) was found indicating acceptable criterion validity. The overall Majeed score showed acceptable construct validity with all five developed hypotheses showing significance (p ≤ 0.05). The overall Majeed score showed acceptable responsiveness to change with a large (≥0.80) effect size and standardized response mean. Overall the Majeed scoring system demonstrated acceptable psychometric properties for outcome assessment in chronic sacroiliac joint pain. Thus, its use in this condition is adequate. However, some domains demonstrated suboptimal performance indicating that improvement might be achieved with the development of an outcome measure specific for sacroiliac joint dysfunction and degeneration.

RBF kernel based support vector regression to estimate the blood volume and heart rate responses during hemodialysis.

PubMed

Javed, Faizan; Chan, Gregory S H; Savkin, Andrey V; Middleton, Paul M; Malouf, Philip; Steel, Elizabeth; Mackie, James; Lovell, Nigel H

2009-01-01

This paper uses non-linear support vector regression (SVR) to model the blood volume and heart rate (HR) responses in 9 hemodynamically stable kidney failure patients during hemodialysis. Using radial bias function (RBF) kernels the non-parametric models of relative blood volume (RBV) change with time as well as percentage change in HR with respect to RBV were obtained. The e-insensitivity based loss function was used for SVR modeling. Selection of the design parameters which includes capacity (C), insensitivity region (e) and the RBF kernel parameter (sigma) was made based on a grid search approach and the selected models were cross-validated using the average mean square error (AMSE) calculated from testing data based on a k-fold cross-validation technique. Linear regression was also applied to fit the curves and the AMSE was calculated for comparison with SVR. For the model based on RBV with time, SVR gave a lower AMSE for both training (AMSE=1.5) as well as testing data (AMSE=1.4) compared to linear regression (AMSE=1.8 and 1.5). SVR also provided a better fit for HR with RBV for both training as well as testing data (AMSE=15.8 and 16.4) compared to linear regression (AMSE=25.2 and 20.1).

Psychometrics and Validation of a Brief Rating Measure of Parent-Infant Interaction: Manchester Assessment of Caregiver-Infant Interaction

ERIC Educational Resources Information Center

Wan, Ming Wai; Brooks, Ami; Green, Jonathan; Abel, Kathryn; Elmadih, Alya

2017-01-01

This study investigated the psychometrics of a recently developed global rating measure of videotaped parent-infant interaction, the "Manchester Assessment of Caregiver-Infant Interaction" (MACI), in a normative sample. Inter-rater reliability, stability over time, and convergent and discriminant validity were tested. Six-minute play…

Creep Strain and Strain Rate Response of 2219 Al Alloy at High Stress Levels

NASA Technical Reports Server (NTRS)

Taminger, Karen M. B.; Wagner, John A.; Lisagor, W. Barry

1998-01-01

As a result of high localized plastic deformation experienced during proof testing in an International Space Station connecting module, a study was undertaken to determine the deformation response of a 2219-T851 roll forging. After prestraining 2219-T851 Al specimens to simulate strains observed during the proof testing, creep tests were conducted in the temperature range from ambient temperature to 107 C (225 F) at stress levels approaching the ultimate tensile strength of 2219-T851 Al. Strain-time histories and strain rate responses were examined. The strain rate response was extremely high initially, but decayed rapidly, spanning as much as five orders of magnitude during primary creep. Select specimens were subjected to incremental step loading and exhibited initial creep rates of similar magnitude for each load step. Although the creep rates decreased quickly at all loads, the creep rates dropped faster and reached lower strain rate levels for lower applied loads. The initial creep rate and creep rate decay associated with primary creep were similar for specimens with and without prestrain; however, prestraining (strain hardening) the specimens, as in the aforementioned proof test, resulted in significantly longer creep life.

Heart Rate Response of Professional Musicians When Playing Music.

PubMed

Vellers, Heather L; Irwin, Conor; Lightfoot, J T

2015-06-01

The primary aim was to determine the level of physiological stress evoked while playing music in a standing position as indicated by heart rate (HR) response. A secondary aim was to analyze the effect of music genre (classic rock, western, contemporary Christian, and metal rock) on the relative HR response. Lastly, we considered potential physiological initiators of the music-playing-induced HR response. HR response was monitored in 27 professional musicians (3 women, 24 men) between the ages of 21 and 67 yrs old during rehearsal and public performances. The percent maximal HR (%MHR) evoked was determined by taking a percentage of the age-predicted maximal HR for each musician and comparing the average %MHR in each genre during public and rehearsal events. The role of the potential initiators of these responses (e.g., number of years playing in public, event type, instrument type, tempo, etc.) was determined using multiple regression analyses. The overall average %MHR responses were 52 ± 5% and 59 ± 5% during rehearsal and public performances, respectively, with genre type having a significant effect on the HR response (p=0.01). Body mass index and tempo were each found to be significant contributors to the HR response while playing music (r²=0.506, p=0.001). Playing music professionally evokes considerable increases in HR response, with music genre influencing the level of the physiological response. We concluded that 50% of the HR response while playing music was associated with body mass index, music tempo, and instrument type.